dataRetrieval 2.7.26

• Switching to v1 of the Water Data APIs.
• Added suite of read_ngwmn to access new National Groundwater Monitoring Network API.
• Created get_monitoring_location_arguments to help users understand what new optional arguments are available in many of the read_waterdata functions.
• Added ability to use ... in the Water Data functions for: daily, latest-continuous, field-measurements, latest-daily, latest-field-measurements, continuous, and peaks. The “…” argument can now accept any parameter that is output from the make_monitoring_location_arguments function.
• Added “q” argument to read_waterdata_monitoring_location. Full-text search across the most relevant text fields for this collection (e.g. site name, identifier, number, state, county, and site type).
• Added “skipGeometry” argument to read_waterdata_continuous. Previously geometry wasn’t included with continuous data, but now is supported.
• Deprecated pcode_to_name since the service was removed.

dataRetrieval 2.7.25

• Added read_waterdata_ratings to access USGS rating curves with new modern endpoint.
• Added read_waterdata_peaks to access USGS peak data with new modern endpoint.
• Increase flexibility of chunking by monitoring_location_id by including it as an argument in each relevant waterdata OGC function.
• Clean up deprecated code.
• Updated retry strategy to include retry_on_failure = TRUE.
• Added countries, methods, method-categories, method-citations, and citations to possible values in read_waterdata_metadata.
• Added field_measurements_series_id argument to read_waterdata_field_measurement
• Removed NWIS tests
• Introduce an error if user inputs a numeric to any of the “time” arguments. Because it is impossible to tell if they intended Dates or POSIX, we cannot know for sure and therefore could add incorrect filters to the query.
• The “id” column that comes back from read_waterdata_field_meta was changed to field_measurements_series_id to match the expectation of read_waterdata_field_measurements
• New argument added to read_waterdata_stats_por: “normal_type” accepts “DOY” and “MOY”
• New argument added to read_waterdata_stats_daterange: “interval_type” accepts “M” (month), “CY” (calendar year), and “WY” (water year).

dataRetrieval 2.7.24

• Let dataRetrieval take care of chunking up requests by monitoring_location_id.
• Fixed bug causing some character columns in importWQP to be numeric
• Fixed bug causing open ended date requests in waterdata funcitons to return full period of record.

dataRetrieval 2.7.23

• Added read_waterdata_stats_por and read_waterdata_stats_daterange to access USGS daily data statistics.
• Added read_waterdata_field_meta, read_waterdata_combine_meta, and read_waterdata_channel
• Added read_ngwmn_water_levels, read_ngwmn_sites, read_ngwmn_providers, read_ngwmn_well_construction, read_ngwmn_lithology
• Removed readNWISgwl, readNWISmeas, and readNGWMN as services have been turned off
• Added data.table to Imports
• Updated next_req_url to allow paging through /statistics API output
• Added deprecation message to readNWISstat function
• Improved time documentation for waterdata functions
• Specify “UTC” attribute for returned time for waterdata functinos
• Added options(“dataRetrieval.attach_request” = TRUE) as default to attach the request object as an attribute to the returned data frames. Setting options(“dataRetrieval.attach_request” = FALSE) will return a data frame without the request attribute
• Improved error handling in WQP functions
• Updated CQL2 templates to allow HUC queries specifically to use a wildcard to get multiple inclusive HUCs.
• Add deprecation message to readNGWMN functions. read_ngwmn will be coming soon.

dataRetrieval 2.7.22

• Added read_waterdata_latest_daily to access latest daily USGS water data.
• Added read_waterdata_continuous to access continuous USGS water data.
• Added state_name and hydrologic_unit_code to read_waterdata_ts_meta
• Removed daily_id from read_waterdata_daily output since it is not stable over time. Moved other “id” columns to end of returned data frames.
• Changed examples for stateCd, countyCd, and parameterCdFile. Users are encouraged to migrate to the “read_waterdata_metadata” functions.
• Added no_paging argument. This will make the request more efficient, but is not recommended because it will silently cut off data after 50,000 rows.
• Removed max_results argument. Was confusing and redundant with the combination of no_paging and limit.
• Increase the flexibility of read_waterdata_metadata to match other OGC functions.
• NLDI to use agency code prefixes and should no longer be stripping the “USGS-” off the site ides.
• Add deprecate message to readNWISuse function as data services have been retired.

dataRetrieval 2.7.21

• Added read_waterdata_field_measurements to access new USGS water data API.
• Added deprecation warning to readNWISgwl and readNWISmeas.
• Added parent_time_series_id to read_waterdata_ts_meta.
• Updated some documentation.
• Handle waterdata empty returns better.

dataRetrieval 2.7.20

• Added id transformation to read_waterdata to match other functions
• Cleaned up time arguments in waterdata functions to allow flexible time zones
• Added read_waterdata_metadata, read_waterdata_parameter_codes
• Fixes a bug caused by httr2 update

dataRetrieval 2.7.19

• Added read_waterdata_daily, read_waterdata_monitoring_location, read_waterdata_ts_meta to access new USGS web services.
• Added whisker and sf as dependencies.
• Renamed read_USGS_samples to read_waterdata_samples.
• Renamed summarize_USGS_samples to summarize_waterdata_samples.
• Added warning to setAccess for non-public endpoints.

dataRetrieval 2.7.18

• Switched from httr to httr2
• Added a way to include a custom user-agent suffix via an enviornmental variable “CUSTOM_DR_UA”
• Added function for USGS discrete data samples_data service: read_USGS_samples
• Restructured stateCdLookup and countyCdLookup to use web services that only list states and counties that have water quality data.

dataRetrieval 2.7.17

• Fixed bug with server problems causing errors.
• Removed the function “readNWISqw” since the underlying data was removed.
• Added message of service URL.
• Removed the forced “empty returns” for WQP, since the WQP now has properly formatted empty returns.
• Moved the column parsing to a dedicated function for WQP.
• Took out zip option for WQP calls, they are not allowed on WQP anymore.
• Added deprecated message getQuerySummary. Users should use readWQPsummary instead.
• Added WQX 3.0 profiles.
• siteInfo attribute for WQP queries converted to a full station return.
• Cleaned up date conversion in WQP
• Updated source for groundwater level data from waterservices to waterdata. Note that waterdata services will ALSO need updating within the next year, but this change will allow for some time to make changes.

dataRetrieval 2.7.16

• Changed the base URL for groundwater level services since GW Levels RDB formats will be discontinued after August 5, 2024.
• Groundwater queries can no longer support siteStatus and siteType. Updates to the services are expected in the next year and those queries will return.
• Updated parameterCdFile.

dataRetrieval 2.7.15

• Update warning about upcoming changes to USGS water quality data.
• Added date sorting to all WQP functions.

dataRetrieval 2.7.14

• Package documentation updated due to roxygen changes
• Update in NLDI function to allow for sites with spaces in the site abbrievations.
• Added an automatic endDate to whatNWISdata if a startDate is given, to make sure it behaves as expected.

dataRetrieval 2.7.13

• Added pcode_to_name function to get WQP characteristics from USGS parameter codes.
• Required readr version 1.4 or greater.

dataRetrieval 2.7.12

• Updated documentation in readWQPdata
• Updates to how NLDI functions handle no data

dataRetrieval 2.7.11

• Updated some documentation to improve examples.
• Changed the check for internet to better account for proxies.
• Fixed bug due to new behavior in NWIS parameter code service.
• Updated documentation for readWQPdata and readWQPsummary

dataRetrieval 2.7.10

• Functions that come back from a server that had and error now return with a message and NULL rather than error.

dataRetrieval 2.7.9

• Fix bug caused by changes in NLDI services
• Adding warnings to NWIS qw functions
• Added new vignette on changes

dataRetrieval 2.7.8

• Fixed missing comments in readNWISqw
• Added Stable Isotopes, Habitat, and Other water quality groupings
• Adding options for updated readr

dataRetrieval 2.7.7

• The NLDI service is now available through the findNLDI function.
• Adjusted Water Quality Portal (WPQ) URLs to follow new structure
• Fixed bug where some WQP results were being duplicated
• Added an argument to readWQPdata to ignore fetching site and parameter attributes.
• Fixed timezone bug in RDB requests that had mixed timezones.
• Updated internal data for parameter codes
• Added parameterCd argument to readNWISgwl as the services had changed
• Allow a “service” argument in readWQPdata, whatWQPsites

dataRetrieval 2.7.5

• Fixed some time zone joining bugs that were happening if the timezone column had no information in the first ~100 returned rows.
• Changed WQP default behavior to a zip return
• Remove reshape2 and dplyr dependencies
• Added ability to customize user agent using options UA.dataRetrieval

dataRetrieval 2.7.3

• Reworked whatNWISdata to allow the full flexibility of ...
• Check for dates in instantaneous data, allowing requests for recent data to be routed directly to waterservices.gov.

dataRetrieval 2.7.1

• Converted vignette to html

dataRetrieval 2.7.0

• Added National Groundwater Monitoring Network services
• Converted WaterML2 code from XML to XML2 dependency. NOTE: The output of this the parseWaterML2 function has changed. This is a first step to a more robust WaterML2 parser
• Added new Water Quality Portal features: whatWQPmetrics, whatWQPdata, whatWQPsamples
• Bug fix on converting GET -> POST
• Bug fix on state abbrieviations
• Minor updates to internal code to improve efficiencies.

dataRetrieval 2.6.3

• All USGS web services are being flipped from http to https. This version of dataRetrieval will attempt to access https, if that fails, will attempt http.

dataRetrieval 2.5.12

• Response to readr 1.0.0 updates
• Added NWIS Water Use data
• Added NWIS Statistical Service data
• Added message on updates to NWIS data on startup message
• Automatically retries web service calls when status code is greater than 400
• More integrated use of pkg.env to set base URLs

dataRetrieval 2.5.7

• HEAD requests can be returned in readWQP* functions. This can give some indication on amount of data available.

dataRetrieval 2.5.0

• Package httr is now used for web service retrievals

dataRetrieval 2.4.0

• Package readr now used for tab delimited parsing
• readr functions used to determine column types. Mostly, this produces the same results.
• In the case where there is text in a numeric column (specified by the RDB header), these now remain characters (previously was converted to numeric)
• Columns that come back from web services as integers remain integers (previously was converted to numeric)
• Added reported time zone code information. dateTime columns by default get converted to UTC, but the original time zone code (tz_cd for instance) is appended to the data frame.

dataRetrieval 2.3.0

• Converted all Water Quality Portal queries to sorted=no to greatly improve retrieval times
• Converted gwlevels in readNWISdata to rdb

dataRetrieval 2.2.0

• Changed the output of tz_cd (in all *NWIS functions) to the timezone that is reported in the data frame. Before this version, it was the time zone reported by NWIS. This was confusing however since the dateTime columns default to UTC.
• Minor bug fixes
• Help file updates
• Improved query options in readNWISdata and readWQPdata functions.

dataRetrieval 2.1.4

• Expanded readNWISdata to qw data
• Improved citation file

dataRetrieval 2.1.1

• Removed tests that call external web services, server upgrades have been causing false negative results
• Added functionality to readWQPdata to allow R objects as arguments rather than just character strings
• Added parameterCd=‘all’ option for qw calls.
• Exposed sysdata constants

dataRetrieval 2.0.2

• Moved data files (parameterCdFile and pCodeToName) to hidden sysdata.rda
• Improved error handling.
• Fixed WaterML2 bug.
• Switched readNWISgwl to read the RDB output.

dataRetrieval 2.0.1

• Removed deprecated functions.
• Added siteInfo and variableInfo dataframe attributes to all data retrival functions
• Improved help files
• Added data file (pCodeToName) that shows the association of USGS parameter code to characteristicName

dataRetrieval 2.0.0

• Overhaul of function names based on initial user feedback
• Metadata attributes added to returned dataframes
• EGRET specific functions moved to EGRET

dataRetrieval 1.4.0

• Changed naming convention:
• Changed WaterML2 rbind fill from plyr function to dplyr. Removed plyr import, added dplyr.

dataRetrieval 1.3.3

• Updated getNWISSiteInfo to retrieve multiple site file datasets at once using a vector of siteNumbers as input argument.
• Updated error-handling for Web service calls. More information is returned when errors happen
• Added some basic processing to Water Quality Portal raw data retrievals. Date columns are returned as Date objects, value columns are numeric, and a column is created from the date/time/timezone columns that is POSIXct.
• Added very generalized NWIS and WQP retrieval functions (getNWISData, getNWISSites, getGeneralWQPData, and whatWQPsites) which allow the user to use any argument available on the Web service platform.

dataRetrieval 1.3.2

• Deprecated getQWData, updated readWQPdata to take either parameter code or characteristic name.
• Changed the name of raw data retrievals to: readNWISqw, getNWISunitData, getNWISdvData, and getWQPqwData (from: readNWISqw, retrieveUnitNWISData, retrieveNWISData, getRawQWData)
• Added NA warning to getDVData function
• Updated mergeReport to allow for Sample data with different measurements taken on the same day

dataRetrieval 1.2.2

• Added getNWISDataAvailability function to find measured parameters and period of record information for a requested station.

• Added constructNWISURL function to get the URL that is used to retrieve the data.

• Added getSampleSTORET function to get STORET data directly in Sample dataframe form.

• Fixed a small leap year bug by changing day of year by making Feb. 29 always 59, and March 1st always 60 (even in non-leap years).

dataRetrieval 1.2.1

• Improved documentation, especially example functions.

• Improved vignette for a more complete walk-through.

• Expanded the capabilities to retrieve raw data from the web services.

• Added Storet data retrievals in readWQPdata function