Skip to content

Updates realtime download and timeslices creation scripts for upstream api changes#123

Open
zhengtaocui wants to merge 6 commits intodevelopmentfrom
ZC_update_realtime_download_and_timeslices_for_upstream_api_changes
Open

Updates realtime download and timeslices creation scripts for upstream api changes#123
zhengtaocui wants to merge 6 commits intodevelopmentfrom
ZC_update_realtime_download_and_timeslices_for_upstream_api_changes

Conversation

@zhengtaocui
Copy link

@zhengtaocui zhengtaocui commented Mar 23, 2026

  1. Updated USGS, USACE, Canadian download scripts to work with current server/API updates. 2) Merged the timeslices creation scripts shared by OWP to be able to read the raw data file downloaded by the updated downloaded scripts. 3) For the Canadian download script, we asked NCO for their latest Canadian gage download code. For now, we modified the existing code. We still need the NCO current code because it seems NCO uses a different server, https://wateroffice.ec.gc.ca/mainmenu/real_time_data_index_e.html. The download files have a different format. 4) The USGS download script doesn't download the TxDOT stations because the access code (3) doesn't work with the new OGC APIs.

Added NCO Canadian gage download scripts and the corresponding OWP timeslices creation scripts for Canadian gages.

Additions

  • USGS realtime discharge download script shared by NCO
  • Canadian gage realtime discharge download script shared by NCO

Removals

  • The NWM v3 USGS download scripts

Changes

  • Merged OWP latest timeslices creation scripts (USGS, USACE, and Canadian)

Notes

  • The NCO has a different version of the Canadian gage download script that uses a different server at https://wateroffice.ec.gc.ca/mainmenu/real_time_data_index_e.html than the server we use now. The NCO version of the download scripts are added.
  • The USGS download script doesn't download the TxDOT gages because the access code (3) doesn't work with the new OGC API.

…t server/API updates. 2) Merged the timeslices creation scripts shared by OWP to be able to read the raw data file downloaded by the updated downloaded scripts. 3) For the Canadian download script, we asked NCO for their latest Canadian gage download code. For now, we modified the existing code. We still need the NCO current code because it seems NCO uses a different server, https://wateroffice.ec.gc.ca/mainmenu/real_time_data_index_e.html. The download files have a different format. 4) The USGS download script doesn't download the TxDOT stations because the access code (3) doesn't work with the new OGC APIs.
@zhengtaocui zhengtaocui self-assigned this Mar 23, 2026
…t server/API updates. 2) Merged the timeslices creation scripts shared by OWP to be able to read the raw data file downloaded by the updated downloaded scripts. 3) For the Canadian download script, we asked NCO for their latest Canadian gage download code. For now, we modified the existing code. We still need the NCO current code because it seems NCO uses a different server, https://wateroffice.ec.gc.ca/mainmenu/real_time_data_index_e.html. The download files have a different format. 4) The USGS download script doesn't download the TxDOT stations because the access code (3) doesn't work with the new OGC APIs.
@miguelp1986 miguelp1986 force-pushed the ZC_update_realtime_download_and_timeslices_for_upstream_api_changes branch from 2ac6fb7 to 37cebef Compare March 23, 2026 20:47
@miguelp1986
Copy link
Member

I rebased onto latest from development to fix a build issue. Pipeline should now pass.

@zhengtaocui zhengtaocui requested a review from miguelp1986 March 24, 2026 20:50
@zhengtaocui
Copy link
Author

I have some updates for the NCO Canadian download scripts. I hope it'll pass CI/CD this time.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants