Replies: 10 comments
-
|
2025-09-11 21:55:18,044 [INFO ] Starting transfer |
Beta Was this translation helpful? Give feedback.
-
|
Laptop, local dockerized postgres |
Beta Was this translation helpful? Give feedback.
-
|
commit: 343af2b1e2654d4fdfdce345fa9edb9d01f6ee7b. local This is significantly slower than previous versions because of the state, county, and quad_name lookup. |
Beta Was this translation helpful? Give feedback.
-
|
@jacob-a-brown removed state,county,quadname lookup. run cleanup_wells as a separate process 2025-09-18 07:14:16,229 [INFO ] ********** STARTING TRANSFER ********** |
Beta Was this translation helpful? Give feedback.
-
|
It certainly makes it slower, and often times out, but shouldn't it still be there for data fidelity and integrity? We could also retrieve those values with GET requests and not store them, but doing so would make the requests take way longer and render them unusable with the frontend. |
Beta Was this translation helpful? Give feedback.
-
|
I want the state, county, and quad values set during a separate process e.g. |
Beta Was this translation helpful? Give feedback.
-
|
Beta Was this translation helpful? Give feedback.
-
|
Cloud run job limit=100 |
Beta Was this translation helpful? Give feedback.
-
|
Cloud run job limit=500 |
Beta Was this translation helpful? Give feedback.
-
|
Cloud run job limit=5000 |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Laptop, cloud-sql-proxy
********** TRANSFERRING WELLS **********
Processing row 25 of 28411. NM-11224, avg rows per second: 0.39
Processing row 50 of 28411. NM-21466, avg rows per second: 0.42
Processing row 75 of 28411. NM-21486, avg rows per second: 0.42
Beta Was this translation helpful? Give feedback.
All reactions