Skip to content
This repository was archived by the owner on Jun 30, 2023. It is now read-only.
This repository was archived by the owner on Jun 30, 2023. It is now read-only.

Use google big query for source data that gets updated weekly  #578

Description

@SashaWeinstein

The way the data sync CRON job currently works is that it writes all records to a new folder. This means a lot of redundancy, as an entire copy of the data is uploaded with only a handful of new records (relatively speaking). I think that google big query would be a good alternative, makes it easy to add new records to an existing table.

Metadata

Metadata

Labels

enhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions