Proposal: Hightable live data viewer

[do-me]

For the Places site (but also addresses and potentially the other datasets) it might be nice to have a live data table where users can explore the actual data of the latest release.

There is a really nice piece of cloud-native software for this called hightable. See the demo here. It can retrieve the data directly from s3 for example.

I'd imagine such a small table window under the map image. In my opinion or familiarizing yourself with the data, it's much faster to scroll around in the table than reading the table schema.

Let me know what you think, happy to take lead if you see fit. If not no problem!

Currently, there seems to be a little bug with large data (hyparam/hightable#437) but shouldn't be much of an issue.

Proposed the same already for the Overture Explore Site here: OvertureMaps/explore-site#235

[danabauer]

This looks great. We could add this to the places guide or it could be a standalone tool.

[do-me]

Great! Would work both of course as embedded mini-viewer and standalone web app. Will check how to implement.

[do-me]

Right now, aggregating multiple files is not yet supported on hightable, but it can:

• read the directory and
• read a single 10M rows chunk from this dir

Reading the full file with 72M rows downloaded with uvx overturemaps download -f geoparquet --type=place -o places.parquet locally works just fine:

Dana Bauer (@danabauer) do we host a consolidated (geo)parquet file ourselves somewhere yet or always chunked versions?