Hyper: load native benchmark data from Parquet - #1357
Conversation
Switch the native Hyper benchmark from the 81 GB CSV input to the 15 GB single-file Parquet dataset. This reduces the measured load time from 327.0 seconds to 187.1 seconds (43%) while producing the same 99,997,497 rows and the same logical results for all 43 ClickBench queries.
8127539 to
9ae7b9a
Compare
|
Results for Logs:
|
|
The run of Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Results for Logs:
|
|
Are those results actually measured against this PR rebased on top of latest |
|
I remember I resolved a conflict and merged with master here: e235fcc Likely, they reflect the latest changes. If not, we can rerun. |
Hyper: load native benchmark data from Parquet
Switch the native Hyper benchmark from the 81 GB CSV input to the 15 GB
single-file Parquet dataset. This reduces the measured load time from 327.0
seconds to 187.1 seconds (43%) while producing the same 99,997,497 rows and
the same logical results for all 43 ClickBench queries.