Skip to content

[Investigate] Why does writing MeterValues Request take 32 seconds and others take 2 seconds? #9

@kelseymok

Description

@kelseymok

In the Batch Processing Silver layer exercise, writing MeterValues request to parquet (single partition) takes 32 seconds... whereas writing all of the other DFs for other actions takes sub 2 seconds. Why is that?

NOTE: to run this exercise, please run the Bronze exercise - it outputs some parquet which the SIlver Exercise requires.

Image

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions