Search before asking
Description
Related to #13285
Implement a batch processing system that enables TopN aggregation for historical data stored on warm and cold nodes. This feature will support scenarios where historical data is imported and users need to generate TopN aggregations retroactively with flexible configuration options.
Background
Non-hot storage tiers (warm and cold nodes) often contain historical data that may be imported in bulk. Currently, there's no efficient mechanism to perform TopN aggregations on this historical data without impacting real-time operations or requiring manual intervention.
Proposed Features
Develop a batch processing capability that supports:
- On-demand TopN aggregation through configurable batch tasks
- Flexible time-range specifications for historical data processing
- User-defined naming conventions for generated TopN results
- Support for importing historical data with subsequent batch aggregation processing
Use case
No response
Related issues
No response
Are you willing to submit a pull request to implement this on your own?
Code of Conduct
Search before asking
Description
Related to #13285
Implement a batch processing system that enables TopN aggregation for historical data stored on warm and cold nodes. This feature will support scenarios where historical data is imported and users need to generate TopN aggregations retroactively with flexible configuration options.
Background
Non-hot storage tiers (warm and cold nodes) often contain historical data that may be imported in bulk. Currently, there's no efficient mechanism to perform TopN aggregations on this historical data without impacting real-time operations or requiring manual intervention.
Proposed Features
Develop a batch processing capability that supports:
Use case
No response
Related issues
No response
Are you willing to submit a pull request to implement this on your own?
Code of Conduct