hanahmily opened a new issue, #13200: URL: https://github.com/apache/skywalking/issues/13200
### Search before asking - [x] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement. ### Description Currently, in BanyanDB, the liaison node acts as the aggregator, collecting raw data from data nodes and applying aggregation functions to produce the final result. This approach has significant drawbacks: 1. **High Bandwidth Consumption**: Transferring large volumes of raw data from data nodes to the liaison node consumes excessive network bandwidth. 2. **Pressure on Liaison Node**: The liaison node bears a heavy computational load due to aggregating raw data from multiple data nodes, which can become a bottleneck as the system scales. To address these issues, we propose adding support for **pre-aggregation** in data nodes. With pre-aggregation, data nodes would perform local aggregation on their data before transferring the intermediate results to the liaison node. The liaison node would then only need to perform a final aggregation on these intermediate results, significantly reducing both bandwidth usage and computational pressure on the liaison node. ### Use case _No response_ ### Related issues _No response_ ### Are you willing to submit a pull request to implement this on your own? - [ ] Yes I am willing to submit a pull request on my own! ### Code of Conduct - [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
