lakshmanan-v opened a new issue, #9492: URL: https://github.com/apache/pinot/issues/9492
We recently introduced gapfill() to interpolate and fill gaps in a time series dataset. In the current solution, the data is moved and gapfilling is performed in the broker. This puts lots of stress on the broker as all of the raw records to be transferred from server to broker. This brings in a lot of limitations and doesn't work for large dataset with larger date range. In V2, let us revisit the implementation to push down the gapfill and aggregations to server side by leveraging data locality and make this feature scale better. cc @weixiangsun @Jackie-Jiang -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
