Jackie-Jiang opened a new issue #6222: URL: https://github.com/apache/incubator-pinot/issues/6222
Currently the time value (`startTime` and `endTime`) stored in the SegmentZKMetadata are not uniformed for offline table and real-time table. In offline table and HLC table, the stored value is the actual time value with the actual time unit; while in LLC table, the stored value is the time in milliseconds, and the time unit is always `MILLISECONDS`. This can cause confusion for the retention management and time boundary management. Also, for simple date format, the actual time value is not preserved in the SegmentZKMetadata, but always converted into milliseconds. Because of this, we cannot use simple date format for hybrid use cases, and we cannot do time pruning on broker. To solve these problems, we should uniform the time value in SegmentZKMetadata: - Store the start and end time in milliseconds for the retention management - Also store the actual start and end time for the time boundary management and broker time based segment pruning ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
