jadami10 opened a new issue, #14695: URL: https://github.com/apache/pinot/issues/14695
#11599 added https://github.com/apache/pinot/blame/master/pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpartition/SegmentPartitionMetadataManager.java#L168-L172 for more logging. Internally, we're seeing this log show up almost 1B times per day over many tables. My hypothesis is it's due to the fact that we have set ``` "segmentPartitionConfig": { "columnPartitionMap": { "<partition_col>": { "functionName": "Murmur", "numPartitions": 1000 } } }, ``` But this mapping doesn't actually match the underlying data. This is a different problem in Pinot where it's not always possible to express partitioning info used for the data in Pinot. But regardless of the cause, this log is way too high volume. possible fixes: - change to DEBUG. Do we actually need this log? - should this ever log more than once per segment? shouldn't the online servers eventually match? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
