keweishang edited a comment on issue #6523: URL: https://github.com/apache/incubator-pinot/issues/6523#issuecomment-872455648
We at Bolt also need this feature. We use Kafka Streams to join different Kafka topics. Kafka Streams' JOIN produces many Kafka records with the same event-time column value. Pinot randomly picks one record as the latest one when the event-time value is the same and it doesn't guarantee that the record of the latest Kafka offset is chosen. It would be great to use other columns (e.g. an int/long column or Kafka Offset) than the event-time column to decide which is the last version when the primary key is the same. We're evaluating Pinot at Bolt and this is a blocking issue for us at the moment. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
