Jackie-Jiang commented on PR #17606: URL: https://github.com/apache/pinot/pull/17606#issuecomment-3976442732
Seems the intention is to directly use a dimension table with upsert semantic, without doing lookup. In that case, we should support upsert in offline table first, then when loading lookup table, only load the valid docs. Supporting upsert in offline table should be simple. It is the same as RT table, but no need to handle `addRecord()` (for consuming segment). When there is no comparison column, we can use segment name/push time to break tie. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
