noob-se7en commented on PR #17688: URL: https://github.com/apache/pinot/pull/17688#issuecomment-3905049963
> > Regarding reading directly from the upstream object store: clarification on the intended mechanism would help. How would Apache Pinot discover new files and track which ones have already been processed? Idea would be around pinot to have its own checkpointing but I think the implementation will be complex, though the setup for a user will be quite simpler. For this PR, Can you help in giving an example like for a user to use this feature what can the upstream setup look like? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
