pratyakshsharma commented on issue #1453: HUDI-644 kafka connect checkpoint provider URL: https://github.com/apache/incubator-hudi/pull/1453#issuecomment-604972381 Thank you for making this tool @garyli1019 Have you thought of a use case where user might want to switch the source more than once? Basically something like a user is running 2 pipelines - pipeline A (using deltaStreamer consuming from kafka, say) and pipeline B (using some other reconciler writing to some other path). Now whenever user finds A is having some issue in terms of data quality, user would like to consume from output of B using DFS source for A and again switch back to kafka for A? And this thing can happen n number of times. Also would like to hear from @vinothchandar on this use case.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
