[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986680#comment-16986680 ] leesf commented on HUDI-288: > Thank you for letting me drive this work. I was thinking if we should add >

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986664#comment-16986664 ] Pratyaksh Sharma commented on HUDI-288: --- [~xleesf] Thank you for letting me drive this work. I was

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986539#comment-16986539 ] Vinoth Chandar commented on HUDI-288: - Great!  > Add support for ingesting multiple kafka streams in a

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986433#comment-16986433 ] leesf commented on HUDI-288: Hi [~vinoth]. Since [~Pratyaksh] have completed most of the code, I would like to

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16986264#comment-16986264 ] Vinoth Chandar commented on HUDI-288: - > So keeping in the target path looks a bit skeptical to me >

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16984368#comment-16984368 ] leesf commented on HUDI-288: Thanks for your sharing. Looks very comprehensive. I have some thoughts.

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983307#comment-16983307 ] Pratyaksh Sharma commented on HUDI-288: --- [~xleesf] Here is what I have done -    Basically we want

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982492#comment-16982492 ] leesf commented on HUDI-288: [~Pratyaksh] Of cause and glad that you have implemented the similar wrapper, it

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16982444#comment-16982444 ] Pratyaksh Sharma commented on HUDI-288: --- [~xleesf] I have written a similar wrapper for my

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16978324#comment-16978324 ] leesf commented on HUDI-288: > I think we can stick to the same whitelist/blacklist that Kafka itself uses? 

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977695#comment-16977695 ] Vinoth Chandar commented on HUDI-288: - I think we can stick to the same whitelist/blacklist that Kafka

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976500#comment-16976500 ] leesf commented on HUDI-288: [~vinoth] Sorry for late feedback. After a closer look to code paths, I prefer

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16944571#comment-16944571 ] Vinoth Chandar commented on HUDI-288: - one additional feature that might be great to support here would

[jira] [Commented] (HUDI-288) Add support for ingesting multiple kafka streams in a single DeltaStreamer deployment

[ https://issues.apache.org/jira/browse/HUDI-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16943728#comment-16943728 ] Vinoth Chandar commented on HUDI-288: - Great! This will help larger companies with more topics easily