[GitHub] [incubator-hudi] vinothchandar commented on issue #128: Evaluate feasibility of scheduling hoodie pipelines w/o need for external workflow managers
vinothchandar commented on issue #128: Evaluate feasibility of scheduling hoodie pipelines w/o need for external workflow managers URL: https://github.com/apache/incubator-hudi/issues/128#issuecomment-479134748 Once we approach beam, we can consider ProcessContext. for now, I think SparkStreamingContext or equivalent would do something similar I beleieve This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-hudi] vinothchandar commented on issue #128: Evaluate feasibility of scheduling hoodie pipelines w/o need for external workflow managers
vinothchandar commented on issue #128: Evaluate feasibility of scheduling hoodie pipelines w/o need for external workflow managers URL: https://github.com/apache/incubator-hudi/issues/128#issuecomment-479134137 @SemanticBeeng this is orthogonal to connection management I believe.. This ticket was around figuring out how to deploy hudi in a long running mode.. Some aspects like givining up containers on dynamic allocation etc could still be useful. let me post this into HUDI-70 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
