MansiSingh17 commented on issue #18479: URL: https://github.com/apache/beam/issues/18479#issuecomment-3947042010
Hi @je-ik and @damccorm , I'd love to take on the second project scope if this split moves forward. On the dependency concern — I think we can handle it by defining Project 2 to start with the skeleton from Project 1 as a baseline assumption, and in the first few weeks coordinate closely with @junaiddshaukat to build on top of the foundation as it gets established. The stateful ParDo and splittable DoFn work can be largely designed and planned during that time even before all the skeleton pieces land. A rough split could be: - Project 1: Job Server, Pipeline Translator, Read, stateless ParDo, GBK, Combine, Window, Flatten, basic ValidatesRunner tests - Project 2: Stateful ParDo, splittable DoFn, timer support, extended ValidatesRunner coverage Happy to discuss further here or move to the mailing list if that's more appropriate. I can also start drafting a proposal outline for the second scope if that helps clarify feasibility. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
