Generic question without commenting on Twister2 specifically: Should runners, current and future, be in the same repository as Beam core? Can or should they be completely separate products with their own release cycles?
Generally, loose coupling leads to more maintainable, reliable projects. Specifically, Cassandra is holding back some other changes in Beam and I really wish it didn't have the ability to block progress. The more different runners we have in core, the worse this problem is likely to become. On Wed, Mar 4, 2020 at 2:03 PM Pulasthi Supun Wickramasinghe <pulasthi...@gmail.com> wrote: > > Hi > > I believe the pull request is pretty complete now with the help of Ismaël. > Kenn, would you be able to take a look at it and suggest any changes if > needed?. The build checks and validations tests are passing at the moment. I > will start working on the documentation that you mentioned in an earlier > email separately. > > Best Regards, > Pulasthi > > > > > > On Tue, Feb 18, 2020 at 1:45 PM Pulasthi Supun Wickramasinghe > <pulasthi...@gmail.com> wrote: >> >> Hi All, >> >> I have created the initial pull request [1] to contribute the Twister2 Beam >> runner to the Apache Beam codebase. More information on Twister2 can be >> found here[2] and the Twister2 codebase is available here[3]. At the moment >> only batch mode is supported in the runner, but we are planning to add >> stream support and implement a portable runner for Twister2 in the near >> future. >> >> As Kenn pointed out in an earlier email it would be great to have inputs >> from the community regarding this contribution since it is a sizable one. I >> am sure there are many improvements that can be done in the contributed >> codebase with input from the community. >> >> [1] https://github.com/apache/beam/pull/10888 >> [2] https://twister2.org/ >> [3] https://github.com/DSC-SPIDAL/twister2 >> >> Best Regards, >> Pulasthi >> -- >> Pulasthi S. Wickramasinghe >> PhD Candidate | Research Assistant >> School of Informatics and Computing | Digital Science Center >> Indiana University, Bloomington >> cell: 224-386-9035 > > > > -- > Pulasthi S. Wickramasinghe > PhD Candidate | Research Assistant > School of Informatics and Computing | Digital Science Center > Indiana University, Bloomington > cell: 224-386-9035 -- Elliotte Rusty Harold elh...@ibiblio.org
