Hi Yi, Thanks for summarizing. But why are we excluding SAMZA-723 from the current release ? Doesn't this break the existing StreamAppender functionality in 0.9?
Thanks! Navina On Thu, Jul 30, 2015 at 4:55 PM, Yi Pan <nickpa...@gmail.com> wrote: > Sorry, hit the send button too fast. Let me correct the summary section: > > 29/32 tickets Status=open/reopen : > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(Open%2C%20Reopened)%20AND%20fixVersion%20%3D%200.10.0%20ORDER%20BY%20due%20ASC%2C%20priority%20DESC%2C%20created%20ASC > > Three tickets excluded: > - SAMZA-689, @Chinmay, were you able to re-produce it? I am thinking of > mark it as won't fix since 0.10.0 will remove the checkpoint topic > altogether. > - SAMZA-747, we will have to upgrade to RocksDB 3.11.1 to include the fix > that breaks Samza 0.10.0 build on Linux boxes > - SAMZA-723, stream appender deadlock issue > > Thanks! > > -Yi > > > On Thu, Jul 30, 2015 at 4:52 PM, Yi Pan <nickpa...@gmail.com> wrote: > > > Hi, all, > > > > Thanks a lot for helping out to select the features planned in 0.10.0. > > > > Based on the above discussion, I am proposing to move the following > > tickets later (i.e. 0.11.0). > > > > 30/32 tickets Status=open/reopen (exception for SAMZA-723: stream > appender > > deadlock issue) : > > > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(Open%2C%20Reopened)%20AND%20fixVersion%20%3D%200.10.0%20ORDER%20BY%20due%20ASC%2C%20priority%20DESC%2C%20created%20ASC > > > > Two tickets excluded: > > - SAMZA-689, @Chinmay, were you able to re-produce it? I am thinking of > > mark it as won't fix since 0.10.0 will remove the checkpoint topic > > altogether. > > - SAMZA-747, we will have to upgrade to RocksDB 3.11.1 to include the fix > > that breaks Samza 0.10.0 build on Linux boxes > > > > Anything that I missed? > > > > Thanks! > > > > -Yi > > > > > > On Wed, Jul 29, 2015 at 9:57 AM, Navina Ramesh < > > nram...@linkedin.com.invalid> wrote: > > > >> +1 for StreamAppender bug fix as a mandatory in 0.10. > >> > >> @Yan: will review SAMZA-676 today and test it out locally. > >> > >> Thanks! > >> Navina > >> > >> On Wed, Jul 29, 2015 at 8:38 AM, Chinmay Soman < > chinmay.cere...@gmail.com > >> > > >> wrote: > >> > >> > I can take care of SAMZA-340, SAMZA-683 and will follow up with Luis > >> for > >> > SAMZA-401,2,3,4 > >> > > >> > On Wed, Jul 29, 2015 at 12:10 AM, Dan <danharve...@gmail.com> wrote: > >> > > >> > > I agree SAMZA-741 for the ElasticSearch producer should be in too so > >> > we've > >> > > got a better API as part of that release. > >> > > > >> > > - Dan > >> > > > >> > > > >> > > On 29 July 2015 at 07:51, Yan Fang <yanfang...@gmail.com> wrote: > >> > > > >> > > > Actually, I also want to include a few patch-available features, > >> > > > especially: > >> > > > > >> > > > 1. broadcast stream (SAMZA-676) > >> > > > - waiting for review > >> > > > > >> > > > 2. graphite support (SAMZA-340) > >> > > > 3. meter and histogram (SAMZA-683) > >> > > > 4. utility (SAMZA-401) > >> > > > - 2,3,4 belong to Luis, if he does not have time to update, > >> since > >> > > they > >> > > > only need some small changes, we can edit it and get +1 from > another > >> > > > committer. > >> > > > > >> > > > 5. hdfs producer (SAMZA-693) > >> > > > - I am reviewing. > >> > > > > >> > > > 6. upgrade yarn to 2.7.1 (SAMZA-563) > >> > > > - though I am reviewing, this ticket is negotiable if we want > to > >> put > >> > > > into the 0.10.0 release. If we do not, I think, when users enable > >> the > >> > > > worker-persisting and container-persisting features, Samza will > not > >> be > >> > > able > >> > > > to handle it. (Some classes are only available after yarn 2.5.0 > >> while > >> > > Samza > >> > > > currently only support yarn 2.4.0) > >> > > > > >> > > > 7. others: scrooge, class loader isolation, etc. > >> > > > - those are waiting for reviewing too. > >> > > > > >> > > > My opinion is that, if we can clean up all the patch-available > >> tickets, > >> > > it > >> > > > will be great. Most of them have been already reviewed more than > >> once. > >> > > So I > >> > > > think it should not be very time-consuming to have them in the > >> 0.10.0 > >> > > > release. > >> > > > > >> > > > What do you think? > >> > > > > >> > > > Of course, another must-have is the bug-fix of the Stream > Appender. > >> :) > >> > > > > >> > > > Thanks, > >> > > > > >> > > > Fang, Yan > >> > > > yanfang...@gmail.com > >> > > > > >> > > > On Tue, Jul 28, 2015 at 10:27 PM, Roger Hoover < > >> roger.hoo...@gmail.com > >> > > > >> > > > wrote: > >> > > > > >> > > > > Thanks, Yi. > >> > > > > > >> > > > > I propose that we also include SAMZA-741 for Elasticsearch > >> versioning > >> > > > > support with the new ES producer. I think it's very close to > >> being > >> > > > merged. > >> > > > > > >> > > > > Roger > >> > > > > > >> > > > > > >> > > > > On Tue, Jul 28, 2015 at 10:08 PM, Yi Pan <nickpa...@gmail.com> > >> > wrote: > >> > > > > > >> > > > > > Hi, all, > >> > > > > > > >> > > > > > I want to start the discussion on the release schedule for > >> 0.10.0. > >> > > > There > >> > > > > > are a few important features that we plan to release in 0.10.0 > >> and > >> > I > >> > > > want > >> > > > > > to start this thread s.t. we can agree on what to include in > >> 0.10.0 > >> > > > > > release. > >> > > > > > > >> > > > > > There are the following main features added in 0.10.0: > >> > > > > > - RocksDB TTL support > >> > > > > > - Add CoordinatorStream and disable CheckpointManager > >> > > > > > - Elasticsearch Producer > >> > > > > > - Host affinity > >> > > > > > And other 0.10.0 tickets: > >> > > > > > > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20SAMZA%20AND%20status%20in%20(%22In%20Progress%22%2C%20Resolved%2C%20Closed)%20AND%20fixVersion%20%3D%200.10.0 > >> > > > > > > >> > > > > > I propose to cut a 0.10.0 release after we get the following > >> issues > >> > > > > > resolved: > >> > > > > > - SAMZA-615: Migrate checkpoint from checkpoint topic to > >> > Coordinator > >> > > > > stream > >> > > > > > - SAMZA-617: YARN host affinity in Samza > >> > > > > > > >> > > > > > Thoughts? > >> > > > > > > >> > > > > > Thanks! > >> > > > > > > >> > > > > > -Yi > >> > > > > > > >> > > > > > >> > > > > >> > > > >> > > >> > > >> > > >> > -- > >> > Thanks and regards > >> > > >> > Chinmay Soman > >> > > >> > >> > >> > >> -- > >> Navina R. > >> > > > > > -- Navina R.
