[Mentors] Releasing install scripts
Hi, I remember reading an email that said we could not release heron's install scripts under Apache. I've looked through my email, but cannot find the email (so very possible I'm remembering this wrong). Is it possible as part of a release to create and distribute a select number of operating system specific install scripts for a release? They are rather large in size ~500MB each. - Josh
Re: [DISCUSSION] Docker OS support
What is it? I/someone else can give some help if needed. On Fri, Jun 5, 2020 at 7:20 PM Ning Wang wrote: > That is the one I am blocked on. Will need to do another full tests before > starting the vote. > > On Fri, Jun 5, 2020 at 2:22 PM Josh Fischer wrote: > > > I just opened a PR that fixes javadoc generation for the website build. > Do > > we have anything else outstanding before we can start a vote on the next > > release candidate? > > > > On Wed, May 27, 2020 at 11:31 AM Ning Wang wrote: > > > > > Yeah. We have chosen Debian 10 for the binary release and clean up the > > > license requirements for the first binary release. > > > > > > In the source level, we would also like to include a few > > platforms/versions > > > in the main source code to be "supported" and the others will be moved > to > > > like a "extra" folder and not actively supported/tested. > > > > > > > > > On Wed, May 27, 2020 at 9:22 AM Dave Fisher wrote: > > > > > > > I thought that the purpose of this discussion was to find the one or > > two > > > > platforms for Heron to support in order to keep down the complexity > of > > > > making the first binary release for the community. > > > > > > > > Other platforms could be on a roadmap for future releases. > > > > > > > > Regards, > > > > Dave > > > > > > > > > On May 26, 2020, at 12:26 PM, Ning Wang > > wrote: > > > > > > > > > > My concern about "latest" is that I feel most people hold it for > some > > > > time > > > > > before migrating to the latest version (if it ever happens). If > there > > > are > > > > > numbers, it could make sense to use the most popular version (plus > > the > > > > > other criterias). > > > > > > > > > > On Tue, May 26, 2020 at 12:14 PM Oliver Bristow < > > > > oli...@oliverbristow.co.uk> > > > > > wrote: > > > > > > > > > >> Sorry if I missed the rationale for Ubuntu 18.04 instead of 20.04, > > but > > > > >> would the latest LTS be a better choice? 18.04 was released before > > > > Debian > > > > >> 10, so that may be an argument for 20.04 re. compatibility if > Debian > > > 10 > > > > is > > > > >> the standard. > > > > >> > > > > >> There's already a 20.04 Dockerfile + I It looks like the vagrant > > setup > > > > will > > > > >> get an upgrade from 14.04 to 20.04 as a part of the python3 > upgrade, > > > and > > > > >> seems to run fine so far. > > > > >> > > > > >> On Tue, 26 May 2020 at 19:30, Josh Fischer > > > wrote: > > > > >> > > > > >>> Thanks for further clarifying. Yes, that is correct. > > > > >>> > > > > >>> > > > > >>> > > > > >>> On Tue, May 26, 2020 at 1:16 PM Ning Wang > > > > wrote: > > > > >>> > > > > +1. > > > > > > > > So my understanding is: > > > > binary (in future release): Debian 10. > > > > source: Debian 9/10 + ubuntu 18.04 + centos 7. version numbers > > will > > > be > > > > updated in the future after more discussions/votes. > > > > > > > > others will be moved to a "extra" folder only for reference. > > > > > > > > > > > > > > > > On Tue, May 26, 2020 at 6:13 AM Josh Fischer < > j...@joshfischer.io > > > > > > > >>> wrote: > > > > > > > > > Hi All, > > > > > > > > > > Based on what I've read on this thread a combination of > > > CentOS/Debian > > > > would > > > > > be the better options for us to support multiple versions for > the > > > > > community. We will also support one version of Ubuntu. > > > > > > > > > > So. I will start a vote in 72 hours that calls on the vote > on > > > > >> this. > > > > > I'm going to write down my understanding of what this thread > > covers > > > > >> to > > > > get > > > > > some actionable topics to vote on. If I've written anything > down > > > > > incorrectly please speak up before we start a vote. > > > > > > > > > > Debian: > > > > >- Debian10 is the official docker image to support and be > > > > >> published > > > > to > > > > > Docker Hub, we will also support Debian9. > > > > > CentOS: > > > > >- We will support CentOS7. Note, I do not think it has > native > > > > > Python3.7 support, but we are also not there yet. > > > > > Ubuntu: > > > > >- We will still support one version. At this time the > version > > is > > > > 18.04. > > > > > > > > > > We will upgrade supported versions of each OS as > > > updates/deprecation > > > > >> of > > > > > support are needed. > > > > > > > > > > Again let's wait 72 hours before starting a vote. Also please > > > check > > > > >>> that > > > > > the statements I wrote down are what you understood! > > > > > > > > > > See below for notes on lazy consensus: > > > > > https://community.apache.org/committers/lazyConsensus.html > > > > > > > > > > - Josh > > > > > > > > > > > > > > > On Wed, May 20, 2020 at 9:41 PM Ning Wang < > wangnin...@gmail.com> > > > > >>> wrote: > > > > > > > > > >>
Re: [DISCUSSION] Docker OS support
That is the one I am blocked on. Will need to do another full tests before starting the vote. On Fri, Jun 5, 2020 at 2:22 PM Josh Fischer wrote: > I just opened a PR that fixes javadoc generation for the website build. Do > we have anything else outstanding before we can start a vote on the next > release candidate? > > On Wed, May 27, 2020 at 11:31 AM Ning Wang wrote: > > > Yeah. We have chosen Debian 10 for the binary release and clean up the > > license requirements for the first binary release. > > > > In the source level, we would also like to include a few > platforms/versions > > in the main source code to be "supported" and the others will be moved to > > like a "extra" folder and not actively supported/tested. > > > > > > On Wed, May 27, 2020 at 9:22 AM Dave Fisher wrote: > > > > > I thought that the purpose of this discussion was to find the one or > two > > > platforms for Heron to support in order to keep down the complexity of > > > making the first binary release for the community. > > > > > > Other platforms could be on a roadmap for future releases. > > > > > > Regards, > > > Dave > > > > > > > On May 26, 2020, at 12:26 PM, Ning Wang > wrote: > > > > > > > > My concern about "latest" is that I feel most people hold it for some > > > time > > > > before migrating to the latest version (if it ever happens). If there > > are > > > > numbers, it could make sense to use the most popular version (plus > the > > > > other criterias). > > > > > > > > On Tue, May 26, 2020 at 12:14 PM Oliver Bristow < > > > oli...@oliverbristow.co.uk> > > > > wrote: > > > > > > > >> Sorry if I missed the rationale for Ubuntu 18.04 instead of 20.04, > but > > > >> would the latest LTS be a better choice? 18.04 was released before > > > Debian > > > >> 10, so that may be an argument for 20.04 re. compatibility if Debian > > 10 > > > is > > > >> the standard. > > > >> > > > >> There's already a 20.04 Dockerfile + I It looks like the vagrant > setup > > > will > > > >> get an upgrade from 14.04 to 20.04 as a part of the python3 upgrade, > > and > > > >> seems to run fine so far. > > > >> > > > >> On Tue, 26 May 2020 at 19:30, Josh Fischer > > wrote: > > > >> > > > >>> Thanks for further clarifying. Yes, that is correct. > > > >>> > > > >>> > > > >>> > > > >>> On Tue, May 26, 2020 at 1:16 PM Ning Wang > > > wrote: > > > >>> > > > +1. > > > > > > So my understanding is: > > > binary (in future release): Debian 10. > > > source: Debian 9/10 + ubuntu 18.04 + centos 7. version numbers > will > > be > > > updated in the future after more discussions/votes. > > > > > > others will be moved to a "extra" folder only for reference. > > > > > > > > > > > > On Tue, May 26, 2020 at 6:13 AM Josh Fischer > > > > >>> wrote: > > > > > > > Hi All, > > > > > > > > Based on what I've read on this thread a combination of > > CentOS/Debian > > > would > > > > be the better options for us to support multiple versions for the > > > > community. We will also support one version of Ubuntu. > > > > > > > > So. I will start a vote in 72 hours that calls on the vote on > > > >> this. > > > > I'm going to write down my understanding of what this thread > covers > > > >> to > > > get > > > > some actionable topics to vote on. If I've written anything down > > > > incorrectly please speak up before we start a vote. > > > > > > > > Debian: > > > >- Debian10 is the official docker image to support and be > > > >> published > > > to > > > > Docker Hub, we will also support Debian9. > > > > CentOS: > > > >- We will support CentOS7. Note, I do not think it has native > > > > Python3.7 support, but we are also not there yet. > > > > Ubuntu: > > > >- We will still support one version. At this time the version > is > > > 18.04. > > > > > > > > We will upgrade supported versions of each OS as > > updates/deprecation > > > >> of > > > > support are needed. > > > > > > > > Again let's wait 72 hours before starting a vote. Also please > > check > > > >>> that > > > > the statements I wrote down are what you understood! > > > > > > > > See below for notes on lazy consensus: > > > > https://community.apache.org/committers/lazyConsensus.html > > > > > > > > - Josh > > > > > > > > > > > > On Wed, May 20, 2020 at 9:41 PM Ning Wang > > > >>> wrote: > > > > > > > >> +1 > > > >> > > > >> On Wed, May 20, 2020 at 7:26 PM Nicholas Nezis < > > > nicholas.ne...@gmail.com > > > >> > > > >> wrote: > > > >> > > > >>> I like those options. > > > >>> > > > >>> On Wed, May 20, 2020 at 10:15 PM Josh Fischer < > > > >> j...@joshfischer.io > > > > > > >> wrote: > > > >>> > > > Let's wait 3 more days for anyone to give input. Then we can > > > start a > > > >>> vote
Re: 6/2/2020 Bi-Weekly OSS Heron Sync-up
- Did some PR reviews - Assisted Oliver with his Python 3 upgrade - Have been testing out a branch with upgraded Zookeeper and Bookkeeper, but ran into blockers On Wed, Jun 3, 2020 at 10:37 PM Josh Fischer wrote: > Hi: > > - I’ve been trying to figure out the Java doc issue as well. The Java doc > issues affects certain build targets of Heron and the breaks the website > build. > - did some review on PRs > > > - Josh > > > On Wed, Jun 3, 2020 at 5:29 AM thinker0 wrote: > > > https://github.com/thinker0/heron-3rdparty > > > > > > > https://search.maven.org/artifact/com.github.thinker0.heron/heron-kafka-client/1.0.2/jar > > > > I cloned org.apache.storm:kafka-clients and made some tweaks to make sure > > it worked fine in Production. > > > > Can we put this in our project? > > > > I put org.apache.heron:kafka-spout into production, and > kafka-offset-commit > > happens too much, so there is an issue that puts too much load on > > kafka-cluster. > > I have already used apache-storm:kafka-clients, so I modified this a bit > > and made it for Heron. > > > > 2020년 6월 2일 (화) 오후 6:24, Ning Wang 님이 작성: > > > > > Hi~ > > > > > > It has been two weeks since our last sync! Let's share our works for > the > > > last two weeks in this thread. > > > > > > My updates: > > > - Testing release candidate 3. The latest error I got is a javadoc > issue. > > > It seems like there is a new PR related to javadoc and I am testing the > > > latest code. > > > > > > Regards, > > > --ning > > > > > > -- > Sent from A Mobile Device >
Re: [DISCUSSION] Docker OS support
I just opened a PR that fixes javadoc generation for the website build. Do we have anything else outstanding before we can start a vote on the next release candidate? On Wed, May 27, 2020 at 11:31 AM Ning Wang wrote: > Yeah. We have chosen Debian 10 for the binary release and clean up the > license requirements for the first binary release. > > In the source level, we would also like to include a few platforms/versions > in the main source code to be "supported" and the others will be moved to > like a "extra" folder and not actively supported/tested. > > > On Wed, May 27, 2020 at 9:22 AM Dave Fisher wrote: > > > I thought that the purpose of this discussion was to find the one or two > > platforms for Heron to support in order to keep down the complexity of > > making the first binary release for the community. > > > > Other platforms could be on a roadmap for future releases. > > > > Regards, > > Dave > > > > > On May 26, 2020, at 12:26 PM, Ning Wang wrote: > > > > > > My concern about "latest" is that I feel most people hold it for some > > time > > > before migrating to the latest version (if it ever happens). If there > are > > > numbers, it could make sense to use the most popular version (plus the > > > other criterias). > > > > > > On Tue, May 26, 2020 at 12:14 PM Oliver Bristow < > > oli...@oliverbristow.co.uk> > > > wrote: > > > > > >> Sorry if I missed the rationale for Ubuntu 18.04 instead of 20.04, but > > >> would the latest LTS be a better choice? 18.04 was released before > > Debian > > >> 10, so that may be an argument for 20.04 re. compatibility if Debian > 10 > > is > > >> the standard. > > >> > > >> There's already a 20.04 Dockerfile + I It looks like the vagrant setup > > will > > >> get an upgrade from 14.04 to 20.04 as a part of the python3 upgrade, > and > > >> seems to run fine so far. > > >> > > >> On Tue, 26 May 2020 at 19:30, Josh Fischer > wrote: > > >> > > >>> Thanks for further clarifying. Yes, that is correct. > > >>> > > >>> > > >>> > > >>> On Tue, May 26, 2020 at 1:16 PM Ning Wang > > wrote: > > >>> > > +1. > > > > So my understanding is: > > binary (in future release): Debian 10. > > source: Debian 9/10 + ubuntu 18.04 + centos 7. version numbers will > be > > updated in the future after more discussions/votes. > > > > others will be moved to a "extra" folder only for reference. > > > > > > > > On Tue, May 26, 2020 at 6:13 AM Josh Fischer > > >>> wrote: > > > > > Hi All, > > > > > > Based on what I've read on this thread a combination of > CentOS/Debian > > would > > > be the better options for us to support multiple versions for the > > > community. We will also support one version of Ubuntu. > > > > > > So. I will start a vote in 72 hours that calls on the vote on > > >> this. > > > I'm going to write down my understanding of what this thread covers > > >> to > > get > > > some actionable topics to vote on. If I've written anything down > > > incorrectly please speak up before we start a vote. > > > > > > Debian: > > >- Debian10 is the official docker image to support and be > > >> published > > to > > > Docker Hub, we will also support Debian9. > > > CentOS: > > >- We will support CentOS7. Note, I do not think it has native > > > Python3.7 support, but we are also not there yet. > > > Ubuntu: > > >- We will still support one version. At this time the version is > > 18.04. > > > > > > We will upgrade supported versions of each OS as > updates/deprecation > > >> of > > > support are needed. > > > > > > Again let's wait 72 hours before starting a vote. Also please > check > > >>> that > > > the statements I wrote down are what you understood! > > > > > > See below for notes on lazy consensus: > > > https://community.apache.org/committers/lazyConsensus.html > > > > > > - Josh > > > > > > > > > On Wed, May 20, 2020 at 9:41 PM Ning Wang > > >>> wrote: > > > > > >> +1 > > >> > > >> On Wed, May 20, 2020 at 7:26 PM Nicholas Nezis < > > nicholas.ne...@gmail.com > > >> > > >> wrote: > > >> > > >>> I like those options. > > >>> > > >>> On Wed, May 20, 2020 at 10:15 PM Josh Fischer < > > >> j...@joshfischer.io > > > > >> wrote: > > >>> > > Let's wait 3 more days for anyone to give input. Then we can > > start a > > >>> vote > > to make a final decision on which containers for us to support. > > Keep > > >> in > > mind that even though we do need to plan for Python3 support > > >>> (There > > > is > > >>> work > > in progress now) we do not need it as of yet. > > > > - Josh > > > > On Wed, May 20, 2020 at 8:34 PM thinker0 > > wrote: > > > > > My experience is
