Hi folks, Thanks for all your comments and feedback above. It seems we reached a consensus to put Ambari-Mpack as a separate top component in Bigtop. I'll update the PR <https://github.com/apache/bigtop/pull/555> for BIGTOP-3264 later. Thanks Matt and Masahiro for your intention to maintain this new component and looking forward to more contributions to it. This is the first step to start to put our eyes on Mpack, but our first priority definitely is to push Bigtop forward and we will surely pay more attention to Bigtop core infrastructure as Olaf suggested. Thanks again!
BRs, Yuqi On Wed, 10 Jun 2020 at 07:55, Masahiro Tanaka <[email protected]> wrote: > Hi BigTop developers, > > I'm Masahiro. Kengo told me about this thread. > > Like Kengo mentioned, though its supported component is limited as of right > now, > it's a good first step. (Thanks Yuqi, and other folks who are working on > this topic!) > > > Then I have a question same as Evans for Yuqi, Matt, or others interested > > in: are you willing to be the maintainer going forward? :) > > I will happily work on it, and of course, other high-priority items. > > Best, > > Masahiro > > > 2020年6月9日(火) 23:13 Ganesh Raju <[email protected]>: > > > Agree with Matt, Kengo and Jun on Ambari mpack. I think it has benefits > to > > Bigtop, again if it can be worked on without reducing efforts on priority > > items. > > +1 > > > > Ganesh > > > > On Tue, Jun 9, 2020 at 2:57 AM Kengo Seki <[email protected]> wrote: > > > > > > Now is a great time for making this move as HDP is no longer going to > > be > > > managed by a company, so BigTop could replace that role in Ambari. > > > > This mpack allows BigTop to be installed into Ambari, and allows > Ambari > > > to manage the hadoop packages. Effectively, it would increase the > reach > > of > > > BigTop to be able to be installed into and managed by Ambari. > > > > > > I agree with Matt. Many customers of my company are using HDP via > > > Ambari, and they are worried about upgrading their stack in the > > > future. > > > Providing mpack may be able to help them, though supported components > > > are very limited for now. > > > So I'm +1 for this vote (but I personally think the vote was not > > > necessarily required, as Olaf said). > > > > > > > Then I have a question same as Evans for Yuqi, Matt, or others > > > interested in: are you willing to be the maintainer going forward? :) > > > > > > I recommend Masahiro Tanaka, who is an Ambari committer and have been > > > contributed some patches to Bigtop in the last few months. > > > I'm going to talk to him about it later. > > > > > > Regarding CI-related tasks, my apologies for the late work. I'll > > > update some Jenkins jobs which don't address new distros yet soon. > > > > > > Kengo Seki <[email protected]> > > > > > > On Tue, Jun 9, 2020 at 4:31 PM Yuqi Gu <[email protected]> wrote: > > > > > > > > Thanks Olaf for expressing the concern on priorities of our Bigtop > core > > > > infrastructure. > > > > > > > > The Mpack gives convenience to the Bigtop users to deploy and manage > > > other > > > > Bigtop components. > > > > It also would help Bigtop become an easy-to-use BigData software > stack > > > for > > > > users as an open source solution. > > > > > > > > It is the first step that costs. This discussion may just be a > > beginning > > > to > > > > start to put our eyes on Mpack > > > > which we may give a low priority. > > > > > > > > Definitely we should pay more attention to Bigtop CI, Hadoop3 as Olaf > > > > listed, > > > > and I surely would like to help to fix the release-1.5 issues driven > by > > > > Kengo. > > > > > > > > > > > > >> > > > > *Then I have a question same as Evans for Yuqi, Matt, or others > > > > interestedin: are you willing to be the maintainer going forward? :)* > > > > > > > > I'm also very pleased to be the maintainer to follow up. > > > > > > > > BRs, > > > > Yuqi > > > > > > > > > > > > On Tue, 9 Jun 2020 at 13:02, Jun HE <[email protected]> wrote: > > > > > > > > > Thanks Olaf for raising those comments/questions. That really helps > > us > > > to > > > > > think more about how this Bigtop-MPack thing could go further. > > > > > > > > > > I think Yuqi is trying to decouple Bigtop-Mpack from Ambari > component > > > > > itself in terms of code/patch/building/packaging, so developer can > > > easily > > > > > contribute to it (MPack). The discussion on the PR thread comes to > > > create a > > > > > new component just like bigtop-jsvc/bigtop-utils things. So for > such > > > change > > > > > (adding new component) it might worth discussing and voting in > > > community > > > > > besides simply reviewing on some patches. > > > > > > > > > > Those items Olaf listed are definitely important to push Bigtop > > > forward, > > > > > especiall CI from my point of view, and we will focus on them. > While > > > MPack > > > > > also gives Bigtop community possibility to extend usage and improve > > > > > influence as the only open source Big Data SW stack, and there are > > > > > potential contributors here, maybe we just get the ball rolling. > > > > > > > > > > Then I have a question same as Evans for Yuqi, Matt, or others > > > interested > > > > > in: are you willing to be the maintainer going forward? :) > > > > > > > > > > Regards, > > > > > > > > > > Jun > > > > > > > > > > > > > > > Matt Andruff <[email protected]> 于2020年6月8日周一 下午10:32写道： > > > > > > > > > > > What problem/case is this additional component trying to solve? > > > > > > > > > > > > My opinion is that it's an enable meant tool to make it easy > > to > > > use > > > > > > BigTop by having it's configuration managed by Ambari. Now is a > > > great > > > > > time > > > > > > for making this move as HDP is no longer going to be managed by a > > > > > company, > > > > > > so BigTop could replace that role in Ambari. > > > > > > > > > > > > This mpack allows BigTop to be installed into Ambari, and > > allows > > > > > > Ambari to manage the hadoop packages. Effectively, it would > > > increase the > > > > > > reach of BigTop to be able to be installed into and managed by > > > Ambari. > > > > > > > > > > > > I hear that you see a lot of other priorities and they sound like > > > good > > > > > > priorities. I'm not able to contribute to those priorities as I > > > don't > > > > > know > > > > > > enough in that area/do not understand what's required. I would > > > > > contribute > > > > > > right now to Ambari MPack as it's more in my wheelhouse. > > > > > > > > > > > > Hope that helps > > > > > > > > > > > > Matt > > > > > > > > > > > > On Sun, Jun 7, 2020 at 12:07 PM Olaf Flebbe <[email protected]> > wrote: > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > Sorry, I am super lost about the implications of that vote. > > > > > > > > > > > > > > Why do we need a vote in the first place? > > > > > > > I am familiar with votes for additional committers, PMC > additions > > > and > > > > > > > releases. For these votes we have the concept of binding votes > by > > > PMC > > > > > > > members. > > > > > > > > > > > > > > Why should I care about this ? > > > > > > > Does it have legal implications? > > > > > > > > > > > > > > Who will maintain this ? > > > > > > > I am a bit surprised that we do anything with ambari, since we > > not > > > even > > > > > > > have a maintainer for it > > > > > > > grep ambari MAINTAINERS.txt -> nothing > > > > > > > > > > > > > > What problem/case is this additional component trying to solve? > > > > > > > If you are asking for a vote I would like to have a more > > elaborate > > > > > > > explanation. I looked at the linked ticket: Sorry I am totally > > lost > > > > > about > > > > > > > what is this about. If you would have simply done it, I > wouldn’t > > > have > > > > > > cared. > > > > > > > > > > > > > > As I understand it should somehow enable more contributions. > > > > > > > Really? MPack is a amabari only technology, that seems not to > > even > > > be > > > > > > > defined properly. How could this ever end in more contributions > > to > > > > > > Bigtop ? > > > > > > > > > > > > > > What will happen if someone is -1 on this vote ? > > > > > > > > > > > > > > If a contributor cares about adopting Bigtop to new business > > cases, > > > > > > that’s > > > > > > > very fine to me. Please go ahead. But please don’t ask for a > > vote. > > > All > > > > > > > committers still have the chance to reject patches. > > > > > > > > > > > > > > Generally I am concerned that we care about an (from Bigtop > side) > > > > > > > unmaintained project while neglecting our core infrastructure > and > > > > > > packages > > > > > > > at the same time. > > > > > > > 1) The ci.bigtop.apache.org certificate expired again > > > > > > > 2) The bigtop-trunk-packages do not reflect the architectures > we > > > ought > > > > > to > > > > > > > support (ubuntu-18.04 for instance) > > > > > > > 3) Trunk-packages for amd64 looks like garbage > > > > > > > 4) Still no-one working on Hadoop3 > > > > > > > 5) CI needs to be redone (with pipeline jobs) . > > > > > > > IMO we might have wrong priorities. > > > > > > > > > > > > > > Best, > > > > > > > Olaf > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Am 04.06.2020 um 19:04 schrieb Ganesh Raju < > > > [email protected]>: > > > > > > > > > > > > > > > > +1 > > > > > > > > > > > > > > > > On Thu, Jun 4, 2020 at 12:01 PM Matt Andruff < > > > > > > [email protected]> > > > > > > > > wrote: > > > > > > > > > > > > > > > >> +1 > > > > > > > >> > > > > > > > >> On Thu., Jun. 4, 2020, 02:35 Yuqi Gu, <[email protected]> > > > wrote: > > > > > > > >> > > > > > > > >>> Hi folks, > > > > > > > >>> > > > > > > > >>> As the discussion with Evans Ye, Jun He, and Matt Andruff > > (from > > > > > > Ambari) > > > > > > > >> on > > > > > > > >>> > > > https://github.com/apache/bigtop/pull/555#issuecomment-635228180: > > > > > > > >>> > > > > > > > >>> For users / Bigtopers could easily modify Mapck and make > > > > > > contributions > > > > > > > to > > > > > > > >>> it like bugfix and adding more services, > > > > > > > >>> How about to decouple Mpack from Ambari and put Mpack as a > > > > > standalone > > > > > > > >>> component in Bigtop, like > > > > > *bigtop-packages/src/common/bigtop-mpack*? > > > > > > > >>> If so, it's convenient for users to get and install Mpack > > > rpm/deb > > > > > > > >> packages > > > > > > > >>> in their own Ambari cluster. > > > > > > > >>> > > > > > > > >>> The VOTE: > > > > > > > >>> [ ] +1, Agree to put Mpack as a standalone component. > > > > > > > >>> [ ] +0, I don't care either way. > > > > > > > >>> [ ] -1, do *not * Agree. > > > > > > > >>> > > > > > > > >>> Look forward to your comments and feedback, thanks. > > > > > > > >>> > > > > > > > >>> BRs, > > > > > > > >>> Yuqi > > > > > > > >>> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > IRC: ganeshraju@#linaro on irc.freenode.ne < > > > http://irc.freenode.net/ > > > > > >t > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t > > >
