I'll follow the ticket, I already have made a couple changes to be added to help make things work.
On Mon, Jun 15, 2020 at 2:57 AM Yuqi Gu <[email protected]> wrote: > Hi folks, > > Thanks for all your comments and feedback above. > It seems we reached a consensus to put Ambari-Mpack as a separate top > component in Bigtop. I'll update the PR > <https://github.com/apache/bigtop/pull/555> for BIGTOP-3264 later. > Thanks Matt and Masahiro for your intention to maintain this new component > and looking forward to more contributions to it. > This is the first step to start to put our eyes on Mpack, but our first > priority definitely is to push Bigtop forward and we will surely pay more > attention to Bigtop core infrastructure as Olaf suggested. Thanks again! > > BRs, > Yuqi > > > > > > > On Wed, 10 Jun 2020 at 07:55, Masahiro Tanaka <[email protected]> > wrote: > > > Hi BigTop developers, > > > > I'm Masahiro. Kengo told me about this thread. > > > > Like Kengo mentioned, though its supported component is limited as of > right > > now, > > it's a good first step. (Thanks Yuqi, and other folks who are working on > > this topic!) > > > > > Then I have a question same as Evans for Yuqi, Matt, or others > interested > > > in: are you willing to be the maintainer going forward? :) > > > > I will happily work on it, and of course, other high-priority items. > > > > Best, > > > > Masahiro > > > > > > 2020年6月9日(火) 23:13 Ganesh Raju <[email protected]>: > > > > > Agree with Matt, Kengo and Jun on Ambari mpack. I think it has benefits > > to > > > Bigtop, again if it can be worked on without reducing efforts on > priority > > > items. > > > +1 > > > > > > Ganesh > > > > > > On Tue, Jun 9, 2020 at 2:57 AM Kengo Seki <[email protected]> wrote: > > > > > > > > Now is a great time for making this move as HDP is no longer going > to > > > be > > > > managed by a company, so BigTop could replace that role in Ambari. > > > > > This mpack allows BigTop to be installed into Ambari, and allows > > Ambari > > > > to manage the hadoop packages. Effectively, it would increase the > > reach > > > of > > > > BigTop to be able to be installed into and managed by Ambari. > > > > > > > > I agree with Matt. Many customers of my company are using HDP via > > > > Ambari, and they are worried about upgrading their stack in the > > > > future. > > > > Providing mpack may be able to help them, though supported components > > > > are very limited for now. > > > > So I'm +1 for this vote (but I personally think the vote was not > > > > necessarily required, as Olaf said). > > > > > > > > > Then I have a question same as Evans for Yuqi, Matt, or others > > > > interested in: are you willing to be the maintainer going forward? :) > > > > > > > > I recommend Masahiro Tanaka, who is an Ambari committer and have been > > > > contributed some patches to Bigtop in the last few months. > > > > I'm going to talk to him about it later. > > > > > > > > Regarding CI-related tasks, my apologies for the late work. I'll > > > > update some Jenkins jobs which don't address new distros yet soon. > > > > > > > > Kengo Seki <[email protected]> > > > > > > > > On Tue, Jun 9, 2020 at 4:31 PM Yuqi Gu <[email protected]> wrote: > > > > > > > > > > Thanks Olaf for expressing the concern on priorities of our Bigtop > > core > > > > > infrastructure. > > > > > > > > > > The Mpack gives convenience to the Bigtop users to deploy and > manage > > > > other > > > > > Bigtop components. > > > > > It also would help Bigtop become an easy-to-use BigData software > > stack > > > > for > > > > > users as an open source solution. > > > > > > > > > > It is the first step that costs. This discussion may just be a > > > beginning > > > > to > > > > > start to put our eyes on Mpack > > > > > which we may give a low priority. > > > > > > > > > > Definitely we should pay more attention to Bigtop CI, Hadoop3 as > Olaf > > > > > listed, > > > > > and I surely would like to help to fix the release-1.5 issues > driven > > by > > > > > Kengo. > > > > > > > > > > > > > > > >> > > > > > *Then I have a question same as Evans for Yuqi, Matt, or others > > > > > interestedin: are you willing to be the maintainer going forward? > :)* > > > > > > > > > > I'm also very pleased to be the maintainer to follow up. > > > > > > > > > > BRs, > > > > > Yuqi > > > > > > > > > > > > > > > On Tue, 9 Jun 2020 at 13:02, Jun HE <[email protected]> wrote: > > > > > > > > > > > Thanks Olaf for raising those comments/questions. That really > helps > > > us > > > > to > > > > > > think more about how this Bigtop-MPack thing could go further. > > > > > > > > > > > > I think Yuqi is trying to decouple Bigtop-Mpack from Ambari > > component > > > > > > itself in terms of code/patch/building/packaging, so developer > can > > > > easily > > > > > > contribute to it (MPack). The discussion on the PR thread comes > to > > > > create a > > > > > > new component just like bigtop-jsvc/bigtop-utils things. So for > > such > > > > change > > > > > > (adding new component) it might worth discussing and voting in > > > > community > > > > > > besides simply reviewing on some patches. > > > > > > > > > > > > Those items Olaf listed are definitely important to push Bigtop > > > > forward, > > > > > > especiall CI from my point of view, and we will focus on them. > > While > > > > MPack > > > > > > also gives Bigtop community possibility to extend usage and > improve > > > > > > influence as the only open source Big Data SW stack, and there > are > > > > > > potential contributors here, maybe we just get the ball rolling. > > > > > > > > > > > > Then I have a question same as Evans for Yuqi, Matt, or others > > > > interested > > > > > > in: are you willing to be the maintainer going forward? :) > > > > > > > > > > > > Regards, > > > > > > > > > > > > Jun > > > > > > > > > > > > > > > > > > Matt Andruff <[email protected]> 于2020年6月8日周一 下午10:32写道： > > > > > > > > > > > > > What problem/case is this additional component trying to solve? > > > > > > > > > > > > > > My opinion is that it's an enable meant tool to make it > easy > > > to > > > > use > > > > > > > BigTop by having it's configuration managed by Ambari. Now is > a > > > > great > > > > > > time > > > > > > > for making this move as HDP is no longer going to be managed > by a > > > > > > company, > > > > > > > so BigTop could replace that role in Ambari. > > > > > > > > > > > > > > This mpack allows BigTop to be installed into Ambari, and > > > allows > > > > > > > Ambari to manage the hadoop packages. Effectively, it would > > > > increase the > > > > > > > reach of BigTop to be able to be installed into and managed by > > > > Ambari. > > > > > > > > > > > > > > I hear that you see a lot of other priorities and they sound > like > > > > good > > > > > > > priorities. I'm not able to contribute to those priorities as > I > > > > don't > > > > > > know > > > > > > > enough in that area/do not understand what's required. I would > > > > > > contribute > > > > > > > right now to Ambari MPack as it's more in my wheelhouse. > > > > > > > > > > > > > > Hope that helps > > > > > > > > > > > > > > Matt > > > > > > > > > > > > > > On Sun, Jun 7, 2020 at 12:07 PM Olaf Flebbe <[email protected]> > > wrote: > > > > > > > > > > > > > > > Hi, > > > > > > > > > > > > > > > > Sorry, I am super lost about the implications of that vote. > > > > > > > > > > > > > > > > Why do we need a vote in the first place? > > > > > > > > I am familiar with votes for additional committers, PMC > > additions > > > > and > > > > > > > > releases. For these votes we have the concept of binding > votes > > by > > > > PMC > > > > > > > > members. > > > > > > > > > > > > > > > > Why should I care about this ? > > > > > > > > Does it have legal implications? > > > > > > > > > > > > > > > > Who will maintain this ? > > > > > > > > I am a bit surprised that we do anything with ambari, since > we > > > not > > > > even > > > > > > > > have a maintainer for it > > > > > > > > grep ambari MAINTAINERS.txt -> nothing > > > > > > > > > > > > > > > > What problem/case is this additional component trying to > solve? > > > > > > > > If you are asking for a vote I would like to have a more > > > elaborate > > > > > > > > explanation. I looked at the linked ticket: Sorry I am > totally > > > lost > > > > > > about > > > > > > > > what is this about. If you would have simply done it, I > > wouldn’t > > > > have > > > > > > > cared. > > > > > > > > > > > > > > > > As I understand it should somehow enable more contributions. > > > > > > > > Really? MPack is a amabari only technology, that seems not to > > > even > > > > be > > > > > > > > defined properly. How could this ever end in more > contributions > > > to > > > > > > > Bigtop ? > > > > > > > > > > > > > > > > What will happen if someone is -1 on this vote ? > > > > > > > > > > > > > > > > If a contributor cares about adopting Bigtop to new business > > > cases, > > > > > > > that’s > > > > > > > > very fine to me. Please go ahead. But please don’t ask for a > > > vote. > > > > All > > > > > > > > committers still have the chance to reject patches. > > > > > > > > > > > > > > > > Generally I am concerned that we care about an (from Bigtop > > side) > > > > > > > > unmaintained project while neglecting our core infrastructure > > and > > > > > > > packages > > > > > > > > at the same time. > > > > > > > > 1) The ci.bigtop.apache.org certificate expired again > > > > > > > > 2) The bigtop-trunk-packages do not reflect the architectures > > we > > > > ought > > > > > > to > > > > > > > > support (ubuntu-18.04 for instance) > > > > > > > > 3) Trunk-packages for amd64 looks like garbage > > > > > > > > 4) Still no-one working on Hadoop3 > > > > > > > > 5) CI needs to be redone (with pipeline jobs) . > > > > > > > > IMO we might have wrong priorities. > > > > > > > > > > > > > > > > Best, > > > > > > > > Olaf > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > Am 04.06.2020 um 19:04 schrieb Ganesh Raju < > > > > [email protected]>: > > > > > > > > > > > > > > > > > > +1 > > > > > > > > > > > > > > > > > > On Thu, Jun 4, 2020 at 12:01 PM Matt Andruff < > > > > > > > [email protected]> > > > > > > > > > wrote: > > > > > > > > > > > > > > > > > >> +1 > > > > > > > > >> > > > > > > > > >> On Thu., Jun. 4, 2020, 02:35 Yuqi Gu, <[email protected] > > > > > > wrote: > > > > > > > > >> > > > > > > > > >>> Hi folks, > > > > > > > > >>> > > > > > > > > >>> As the discussion with Evans Ye, Jun He, and Matt Andruff > > > (from > > > > > > > Ambari) > > > > > > > > >> on > > > > > > > > >>> > > > > https://github.com/apache/bigtop/pull/555#issuecomment-635228180: > > > > > > > > >>> > > > > > > > > >>> For users / Bigtopers could easily modify Mapck and make > > > > > > > contributions > > > > > > > > to > > > > > > > > >>> it like bugfix and adding more services, > > > > > > > > >>> How about to decouple Mpack from Ambari and put Mpack as > a > > > > > > standalone > > > > > > > > >>> component in Bigtop, like > > > > > > *bigtop-packages/src/common/bigtop-mpack*? > > > > > > > > >>> If so, it's convenient for users to get and install Mpack > > > > rpm/deb > > > > > > > > >> packages > > > > > > > > >>> in their own Ambari cluster. > > > > > > > > >>> > > > > > > > > >>> The VOTE: > > > > > > > > >>> [ ] +1, Agree to put Mpack as a standalone component. > > > > > > > > >>> [ ] +0, I don't care either way. > > > > > > > > >>> [ ] -1, do *not * Agree. > > > > > > > > >>> > > > > > > > > >>> Look forward to your comments and feedback, thanks. > > > > > > > > >>> > > > > > > > > >>> BRs, > > > > > > > > >>> Yuqi > > > > > > > > >>> > > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > > > > > > > IRC: ganeshraju@#linaro on irc.freenode.ne < > > > > http://irc.freenode.net/ > > > > > > >t > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- > > > IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t > > > > > >
