Of course. Hi everyone,
Here are the details I share with Kengo, Brahma and Michiel: Let me explain why we want to restart Ambari's community and the current status of re-incubation. Since Ambari still has large demands, the retirement makes lots of companies looking for a replacement. My team also needs to manage some new bigdata components that Ambari doesn't provide, But the only choice is to redevelop a fork version of it, And we have the idea to upload it to github, start a new community. But compare to maintain the Ambari's original community, start a new one based on fork version has some disadvantages. First, we can no longer use the name "Ambari", which will make it difficult for original users to find it. It can also lead to insufficient attraction of new developers. Next, that name change also causes inconvenience for end users and other projects leveraging Ambari, e.g., Bigtop. They have to change their operational procedures, scripts, users guide, and so on. Lastly, we have to rebuild the development infrastructure and workflows etc., but it's time-consuming and meaningless because Ambari has already done it. So we hope we can help restart Ambari's community again. And if Ambari can be successfully re-incubated, I think there should be in-depth collaboration with bigtop community in the future. Currently, the proposal has a draft version, and we now have 1 champion, 2 mentors, and some initial committers(Sorry I cannot share the details here). So let me know if you're interested, or you can join the slack channel sent by Brahma. Best Regards, Zhiguo Wu > On Jun 3, 2022, at 16:15, Evans Ye <[email protected]> wrote: > > Zhiguo, > > This Is definitely great if we can have all the folks to work on Apache > Ambari collaboratively. > > My two cents: > maybe you can share more details to folks in public as I believe there will > be more users/developers interstinging in it. > > At Apache, we encourage: “thing can be public, must be public”. > > - Evans > > Michiel Verheul <[email protected]>於 2022年6月3日 週五，上午2:29寫道： > >> Hi Zhiguo, >> >> I definitely want to be part of this. Please count me in. >> >> Michiel >> >> Op wo 1 jun. 2022 08:51 schreef 吴治国 <[email protected]>: >> >>> Hi everyone, >>> >>> I find that most people still rely on Ambari, including myself. >>> Therefore, my team is planning to bring Ambari back to incubator, and we >>> have connected with some IPMCs who are willing to help. >>> Currently, we are preparing the proposal, and we believe that we can >> start >>> voting about this in the Apache Incubator community in the near future. >>> Even if the proposal is rejected, we will still create a fork version on >>> github and keep it running. >>> If you are also interested in this, or want to be part of this, please >>> contact me, thanks! >>> >>> Best Regards, >>> Zhiguo Wu >>> >>> On 2022/05/19 06:41:57 Yuqi Gu wrote: >>>> Bigtop adopted the Ambari stable version (2.7.5) as the cluster >>> management >>>> tools for the potential developers and administrators. It also provided >>> the >>>> bigtop-ambari-mpack(Bgtp-Mpack) to decouple stack management and >>> definition >>>> from Ambari's core. >>>> Currently Bgtp-Mpack still just supports Bigtop-1.5 (Hadoop 2.x), but >> the >>>> Bigtop has already supported Hadoop 3.x in Bigtop 3 release. So we plan >>> to >>>> start working on upgrading Bgtp-Mpack services from Bigtop-1.5 (Hadoop >>> 2.x) >>>> to Bigtop-3 (Hadoop-3.x). >>>> >>>> BRs, >>>> Yuqi >>>> >>>> >>>> >>>> Michiel Verheul <[email protected]> 于2022年5月19日周四 03:56写道： >>>> >>>>> Personally I'm struggling with the exactly the same issue. There was >>>>> already some kind of discussion on this topic here, earlier: >>>>> >>>>> https://lists.apache.org/thread/wj898zq8q348721xf460mttqlty4v3zw >>>>> >>>>> Personally I have never ran a production cluster without CM before. >>> Bigtop >>>>> 3 with Ambari seemed ideal, but as there was no ambari-mpack for >>> bigtop 3 >>>>> yet, I put some energy in porting the HDP mpack to support bigtop. >>>>> But I can understand that maintaining such a component under the >> Bigtop >>>>> project is a no-go, because of Ambari's attic state, Python 2.7 and >> the >>>>> (un)maintainability of such an mpack, so I stopped working on that. >>>>> >>>>> From what I also understand from the above thread, 李帅 is already >>> working on >>>>> some light weight ambari alternative. It feels like that would be a >>> good >>>>> way forward but I don't know how much work has to be done to make >> this >>> work >>>>> and if it's still viable? >>>>> >>>>> The alternative would be running vanilla hadoop/bigtop. I don't have >>> any >>>>> experience with it but I guess the most important gaps for me will >> be: >>>>> >>>>> - initial installation (with support for Kerberos and SSL) >>>>> - (rolling) service restarts >>>>> - basic service monitoring (is a service running or down?) >>>>> >>>>> Maybe we just have to put some energy in creating puppet/Ansible >>> scripts >>>>> for this purpose and just forget about Ambari. >>>>> >>>>> >>>>> Op wo 18 mei 2022 20:07 schreef Battula, Brahma Reddy >>>>> <[email protected]>: >>>>> >>>>>> Supposed to ask same question @Martin Blom here. >>>>>> IMO, still Ambari will be good choice for cluster management. I >>> think, >>>>>> most/some amount of people from bigtop(who are using for building >> the >>>>>> packages) still use ambari. >>>>>> >>>>>> Planning to take collective opinion on bring back even with some >>> other >>>>>> name if not with same name. >>>>>> >>>>>> Any thoughts on this..? >>>>>> >>>>>> >>>>>> On 18/05/22, 6:28 PM, "李帅" <[email protected]> wrote: >>>>>> >>>>>> Maintaining Ambari is not easy for its complex architecture. >>> There >>>>> are >>>>>> many >>>>>> Configuration Management Tools such as Puppet, Ansible for >>>>>> alternatives. So >>>>>> for me, I will try to use Puppet or Ansible to deploy and >> monitor >>>>>> cluster. >>>>>> Using Puppet and Ansible without Ambari-like web ui will be a >>> gap for >>>>>> common users. >>>>>> >>>>>> >>>>>> >>>>>> Martin Blom <[email protected]> 于 2022年5月18日周三 17:04写道： >>>>>> >>>>>>> >>>>>>> Hi all. I'm new here. >>>>>>> >>>>>>> So at work we provide a service that's been running >> flawlessly >>> on >>>>>> top of >>>>>>> HDP since at least 2014. The recent "events" (which we became >>> aware >>>>>> of only >>>>>>> late last year, when it was already too late) had us >> panicking >>> a >>>>> bit >>>>>> at >>>>>>> first, since we realised we could no longer manage our >>> cluster, but >>>>>> we've >>>>>>> since then been able to track down repo mirrors so the >>> immediate >>>>>> crisis is >>>>>>> over (no thanks to Cloudera). >>>>>>> >>>>>>> However, with HDP dead and CentOS 7 nearing EOL, it's clear >>> that we >>>>>> need >>>>>>> to move on. While we have evaluated both CDP, GCP Dataproc >> and >>> even >>>>>>> considered migrating from HBase to Bigtable, Bigtop seems >> like >>> the >>>>>> only >>>>>>> sensible way forward. We just want a small database/MQ >> backend >>>>>> cluster that >>>>>>> keeps running forever to power our service. >>>>>>> >>>>>>> Which brings us to Ambari. I really liked Ambari, for cluster >>>>>> management >>>>>>> obviously but also so for monitoring, and it has worked great >>> for >>>>> us >>>>>> all >>>>>>> those years. A lot of work has obviously been put into Ambari >>> and >>>>> it >>>>>> seems >>>>>>> like such a waste to throw it all away. >>>>>>> >>>>>>> What are this Bigtop's plans for Ambari, the upstream project >>> being >>>>>>> retired and all? >>>>>>> >>>>>>> For us, we would like to bring us to the point were, in 2024 >>> when >>>>>> CentOS 7 >>>>>>> goes EOL, we can bring up a new cluster on Rocky 8 with HDFS, >>> Yarn, >>>>>> HBase, >>>>>>> Kafka and Zookeeper using Ambari to manage, monitor and keep >>> it up >>>>>> and >>>>>>> running like that until at least 2029 when RL8 retires. It >>> doesn't >>>>>> seem >>>>>>> *that* difficult given the HDP 3.1 vs Bigtop 3.0.1 BOMs for >> the >>>>>> components >>>>>>> we need. We would also be willing to put some time into >> making >>> that >>>>>>> happening. >>>>>>> >>>>>>> What are your thoughts on that? Is anybody here still >>> interested in >>>>>>> Ambari? Has anybody actually been using it to manage Bigtop >>>>>> components? >>>>>>> >>>>>>> PS. Also cross-posting to user. Anybody else in my situation? >>> What >>>>>> are you >>>>>>> all using to monitor your clusters once deployed? >>>>>>> >>>>>>> -- >>>>>>> Martin Blom >>>>>>> [email protected] >>>>>>> >>>>>>> >>>>>> >>>>>> >>>>> >>>> >>> >>
