Il giorno mer 15 gen 2020 alle ore 20:26 Olaf Flebbe <o...@oflebbe.de> ha scritto: > > hi, > > Thanks for your request, I was anticipating requests from wikimedia for years! > > let me add some bits since I did the initial Debian port, hue maintenance, > and hadoop 3 poc... my answer might be too pessimistic, but there is a whole > lot of things to be done in order to get it in alignment with upstream > packages again.
Pessimistic views are always good in my opinion, usually close to the truth :) >> - Upgrade the OS to Debian 10 Buster > > > debian 10 may not be supported by bigtop. problematic are upstream packages > colliding with bigtop like (IIRC) zookeeper. I am not sure if patches for > these topics made it upstream. I'd be interested to know what are the blockers/problems/etc.., we have a lot of Debian Developers that might be able to help. I'd be also interested to help out in testing for Debian 10 if needed. We currently use Zookeeper from Debian Buster, running on Java 11, meanwhile Hadoop runs Java 8 and CDH. Nothing weird to report. >> >> All the BigTop packages seem to be enough for our use cases (we >> already have our own puppet automation), the only thing left would be >> Hue but it is easy to package it (or re-use the CDH version as interim >> solution). I have a couple of questions for you: > > > Hue was included before 1.2.1 (inclusive), however dropped since 1.3 release. > It was done in [3]. > I can't recall the reason of dropping hue though... > > > hue was dropped, because dependency management was a nightmare. hue decided > to fork several packages and had no clean diffs, so aligning and updating > with distro packages was not possible any more (for me). iirc it was > dependent on oozie, where upstream support was stalled at that time and > didn't worked with kerberos (at least not for me). Hue is also only now moving to Python 3, and it will only be shipped with CDH 6. If needed we'll package it for our own use case, I completely get why it was dropped. > ah it changes made it upstream, good. but bigtop has no regular ci for debian > 10 running, there will be other problems around. It would be great to see if 1.4 builds on Debian 10, if possible it would be a nice thing to add to CI, but I agree that it will put more burden on the dev community :( Thanks a lot for the info! Luca
