thanks. This is "unfortunate". I know nobody wanted this to happen, but it is still pretty serious.
For the specific HADOOP-15407 branch I'd just rebase onto trunk and force-push it out, but apache git seems to be blocking me from doing that... I will keep an eye on YARN-8387; unrepeatable builds are the enemy of us all. -steve On 5 Jul 2018, at 19:11, Sunil G <sun...@apache.org<mailto:sun...@apache.org>> wrote: Hi Steve I was recently looking into this failure and this is due to a repo hosting problem. It seems Bower team has deprecated old registry url https://bower.herokuapp.com<https://bower.herokuapp.com/> and need to change registry url to https://registry.bower.io<https://registry.bower.io/>. YARN-8457 addressed this problem is backported till branch-2.9. I think the branch also needs a rebase to run away from this problem. 1. What is Bower? YARN ui2 is a single page web application and using ember js framework. ember-2 is using bower as package manager. Bibin is doing some work in YARN-8387 to move away from bower to resolve such issue in future. 2. Why is it breaking Jenkins builds Bower team has deprecated old registry url https://bower.herokuapp.com<https://bower.herokuapp.com/> and need to change registry url to https://registry.bower.io<https://registry.bower.io/>. 3. Can you nominate someone to provide the patch to fix this? YARN-8457 addressed this problem. Cud u pls backport this patch alone to the branch and help to verify. 4. Will every active branch need a similar patch? Yes. This is a bit unfortunate. If these branches can be rebased to top of respective main branches or backport this patch alone, we could avoid this build error. 5. Have any releases stopped building (3.1.0?) Since this patch is already in 3.1.0, this is unblocked. 6. Do we have any stability guarantees about Bower's build process in future? YARN-8387 will be helping on this. Bibin Chundatt has some offline patches which he still working on with the help of other communities to resolve bower dependencies and upgrade to ember 3 which will help in offline compilation. - Sunil On Thu, Jul 5, 2018 at 4:45 AM Steve Loughran <ste...@hortonworks.com<mailto:ste...@hortonworks.com>> wrote: Hi The HADOOP-15407 "abfs" branch has started failing https://builds.apache.org/job/PreCommit-HADOOP-Build/14861/artifact/out/patch-compile-root.txt [INFO] --- frontend-maven-plugin:1.5:bower (bower install) @ hadoop-yarn-ui --- [INFO] Running 'bower install' in /testptch/hadoop/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/target/webapp [ERROR] bower ember-cli-test-loader#0.2.1 EINVRES Request to https://bower.herokuapp.com/packages/ember-cli-test-loader failed with 502 [INFO] ------------------------------------------------------------------------ [INFO] Reactor Summary: And the namedc web page returns : This Bower version is deprecated. Please update it: npm install -g bower. The new registry address is https://registry.bower.io We haven't gone near the YARN code, and yet a branch which is only a few weeks old is now failing to build on Jenkins systems I have a few questions for the Yarn team 1. What is Bower? 2. Why is it breaking Jenkins builds 3. Can you nominate someone to provide the patch to fix this? 4. Will every active branch need a similar patch? 5. Have any releases stopped building (3.1.0?) 6. Do we have any stability guarantees about Bower's build process in future? Given a fork I'm worried about the long-term reproducibility of builds. Is this just a one off move of some build artifact repository, or is this a moving target which will stop source code releases from working. I can deal with cherry picking patches to WiP branches, tuning Jenkins, etc, but if we lose the ability to rebuild releases, the whole notion of "stable release" is dead. I know Maven exposes us to similar risks, but the maven central repo is stabile and available, so hasn't forced us into building an SCM-msnaged artifact tree the way I've done elsewhere (Ivy makes that straightforward; maven less so as you need to be online to boot). And we are now relying on docker for release builds. So we are already vulnerable...I'm just worried that Bower is making things worse. -Steve (ps: Sides from Olaf Febbe on the bigtop team on attacking builds through mavan https://oflebbe.de/presentations/2018/attackingiotdev.pdf)