Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a problem:
https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS=fedora-25-ppc64le/lastFailedBuild/console I *think* I've tracked this down to the location of protobuf. Note the URL for rpm-based ppc64le distros: https://github.com/apache/bigtop/blob/master/bigtop_toolchain/manifests/protobuf.pp#L54 Those fedora-22 URLs are no longer valid: https://dl.fedoraproject.org/pub/fedora-secondary/releases/22/Everything/ppc64le/ It seems in late September, fedora 22 moved to fedora archives, so I think we just need those URLs changed to: http://archives.fedoraproject.org/pub/archive/fedora-secondary/releases/22/Everything/ppc64le/ I don't have the capacity to test fedora on a ppc64le machine, but it seems like simple fix on paper ;) -Kevin On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <[email protected]> wrote: > Okay, heading down the path to 1.2.1 release. > I'm on the journey to prepare the repos on S3... > > PROGRESS > [V] Build 1.2.1 Docker slave images > [V] Build 1.2.1 RPM/DEB packages > [V] Sign packages > [X] Upload artifacts to S3 > [X] Run through deployment test > [X] Vote for RC -> release > > Finally I'm able to produce all x86_64 artifacts: > https://ci.bigtop.apache.org/job/Bigtop-1.2.1 > (Actually I've to keep retrying to get these builds done. Don't know why > sometimes entering infinite loop though...) > and their corresponding signed repos for S3 uploading. > > However, I got some problems with PPC64LE. > We can build arch independent artifacts on other machines for sure, but > hadoop, > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And that > is currently failing on ubuntu 16.04: > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/ > > At a glance I guess something need to be fixed for PPC docker slaves image. > I can give it a look, but if some one can help it would be appreciated. > It is indeed tons of work for getting a release out ;) > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <[email protected]>: > > > Hi, > > > > The failure of gpdb looks like a serious problem to me, see BIGTOP-2901 > > I am too for an +1 to disable this for 1.2.1 > > > > Thank you Evans for being still on track to release. > > > > Olaf > > > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <[email protected]>: > > > > > > Well, if we can't fix it - let's nuke it. +1 > > > -- > > > With regards, > > > Konstantin (Cos) Boudnik > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > > > > > Disclaimer: Opinions expressed in this email are those of the author, > > > and do not necessarily represent the views of any company the author > > > might be affiliated with at the moment of writing. > > > > > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <[email protected]> wrote: > > >> Thanks Olaf! > > >> I see all the slaves images are now back to normal. > > >> > > >> I'll have a national holiday tomorrow and I'd like to spend it on > Bigtop > > >> 1.2.1 release. > > >> Right now, we're blocked by two issues: > > >> > > >> Crunch build failed: https://issues.apache.org/ > jira/browse/BIGTOP-2900 > > >> GPDB build failed: https://issues.apache.org/jira/browse/BIGTOP-2901 > > >> > > >> I've provided a workaround patch in BIGTOP-2900, however I have > > completely > > >> no idea for BIGTOP-2901. > > >> Since I've raised the problem few days ago, if no one has time to fix > > it, > > >> I'd like to propose to disable GPDB in 1.2.1 release. > > >> That means in 1.2.1 release there is no GPDB binary artifact > available, > > but > > >> we can still refine GPDB's quality in the master branch. > > >> > > >> How do you think? > > >> > > >> > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <[email protected]>: > > >> > > >>> Let me take a look today > > >>> > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik <[email protected]> > > >>> wrote: > > >>>> Explicitly adding Rvs in the loop > > >>>> -- > > >>>> With regards, > > >>>> Konstantin (Cos) Boudnik > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > >>>> > > >>>> Disclaimer: Opinions expressed in this email are those of the > author, > > >>>> and do not necessarily represent the views of any company the author > > >>>> might be affiliated with at the moment of writing. > > >>>> > > >>>> > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <[email protected]> > > wrote: > > >>>>> Hi Bigtoper, > > >>>>> > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to the > > finish > > >>>>> line by the end on Sept. > > >>>>> > > >>>>> Right now we still have a few issues blocking: > > >>>>> > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1] > > >>>>> 2. Toolchain build failed on PPC64LE platform[2] > > >>>>> > > >>>>> I'll update more down the path. But right now I'd like to seek for > > some > > >>>>> helps on GPDB and PPC64LE side ;) > > >>>>> > > >>>>> > > >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1/ > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker- > > >>> Toolchain-1.2.1/ > > >>>>> > > >>>>> > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <[email protected]>: > > >>>>> > > >>>>>> Thanks, Arnaud > > >>>>>> > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l > > >>>>>> root@596ef2c638de:/# java -version > > >>>>>> openjdk version "1.8.0_131" > > >>>>>> OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1. > > >>>>>> 16.04.2-b11) > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode) > > >>>>>> > > >>>>>> Looks linked! > > >>>>>> > > >>>>>> > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <[email protected]>: > > >>>>>> > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit: > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we rebuild > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as what we > > >>> faced > > >>>>>>>> building with 1.2.1 images. > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images. > > >>>>>>>> Any thoughts? > > >>>>>>> > > >>>>>>> Check the java version, somehow the java docs whatever stuff > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8 > > >=131 . > > >>>>>>> Might be linked. > > >>>>>>> > > >>>>>>> Arnaud. > > >>>>>>> > > >>>>>> > > >>>>>> > > >>> > > > > >
