Evans What is needed to reestablish the CI builds for Aarch? We are ready to help that getting setup as well We have setup CI builds internally in Linaro which has been working fine.
Do you need access to the two arm systems for builds? Thanks, Ganesh On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <[email protected]> wrote: > Thanks Kevin for doing the investigation. That is addressed in BIGTOP-2904. > > Regarding to 1.2.1 release. I've finally crossed the finish line and have > put it up for a vote. > Let me share some of the details here: > > * All the signed repos are on repos.bigtop.apache.org, which is backed by > our new S3 directory > * Deployment evaluated by > https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1. > 2.1-deployments/, > which installs packages from repos.bigtop.apache.org. Surely we've some > red > dots, but those problems are also in 1.2.0 as well. 1.2.1 actually > improves/fixes things that was broken in 1.2.0. > * Binary convenient artifacts are not available for PPC64LE, but we can > still put them up afterwards. > > Thanks for everyone who helped making this release happening. > The release stuffs are in the [VOTE] mailing thread. If you've time. Please > give it try and provide your feedback. > > > Evans > > > > 2017-10-10 2:02 GMT+08:00 Kevin Monroe <[email protected]>: > > > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 has a > > problem: > > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS= > > fedora-25-ppc64le/lastFailedBuild/console > > > > I *think* I've tracked this down to the location of protobuf. Note the > URL > > for rpm-based ppc64le distros: > > > > https://github.com/apache/bigtop/blob/master/bigtop_ > > toolchain/manifests/protobuf.pp#L54 > > > > Those fedora-22 URLs are no longer valid: > > > > https://dl.fedoraproject.org/pub/fedora-secondary/releases/ > > 22/Everything/ppc64le/ > > > > It seems in late September, fedora 22 moved to fedora archives, so I > think > > we just need those URLs changed to: > > > > http://archives.fedoraproject.org/pub/archive/fedora- > > secondary/releases/22/Everything/ppc64le/ > > > > I don't have the capacity to test fedora on a ppc64le machine, but it > seems > > like simple fix on paper ;) > > > > -Kevin > > > > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <[email protected]> wrote: > > > > > Okay, heading down the path to 1.2.1 release. > > > I'm on the journey to prepare the repos on S3... > > > > > > PROGRESS > > > [V] Build 1.2.1 Docker slave images > > > [V] Build 1.2.1 RPM/DEB packages > > > [V] Sign packages > > > [X] Upload artifacts to S3 > > > [X] Run through deployment test > > > [X] Vote for RC -> release > > > > > > Finally I'm able to produce all x86_64 artifacts: > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1 > > > (Actually I've to keep retrying to get these builds done. Don't know > why > > > sometimes entering infinite loop though...) > > > and their corresponding signed repos for S3 uploading. > > > > > > However, I got some problems with PPC64LE. > > > We can build arch independent artifacts on other machines for sure, but > > > hadoop, > > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. And > > that > > > is currently failing on ubuntu 16.04: > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1-ppc64le/ > > > > > > At a glance I guess something need to be fixed for PPC docker slaves > > image. > > > I can give it a look, but if some one can help it would be appreciated. > > > It is indeed tons of work for getting a release out ;) > > > > > > > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <[email protected]>: > > > > > > > Hi, > > > > > > > > The failure of gpdb looks like a serious problem to me, see > BIGTOP-2901 > > > > I am too for an +1 to disable this for 1.2.1 > > > > > > > > Thank you Evans for being still on track to release. > > > > > > > > Olaf > > > > > > > > > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik <[email protected] > >: > > > > > > > > > > Well, if we can't fix it - let's nuke it. +1 > > > > > -- > > > > > With regards, > > > > > Konstantin (Cos) Boudnik > > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > > > > > > > > > Disclaimer: Opinions expressed in this email are those of the > author, > > > > > and do not necessarily represent the views of any company the > author > > > > > might be affiliated with at the moment of writing. > > > > > > > > > > > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <[email protected]> > > wrote: > > > > >> Thanks Olaf! > > > > >> I see all the slaves images are now back to normal. > > > > >> > > > > >> I'll have a national holiday tomorrow and I'd like to spend it on > > > Bigtop > > > > >> 1.2.1 release. > > > > >> Right now, we're blocked by two issues: > > > > >> > > > > >> Crunch build failed: https://issues.apache.org/ > > > jira/browse/BIGTOP-2900 > > > > >> GPDB build failed: https://issues.apache.org/ > > jira/browse/BIGTOP-2901 > > > > >> > > > > >> I've provided a workaround patch in BIGTOP-2900, however I have > > > > completely > > > > >> no idea for BIGTOP-2901. > > > > >> Since I've raised the problem few days ago, if no one has time to > > fix > > > > it, > > > > >> I'd like to propose to disable GPDB in 1.2.1 release. > > > > >> That means in 1.2.1 release there is no GPDB binary artifact > > > available, > > > > but > > > > >> we can still refine GPDB's quality in the master branch. > > > > >> > > > > >> How do you think? > > > > >> > > > > >> > > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <[email protected]>: > > > > >> > > > > >>> Let me take a look today > > > > >>> > > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik < > > [email protected]> > > > > >>> wrote: > > > > >>>> Explicitly adding Rvs in the loop > > > > >>>> -- > > > > >>>> With regards, > > > > >>>> Konstantin (Cos) Boudnik > > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > > > > >>>> > > > > >>>> Disclaimer: Opinions expressed in this email are those of the > > > author, > > > > >>>> and do not necessarily represent the views of any company the > > author > > > > >>>> might be affiliated with at the moment of writing. > > > > >>>> > > > > >>>> > > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye <[email protected]> > > > > wrote: > > > > >>>>> Hi Bigtoper, > > > > >>>>> > > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it to > the > > > > finish > > > > >>>>> line by the end on Sept. > > > > >>>>> > > > > >>>>> Right now we still have a few issues blocking: > > > > >>>>> > > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1] > > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2] > > > > >>>>> > > > > >>>>> I'll update more down the path. But right now I'd like to seek > > for > > > > some > > > > >>>>> helps on GPDB and PPC64LE side ;) > > > > >>>>> > > > > >>>>> > > > > >>>>> [1]. https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2 > . > > 1/ > > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker- > > > > >>> Toolchain-1.2.1/ > > > > >>>>> > > > > >>>>> > > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <[email protected]>: > > > > >>>>> > > > > >>>>>> Thanks, Arnaud > > > > >>>>>> > > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm > > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l > > > > >>>>>> root@596ef2c638de:/# java -version > > > > >>>>>> openjdk version "1.8.0_131" > > > > >>>>>> OpenJDK Runtime Environment (build > 1.8.0_131-8u131-b11-0ubuntu1. > > > > >>>>>> 16.04.2-b11) > > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode) > > > > >>>>>> > > > > >>>>>> Looks linked! > > > > >>>>>> > > > > >>>>>> > > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <[email protected]>: > > > > >>>>>> > > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a écrit: > > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we > > rebuild > > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as > what > > we > > > > >>> faced > > > > >>>>>>>> building with 1.2.1 images. > > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images. > > > > >>>>>>>> Any thoughts? > > > > >>>>>>> > > > > >>>>>>> Check the java version, somehow the java docs whatever stuff > > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with java8 > > > > >=131 . > > > > >>>>>>> Might be linked. > > > > >>>>>>> > > > > >>>>>>> Arnaud. > > > > >>>>>>> > > > > >>>>>> > > > > >>>>>> > > > > >>> > > > > > > > > > > > > > > -- IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t
