Hi all, I'm slowly finalizing 1.2.1 release. Please hang on. Will do an announcement when everything is ready.
Best, Evans 2017-10-14 17:23 GMT+08:00 Evans Ye <[email protected]>: > More test have been done for 1.2.1 release. > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-installation > > This job tests whether packages can be installed cleanly with pgp > verification > > Though not all the packages can be successfully installed due to > conflicts, most of them are good. > > Following are packages failed to install: > > CentOS, Fedora: > qfs-python.x86_64 > > OpenSuSE: > Hue, Oozie > > Debian, Ubuntu: > Hue, Oozie, Phoenix, QFS > > > > > 2017-10-13 3:39 GMT+08:00 Evans Ye <[email protected]>: > >> AFAIK, the build slave for arm is offline in our CI: >> >> docker-slave-arm-1 >> <https://ci.bigtop.apache.org/computer/docker-slave-arm-1/> (offline) >> >> If you can get it back into business, then there's no reason not to >> include it as long as it's in good shape. >> >> 2017-10-13 3:31 GMT+08:00 Ganesh Raju <[email protected]>: >> >>> Evans >>> >>> What is needed to reestablish the CI builds for Aarch? We are ready to >>> help >>> that getting setup as well >>> We have setup CI builds internally in Linaro which has been working fine. >>> >>> Do you need access to the two arm systems for builds? >>> >>> >>> Thanks, >>> Ganesh >>> >>> On Thu, Oct 12, 2017 at 1:56 PM, Evans Ye <[email protected]> wrote: >>> >>> > Thanks Kevin for doing the investigation. That is addressed in >>> BIGTOP-2904. >>> > >>> > Regarding to 1.2.1 release. I've finally crossed the finish line and >>> have >>> > put it up for a vote. >>> > Let me share some of the details here: >>> > >>> > * All the signed repos are on repos.bigtop.apache.org, which is >>> backed by >>> > our new S3 directory >>> > * Deployment evaluated by >>> > https://ci.bigtop.apache.org/view/Provisioner/job/Bigtop-1. >>> > 2.1-deployments/, >>> > which installs packages from repos.bigtop.apache.org. Surely we've >>> some >>> > red >>> > dots, but those problems are also in 1.2.0 as well. 1.2.1 actually >>> > improves/fixes things that was broken in 1.2.0. >>> > * Binary convenient artifacts are not available for PPC64LE, but we can >>> > still put them up afterwards. >>> > >>> > Thanks for everyone who helped making this release happening. >>> > The release stuffs are in the [VOTE] mailing thread. If you've time. >>> Please >>> > give it try and provide your feedback. >>> > >>> > >>> > Evans >>> > >>> > >>> > >>> > 2017-10-10 2:02 GMT+08:00 Kevin Monroe <[email protected]>: >>> > >>> > > Hey Evans, ubuntu 16.04 seems ok from your CI link, but fedora 25 >>> has a >>> > > problem: >>> > > >>> > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1-ppc64le/OS= >>> > > fedora-25-ppc64le/lastFailedBuild/console >>> > > >>> > > I *think* I've tracked this down to the location of protobuf. Note >>> the >>> > URL >>> > > for rpm-based ppc64le distros: >>> > > >>> > > https://github.com/apache/bigtop/blob/master/bigtop_ >>> > > toolchain/manifests/protobuf.pp#L54 >>> > > >>> > > Those fedora-22 URLs are no longer valid: >>> > > >>> > > https://dl.fedoraproject.org/pub/fedora-secondary/releases/ >>> > > 22/Everything/ppc64le/ >>> > > >>> > > It seems in late September, fedora 22 moved to fedora archives, so I >>> > think >>> > > we just need those URLs changed to: >>> > > >>> > > http://archives.fedoraproject.org/pub/archive/fedora- >>> > > secondary/releases/22/Everything/ppc64le/ >>> > > >>> > > I don't have the capacity to test fedora on a ppc64le machine, but it >>> > seems >>> > > like simple fix on paper ;) >>> > > >>> > > -Kevin >>> > > >>> > > On Sun, Oct 8, 2017 at 3:29 PM, Evans Ye <[email protected]> wrote: >>> > > >>> > > > Okay, heading down the path to 1.2.1 release. >>> > > > I'm on the journey to prepare the repos on S3... >>> > > > >>> > > > PROGRESS >>> > > > [V] Build 1.2.1 Docker slave images >>> > > > [V] Build 1.2.1 RPM/DEB packages >>> > > > [V] Sign packages >>> > > > [X] Upload artifacts to S3 >>> > > > [X] Run through deployment test >>> > > > [X] Vote for RC -> release >>> > > > >>> > > > Finally I'm able to produce all x86_64 artifacts: >>> > > > https://ci.bigtop.apache.org/job/Bigtop-1.2.1 >>> > > > (Actually I've to keep retrying to get these builds done. Don't >>> know >>> > why >>> > > > sometimes entering infinite loop though...) >>> > > > and their corresponding signed repos for S3 uploading. >>> > > > >>> > > > However, I got some problems with PPC64LE. >>> > > > We can build arch independent artifacts on other machines for >>> sure, but >>> > > > hadoop, >>> > > > qfs, bigtop-jsvc, zookeeper, hue need to be built on PPC machines. >>> And >>> > > that >>> > > > is currently failing on ubuntu 16.04: >>> > > > https://ci.bigtop.apache.org/view/Releases/job/Bigtop-1.2.1- >>> ppc64le/ >>> > > > >>> > > > At a glance I guess something need to be fixed for PPC docker >>> slaves >>> > > image. >>> > > > I can give it a look, but if some one can help it would be >>> appreciated. >>> > > > It is indeed tons of work for getting a release out ;) >>> > > > >>> > > > >>> > > > 2017-10-03 23:22 GMT+08:00 Olaf Flebbe <[email protected]>: >>> > > > >>> > > > > Hi, >>> > > > > >>> > > > > The failure of gpdb looks like a serious problem to me, see >>> > BIGTOP-2901 >>> > > > > I am too for an +1 to disable this for 1.2.1 >>> > > > > >>> > > > > Thank you Evans for being still on track to release. >>> > > > > >>> > > > > Olaf >>> > > > > >>> > > > > >>> > > > > > Am 03.10.2017 um 16:20 schrieb Konstantin Boudnik < >>> [email protected] >>> > >: >>> > > > > > >>> > > > > > Well, if we can't fix it - let's nuke it. +1 >>> > > > > > -- >>> > > > > > With regards, >>> > > > > > Konstantin (Cos) Boudnik >>> > > > > > 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 >>> > > > > > >>> > > > > > Disclaimer: Opinions expressed in this email are those of the >>> > author, >>> > > > > > and do not necessarily represent the views of any company the >>> > author >>> > > > > > might be affiliated with at the moment of writing. >>> > > > > > >>> > > > > > >>> > > > > > On Tue, Oct 3, 2017 at 10:11 AM, Evans Ye <[email protected]> >>> > > wrote: >>> > > > > >> Thanks Olaf! >>> > > > > >> I see all the slaves images are now back to normal. >>> > > > > >> >>> > > > > >> I'll have a national holiday tomorrow and I'd like to spend >>> it on >>> > > > Bigtop >>> > > > > >> 1.2.1 release. >>> > > > > >> Right now, we're blocked by two issues: >>> > > > > >> >>> > > > > >> Crunch build failed: https://issues.apache.org/ >>> > > > jira/browse/BIGTOP-2900 >>> > > > > >> GPDB build failed: https://issues.apache.org/ >>> > > jira/browse/BIGTOP-2901 >>> > > > > >> >>> > > > > >> I've provided a workaround patch in BIGTOP-2900, however I >>> have >>> > > > > completely >>> > > > > >> no idea for BIGTOP-2901. >>> > > > > >> Since I've raised the problem few days ago, if no one has >>> time to >>> > > fix >>> > > > > it, >>> > > > > >> I'd like to propose to disable GPDB in 1.2.1 release. >>> > > > > >> That means in 1.2.1 release there is no GPDB binary artifact >>> > > > available, >>> > > > > but >>> > > > > >> we can still refine GPDB's quality in the master branch. >>> > > > > >> >>> > > > > >> How do you think? >>> > > > > >> >>> > > > > >> >>> > > > > >> 2017-09-26 5:16 GMT+08:00 Roman Shaposhnik <[email protected]>: >>> > > > > >> >>> > > > > >>> Let me take a look today >>> > > > > >>> >>> > > > > >>> On Sat, Sep 23, 2017 at 9:34 AM, Konstantin Boudnik < >>> > > [email protected]> >>> > > > > >>> wrote: >>> > > > > >>>> Explicitly adding Rvs in the loop >>> > > > > >>>> -- >>> > > > > >>>> With regards, >>> > > > > >>>> Konstantin (Cos) Boudnik >>> > > > > >>>> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 >>> > > > > >>>> >>> > > > > >>>> Disclaimer: Opinions expressed in this email are those of >>> the >>> > > > author, >>> > > > > >>>> and do not necessarily represent the views of any company >>> the >>> > > author >>> > > > > >>>> might be affiliated with at the moment of writing. >>> > > > > >>>> >>> > > > > >>>> >>> > > > > >>>> On Sat, Sep 23, 2017 at 12:24 PM, Evans Ye < >>> [email protected]> >>> > > > > wrote: >>> > > > > >>>>> Hi Bigtoper, >>> > > > > >>>>> >>> > > > > >>>>> I'm working on the 1.2.1 release. Hopefully we can get it >>> to >>> > the >>> > > > > finish >>> > > > > >>>>> line by the end on Sept. >>> > > > > >>>>> >>> > > > > >>>>> Right now we still have a few issues blocking: >>> > > > > >>>>> >>> > > > > >>>>> 1. GPDB build failed on OpenSuSE 42.1[1] >>> > > > > >>>>> 2. Toolchain build failed on PPC64LE platform[2] >>> > > > > >>>>> >>> > > > > >>>>> I'll update more down the path. But right now I'd like to >>> seek >>> > > for >>> > > > > some >>> > > > > >>>>> helps on GPDB and PPC64LE side ;) >>> > > > > >>>>> >>> > > > > >>>>> >>> > > > > >>>>> [1]. https://ci.bigtop.apache.org/v >>> iew/Releases/job/Bigtop-1.2 >>> > . >>> > > 1/ >>> > > > > >>>>> [2]. https://ci.bigtop.apache.org/view/Docker/job/Docker- >>> > > > > >>> Toolchain-1.2.1/ >>> > > > > >>>>> >>> > > > > >>>>> >>> > > > > >>>>> 2017-07-26 11:24 GMT+08:00 Evans Ye <[email protected]>: >>> > > > > >>>>> >>> > > > > >>>>>> Thanks, Arnaud >>> > > > > >>>>>> >>> > > > > >>>>>> [jenkins@ip bigtop-ubuntu-16.04]$ docker run -ti --rm >>> > > > > >>>>>> bigtop/slaves:1.2.1-$OS bash -l >>> > > > > >>>>>> root@596ef2c638de:/# java -version >>> > > > > >>>>>> openjdk version "1.8.0_131" >>> > > > > >>>>>> OpenJDK Runtime Environment (build >>> > 1.8.0_131-8u131-b11-0ubuntu1. >>> > > > > >>>>>> 16.04.2-b11) >>> > > > > >>>>>> OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode) >>> > > > > >>>>>> >>> > > > > >>>>>> Looks linked! >>> > > > > >>>>>> >>> > > > > >>>>>> >>> > > > > >>>>>> 2017-07-26 3:02 GMT+08:00 Arnaud Launay <[email protected]>: >>> > > > > >>>>>> >>> > > > > >>>>>>> Le Wed, Jul 26, 2017 at 12:45:50AM +0800, Evans Ye a >>> écrit: >>> > > > > >>>>>>>> 1. Somehow packages on centos and debian changed. If we >>> > > rebuild >>> > > > > >>>>>>>> bigtop/slaves for trunk, then Solr will fail the same as >>> > what >>> > > we >>> > > > > >>> faced >>> > > > > >>>>>>>> building with 1.2.1 images. >>> > > > > >>>>>>>> 2. We've special tweaks for bigtop/slaves trunk images. >>> > > > > >>>>>>>> Any thoughts? >>> > > > > >>>>>>> >>> > > > > >>>>>>> Check the java version, somehow the java docs whatever >>> stuff >>> > > > > >>>>>>> changed in 8.131, and solr doesn't compile anymore with >>> java8 >>> > > > > >=131 . >>> > > > > >>>>>>> Might be linked. >>> > > > > >>>>>>> >>> > > > > >>>>>>> Arnaud. >>> > > > > >>>>>>> >>> > > > > >>>>>> >>> > > > > >>>>>> >>> > > > > >>> >>> > > > > >>> > > > > >>> > > > >>> > > >>> > >>> >>> >>> >>> -- >>> IRC: ganeshraju@#linaro on irc.freenode.ne <http://irc.freenode.net/>t >>> >> >> >
