Hi Cos, I think it would be better to go for Docker native solution by running as specific user.
Hi all, I've tested the docker --user jenkins option: https://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages-zeppelin/ It seems working well building zeppelin. The ONLY change for our build script in Jenkins is -u jenkins: [BEFORE] docker run --rm -v `pwd`:/ws$DOCKER_SELINUX --workdir /ws -e COMPONENTS=$COMPONENTS -e CONFIGURE_NEXUS=$CONFIGURE_NEXUS $NEXUS bigtop/slaves:trunk-$OS \ bash -c '. /etc/profile.d/bigtop.sh; ./gradlew allclean $CONFIGURE_NEXUS $COMPONENTS-pkg' [AFTER] docker run -u jenkins --rm -v `pwd`:/ws$DOCKER_SELINUX --workdir /ws -e COMPONENTS=$COMPONENTS -e CONFIGURE_NEXUS=$CONFIGURE_NEXUS $NEXUS bigtop/slaves:trunk-$OS \ bash -c '. /etc/profile.d/bigtop.sh; ./gradlew allclean $CONFIGURE_NEXUS $COMPONENTS-pkg' Let me try to adopt this in trunk-packages. 2017-03-20 3:42 GMT+08:00 Konstantin Boudnik <[email protected]>: > Here's a tiny script I put together a while back to do just that > (running builds under a non-privileged account). Feel free to use it > https://is.gd/eMBIcG > > Cos > > > -- > Take care, > Konstantin (Cos) Boudnik > > > On Sat, Mar 18, 2017 at 10:34 PM, 김영우 (YoungWoo Kim) <[email protected]> > wrote: > > Thanks Cos! > > > > Building Zeppelin 0.7.0 is failing because ci job is building Z as root > > user on docker. (We have a hack in Tez build to prevent this but the hack > > does not work for Z) > > > > Evans, Is it possible to start the job on containers as jenkins user or > > other appropriate user? > > > > Youngwoo > > > > > > 2017. 3. 19. 오전 9:50에 "Konstantin Boudnik" <[email protected]>님이 작성: > > > >> I have combed through the tickets marked against 1.2 and reduced the > >> list to just 40. Here's the link to the query > >> https://is.gd/lij6iI > >> > >> I've commented on most of the tickets that look to be almost ready or > >> require attention and pinged people involved. Please take a look into > >> the tickets assigned to you and either make an effort to finish them > >> or move them to backlog or to the next release if you plan to work on > >> it later. > >> > >> There are still a few blocker, Zep 0.7 is one them - it is broken on > >> every single platform (BIGTOP-2699) and JDK8 Hadoop related issue > >> (BIGTOP-2673). > >> > >> Thanks for your help! > >> Cos > >> -- > >> Take care, > >> Konstantin (Cos) Boudnik > >> > >> > >> On Fri, Mar 17, 2017 at 7:31 PM, Evans Ye <[email protected]> wrote: > >> > Huge +1 here. > >> > Please ping me either for review or for release related tasks. For > 1.2 to > >> > release I personally would like work on some task to make provisioner > and > >> > sandbox more mature. > >> > > >> > Amir do you have any input from ppc64le side? > >> > Everything is good for release? > >> > > >> > Konstantin Boudnik <[email protected]>於 2017年3月18日 週六,上午2:29寫道: > >> > > >> >> I would think so, yes > >> >> > >> >> -- > >> >> > >> >> Take care, > >> >> > >> >> Konstantin (Cos) Boudnik > >> >> > >> >> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > >> >> > >> >> > >> >> > >> >> Disclaimer: Opinions expressed in this email are those of the author, > >> >> > >> >> and do not necessarily represent the views of any company the author > >> >> > >> >> might be affiliated with at the moment of writing. > >> >> > >> >> > >> >> > >> >> > >> >> > >> >> On Fri, Mar 17, 2017 at 11:27 AM, Andrew Musselman > >> >> > >> >> <[email protected]> wrote: > >> >> > >> >> > We have a new Mahout release coming out hopefully in the next few > >> days; > >> >> is > >> >> > >> >> > there time to get a new rev into Bigtop? > >> >> > >> >> > > >> >> > >> >> > On Fri, Mar 17, 2017 at 11:18 AM, Konstantin Boudnik < > [email protected]> > >> >> wrote: > >> >> > >> >> > > >> >> > >> >> >> Thanks for the push, dude - we really need to release it. It > doesn't > >> >> > >> >> >> even matter what board says on the topic - it is just a common > sense > >> >> > >> >> >> for a viable project like Bigtop. > >> >> > >> >> >> > >> >> > >> >> >> Considering how fast Groovy is moving forward we need to be > upgrading > >> >> > >> >> >> to 2.4.10 at least ;) > >> >> > >> >> >> Same with Ignite - 1.9 is out now, I will update the ticket and > will > >> >> > >> >> >> try to work on it over the weekend. > >> >> > >> >> >> > >> >> > >> >> >> -- > >> >> > >> >> >> Take care, > >> >> > >> >> >> Konstantin (Cos) Boudnik > >> >> > >> >> >> 2CAC 8312 4870 D885 8616 6115 220F 6980 1F27 E622 > >> >> > >> >> >> > >> >> > >> >> >> Disclaimer: Opinions expressed in this email are those of the > author, > >> >> > >> >> >> and do not necessarily represent the views of any company the > author > >> >> > >> >> >> might be affiliated with at the moment of writing. > >> >> > >> >> >> > >> >> > >> >> >> > >> >> > >> >> >> On Fri, Mar 17, 2017 at 8:22 AM, Roman Shaposhnik < > >> [email protected] > >> >> > > >> >> > >> >> >> wrote: > >> >> > >> >> >> > Hi! > >> >> > >> >> >> > > >> >> > >> >> >> > as was pointed out by the ASF board lately we haven't > >> >> > >> >> >> > had a release in quite some time. They are right -- release > >> >> > >> >> >> > early and release often is the only way to go. So, I'd like > >> >> > >> >> >> > to volunteer to be a co-{release manager} with Cos and > >> >> > >> >> >> > push 1.2 out ASAP. > >> >> > >> >> >> > > >> >> > >> >> >> > Looking at > >> >> > >> >> >> > https://issues.apache.org/jira/browse/BIGTOP-2282 > >> >> > >> >> >> > makes me think that we're 90% done with formalizing > >> >> > >> >> >> > the BOM. The only two things outstanding are: > >> >> > >> >> >> > Bump Ignite to 1.8 > >> >> > >> >> >> > Bump Groovy version to 2.4.7 > >> >> > >> >> >> > > >> >> > >> >> >> > With Groovy I can take care of it myself. But with Ignite > >> >> > >> >> >> > I either need somebody to help, or given how long it is > >> >> > >> >> >> > outstanding, may be we can just leave it be. Please chime > >> >> > >> >> >> > in if you'd like to volunteer. > >> >> > >> >> >> > > >> >> > >> >> >> > Looking at: > >> >> > >> >> >> > > >> >> https://ci.bigtop.apache.org/view/Packages/job/Bigtop- > trunk-packages/ > >> >> > >> >> >> > makes me think that the biggest obstacle there is ARM64 > >> >> > >> >> >> > which we should fix pretty soon. The rest looks reasonable. > >> >> > >> >> >> > > >> >> > >> >> >> > With all of that in mind, I'd like to shoot for the first RC > made > >> >> > >> >> >> > available over the next weekend. > >> >> > >> >> >> > > >> >> > >> >> >> > Thoughts? > >> >> > >> >> >> > > >> >> > >> >> >> > Thanks, > >> >> > >> >> >> > Roman. > >> >> > >> >> >> > >> >> > >> >> > >> >
