Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Jonathan, Thank you for your input. There are 15,300 matches for querying Google: dockerfile-maven-plugin site:github.com and 377 matches for query apache hosted projects. I see that many projects opt in to use profile to work around building docker images all the time while others stay

Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Arpit, On Docker Hub, Hadoop tagged with version number that looks like: docker-hadoop-runner-latest, or jdk11. It is hard to tell if jdk11 image is Hadoop 3 or Hadoop 2 because there is no consistency in tag format usage. This is my reasoning against tag as your heart desired because

Re: [DISCUSS] Docker build process

2019-03-19 Thread Arpit Agarwal
Hi Eric, > Dockerfile is most likely to change to apply the security fix. I am not sure this is always. Marton’s point about revising docker images independent of Hadoop versions is valid. > When maven release is automated through Jenkins, this is a breeze > of clicking a button. Jenkins

Re: [DISCUSS] Docker build process

2019-03-19 Thread Jonathan Eagles
This email discussion thread is the result of failing to reach consensus in the JIRA. If you participate in this discussion thread, please recognize that a considerable effort has been made by contributors on this JIRA. On the other hand, contributors to this JIRA need to listen carefully to the

Re: [DISCUSS] Docker build process

2019-03-19 Thread Jim Brennan
I agree with Steve and Marton. I am ok with having the docker build as an option, but I don't want it to be the default. Jim On Tue, Mar 19, 2019 at 12:19 PM Eric Yang wrote: > Hi Marton, > > Thank you for your input. I agree with most of what you said with a few > exceptions. Security fix

Re: [DISCUSS] Docker build process

2019-03-19 Thread Eric Yang
Hi Marton, Thank you for your input. I agree with most of what you said with a few exceptions. Security fix should result in a different version of the image instead of replace of a certain version. Dockerfile is most likely to change to apply the security fix. If it did not change, the

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2019-03-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/1080/ [Mar 17, 2019 9:08:29 AM] (sammichen) HDDS-699. Detect Ozone Network topology. Contributed by Sammi Chen. [Mar 18, 2019 11:45:01 AM] (templedf) MAPREDUCE-7188. [Clean-up] Remove NULL check before

Apache Hadoop qbt Report: branch2+JDK7 on Linux/x86

2019-03-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-branch2-java7-linux-x86/265/ [Mar 18, 2019 4:00:40 PM] (xkrogen) HADOOP-16192. Fix CallQueue backoff bugs: perform backoff when add() is -1 overall The following subsystems voted -1: asflicense findbugs hadolint pathlen

Re: [DISCUSS] Kerberos credential cache location in UGI

2019-03-19 Thread Steve Loughran
I'f you haven't guessed, Kerberos is an eternal support of pain and suffering Any change must be matched with clarifications the hadoop security docs, and KDiag extended to provide extra information about the source of the cache. One big risk here is over regressions across versions of clients

Re: [DISCUSS] Docker build process

2019-03-19 Thread Elek, Marton
Thank you Eric to describe the problem. I have multiple small comments, trying to separate them. I. separated vs in-build container image creation > The disadvantages are: > > 1. Require developer to have access to docker. > 2. Default build takes longer. These are not the only