[ 
https://issues.apache.org/jira/browse/HADOOP-10530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239250#comment-14239250
 ] 

Steve Loughran commented on HADOOP-10530:
-----------------------------------------

colin, sorry must have missed this. 


bq. In the future, we should make sure that all the precommit jobs work before 
committing stuff like this, not just the hadoop-common one. 



I actually spent the whole weekend spinning up jenkins builds and seeing the 
results, which included the precommit builds. Somehow that bit escaped me.  

I do note that if I browse to 
[[https://builds.apache.org/view/H-L/view/Hadoop/job/PreCommit-HDFS-Build/]] I 
can see a large number of builds over the weekend; pretty much everything from 
#8949 to #8966. The fact that this build took two hours meant that it was one 
of the

Even identifying the fact that not only was java/latest the wrong value, so was 
java/latest7; I ended up having add ls commands to the build to identify which 
JDKs were present, then experimenting to see how much worked. Then there were, 
as I noted, race conditions. Things get confused if you are running enough 
builds that >1 precommit is on the same node.

There's also 
# the fact that the output handling of the different precommits vary. Why do 
some builds end up with a {{../patchprocess}} dir, when others do not -and 
pasting in the {{mv}} command fails?
# the need to go through every build and enter the memory requirements
# fixing the XML test capture so they pick up stuff like the contrib/ section 
in the hbase project.

A lot of the work I ended up doing was not actually the java7 migration, it was 
fixing a set of jenkins builds that were in a strongly inconsistent state.

I did not expect so much of my weekend to be frittered away with returning to 
my keyboard every hour —if you look at the build logs for all the projects you 
can see how many times I did end up triggering builds, from 10 am to midnight 
both days. I therefore consider the implication that I didn't look at the HDFS 
build invalid and unappreciative of the effort I put in.

I shall give you the honour of repeating this process when we move to java 8. 

> Make hadoop trunk build on Java7+ only
> --------------------------------------
>
>                 Key: HADOOP-10530
>                 URL: https://issues.apache.org/jira/browse/HADOOP-10530
>             Project: Hadoop Common
>          Issue Type: Improvement
>          Components: build
>    Affects Versions: 3.0.0, 2.6.0
>         Environment: Java 1.7+
>            Reporter: Steve Loughran
>            Assignee: Steve Loughran
>            Priority: Blocker
>             Fix For: 2.7.0
>
>         Attachments: HADOOP-10530-001.patch, HADOOP-10530-002.patch, 
> HADOOP-10530-003.patch, HADOOP-10530-004.patch, HADOOP-10530-005.patch, 
> HADOOP-10530-debug.000.patch, Screen Shot 2014-09-20 at 18.09.05.png
>
>
> As discussed on hadoop-common, hadoop 3 is envisaged to be Java7+ *only* 
> -this JIRA covers switching the build for this
> # maven enforcer plugin to set Java version = {{[1.7)}}
> # compiler to set language to java 1.7



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to