[jira] [Created] (HADOOP-13250) jdiff and dependency reports aren't linked in site web pages

2016-06-08 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-13250:
-

 Summary: jdiff and dependency reports aren't linked in site web 
pages
 Key: HADOOP-13250
 URL: https://issues.apache.org/jira/browse/HADOOP-13250
 Project: Hadoop Common
  Issue Type: Bug
  Components: build, documentation
Affects Versions: 3.0.0-alpha1
Reporter: Allen Wittenauer


Even though they are in the site tar ball (after HADOOP-13245), they aren't 
actually reachable.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



[jira] [Created] (HADOOP-13249) RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep

2016-06-08 Thread zhihai xu (JIRA)
zhihai xu created HADOOP-13249:
--

 Summary: RetryInvocationHandler need wrap InterruptedException in 
IOException when call Thread.sleep
 Key: HADOOP-13249
 URL: https://issues.apache.org/jira/browse/HADOOP-13249
 Project: Hadoop Common
  Issue Type: Bug
  Components: ipc
Affects Versions: 2.8.0
Reporter: zhihai xu
Assignee: zhihai xu


RetryInvocationHandler need wrap InterruptedException in IOException when call 
Thread.sleep. Otherwise InterruptedException can't be handled correctly by 
other components such as HDFS. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: Pre-commit Docker image build failures on H2?

2016-06-08 Thread Allen Wittenauer

> On Jun 8, 2016, at 10:09 AM, Anu Engineer  wrote:
> 
> Sorry did not know about the network. Is it possible to have Java 
> pre-installed in the docker image?

Nope. Licensing issues.

> Are downloading only Java from the net, because all of the cases are Oracle 
> Java install failure with error code 100.

  I've seen it fail over the past week after that point too.  It just 
happens that the JDK download is the largest one by a large percentage so much 
more likely to be the one that fails.

> If it was a case of network failure, the coincidence is a bit too much.

ubuntu:trusty got updated, which triggered docker image updates, which 
triggers new image creation, which triggers mass re-downloads, which results in 
more network traffic, 


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: Pre-commit Docker image build failures on H2?

2016-06-08 Thread Anu Engineer
Sorry did not know about the network. Is it possible to have Java pre-installed 
in the docker image?
 
Are downloading only Java from the net, because all of the cases are Oracle 
Java install failure with error code 100.

If it was a case of network failure, the coincidence is a bit too much.

Thanks
Anu


On 6/8/16, 9:58 AM, "Allen Wittenauer"  
wrote:

>
>   You guys know that the build machines in the Yahoo data center 
> temporarily lose network all the time, right?  It's been happening for months 
> now...
>
>
>
>> On Jun 8, 2016, at 9:53 AM, Anu Engineer  wrote:
>> 
>> Another instance of the same failure.
>> 
>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console
>> 
>> I am going to open a JIRA so that we can track this issue there. This is on 
>> H1 so I don’t think it is machine specific.
>> 
>> Thanks
>> Anu
>> 
>> 
>> On 6/7/16, 5:30 PM, "Anu Engineer"  wrote:
>> 
>>> Hi Chris,
>>> Thanks for bringing this up. I just ran into the same issue.
>>> 
>>> https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console
>>> 
>>> But in my case it seems like a different host.  “Building remotely on H0”.
>>> 
>>> Thanks
>>> Anu
>>> 
>>> 
>>> On 6/6/16, 3:44 PM, "Chris Nauroth"  wrote:
>>> 
 I'm curious if anyone has noticed issues with pre-commit failing during 
 the Docker image build on Jenkins node H2.  Here are a few examples.
 
 https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console
 
 https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console
 
 https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console
 
 These are all test runs for the same patch, but the patch just removes 5 
 lines of Java code, so I don't expect the particular patch could cause a 
 failure like this.  I noticed that they all ran on H2.  It seems to be a 
 problem installing oracle-java8-installer:
 
 
 WARNING: The following packages cannot be authenticated!
 oracle-java8-installer
 ?[91mE: There are problems and -y was used without --force-yes
 ?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
 oracle-java8-installer' returned a non-zero code: 100
 
 --Chris Nauroth
>>> 
>> 
>
>



Re: Pre-commit Docker image build failures on H2?

2016-06-08 Thread Allen Wittenauer

You guys know that the build machines in the Yahoo data center 
temporarily lose network all the time, right?  It's been happening for months 
now...



> On Jun 8, 2016, at 9:53 AM, Anu Engineer  wrote:
> 
> Another instance of the same failure.
> 
> https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console
> 
> I am going to open a JIRA so that we can track this issue there. This is on 
> H1 so I don’t think it is machine specific.
> 
> Thanks
> Anu
> 
> 
> On 6/7/16, 5:30 PM, "Anu Engineer"  wrote:
> 
>> Hi Chris,
>> Thanks for bringing this up. I just ran into the same issue.
>> 
>> https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console
>> 
>> But in my case it seems like a different host.  “Building remotely on H0”.
>> 
>> Thanks
>> Anu
>> 
>> 
>> On 6/6/16, 3:44 PM, "Chris Nauroth"  wrote:
>> 
>>> I'm curious if anyone has noticed issues with pre-commit failing during the 
>>> Docker image build on Jenkins node H2.  Here are a few examples.
>>> 
>>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console
>>> 
>>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console
>>> 
>>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console
>>> 
>>> These are all test runs for the same patch, but the patch just removes 5 
>>> lines of Java code, so I don't expect the particular patch could cause a 
>>> failure like this.  I noticed that they all ran on H2.  It seems to be a 
>>> problem installing oracle-java8-installer:
>>> 
>>> 
>>> WARNING: The following packages cannot be authenticated!
>>> oracle-java8-installer
>>> ?[91mE: There are problems and -y was used without --force-yes
>>> ?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
>>> oracle-java8-installer' returned a non-zero code: 100
>>> 
>>> --Chris Nauroth
>> 
> 


-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Re: Pre-commit Docker image build failures on H2?

2016-06-08 Thread Anu Engineer
Another instance of the same failure.

https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console

I am going to open a JIRA so that we can track this issue there. This is on H1 
so I don’t think it is machine specific.

Thanks
Anu


On 6/7/16, 5:30 PM, "Anu Engineer"  wrote:

>Hi Chris,
>Thanks for bringing this up. I just ran into the same issue.
>
>https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console
>
>But in my case it seems like a different host.  “Building remotely on H0”.
>
>Thanks
>Anu
>
>
>On 6/6/16, 3:44 PM, "Chris Nauroth"  wrote:
>
>>I'm curious if anyone has noticed issues with pre-commit failing during the 
>>Docker image build on Jenkins node H2.  Here are a few examples.
>>
>>https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console
>>
>>https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console
>>
>>https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console
>>
>>These are all test runs for the same patch, but the patch just removes 5 
>>lines of Java code, so I don't expect the particular patch could cause a 
>>failure like this.  I noticed that they all ran on H2.  It seems to be a 
>>problem installing oracle-java8-installer:
>>
>>
>>WARNING: The following packages cannot be authenticated!
>>  oracle-java8-installer
>>?[91mE: There are problems and -y was used without --force-yes
>>?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y 
>>oracle-java8-installer' returned a non-zero code: 100
>>
>>--Chris Nauroth
>



Re: Cannot create release artifacts for branch-2.8

2016-06-08 Thread Akira AJISAKA

+1 for fixing create-release. I'll try to backport HADOOP-12892.

Thanks,
Akira

On 6/8/16 07:05, Wangda Tan wrote:

It's also the best option to fix create-release. If we cannot get help to
fix the script, it seems the only choice is to maintain CHANGES.txt again
in branch-2.

On Tue, Jun 7, 2016 at 2:56 PM, Andrew Wang 
wrote:


I'm not super happy about the alternative of reverting the auto-generated
CHANGES/RL JIRAs, since it means we have to do CHANGES.txt maintenance
again in branch-2. That's an overhead that we pay for every commit, and
it's particularly bad when doing backports.

As I commented on HADOOP-12892, I think the backport should be possible,
and hopefully without backporting all the conflicting JIRAs. Maybe another
bash-savvy contributor could attempt it?



On Tue, Jun 7, 2016 at 2:45 PM, Wangda Tan  wrote:



I'm not the one who cherry-picked them into branch-2, so I don't
care either way.  I've been extremely open about targeting my code for

the

past three years for trunk. With few exceptions, I generally only commit
code I write or even review to branch-2 if someone practically begs me.
That branch needs to die.  Given my current situation, I'm certainly not
going to spend any unpaid time on it.



Yeah, we all knew your preferences about this, you have the choice to work
on whatever branch you like. :)

Actually this question is to Andrew and Akira, I want to get consensus on
this.

Thanks,
Wangda









-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org



Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-06-08 Thread Apache Jenkins Server
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/

[Jun 7, 2016 8:52:55 AM] (aajisaka) HDFS-10485. Fix findbugs warning in 
FSEditLog.java. (aajisaka)
[Jun 7, 2016 4:18:58 PM] (junping_du) HADOOP-10048. LocalDirAllocator should 
avoid holding locks while
[Jun 7, 2016 5:48:21 PM] (jing9) HDFS-10468. HDFS read ends up ignoring an 
interrupt. Contributed by Jing
[Jun 7, 2016 10:06:42 PM] (wangda) YARN-4837. User facing aspects of 'AM 
blacklisting' feature need fixing.
[Jun 7, 2016 10:46:06 PM] (rkanter) MAPREDUCE-6702. 
TestMiniMRChildTask.testTaskEnv and
[Jun 7, 2016 10:59:43 PM] (Arun Suresh) Addendum patch for YARN-5180 updating 
findbugs-exclude.xml
[Jun 7, 2016 11:07:02 PM] (xgong) YARN-5199. Close LogReader in in 
AHSWebServices#getStreamingOutput and
[Jun 8, 2016 12:16:18 AM] (Arun Suresh) YARN-5176. More test cases for queuing 
of containers at the NM.




-1 overall


The following subsystems voted -1:
findbugs unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

FindBugs :

   module:hadoop-common-project/hadoop-minikdc 
   org.apache.hadoop.minikdc.MiniKdc.stop() calls Thread.sleep() with a 
lock held At MiniKdc.java:lock held At MiniKdc.java:[line 345] 

Failed junit tests :

   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery 
   hadoop.hdfs.TestRollingUpgrade 
   
hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
 
   hadoop.yarn.server.resourcemanager.TestClientRMTokens 
   hadoop.yarn.server.resourcemanager.TestAMAuthorization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.client.cli.TestLogsCLI 
   hadoop.yarn.client.api.impl.TestAMRMProxy 
   hadoop.yarn.client.api.impl.TestDistributedScheduling 
   hadoop.yarn.client.TestGetGroups 
   hadoop.mapred.TestMRCJCFileOutputCommitter 

Timed out junit tests :

   org.apache.hadoop.yarn.client.cli.TestYarnCLI 
   org.apache.hadoop.yarn.client.api.impl.TestAMRMClient 
   org.apache.hadoop.yarn.client.api.impl.TestYarnClient 
   org.apache.hadoop.yarn.client.api.impl.TestNMClient 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-compile-javac-root.txt
  [164K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-pylint.txt
  [16K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/whitespace-eol.txt
  [12M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/whitespace-tabs.txt
  [1.3M]

   findbugs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc-warnings.html
  [8.0K]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-javadoc-javadoc-root.txt
  [2.3M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [144K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt
  [36K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt
  [60K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [268K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt
  [908K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [92K]