[jira] [Created] (HADOOP-13250) jdiff and dependency reports aren't linked in site web pages
Allen Wittenauer created HADOOP-13250: - Summary: jdiff and dependency reports aren't linked in site web pages Key: HADOOP-13250 URL: https://issues.apache.org/jira/browse/HADOOP-13250 Project: Hadoop Common Issue Type: Bug Components: build, documentation Affects Versions: 3.0.0-alpha1 Reporter: Allen Wittenauer Even though they are in the site tar ball (after HADOOP-13245), they aren't actually reachable. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13249) RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep
zhihai xu created HADOOP-13249: -- Summary: RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep Key: HADOOP-13249 URL: https://issues.apache.org/jira/browse/HADOOP-13249 Project: Hadoop Common Issue Type: Bug Components: ipc Affects Versions: 2.8.0 Reporter: zhihai xu Assignee: zhihai xu RetryInvocationHandler need wrap InterruptedException in IOException when call Thread.sleep. Otherwise InterruptedException can't be handled correctly by other components such as HDFS. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Pre-commit Docker image build failures on H2?
> On Jun 8, 2016, at 10:09 AM, Anu Engineerwrote: > > Sorry did not know about the network. Is it possible to have Java > pre-installed in the docker image? Nope. Licensing issues. > Are downloading only Java from the net, because all of the cases are Oracle > Java install failure with error code 100. I've seen it fail over the past week after that point too. It just happens that the JDK download is the largest one by a large percentage so much more likely to be the one that fails. > If it was a case of network failure, the coincidence is a bit too much. ubuntu:trusty got updated, which triggered docker image updates, which triggers new image creation, which triggers mass re-downloads, which results in more network traffic, - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Pre-commit Docker image build failures on H2?
Sorry did not know about the network. Is it possible to have Java pre-installed in the docker image? Are downloading only Java from the net, because all of the cases are Oracle Java install failure with error code 100. If it was a case of network failure, the coincidence is a bit too much. Thanks Anu On 6/8/16, 9:58 AM, "Allen Wittenauer"wrote: > > You guys know that the build machines in the Yahoo data center > temporarily lose network all the time, right? It's been happening for months > now... > > > >> On Jun 8, 2016, at 9:53 AM, Anu Engineer wrote: >> >> Another instance of the same failure. >> >> https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console >> >> I am going to open a JIRA so that we can track this issue there. This is on >> H1 so I don’t think it is machine specific. >> >> Thanks >> Anu >> >> >> On 6/7/16, 5:30 PM, "Anu Engineer" wrote: >> >>> Hi Chris, >>> Thanks for bringing this up. I just ran into the same issue. >>> >>> https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console >>> >>> But in my case it seems like a different host. “Building remotely on H0”. >>> >>> Thanks >>> Anu >>> >>> >>> On 6/6/16, 3:44 PM, "Chris Nauroth" wrote: >>> I'm curious if anyone has noticed issues with pre-commit failing during the Docker image build on Jenkins node H2. Here are a few examples. https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console These are all test runs for the same patch, but the patch just removes 5 lines of Java code, so I don't expect the particular patch could cause a failure like this. I noticed that they all ran on H2. It seems to be a problem installing oracle-java8-installer: WARNING: The following packages cannot be authenticated! oracle-java8-installer ?[91mE: There are problems and -y was used without --force-yes ?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y oracle-java8-installer' returned a non-zero code: 100 --Chris Nauroth >>> >> > >
Re: Pre-commit Docker image build failures on H2?
You guys know that the build machines in the Yahoo data center temporarily lose network all the time, right? It's been happening for months now... > On Jun 8, 2016, at 9:53 AM, Anu Engineerwrote: > > Another instance of the same failure. > > https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console > > I am going to open a JIRA so that we can track this issue there. This is on > H1 so I don’t think it is machine specific. > > Thanks > Anu > > > On 6/7/16, 5:30 PM, "Anu Engineer" wrote: > >> Hi Chris, >> Thanks for bringing this up. I just ran into the same issue. >> >> https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console >> >> But in my case it seems like a different host. “Building remotely on H0”. >> >> Thanks >> Anu >> >> >> On 6/6/16, 3:44 PM, "Chris Nauroth" wrote: >> >>> I'm curious if anyone has noticed issues with pre-commit failing during the >>> Docker image build on Jenkins node H2. Here are a few examples. >>> >>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console >>> >>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console >>> >>> https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console >>> >>> These are all test runs for the same patch, but the patch just removes 5 >>> lines of Java code, so I don't expect the particular patch could cause a >>> failure like this. I noticed that they all ran on H2. It seems to be a >>> problem installing oracle-java8-installer: >>> >>> >>> WARNING: The following packages cannot be authenticated! >>> oracle-java8-installer >>> ?[91mE: There are problems and -y was used without --force-yes >>> ?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y >>> oracle-java8-installer' returned a non-zero code: 100 >>> >>> --Chris Nauroth >> > - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: Pre-commit Docker image build failures on H2?
Another instance of the same failure. https://builds.apache.org/job/PreCommit-HADOOP-Build/9690/console I am going to open a JIRA so that we can track this issue there. This is on H1 so I don’t think it is machine specific. Thanks Anu On 6/7/16, 5:30 PM, "Anu Engineer"wrote: >Hi Chris, >Thanks for bringing this up. I just ran into the same issue. > >https://builds.apache.org/job/PreCommit-HDFS-Build/15700/console > >But in my case it seems like a different host. “Building remotely on H0”. > >Thanks >Anu > > >On 6/6/16, 3:44 PM, "Chris Nauroth" wrote: > >>I'm curious if anyone has noticed issues with pre-commit failing during the >>Docker image build on Jenkins node H2. Here are a few examples. >> >>https://builds.apache.org/job/PreCommit-HADOOP-Build/9661/console >> >>https://builds.apache.org/job/PreCommit-HADOOP-Build/9662/console >> >>https://builds.apache.org/job/PreCommit-HADOOP-Build/9670/console >> >>These are all test runs for the same patch, but the patch just removes 5 >>lines of Java code, so I don't expect the particular patch could cause a >>failure like this. I noticed that they all ran on H2. It seems to be a >>problem installing oracle-java8-installer: >> >> >>WARNING: The following packages cannot be authenticated! >> oracle-java8-installer >>?[91mE: There are problems and -y was used without --force-yes >>?[0mThe command '/bin/sh -c apt-get -q install --no-install-recommends -y >>oracle-java8-installer' returned a non-zero code: 100 >> >>--Chris Nauroth >
Re: Cannot create release artifacts for branch-2.8
+1 for fixing create-release. I'll try to backport HADOOP-12892. Thanks, Akira On 6/8/16 07:05, Wangda Tan wrote: It's also the best option to fix create-release. If we cannot get help to fix the script, it seems the only choice is to maintain CHANGES.txt again in branch-2. On Tue, Jun 7, 2016 at 2:56 PM, Andrew Wangwrote: I'm not super happy about the alternative of reverting the auto-generated CHANGES/RL JIRAs, since it means we have to do CHANGES.txt maintenance again in branch-2. That's an overhead that we pay for every commit, and it's particularly bad when doing backports. As I commented on HADOOP-12892, I think the backport should be possible, and hopefully without backporting all the conflicting JIRAs. Maybe another bash-savvy contributor could attempt it? On Tue, Jun 7, 2016 at 2:45 PM, Wangda Tan wrote: I'm not the one who cherry-picked them into branch-2, so I don't care either way. I've been extremely open about targeting my code for the past three years for trunk. With few exceptions, I generally only commit code I write or even review to branch-2 if someone practically begs me. That branch needs to die. Given my current situation, I'm certainly not going to spend any unpaid time on it. Yeah, we all knew your preferences about this, you have the choice to work on whatever branch you like. :) Actually this question is to Andrew and Akira, I want to get consensus on this. Thanks, Wangda - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/ [Jun 7, 2016 8:52:55 AM] (aajisaka) HDFS-10485. Fix findbugs warning in FSEditLog.java. (aajisaka) [Jun 7, 2016 4:18:58 PM] (junping_du) HADOOP-10048. LocalDirAllocator should avoid holding locks while [Jun 7, 2016 5:48:21 PM] (jing9) HDFS-10468. HDFS read ends up ignoring an interrupt. Contributed by Jing [Jun 7, 2016 10:06:42 PM] (wangda) YARN-4837. User facing aspects of 'AM blacklisting' feature need fixing. [Jun 7, 2016 10:46:06 PM] (rkanter) MAPREDUCE-6702. TestMiniMRChildTask.testTaskEnv and [Jun 7, 2016 10:59:43 PM] (Arun Suresh) Addendum patch for YARN-5180 updating findbugs-exclude.xml [Jun 7, 2016 11:07:02 PM] (xgong) YARN-5199. Close LogReader in in AHSWebServices#getStreamingOutput and [Jun 8, 2016 12:16:18 AM] (Arun Suresh) YARN-5176. More test cases for queuing of containers at the NM. -1 overall The following subsystems voted -1: findbugs unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-common-project/hadoop-minikdc org.apache.hadoop.minikdc.MiniKdc.stop() calls Thread.sleep() with a lock held At MiniKdc.java:lock held At MiniKdc.java:[line 345] Failed junit tests : hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.TestRollingUpgrade hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager hadoop.yarn.server.resourcemanager.TestClientRMTokens hadoop.yarn.server.resourcemanager.TestAMAuthorization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.client.cli.TestLogsCLI hadoop.yarn.client.api.impl.TestAMRMProxy hadoop.yarn.client.api.impl.TestDistributedScheduling hadoop.yarn.client.TestGetGroups hadoop.mapred.TestMRCJCFileOutputCommitter Timed out junit tests : org.apache.hadoop.yarn.client.cli.TestYarnCLI org.apache.hadoop.yarn.client.api.impl.TestAMRMClient org.apache.hadoop.yarn.client.api.impl.TestYarnClient org.apache.hadoop.yarn.client.api.impl.TestNMClient cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-compile-javac-root.txt [164K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/whitespace-tabs.txt [1.3M] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/branch-findbugs-hadoop-common-project_hadoop-minikdc-warnings.html [8.0K] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/diff-javadoc-javadoc-root.txt [2.3M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [144K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [36K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [60K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [908K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/51/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [92K]