[DISCUSS] YARN v2 web UI hackathon

Hi YARN Devs, As we discussed in our last YARN meetup, I'm proposing to have a one-day YARN v2 Web UI hackathon at end of May. We can all come together, scope down and build some of the following: - Make YARN UI work under HA and secure environments - Make it work with fair scheduler - Add

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1439

See Changes: [jlowe] YARN-4325. Nodemanager log handlers fail to send finished/failed events -- [...truncated 4606 lines...] ---

Hadoop-Yarn-trunk-Java8 - Build # 1439 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1439/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4799 lines...] However, there were other

Re: [VOTE] Merge feature branch HADOOP-12930

Understood about the tests. --Chris Nauroth On 5/15/16, 7:30 AM, "Allen Wittenauer" wrote: > >> On May 14, 2016, at 3:11 PM, Chris Nauroth >>wrote: >> >> +1 (binding) >> >> -Tried a dry-run merge of HADOOP-12930 to trunk. >> -Successfully built

Hadoop-Yarn-trunk - Build # 2150 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2150/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8908 lines...] However, there were other interactions

Build failed in Jenkins: Hadoop-Yarn-trunk #2150

See Changes: [jlowe] YARN-4325. Nodemanager log handlers fail to send finished/failed events -- [...truncated 8715 lines...] [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork

Re: Different JIRA permissions for HADOOP and HDFS

Great, Thanks Junping! Yes, the JIRA assignment works for me now. zhihai On Mon, May 16, 2016 at 5:29 AM, Junping Du wrote: > Zhihai, I just set you with committer permissions on MAPREDUCE JIRA. Would > you try if the JIRA assignment works now? I cannot help on Hive

Build failed in Jenkins: Hadoop-Yarn-trunk #2151

See Changes: [cnauroth] HADOOP-13148. TestDistCpViewFs to include IOExceptions in test error [cnauroth] HADOOP-13149. Windows distro build fails on dist-copynativelibs. -- [...truncated 8715

Hadoop-Yarn-trunk - Build # 2151 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2151/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8908 lines...] However, there were other interactions

Build failed in Jenkins: Hadoop-Yarn-trunk #2152

See Changes: [epayne] YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. -- [...truncated 8715 lines...] [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork

Hadoop-Yarn-trunk - Build # 2152 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2152/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8908 lines...] However, there were other interactions

Hadoop-Yarn-trunk-Java8 - Build # 1440 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1440/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4799 lines...] However, there were other

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1440

See Changes: [cnauroth] HADOOP-13148. TestDistCpViewFs to include IOExceptions in test error [cnauroth] HADOOP-13149. Windows distro build fails on dist-copynativelibs. -- [...truncated

[jira] [Resolved] (YARN-5075) Fix findbugs warning in hadoop-yarn-common module

[ https://issues.apache.org/jira/browse/YARN-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-5075. --- Resolution: Duplicate Going to reopen YARN-4412 - that's better than filing

Re: Different JIRA permissions for HADOOP and HDFS

Thanks Junping! It seems to work now. On Mon, May 16, 2016 at 5:22 PM, Junping Du wrote: > Someone fix the permission issue so that Administrator, committer and > reporter can edit the issue now. > > Sangjin, it sounds like you were not in JIRA's committer list before and

[RESULT] Re: [VOTE] Merge feature branch HADOOP-12930

Vote passes. 1 = +1 non-binding 4 = +1 binding I’ll squash and commit here in a sec. Thanks everyone! - To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail:

[jira] [Created] (YARN-5098) Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token

Yesha Vora created YARN-5098: Summary: Yarn Application log Aggreagation fails due to NM can not get correct HDFS delegation token Key: YARN-5098 URL: https://issues.apache.org/jira/browse/YARN-5098

Hadoop-Yarn-trunk-Java8 - Build # 1443 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1443/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4397 lines...] Results : Tests in error:

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1443

See Changes: [lei] HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John -- [...truncated 4204 lines...] } [INFO] Running make -j 16 VERBOSE=1 [WARNING]

Build failed in Jenkins: Hadoop-Yarn-trunk #2154

See Changes: [lei] HDFS-10410. RedundantEditLogInputStream.LOG is set to wrong class. (John [aw] HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) -- [...truncated 59 lines...]

Hadoop-Yarn-trunk - Build # 2154 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2154/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 251 lines...] [INFO] --- maven-clean-plugin:2.5:clean

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

There’s a bunch of stuff that needs to happen at the Jenkins level: * Kill off the JDK7 trunk builds for HADOOP, HDFS, MAPRED, YARN * Remove JDK7 from pre-commit for HADOOP, HDFS, MAPRED, YARN One thing that needs to happen in the Apache Yetus project: * Wait until YETUS-369 has been written

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1441

See Changes: [epayne] YARN-5069. TestFifoScheduler.testResourceOverCommit race condition. -- [...truncated 4604 lines...] ---

[jira] [Created] (YARN-5094) some YARN container events have timestamp of -1 in REST output

Sangjin Lee created YARN-5094: - Summary: some YARN container events have timestamp of -1 in REST output Key: YARN-5094 URL: https://issues.apache.org/jira/browse/YARN-5094 Project: Hadoop YARN

Hadoop-Yarn-trunk-Java8 - Build # 1441 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1441/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4797 lines...] However, there were other

Re: Different JIRA permissions for HADOOP and HDFS

I also find myself unable to edit most of the JIRA fields, and that is across projects (HADOOP, YARN, MAPREDUCE, and HDFS). Commenting and the workflow buttons seem to work, however. On Mon, May 16, 2016 at 8:14 AM, Zhihai Xu wrote: > Great, Thanks Junping! Yes, the JIRA

[jira] [Created] (YARN-5093) created time shows 0 in most REST output

Sangjin Lee created YARN-5093: - Summary: created time shows 0 in most REST output Key: YARN-5093 URL: https://issues.apache.org/jira/browse/YARN-5093 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5096) timelinereader has a lot of logging that's not useful

Sangjin Lee created YARN-5096: - Summary: timelinereader has a lot of logging that's not useful Key: YARN-5096 URL: https://issues.apache.org/jira/browse/YARN-5096 Project: Hadoop YARN Issue

[jira] [Created] (YARN-5095) flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled

Sangjin Lee created YARN-5095: - Summary: flow activities and flow runs are populated with wrong timestamp when RM restarts w/ recovery enabled Key: YARN-5095 URL: https://issues.apache.org/jira/browse/YARN-5095

Build failed in Jenkins: Hadoop-Yarn-trunk #2153

See Changes: [jing9] HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo [wang] HADOOP-11858. [JDK8] Set minimum version of Hadoop 3 to JDK 8. -- [...truncated 59 lines...]

Hadoop-Yarn-trunk - Build # 2153 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2153/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 251 lines...] [INFO] --- maven-clean-plugin:2.5:clean

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

Very happy to announce that we've committed HADOOP-11858. I'm looking forward to writing my first lambda in Java. I also attached a video to the JIRA so we can all relive this moment in Hadoop development history. It sounds like there's some precommit work to align test-patch with this change.

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1442

See Changes: [jing9] HADOOP-13146. Refactor RetryInvocationHandler. Contributed by Tsz Wo [wang] HADOOP-11858. [JDK8] Set minimum version of Hadoop 3 to JDK 8. -- [...truncated 4202

Hadoop-Yarn-trunk-Java8 - Build # 1442 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1442/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4395 lines...] Results : Tests in error:

[jira] [Created] (YARN-5097) NPE in Separator.joinEncoded()

Sangjin Lee created YARN-5097: - Summary: NPE in Separator.joinEncoded() Key: YARN-5097 URL: https://issues.apache.org/jira/browse/YARN-5097 Project: Hadoop YARN Issue Type: Sub-task

Re: Different JIRA permissions for HADOOP and HDFS

Someone fix the permission issue so that Administrator, committer and reporter can edit the issue now. Sangjin, it sounds like you were not in JIRA's committer list before and I just add you into committer roles for 4 projects. Hope it works for you now.​ Thanks, Junping

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1446

See Changes: [aw] HADOOP-13161. remove JDK7 from Dockerfile (aw) -- [...truncated 4202 lines...] } [INFO] Running make -j 16 VERBOSE=1 [WARNING]

Hadoop-Yarn-trunk-Java8 - Build # 1446 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1446/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4395 lines...] Results : Tests in error:

Re: Different JIRA permissions for HADOOP and HDFS

Hi Junping, It looks like, I too dont have permissions in projects except HDFS. Please grant me also to the group. Thanks in advance, -Vinay On 17 May 2016 6:10 a.m., "Sangjin Lee" wrote: Thanks Junping! It seems to work now. On Mon, May 16, 2016 at 5:22 PM, Junping Du

Re: [VOTE] Merge feature branch HADOOP-12930

+1. - Checked out HADOOP-12930 - Built by "mvn package -Pdist -DskipTests -Dtar" successfully - Added custom subcommands to ~/.hadooprc and confirmed they worked - Built documentation and it looks good Thanks, Akira On 5/15/16 02:33, Allen Wittenauer wrote: This vote closes in 2 days and the

Hadoop-Yarn-trunk-Java8 - Build # 1444 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1444/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4395 lines...] Results : Tests in error:

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1444

See Changes: [aw] HADOOP-12930. Dynamic subcommands for hadoop shell scripts (aw) -- [...truncated 4202 lines...] } [INFO] Running make -j 16 VERBOSE=1 [WARNING]

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

OK, it looks like if someone commits HADOOP-13161, then trunk only uses JDK8 and branch-2 will use JDK7 and JDK8 during precommit with no changes required to Apache Yetus. :D > On May 16, 2016, at 5:38 PM, Allen Wittenauer > wrote: > > > There’s a

[jira] [Created] (YARN-5100) The YarnApplicationState is always running in ATS no matter the application is running or finishes.

Xuan Gong created YARN-5100: --- Summary: The YarnApplicationState is always running in ATS no matter the application is running or finishes. Key: YARN-5100 URL: https://issues.apache.org/jira/browse/YARN-5100

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1445

See Changes: [sjlee] HDFS-10208. Addendum for HDFS-9579: to handle the case when client -- [...truncated 4204 lines...] } [INFO] Running make -j 16 VERBOSE=1 [WARNING]

Hadoop-Yarn-trunk-Java8 - Build # 1445 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1445/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4397 lines...] Results : Tests in error:

Re: Different JIRA permissions for HADOOP and HDFS

Hi Vinay, Added you into committer roles for HADOOP/MAPREDUCE/YARN. Regards, Akira On 5/17/16 13:45, Vinayakumar B wrote: Hi Junping, It looks like, I too dont have permissions in projects except HDFS. Please grant me also to the group. Thanks in advance, -Vinay On 17 May 2016 6:10 a.m.,

Re: Different JIRA permissions for HADOOP and HDFS

Thanks Akira. On 17 May 2016 10:59, "Akira Ajisaka" wrote: > Hi Vinay, > > Added you into committer roles for HADOOP/MAPREDUCE/YARN. > > Regards, > Akira > > On 5/17/16 13:45, Vinayakumar B wrote: > >> Hi Junping, >> >> It looks like, I too dont have permissions in projects

Hadoop-Yarn-trunk-Java8 - Build # 1437 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1437/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4799 lines...] However, there were other

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1437

See Changes: [wang] HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure -- [...truncated 4606 lines...] ---

Build failed in Jenkins: Hadoop-Yarn-trunk #2148

See Changes: [wang] HDFS-10333. Intermittent org.apache.hadoop.hdfs.TestFileAppend failure -- [...truncated 8715 lines...] [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork

Hadoop-Yarn-trunk - Build # 2148 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2148/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8908 lines...] However, there were other interactions

Re: [VOTE] Merge feature branch HADOOP-12930

> Fix (with unit tests!) committed. Thanks, Allen. +1. - checked out HADOOP-12930 and ran shelltest on my local - ran 'mvn package -Pdist -Pnative -DskipTests' - started pseudo-distributed cluster by start-dfs.sh and start-yarn.sh - ran 'hadoop distcp' and 'mapred streaming' successfully -

Re: Different JIRA permissions for HADOOP and HDFS

Not sure if this is related.. but It also looks like I am now no longer allowed to modify description and headline of JIRAs anymore.. Would appreciate greatly if someone can help revert this ! Cheers -Arun On Mon, May 16, 2016 at 1:21 AM, Zhihai Xu wrote: > Currently I also

Build failed in Jenkins: Hadoop-Yarn-trunk #2149

See Changes: [kai.zheng] HDFS-8449. Add tasks count metrics to datanode for ECWorker. Contributed -- [...truncated 8719 lines...] [INFO] [INFO] --- maven-source-plugin:2.3:jar-no-fork

Hadoop-Yarn-trunk - Build # 2149 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk/2149/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8912 lines...] However, there were other interactions

Build failed in Jenkins: Hadoop-Yarn-trunk-Java8 #1438

See Changes: [kai.zheng] HDFS-8449. Add tasks count metrics to datanode for ECWorker. Contributed -- [...truncated 4606 lines...] ---

Hadoop-Yarn-trunk-Java8 - Build # 1438 - Still Failing

See https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/1438/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 4799 lines...] However, there were other

[jira] [Created] (YARN-5092) TestRMDelegationTokens fails intermittently

Rohith Sharma K S created YARN-5092: --- Summary: TestRMDelegationTokens fails intermittently Key: YARN-5092 URL: https://issues.apache.org/jira/browse/YARN-5092 Project: Hadoop YARN Issue

Re: Different JIRA permissions for HADOOP and HDFS

Likewise, I've found that I am unable to set fix version, etc on a JIRA that I committed and resolved. On Mon, May 16, 2016 at 8:29 AM, Junping Du wrote: > Zhihai, I just set you with committer permissions on MAPREDUCE JIRA. Would > you try if the JIRA assignment works

Re: Different JIRA permissions for HADOOP and HDFS

Zhihai, I just set you with committer permissions on MAPREDUCE JIRA. Would you try if the JIRA assignment works now? I cannot help on Hive project. It is better to ask hive project community for help. For Arun's problem. from my check, the Edit permission on JIRA only authorized to