Re: [DISCUSS] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
Hi Arun Sorry for late reply. * Is there a branch-2 merge planned for this ? Branch-2 is not planned for this merge. * I understand YARN-7126 has some introductory documentation, But I think we need to flesh it up a bit more before release, I would also like to see steps to deploy a sample

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
Hi Andrew, At this point, there are no more release blockers including documentations from our side - all work done. But I agree it is too close to the release, after talking with other team members, we are fine to drop this from beta, And we want to target this for GA. I’m withdrawing this

[jira] [Created] (MAPREDUCE-6956) FileOutputCommitter to gain abstract superclass PathOutputCommitter

2017-09-08 Thread Steve Loughran (JIRA)
Steve Loughran created MAPREDUCE-6956: - Summary: FileOutputCommitter to gain abstract superclass PathOutputCommitter Key: MAPREDUCE-6956 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6956

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-08 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/517/ [Sep 7, 2017 7:46:20 AM] (sunilg) YARN-6992. Kill application button is visible even if the application is [Sep 7, 2017 12:38:23 PM] (kai.zheng) HDFS-12402. Refactor ErasureCodingPolicyManager and related

[jira] [Resolved] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

2017-09-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/MAPREDUCE-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6955. --- Resolution: Not A Problem > remove unnecessary dependency from

[jira] [Created] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

2017-09-08 Thread Haibo Chen (JIRA)
Haibo Chen created MAPREDUCE-6955: - Summary: remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle Key: MAPREDUCE-6955 URL:

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-08 Thread Jian He
Hi Allen, The documentations are committed. Please check QuickStart.md and others in the same folder. YarnCommands.md doc is updated to include new commands. DNS default port is also documented. Would you like to give a look and see if it address your concerns ? Jian > On Sep 6, 2017, at 10:19

[jira] [Created] (MAPREDUCE-6954) Disable erasure coding for files that are uploaded to the MR staging area

2017-09-08 Thread Peter Bacsko (JIRA)
Peter Bacsko created MAPREDUCE-6954: --- Summary: Disable erasure coding for files that are uploaded to the MR staging area Key: MAPREDUCE-6954 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6954

[DISCUSS] official docker image(s) for hadoop

2017-09-08 Thread Marton, Elek
TL;DR: I propose to create official hadoop images and upload them to the dockerhub. GOAL/SCOPE: I would like improve the existing documentation with easy-to-use docker based recipes to start hadoop clusters with various configuration. The images also could be used to test experimental

hadoop roadmaps

2017-09-08 Thread Marton, Elek
Hi, I tried to summarize all of the information from different mail threads about the upcomming releases: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap Please fix it / let me know if you see any invalid data. I will try to follow the conversations and update accordingly. Two

[jira] [Created] (MAPREDUCE-6953) Skip the testcase testJobWithChangePriority if FairScheduler is used

2017-09-08 Thread Peter Bacsko (JIRA)
Peter Bacsko created MAPREDUCE-6953: --- Summary: Skip the testcase testJobWithChangePriority if FairScheduler is used Key: MAPREDUCE-6953 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6953

Re: 2017-09-07 Hadoop 3 release status update

2017-09-08 Thread Steve Loughran
On 8 Sep 2017, at 00:50, Andrew Wang > wrote: - HADOOP-14738 (Remove S3N and obsolete bits of S3A; rework docs): Steve has been actively revving this with our new committer Aaron