Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-07 Thread Vinod Kumar Vavilapalli
Thanks for starting this thread, Wangda! +1 for establishing a faster cadence now itself. One word of caution though. The same I expressed while we were trying to do both 2.8 and 3.0 releases at the same time. Please try avoiding concurrent releases and splitting community bandwidth - it's not

Re: [DISCUSS] Looking to a 2.9.0 release

2017-09-07 Thread Vrushali C
As I mentioned in the [VOTE] thread at [1], for Timeline Service v2, we are thinking about merging to branch2 some time in the next couple of weeks. So far, we have been maintaining a branch2 based YARN-5355_branch2 along with our trunk based feature branch YARN-5355. Varun Saxena has been

2017-09-07 Hadoop 3 release status update

2017-09-07 Thread Andrew Wang
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-09-07 Slightly early update since I'll be out tomorrow. We're one week out, and focus is on blocker burndown. Highlights: - 3.1.0 release planning is underway, led by Wangda. Target release date is in

Re: [VOTE] Merge yarn-native-services branch into trunk

2017-09-07 Thread Andrew Wang
Hi folks, This vote closes today. I see a -1 from Allen on inclusion in beta1. I see there's active fixing going on, but given that we're one week out from RC0, I think we should drop this from beta1. Allen, Jian, others, is this reasonable? What release should we retarget this for? I don't have

Re: [DISCUSS] Looking to Apache Hadoop 3.1 release

2017-09-07 Thread Wangda Tan
Thanks for all your valuable feedbacks. Regarding to security issues for alpha features: I completely agree with Larry: ideally, all alpha features should be disabled by default. Steve/Arun/Haibo: could you please comment about feature's rough merge plan and status (like alpha/beta). I will

Re: [DISCUSS] Looking to a 2.9.0 release

2017-09-07 Thread Iñigo Goiri
Hi Subru, We are also discussing the merge of HDFS-10467 (Router-based federation) and we would like to target 2.9 to do a full release together with YARN federation. Chris Douglas already arranged the integration into trunk for 3.0.0 GA. Regarding the points to cover: 1. API compatibility: we

Re: DISCUSS: Hadoop Compatability Guidelines

2017-09-07 Thread Steve Loughran
On 7 Sep 2017, at 19:13, Daniel Templeton > wrote: Good point. I think it would be valuable to enumerate the policies around the versioned state stores. We have the three you listed. We should probably include the HDFS fsimage in that list.

Re: DISCUSS: Hadoop Compatability Guidelines

2017-09-07 Thread Daniel Templeton
Good point.  I think it would be valuable to enumerate the policies around the versioned state stores.  We have the three you listed. We should probably include the HDFS fsimage in that list.  Any others? I also want to add a section that clarifies when it's OK to change the visibility or

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-07 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/516/ [Sep 6, 2017 6:51:51 AM] (cdouglas) HADOOP-12077. Provide a multi-URI replication Inode for ViewFs. [Sep 6, 2017 8:19:34 PM] (junping_du) YARN-7148. TestLogsCLI fails in trunk and branch-2 and javadoc

[jira] [Created] (MAPREDUCE-6952) Using DistributedCache.addFileToClasspath with a rename fragment fails during job submit

2017-09-07 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-6952: - Summary: Using DistributedCache.addFileToClasspath with a rename fragment fails during job submit Key: MAPREDUCE-6952 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6952

[jira] [Created] (MAPREDUCE-6951) Jobs fails when mapreduce.jobhistory.webapp.address is in wrong format

2017-09-07 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created MAPREDUCE-6951: Summary: Jobs fails when mapreduce.jobhistory.webapp.address is in wrong format Key: MAPREDUCE-6951 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6951