[jira] [Created] (HADOOP-14917) AdlFileSystem should support getStorageStatistics

2017-09-29 Thread John Zhuge (JIRA)
John Zhuge created HADOOP-14917: --- Summary: AdlFileSystem should support getStorageStatistics Key: HADOOP-14917 URL: https://issues.apache.org/jira/browse/HADOOP-14917 Project: Hadoop Common

2017-09-20 Hadoop 3 release status update

2017-09-29 Thread Andrew Wang
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+3+release+status+updates 2017-09-29 After about a month of slip, RC0 has been sent out for a VOTE. Focus now turns to GA, where we will attempt to keep the original beta1 target date (early November). Highlights: - RC0 vote was sent

[jira] [Created] (HADOOP-14916) Replace HdfsFileStatus constructors with a builder pattern.

2017-09-29 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HADOOP-14916: --- Summary: Replace HdfsFileStatus constructors with a builder pattern. Key: HADOOP-14916 URL: https://issues.apache.org/jira/browse/HADOOP-14916 Project:

2.9.0 Status Update [09/2017]

2017-09-29 Thread Subru Krishnan
Folks, Quick update on 2.9.0 release. Looks like we are looking at around a week of delay in the feature freeze: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap For feature owners, where the status is: 1. Green - no action required at this point. 2. Orange - revert with

Re: [DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-09-29 Thread Eric Yang
Hi Chris and Andrew, The intend is for new code to have better unit test cases without resort to invocation of miniHDFSCluster or miniYarnCluster. Existing code don’t require refactoring, if the test cases already have good coverages. I am currently working on part of YARN to improve YARN

Re: [DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-09-29 Thread Andrew Wang
Making code testable is about a lot more than your mocking library. In HDFS, the NameNode is very monolithic, so it's hard to instantiate little pieces of functionality in isolation and mock things out. I have my doubts that Powermock will help with this unless someone's willing to invest in

Re: H9 build slave is bad

2017-09-29 Thread Xiao Chen
Running into this again, filed https://issues.apache.org/jira/browse/INFRA-15194 Noticed some of the HDFS jobs succeeding even the job itself failed and says 'see HADOOP-13591' in the end. Though not my run wasn't that luck. :( -Xiao On Fri, Mar 10, 2017 at 10:19 AM, Sean Busbey

[jira] [Resolved] (HADOOP-14636) TestKDiag failing intermittently on Jenkins/Yetus at login from keytab

2017-09-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-14636. - Resolution: Duplicate you are right resolving. Doesn't fix the problem though. I think

Re: [DISCUSS] Merging API-based scheduler configuration to trunk/branch-2

2017-09-29 Thread larry mccay
Hi Jonathan - Thank you for bringing this up for discussion! I would personally like to see a specific security review of features like this - especially ones that allow for remote access to configuration. I'll take a look at the JIRA and see whether I can come up with any concerns or questions

Re: [DISCUSS] Merging API-based scheduler configuration to trunk/branch-2

2017-09-29 Thread Andrew Wang
Hi Jonathan, I'm okay with putting this into branch-3.0 for GA if it can be merged within the next two weeks. Even though beta1 has slipped by a month, I want to stick to the targeted GA data of Nov 1st as much as possible. Of course, let's not sacrifice quality or stability for speed; if

[DISCUSS] HADOOP-9122 Add power mock library for writing better unit tests

2017-09-29 Thread Eric Yang
Hi Hadoop-dev, Long time ago, Hadoop community decided to put Powermock on hold for unit tests. Both mockito and powermock has evolved a lot in the past 5 years. There are mature versions of both software, and there are compatibility charts to indicate which versions can work together.

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2017-09-29 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/542/ [Sep 28, 2017 12:10:26 PM] (weichiu) HDFS-12458. TestReencryptionWithKMS fails regularly. Contributed by Xiao [Sep 28, 2017 5:22:27 PM] (cliang) HDFS-12560. Remove the extra word it in HdfsUserGuide.md.