[jira] [Created] (HDFS-8203) Erasure Coding: Seek and other Ops in DFSStripedInputStream.

2015-04-21 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8203: Summary: Erasure Coding: Seek and other Ops in DFSStripedInputStream. Key: HDFS-8203 URL: https://issues.apache.org/jira/browse/HDFS-8203 Project: Hadoop HDFS Issue Type:

A replica waiting to be recovered does not provision read

2015-04-21 Thread lei liu
One block has three replicas, I restart all DataNodes, so the three replicas all are RWR state, When one dfs client read the file , that throw IOException. The visible length of RWR state replica is -1, why is not BytesOnDisk? Thanks, LiuLei

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #161

2015-04-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/161/changes Changes: [jianhe] YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe [rkanter] MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which

[jira] [Created] (HDFS-8205) fs -count -q -t -v -h displays wrong information

2015-04-21 Thread Peter Shi (JIRA)
Peter Shi created HDFS-8205: --- Summary: fs -count -q -t -v -h displays wrong information Key: HDFS-8205 URL: https://issues.apache.org/jira/browse/HDFS-8205 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-8204) Balancer: 2 replicas ends in same node after running balance.

2015-04-21 Thread Walter Su (JIRA)
Walter Su created HDFS-8204: --- Summary: Balancer: 2 replicas ends in same node after running balance. Key: HDFS-8204 URL: https://issues.apache.org/jira/browse/HDFS-8204 Project: Hadoop HDFS Issue

Build failed in Jenkins: Hadoop-Hdfs-trunk #2102

2015-04-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2102/changes Changes: [jianhe] YARN-3497. ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy. Contributed by Jason Lowe [rkanter] MAPREDUCE-6238. MR2 can't run local jobs with -libjars command options which is a

Re: committing HADOOP-11746 test-patch improvements

2015-04-21 Thread Allen Wittenauer
FYI, MAPREDUCE-6324 is the first JIRA to be tested with the new code in place if someone hasn’t seen the new output. On Apr 21, 2015, at 9:06 PM, Allen Wittenauer a...@altiscale.com wrote: Just a heads up that I’ll be committing this to trunk and branch-2 here in a bit. I’ll

[jira] [Created] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8212: - Summary: DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver Key: HDFS-8212 URL: https://issues.apache.org/jira/browse/HDFS-8212

[DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Vinod Kumar Vavilapalli
With 2.7.0 out of the way, and with more maintenance releases to stabilize it, I propose we start thinking about 2.8.0. Here's my first cut of the proposal, will update the Roadmap wiki. - Support *both* JDK7 and JDK8 runtimes: HADOOP-11090 - Compatibility tools to catch backwards, forwards

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
+ yarn-dev, hdfs-dev, mapred-dev On Tue, Apr 21, 2015 at 3:14 PM, Robert Kanter rkan...@cloudera.com wrote: Hi all, Moving forward on some of the discussions on Hadoop 3, I've created HADOOP-11858 to set the minimum version of Hadoop 3 to JDK 8. I just wanted to let everyone know in case

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Andrew Wang
I would also like to support Karthik's proposal on the release thread about version numbering. 2.7.0 being alpha is pretty confusing since all of the other 2.x releases since GA have been stable. I think users would prefer a version like 2.8.0-alpha1 instead, which is very clear and similar to

[jira] [Resolved] (HDFS-8204) Balancer: 2 replicas ends in same node after running balance.

2015-04-21 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su resolved HDFS-8204. - Resolution: Duplicate Balancer: 2 replicas ends in same node after running balance.

[jira] [Resolved] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8216. - Resolution: Fixed Hadoop Flags: Reviewed TestDFSStripedOutputStream should use BlockReaderTestUtil

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Chris Nauroth
Suppose we configure maven-compiler-plugin with source set to 1.7 but target set to 1.8 in trunk. I believe this would have the effect of generating JDK 8 bytecode, but enforcing that our code sticks to JDK 7 compatibility at compile time. Does that still satisfy requirements for HADOOP-11858?

[jira] [Resolved] (HDFS-8212) DistributedFileSystem.createErasureCodingZone should pass schema in FileSystemLinkResolver

2015-04-21 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8212. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed

[jira] [Created] (HDFS-8218) Move classes that used by ClientProtocol into hdfs-client

2015-04-21 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8218: Summary: Move classes that used by ClientProtocol into hdfs-client Key: HDFS-8218 URL: https://issues.apache.org/jira/browse/HDFS-8218 Project: Hadoop HDFS Issue

Re: Set minimum version of Hadoop 3 to JDK 8

2015-04-21 Thread Robert Kanter
Sure, I'll try to change the Jenkins builds to 1.8 first. On Tue, Apr 21, 2015 at 3:31 PM, Andrew Wang andrew.w...@cloudera.com wrote: Hey Robert, As a first step, could we try switching all our precommit and nightly builds over to use 1.8? This is a prerequisite for HADOOP-11858, and safe

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Vinod Kumar Vavilapalli
Thanks for your comment Karthik. Here's my take. Feature based release is going to put us back into the same prolonged release cycle. That is why I am proposing that we look at 2-3 months time and get whatever is ready. If we don't have even a single feature in by then, clearly we can drop the

[jira] [Created] (HDFS-8216) TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader

2015-04-21 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-8216: - Summary: TestDFSStripedOutputStream should use BlockReaderTestUtil to create BlockReader Key: HDFS-8216 URL: https://issues.apache.org/jira/browse/HDFS-8216

[jira] [Created] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

2015-04-21 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-8214: -- Summary: Secondary NN Web UI shows wrong date for Last Checkpoint Key: HDFS-8214 URL: https://issues.apache.org/jira/browse/HDFS-8214 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-8215) Refactor NamenodeFsck#check method

2015-04-21 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-8215: -- Summary: Refactor NamenodeFsck#check method Key: HDFS-8215 URL: https://issues.apache.org/jira/browse/HDFS-8215 Project: Hadoop HDFS Issue Type:

[jira] [Resolved] (HDFS-3108) [UI] Few Namenode links are not working

2015-04-21 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved HDFS-3108. Resolution: Duplicate [UI] Few Namenode links are not working

[jira] [Created] (HDFS-8208) Namenode reports stale block locations during decommissioning

2015-04-21 Thread James Mulcahy (JIRA)
James Mulcahy created HDFS-8208: --- Summary: Namenode reports stale block locations during decommissioning Key: HDFS-8208 URL: https://issues.apache.org/jira/browse/HDFS-8208 Project: Hadoop HDFS

[jira] [Created] (HDFS-8211) DataNode UUID is always null in the JMX counter

2015-04-21 Thread Anu Engineer (JIRA)
Anu Engineer created HDFS-8211: -- Summary: DataNode UUID is always null in the JMX counter Key: HDFS-8211 URL: https://issues.apache.org/jira/browse/HDFS-8211 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-8210) Ozone: Implement storage container manager

2015-04-21 Thread Jitendra Nath Pandey (JIRA)
Jitendra Nath Pandey created HDFS-8210: -- Summary: Ozone: Implement storage container manager Key: HDFS-8210 URL: https://issues.apache.org/jira/browse/HDFS-8210 Project: Hadoop HDFS

Re: [DISCUSS] Looking to a 2.8.0 release

2015-04-21 Thread Karthik Kambatla
The feature set here seems pretty long, even for 2 - 3 months. Can we come up with a minimum set of features (or a number of features) that justify a new minor release, and start stabilizing as soon as those are in? On Tue, Apr 21, 2015 at 2:39 PM, Vinod Kumar Vavilapalli vino...@apache.org

[jira] [Created] (HDFS-8206) Fix the typos in hadoop-hdfs-httpfs

2015-04-21 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-8206: -- Summary: Fix the typos in hadoop-hdfs-httpfs Key: HDFS-8206 URL: https://issues.apache.org/jira/browse/HDFS-8206 Project: Hadoop HDFS Issue