Re: Thinking ahead to hadoop-2.6

2014-11-05 Thread Arun C Murthy
Looks like most of the big ones are in. I'll try prod people into finishing up the rest and get an RC going this week. Thanks everyone! Arun On Oct 14, 2014, at 11:25 AM, Arun C Murthy a...@hortonworks.com wrote: 2.6.0 is close now. Here are the remaining blockers, I'm hoping cut an RC in

Hadoop-Hdfs-trunk - Build # 1923 - Failure

2014-11-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1923/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6165 lines...] [INFO] [INFO] ---

Build failed in Jenkins: Hadoop-Hdfs-trunk #1923

2014-11-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1923/changes Changes: [jing9] HDFS-7340. Make rollingUpgrade start/finalize idempotent. Contributed by Jing Zhao. [cnauroth] HADOOP-11165. TestUTF8 fails when run against java 8. Contributed by Stephen Chu. [wheat9] HADOOP-10847. Remove the

[jira] [Reopened] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe reopened HDFS-7199: DFSOutputStream should not silently drop data if DataStreamer crashes with an

[jira] [Resolved] (HDFS-7199) DFSOutputStream should not silently drop data if DataStreamer crashes with an unchecked exception

2014-11-05 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe resolved HDFS-7199. Resolution: Fixed Fix Version/s: (was: 2.7.0) 2.6.0

[jira] [Created] (HDFS-7360) Test libhdfs3 against MiniDFSCluster

2014-11-05 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7360: Summary: Test libhdfs3 against MiniDFSCluster Key: HDFS-7360 URL: https://issues.apache.org/jira/browse/HDFS-7360 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-7361) TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation.

2014-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7361: --- Summary: TestCheckpoint#testStorageAlreadyLockedErrorMessage fails after change of log message related to locking violation. Key: HDFS-7361 URL:

[jira] [Created] (HDFS-7362) Proxy user refresh won't modify or remove existing groups or hosts from super user list

2014-11-05 Thread Eric Payne (JIRA)
Eric Payne created HDFS-7362: Summary: Proxy user refresh won't modify or remove existing groups or hosts from super user list Key: HDFS-7362 URL: https://issues.apache.org/jira/browse/HDFS-7362 Project:

[jira] [Created] (HDFS-7363) Pluggable algorithms to form block groups in erasure coding

2014-11-05 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7363: --- Summary: Pluggable algorithms to form block groups in erasure coding Key: HDFS-7363 URL: https://issues.apache.org/jira/browse/HDFS-7363 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-7364) Balancer always show zero Bytes Already Moved

2014-11-05 Thread Tsz Wo Nicholas Sze (JIRA)
Tsz Wo Nicholas Sze created HDFS-7364: - Summary: Balancer always show zero Bytes Already Moved Key: HDFS-7364 URL: https://issues.apache.org/jira/browse/HDFS-7364 Project: Hadoop HDFS

[jira] [Created] (HDFS-7365) Remove hdfs.server.blockmanagement.MutableBlockCollection

2014-11-05 Thread Li Lu (JIRA)
Li Lu created HDFS-7365: --- Summary: Remove hdfs.server.blockmanagement.MutableBlockCollection Key: HDFS-7365 URL: https://issues.apache.org/jira/browse/HDFS-7365 Project: Hadoop HDFS Issue Type:

Re: Why do reads take as long as replicated writes?

2014-11-05 Thread Eitan Rosenfeld
Daemeon - Indeed, I neglected to mention that I am clearing the caches throughout my cluster before running the read benchmark. My expectation was to ideally get results that were proportionate to disk I/O, given that replicated writes perform twice the disk I/O relative to reads. I've verified

[jira] [Created] (HDFS-7366) BlockInfo should take replication as an short in the constructor

2014-11-05 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-7366: Summary: BlockInfo should take replication as an short in the constructor Key: HDFS-7366 URL: https://issues.apache.org/jira/browse/HDFS-7366 Project: Hadoop HDFS

[jira] [Created] (HDFS-7367) HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol.

2014-11-05 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-7367: --- Summary: HDFS short-circuit read cannot negotiate shared memory slot and file descriptors when SASL is enabled on DataTransferProtocol. Key: HDFS-7367 URL:

Build failed in Jenkins: Hadoop-Hdfs-trunk #1924

2014-11-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1924/changes Changes: [cnauroth] HADOOP-11265. Credential and Key Shell Commands not available on Windows. Contributed by Larry McCay. [shv] HDFS-7335. Redundant checkOperation() in FSN.analyzeFileState(). Contributed by Milan Desai. [shv]

Hadoop-Hdfs-trunk - Build # 1924 - Still Failing

2014-11-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1924/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6169 lines...] [mkdir] Created dir:

[jira] [Created] (HDFS-7369) Distribute parity block encoding work to DataNode via heartbeat

2014-11-05 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7369: --- Summary: Distribute parity block encoding work to DataNode via heartbeat Key: HDFS-7369 URL: https://issues.apache.org/jira/browse/HDFS-7369 Project: Hadoop HDFS