[jira] [Commented] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088928#comment-14088928 ] Arpit Agarwal commented on HDFS-6809: - +1 for the patch. Move some Balancer's inner

[jira] [Updated] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6812: Summary: Remove addBlock and replaceBlock from DatanodeDescriptor (was: Reomve addBlock and

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088933#comment-14088933 ] Hadoop QA commented on HDFS-6781: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088936#comment-14088936 ] Arpit Agarwal commented on HDFS-6812: - Nice little simplification. I think we can also

[jira] [Updated] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6809: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6506) Newly moved block replica been invalidated and deleted in TestBalancer

[ https://issues.apache.org/jira/browse/HDFS-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088966#comment-14088966 ] Hadoop QA commented on HDFS-6506: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088972#comment-14088972 ] Arpit Agarwal commented on HDFS-6781: - Hi Akira, thanks for your continued efforts to

[jira] [Commented] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088977#comment-14088977 ] Hudson commented on HDFS-6812: -- FAILURE: Integrated in Hadoop-trunk-Commit #6027 (See

[jira] [Commented] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088976#comment-14088976 ] Hudson commented on HDFS-6809: -- FAILURE: Integrated in Hadoop-trunk-Commit #6027 (See

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6781: Attachment: HDFS-6781.2.patch Thanks Arpit for the review. Modified site.xml to use HDFS Commands

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6781: Attachment: (was: HDFS-6781.2.patch) Separate HDFS commands from CommandsManual.apt.vm

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6781: Attachment: HDFS-6781.2.patch Separate HDFS commands from CommandsManual.apt.vm

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6781: Attachment: HDFS-6781-branch-2.2.patch Updated the patch for branch-2 also. Separate HDFS

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089031#comment-14089031 ] Hadoop QA commented on HDFS-6781: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6682) Add a metric to expose the timestamp of the oldest under-replicated block

[ https://issues.apache.org/jira/browse/HDFS-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089060#comment-14089060 ] Akira AJISAKA commented on HDFS-6682: - [~atm], would you please review this patch?

[jira] [Commented] (HDFS-6830) BlockManager.addStorage fails when DN updates storage

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089092#comment-14089092 ] Hadoop QA commented on HDFS-6830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6812: -- Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed

[jira] [Updated] (HDFS-6134) Transparent data at rest encryption

[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-6134: --- Attachment: HDFSDataatRestEncryption.pdf I've attached a document that discusses the general design

[jira] [Commented] (HDFS-6134) Transparent data at rest encryption

[ https://issues.apache.org/jira/browse/HDFS-6134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089124#comment-14089124 ] Hadoop QA commented on HDFS-6134: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089138#comment-14089138 ] Hudson commented on HDFS-6812: -- FAILURE: Integrated in Hadoop-Yarn-trunk #637 (See

[jira] [Commented] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089136#comment-14089136 ] Hudson commented on HDFS-6809: -- FAILURE: Integrated in Hadoop-Yarn-trunk #637 (See

[jira] [Created] (HDFS-6833) DirectoryScanner should not register a deleting block with memory of DataNode

Shinichi Yamashita created HDFS-6833: Summary: DirectoryScanner should not register a deleting block with memory of DataNode Key: HDFS-6833 URL: https://issues.apache.org/jira/browse/HDFS-6833

[jira] [Commented] (HDFS-6517) Remove hadoop-metrics2.properties from hdfs project

[ https://issues.apache.org/jira/browse/HDFS-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089226#comment-14089226 ] Hudson commented on HDFS-6517: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1830 (See

[jira] [Commented] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089222#comment-14089222 ] Hudson commented on HDFS-6791: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1830 (See

[jira] [Commented] (HDFS-6812) Remove addBlock and replaceBlock from DatanodeDescriptor

[ https://issues.apache.org/jira/browse/HDFS-6812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089225#comment-14089225 ] Hudson commented on HDFS-6812: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1830 (See

[jira] [Commented] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089223#comment-14089223 ] Hudson commented on HDFS-6809: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1830 (See

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089247#comment-14089247 ] Daryn Sharp commented on HDFS-6776: --- Sorry, but this patch is completely wrong. # If

[jira] [Commented] (HDFS-6809) Move some Balancer's inner classes to standalone classes

[ https://issues.apache.org/jira/browse/HDFS-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089302#comment-14089302 ] Hudson commented on HDFS-6809: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1856 (See

[jira] [Commented] (HDFS-6791) A block could remain under replicated if all of its replicas are on decommissioned nodes

[ https://issues.apache.org/jira/browse/HDFS-6791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089301#comment-14089301 ] Hudson commented on HDFS-6791: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1856 (See

[jira] [Commented] (HDFS-6517) Remove hadoop-metrics2.properties from hdfs project

[ https://issues.apache.org/jira/browse/HDFS-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089305#comment-14089305 ] Hudson commented on HDFS-6517: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1856 (See

[jira] [Commented] (HDFS-6776) distcp from insecure cluster (source) to secure cluster (destination) doesn't work

[ https://issues.apache.org/jira/browse/HDFS-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089372#comment-14089372 ] Yongjun Zhang commented on HDFS-6776: - HI [~daryn], thank you so much for the very

[jira] [Commented] (HDFS-6782) Improve FS editlog logSync

[ https://issues.apache.org/jira/browse/HDFS-6782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089402#comment-14089402 ] Daryn Sharp commented on HDFS-6782: --- Edit logging is pretty tricky. I need to think

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6781: Attachment: HDFS-6781.3.patch Resubmitting the trunk patch with a different name for Jenkins.

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089410#comment-14089410 ] Arpit Agarwal commented on HDFS-6781: - +1 pending Jenkins. Separate HDFS commands

[jira] [Updated] (HDFS-6828) Separate block replica dispatching from Balancer

[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6828: -- Status: Patch Available (was: Open) Separate block replica dispatching from Balancer

[jira] [Updated] (HDFS-6828) Separate block replica dispatching from Balancer

[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6828: -- Attachment: h6828_20140808.patch h6828_20140808.patch: separates Dispatcher from

[jira] [Commented] (HDFS-6831) Inconsistency between 'hdfs dfsadmin' and 'hdfs dfsadmin -help'

[ https://issues.apache.org/jira/browse/HDFS-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089505#comment-14089505 ] Jing Zhao commented on HDFS-6831: - Also in dfsadmin -help there are only a couple of

[jira] [Created] (HDFS-6834) Improve the configuration guidance in DFSClient when there are no Codec classes found in configs

Uma Maheswara Rao G created HDFS-6834: - Summary: Improve the configuration guidance in DFSClient when there are no Codec classes found in configs Key: HDFS-6834 URL:

[jira] [Updated] (HDFS-6834) Improve the configuration guidance in DFSClient when there are no Codec classes found in configs

[ https://issues.apache.org/jira/browse/HDFS-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6834: -- Attachment: HDFS-6834.patch Attached simple patch handle. Improve the configuration

[jira] [Updated] (HDFS-6830) BlockManager.addStorage fails when DN updates storage

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6830: Attachment: HDFS-6830.02.patch Rebase patch after HDFS-6812 commit. BlockManager.addStorage fails

[jira] [Commented] (HDFS-6803) Documenting DFSClient#DFSInputStream expectations reading and preading in concurrent context

[ https://issues.apache.org/jira/browse/HDFS-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089546#comment-14089546 ] stack commented on HDFS-6803: - [~cmccabe] Thanks for the very nice feedback. Let me

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089597#comment-14089597 ] Arpit Agarwal commented on HDFS-6772: - [~mingma], I was unsure whether this delta can

[jira] [Resolved] (HDFS-6821) Atomicity of multi file operations

[ https://issues.apache.org/jira/browse/HDFS-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-6821. - Resolution: Won't Fix Hi, [~samera]. Ideas similar to this have been proposed several times.

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089650#comment-14089650 ] Arpit Agarwal commented on HDFS-6772: - Also the test case should be wrapped in try..

[jira] [Commented] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089653#comment-14089653 ] Arpit Agarwal commented on HDFS-6425: - Hi Ming, is this problem mitigated by your fix

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089670#comment-14089670 ] Hadoop QA commented on HDFS-6781: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6825: Attachment: HDFS-6825.001.patch Edit log corruption due to delayed block removal

[jira] [Commented] (HDFS-6821) Atomicity of multi file operations

[ https://issues.apache.org/jira/browse/HDFS-6821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089671#comment-14089671 ] Samer Al-Kiswany commented on HDFS-6821: I see. Thanks Chris. -samer Atomicity

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6781: Issue Type: Improvement (was: Bug) Separate HDFS commands from CommandsManual.apt.vm

[jira] [Updated] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6825: Status: Patch Available (was: Open) Submit patch 001 to address the issue. Two additional issues

[jira] [Commented] (HDFS-6828) Separate block replica dispatching from Balancer

[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089690#comment-14089690 ] Hadoop QA commented on HDFS-6828: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6781: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target

[jira] [Commented] (HDFS-6781) Separate HDFS commands from CommandsManual.apt.vm

[ https://issues.apache.org/jira/browse/HDFS-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089705#comment-14089705 ] Hudson commented on HDFS-6781: -- FAILURE: Integrated in Hadoop-trunk-Commit #6030 (See

[jira] [Commented] (HDFS-6834) Improve the configuration guidance in DFSClient when there are no Codec classes found in configs

[ https://issues.apache.org/jira/browse/HDFS-6834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089758#comment-14089758 ] Andrew Wang commented on HDFS-6834: --- +1 thanks Uma Improve the configuration guidance

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089828#comment-14089828 ] stack commented on HDFS-6766: - Ran tests with 10 concurrent writers to a HDFS file hosted on a

[jira] [Commented] (HDFS-6766) optimize ack notify mechanism to avoid thundering herd issue

[ https://issues.apache.org/jira/browse/HDFS-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089847#comment-14089847 ] stack commented on HDFS-6766: - 5-10% improvement in context switches. That said, tests with

[jira] [Updated] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6772: -- Attachment: HDFS-6772-2.patch Thanks, Arpit. Here is the updated patch to address the issues you raised. I

[jira] [Commented] (HDFS-6830) BlockManager.addStorage fails when DN updates storage

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089903#comment-14089903 ] Hadoop QA commented on HDFS-6830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6830) BlockManager.addStorage fails when DN updates storage

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6830: Attachment: HDFS-6830.03.patch Fix test case. BlockManager.addStorage fails when DN updates

[jira] [Commented] (HDFS-6425) Large postponedMisreplicatedBlocks has impact on blockReport latency

[ https://issues.apache.org/jira/browse/HDFS-6425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089967#comment-14089967 ] Ming Ma commented on HDFS-6425: --- Thanks, Arpit. This jira can address more common NN failover

[jira] [Commented] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089969#comment-14089969 ] Hadoop QA commented on HDFS-6825: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089980#comment-14089980 ] Aaron T. Myers commented on HDFS-6728: -- Thanks, Eddy. I agree that the test failure is

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089983#comment-14089983 ] Arpit Agarwal commented on HDFS-6772: - Thanks Ming. The patch looks good. Following

[jira] [Commented] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089986#comment-14089986 ] Lei (Eddy) Xu commented on HDFS-6728: - Great! Thank you for the reviews, [~atm].

[jira] [Updated] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6728: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Commented] (HDFS-6740) FSDataset adds data volumes dynamically

[ https://issues.apache.org/jira/browse/HDFS-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14089998#comment-14089998 ] Aaron T. Myers commented on HDFS-6740: -- Pretty confident that the test failure is

[jira] [Updated] (HDFS-6740) Make FSDataset support adding data volumes dynamically

[ https://issues.apache.org/jira/browse/HDFS-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6740: - Summary: Make FSDataset support adding data volumes dynamically (was: FSDataset adds data

[jira] [Updated] (HDFS-6740) Make FSDataset support adding data volumes dynamically

[ https://issues.apache.org/jira/browse/HDFS-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6740: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status:

[jira] [Updated] (HDFS-6828) Separate block replica dispatching from Balancer

[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6828: -- Attachment: h6828_20140808b.patch h6828_20140808b.patch: fixes some bugs. Separate

[jira] [Commented] (HDFS-6728) Dynamically add new volumes to DataStorage, formatted if necessary.

[ https://issues.apache.org/jira/browse/HDFS-6728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090033#comment-14090033 ] Hudson commented on HDFS-6728: -- FAILURE: Integrated in Hadoop-trunk-Commit #6033 (See

[jira] [Commented] (HDFS-6740) Make FSDataset support adding data volumes dynamically

[ https://issues.apache.org/jira/browse/HDFS-6740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090035#comment-14090035 ] Hudson commented on HDFS-6740: -- FAILURE: Integrated in Hadoop-trunk-Commit #6033 (See

[jira] [Created] (HDFS-6835) Archival Storage: Add a new API to set storage policy

Tsz Wo Nicholas Sze created HDFS-6835: - Summary: Archival Storage: Add a new API to set storage policy Key: HDFS-6835 URL: https://issues.apache.org/jira/browse/HDFS-6835 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090053#comment-14090053 ] Hadoop QA commented on HDFS-6772: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6774) Make FsDataset and DataStore support removing volumes.

[ https://issues.apache.org/jira/browse/HDFS-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6774: Summary: Make FsDataset and DataStore support removing volumes. (was: Remove volumes from

[jira] [Updated] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-6772: -- Attachment: HDFS-6772-3.patch Thanks, Arpit. Here is the updated patch. The reason I renamed from stale

[jira] [Updated] (HDFS-6774) Make FsDataset and DataStore support removing volumes.

[ https://issues.apache.org/jira/browse/HDFS-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6774: Attachment: HDFS-6774.000.patch This patch enables {{FsDataset}} and {{DataStorage}} to remove data

[jira] [Updated] (HDFS-6774) Make FsDataset and DataStore support removing volumes.

[ https://issues.apache.org/jira/browse/HDFS-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6774: Status: Patch Available (was: Open) Make FsDataset and DataStore support removing volumes.

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090097#comment-14090097 ] Arpit Agarwal commented on HDFS-6772: - Thanks Ming, I think we can clarify that

[jira] [Updated] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-6826: - Target Version/s: 2.6.0 Plugin interface to enable delegation of HDFS authorization assertions

[jira] [Updated] (HDFS-6758) block writer should pass the expected block size to DataXceiverServer

[ https://issues.apache.org/jira/browse/HDFS-6758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6758: Issue Type: Improvement (was: Bug) block writer should pass the expected block size to

[jira] [Updated] (HDFS-6825) Edit log corruption due to delayed block removal

[ https://issues.apache.org/jira/browse/HDFS-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-6825: Attachment: HDFS-6825.002.patch Upload patch 002 to address test failure. Edit log corruption

[jira] [Commented] (HDFS-6830) BlockManager.addStorage fails when DN updates storage

[ https://issues.apache.org/jira/browse/HDFS-6830?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090253#comment-14090253 ] Hadoop QA commented on HDFS-6830: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6828) Separate block replica dispatching from Balancer

[ https://issues.apache.org/jira/browse/HDFS-6828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090274#comment-14090274 ] Hadoop QA commented on HDFS-6828: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6722) Display readable last contact time for dead nodes on NN webUI

[ https://issues.apache.org/jira/browse/HDFS-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6722: - Resolution: Fixed Fix Version/s: 2.6.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-6774) Make FsDataset and DataStore support removing volumes.

[ https://issues.apache.org/jira/browse/HDFS-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090315#comment-14090315 ] Hadoop QA commented on HDFS-6774: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6772) Get DNs out of blockContentsStale==true state faster when NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090317#comment-14090317 ] Hadoop QA commented on HDFS-6772: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6722) Display readable last contact time for dead nodes on NN webUI

[ https://issues.apache.org/jira/browse/HDFS-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090323#comment-14090323 ] Hudson commented on HDFS-6722: -- FAILURE: Integrated in Hadoop-trunk-Commit #6035 (See

[jira] [Updated] (HDFS-6772) Get DN storages out of blockContentsStale state faster after NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6772: Summary: Get DN storages out of blockContentsStale state faster after NN restarts (was: Get DNs

[jira] [Updated] (HDFS-6772) Get DN storages out of blockContentsStale state faster after NN restarts

[ https://issues.apache.org/jira/browse/HDFS-6772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6772: Resolution: Fixed Fix Version/s: 2.6.0 3.0.0 Target