[jira] [Created] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-10-08 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7208: - Summary: NN doesn't schedule replication when a DN storage fails Key: HDFS-7208 URL: https://issues.apache.org/jira/browse/HDFS-7208 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-10-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7208: -- Description: We found the following problem. When a storage device on a DN fails, NN continues to believe

[jira] [Updated] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-10-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-7208: -- Description: We found the following problem. When a storage device on a DN fails, NN continues to believe

[jira] [Commented] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-10-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163169#comment-14163169 ] Ming Ma commented on HDFS-7208: --- We can work around it by setting

[jira] [Commented] (HDFS-7196) Fix several issues of hadoop security configuration in user doc.

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163173#comment-14163173 ] Hadoop QA commented on HDFS-7196: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7010) boot up libhdfs3 project

2014-10-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163178#comment-14163178 ] Zhanwei Wang commented on HDFS-7010: Hi [~wheat9] You concern is absolutely

[jira] [Updated] (HDFS-7205) Delegation token for KMS should only be got once if it already exists

2014-10-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7205: - Attachment: HDFS-7205.001.patch Update the patch, and verify that dt for KMS is got once if it already exists in

[jira] [Updated] (HDFS-7205) Delegation token for KMS should only be got once if it already exists

2014-10-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7205: - Status: Patch Available (was: Open) Delegation token for KMS should only be got once if it already exists

[jira] [Commented] (HDFS-7014) Implement input and output streams to DataNode for native client

2014-10-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163227#comment-14163227 ] Zhanwei Wang commented on HDFS-7014: 1. missing encryption.proto and inotify.proto

[jira] [Updated] (HDFS-7014) Implement input and output streams to DataNode for native client

2014-10-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhanwei Wang updated HDFS-7014: --- Attachment: HDFS-7014-pnative.002.patch fix above issues Implement input and output streams to

[jira] [Commented] (HDFS-7200) Rename libhdfs3 to libndfs++

2014-10-08 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163239#comment-14163239 ] Zhanwei Wang commented on HDFS-7200: I prefer libhdfs++ too. Rename libhdfs3 to

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163240#comment-14163240 ] Vinayakumar B commented on HDFS-7175: - Below changes could serve the purpose mentioned

[jira] [Created] (HDFS-7209) Improve fs-encryption performance: fill the key queue when creating encryption zone

2014-10-08 Thread Yi Liu (JIRA)
Yi Liu created HDFS-7209: Summary: Improve fs-encryption performance: fill the key queue when creating encryption zone Key: HDFS-7209 URL: https://issues.apache.org/jira/browse/HDFS-7209 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7187) DomainSocketWatcher thread crashes causing datanode to leak connection threads

2014-10-08 Thread Maxim Ivanov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Maxim Ivanov resolved HDFS-7187. Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/HADOOP-10404

[jira] [Commented] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163268#comment-14163268 ] Vinayakumar B commented on HDFS-7203: - Good finding [~kihwal]. Your test reproduces the

[jira] [Created] (HDFS-7210) Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient

2014-10-08 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-7210: --- Summary: Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient Key: HDFS-7210 URL: https://issues.apache.org/jira/browse/HDFS-7210

[jira] [Commented] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163277#comment-14163277 ] Vinayakumar B commented on HDFS-7203: - Filed HDFS-7210 for the improvement Concurrent

[jira] [Updated] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-7175: Attachment: HDFS-7175.3.patch Thanks [~aw] and [~vinayrpet] for comments. Attaching a patch as

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163323#comment-14163323 ] Akira AJISAKA commented on HDFS-7175: - bq. elapsed time since the last flush adds a

[jira] [Commented] (HDFS-7186) Document the hadoop trace command.

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163362#comment-14163362 ] Hudson commented on HDFS-7186: -- FAILURE: Integrated in Hadoop-Yarn-trunk #705 (See

[jira] [Commented] (HDFS-7128) Decommission slows way down when it gets towards the end

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163358#comment-14163358 ] Hudson commented on HDFS-7128: -- FAILURE: Integrated in Hadoop-Yarn-trunk #705 (See

[jira] [Commented] (HDFS-7112) LazyWriter should use either async IO or one thread per physical disk

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163364#comment-14163364 ] Hudson commented on HDFS-7112: -- FAILURE: Integrated in Hadoop-Yarn-trunk #705 (See

[jira] [Updated] (HDFS-7209) fill the key queue when creating encryption zone

2014-10-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7209: - Summary: fill the key queue when creating encryption zone (was: Improve fs-encryption performance: fill the key

[jira] [Updated] (HDFS-7209) fill the key queue when creating encryption zone

2014-10-08 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-7209: - Issue Type: Sub-task (was: Improvement) Parent: HDFS-6891 fill the key queue when creating encryption

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163498#comment-14163498 ] Hadoop QA commented on HDFS-7175: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7128) Decommission slows way down when it gets towards the end

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163511#comment-14163511 ] Hudson commented on HDFS-7128: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1895 (See

[jira] [Commented] (HDFS-7112) LazyWriter should use either async IO or one thread per physical disk

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163517#comment-14163517 ] Hudson commented on HDFS-7112: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1895 (See

[jira] [Commented] (HDFS-7186) Document the hadoop trace command.

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163515#comment-14163515 ] Hudson commented on HDFS-7186: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1895 (See

[jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process

2014-10-08 Thread Ted Malaska (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163583#comment-14163583 ] Ted Malaska commented on HDFS-4420: --- What is the status on this Jira. I am interested in

[jira] [Commented] (HDFS-7186) Document the hadoop trace command.

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7186?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163593#comment-14163593 ] Hudson commented on HDFS-7186: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1920 (See

[jira] [Commented] (HDFS-7128) Decommission slows way down when it gets towards the end

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163589#comment-14163589 ] Hudson commented on HDFS-7128: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1920 (See

[jira] [Commented] (HDFS-7112) LazyWriter should use either async IO or one thread per physical disk

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163595#comment-14163595 ] Hudson commented on HDFS-7112: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1920 (See

[jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163600#comment-14163600 ] Hadoop QA commented on HDFS-4420: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7208) NN doesn't schedule replication when a DN storage fails

2014-10-08 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163615#comment-14163615 ] Daryn Sharp commented on HDFS-7208: --- I think #3 will be the minimally invasive change.

[jira] [Commented] (HDFS-4420) Provide a way to exclude subtree from balancing process

2014-10-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163623#comment-14163623 ] Yongjun Zhang commented on HDFS-4420: - HI [~malaskat], FYI, [~zhaoyunjiong] has been

[jira] [Updated] (HDFS-7210) Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient

2014-10-08 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7210: Attachment: HDFS-7210-001.patch Attached patch for the same. Changes: 1. Wrapping {{LocatedBlock}}

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-10-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163735#comment-14163735 ] Yongjun Zhang commented on HDFS-7146: - Hi [~aw], Thanks for your earlier review and

[jira] [Created] (HDFS-7211) Block invalidation work should be ordered

2014-10-08 Thread Zhe Zhang (JIRA)
Zhe Zhang created HDFS-7211: --- Summary: Block invalidation work should be ordered Key: HDFS-7211 URL: https://issues.apache.org/jira/browse/HDFS-7211 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-7212) Huge number of BLOCKED threads rendering DataNodes useless

2014-10-08 Thread Istvan Szukacs (JIRA)
Istvan Szukacs created HDFS-7212: Summary: Huge number of BLOCKED threads rendering DataNodes useless Key: HDFS-7212 URL: https://issues.apache.org/jira/browse/HDFS-7212 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7207) libhdfs3 should not expose exceptions in public C++ API

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7207: --- Summary: libhdfs3 should not expose exceptions in public C++ API (was: libhdfs3

[jira] [Commented] (HDFS-7207) libhdfs3 should not expose exceptions in public C++ API

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163818#comment-14163818 ] Colin Patrick McCabe commented on HDFS-7207: Just to get everyone up to speed

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163825#comment-14163825 ] Colin Patrick McCabe commented on HDFS-7199: I think it makes sense to wrap the

[jira] [Commented] (HDFS-7211) Block invalidation work should be ordered

2014-10-08 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163827#comment-14163827 ] Zhe Zhang commented on HDFS-7211: - [~tlipcon] We just encountered an issue where a DN is

[jira] [Commented] (HDFS-7185) The active NameNode will not accept an fsimage sent from the standby during rolling upgrade

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163839#comment-14163839 ] Colin Patrick McCabe commented on HDFS-7185: Thanks, Jing. I like the idea of

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163847#comment-14163847 ] Jason Lowe commented on HDFS-7199: -- bq. But I also wonder why you are getting a

[jira] [Updated] (HDFS-7014) Implement input and output streams to DataNode for native client

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7014: --- Assignee: Zhanwei Wang (was: Colin Patrick McCabe) Implement input and output

[jira] [Commented] (HDFS-7014) Implement input and output streams to DataNode for native client

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163865#comment-14163865 ] Colin Patrick McCabe commented on HDFS-7014: Hi Zhanwei, I'm going to assign

[jira] [Commented] (HDFS-7185) The active NameNode will not accept an fsimage sent from the standby during rolling upgrade

2014-10-08 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163873#comment-14163873 ] Jing Zhao commented on HDFS-7185: - hmm, in general we should update the VERSION file

[jira] [Commented] (HDFS-7200) Rename libhdfs3 to libndfs++

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163878#comment-14163878 ] Colin Patrick McCabe commented on HDFS-7200: bq. I prefer libhdfs++ than

[jira] [Commented] (HDFS-7199) DFSOutputStream can silently drop data if DataStreamer crashes with a non-I/O exception

2014-10-08 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14163889#comment-14163889 ] Colin Patrick McCabe commented on HDFS-7199: bq. The bug in the case we

[jira] [Created] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-7213: - Summary: processIncrementalBlockReport performance degradation Key: HDFS-7213 URL: https://issues.apache.org/jira/browse/HDFS-7213 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7195: Attachment: hadoop-site.tar.bz2 Update user doc of secure mode about Datanodes don't require root

[jira] [Updated] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7195: Attachment: HDFS-7195.1.patch Thank you for filing this issue, Yi. I've been meaning to do this,

[jira] [Updated] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7195: Component/s: documentation Target Version/s: 2.6.0 (was: 2.7.0) I'm targeting this for

[jira] [Updated] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7195: Status: Patch Available (was: Open) Update user doc of secure mode about Datanodes don't require

[jira] [Created] (HDFS-7214) Display the time when NN became active on the webUI

2014-10-08 Thread Siqi Li (JIRA)
Siqi Li created HDFS-7214: - Summary: Display the time when NN became active on the webUI Key: HDFS-7214 URL: https://issues.apache.org/jira/browse/HDFS-7214 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Assigned] (HDFS-7214) Display the time when NN became active on the webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned HDFS-7214: - Assignee: Siqi Li Display the time when NN became active on the webUI

[jira] [Commented] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164062#comment-14164062 ] Kihwal Lee commented on HDFS-7203: -- Thanks for the review, Vinay. Concurrent appending

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-7214: -- Description: The currently NN webUI displayed JVM start up. It will be useful to show when NN became active.

[jira] [Updated] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7203: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) I've

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-7214: -- Attachment: HDFS-7214.v1.patch Display the time when NN became active on the webUI

[jira] [Commented] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164083#comment-14164083 ] Hudson commented on HDFS-7203: -- FAILURE: Integrated in Hadoop-trunk-Commit #6214 (See

[jira] [Updated] (HDFS-7214) Display the time when NN became active on the webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-7214: -- Status: Patch Available (was: Open) Display the time when NN became active on the webUI

[jira] [Created] (HDFS-7215) Add gc log to NFS gateway

2014-10-08 Thread Brandon Li (JIRA)
Brandon Li created HDFS-7215: Summary: Add gc log to NFS gateway Key: HDFS-7215 URL: https://issues.apache.org/jira/browse/HDFS-7215 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Commented] (HDFS-5928) show namespace and namenode ID on NN dfshealth page

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164113#comment-14164113 ] Siqi Li commented on HDFS-5928: --- I think using MXBean is the way to pass information to the

[jira] [Updated] (HDFS-7210) Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient

2014-10-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7210: -- Component/s: hdfs-client Avoid two separate RPC's namenode.append() and

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164123#comment-14164123 ] Allen Wittenauer commented on HDFS-7146: The more and more I think about this, the

[jira] [Commented] (HDFS-7215) Add gc log to NFS gateway

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164126#comment-14164126 ] Allen Wittenauer commented on HDFS-7215: I'm not sure what work needs to be done

[jira] [Commented] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164131#comment-14164131 ] Hadoop QA commented on HDFS-7195: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7195) Update user doc of secure mode about Datanodes don't require root or jsvc

2014-10-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164139#comment-14164139 ] Chris Nauroth commented on HDFS-7195: - The test failure has to be unrelated, because

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164137#comment-14164137 ] Allen Wittenauer commented on HDFS-7175: It'd be good to hear from LinkedIn to see

[jira] [Assigned] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer reassigned HDFS-7204: -- Assignee: Allen Wittenauer balancer doesn't run as a daemon

[jira] [Updated] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7204: --- Attachment: HDFS-7204.patch -00: * Enables daemonization for balancer such that hdfs

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-10-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164201#comment-14164201 ] Yongjun Zhang commented on HDFS-7146: - Hi [~aw], Thanks for your input. I did some

[jira] [Updated] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7204: --- Attachment: HDFS-7204-01.patch -01: * Another minor fix: exec hdfs in stop-balancer.

[jira] [Updated] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7204: --- Status: Patch Available (was: Open) balancer doesn't run as a daemon

[jira] [Commented] (HDFS-5175) Provide clients a way to set IP header bits on connections

2014-10-08 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164219#comment-14164219 ] Ming Ma commented on HDFS-5175: --- [~cnauroth], thanks for the suggestion. We want the ability

[jira] [Commented] (HDFS-7215) Add gc log to NFS gateway

2014-10-08 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164221#comment-14164221 ] Brandon Li commented on HDFS-7215: -- Question is: should we turn it on all the time? Add

[jira] [Updated] (HDFS-7203) Concurrent appending to the same file can cause data corruption

2014-10-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7203: -- Component/s: hdfs-client Concurrent appending to the same file can cause data

[jira] [Updated] (HDFS-7210) Avoid two separate RPC's namenode.append() and namenode.getFileInfo() for an append call from DFSClient

2014-10-08 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-7210: -- Component/s: namenode Avoid two separate RPC's namenode.append() and

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7213: - Attachment: HDFS-7213.1412804753 processIncrementalBlockReport performance degradation

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7213: - Status: Patch Available (was: Open) processIncrementalBlockReport performance degradation

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164237#comment-14164237 ] Eric Payne commented on HDFS-7213: -- [~daryn], would you mind taking a look at this patch?

[jira] [Commented] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164238#comment-14164238 ] Hadoop QA commented on HDFS-7213: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164244#comment-14164244 ] Hadoop QA commented on HDFS-7204: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6673) Add Delimited format supports for PB OIV tool

2014-10-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6673: Attachment: HDFS-6673.002.patch Update the patch to use LevelDB as temporary external sorting

[jira] [Updated] (HDFS-6673) Add Delimited format supports for PB OIV tool

2014-10-08 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-6673: Status: Patch Available (was: Open) Add Delimited format supports for PB OIV tool

[jira] [Assigned] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li reassigned HDFS-6743: - Assignee: Siqi Li Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6743: -- Attachment: HDFS-6743.v1.patch Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6743: -- Status: Patch Available (was: Open) Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-7213) processIncrementalBlockReport performance degradation

2014-10-08 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated HDFS-7213: - Attachment: HDFS-7213.1412806496.txt Sorry, bad patch. This one should be better.

[jira] [Commented] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164281#comment-14164281 ] Hadoop QA commented on HDFS-6743: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164285#comment-14164285 ] Allen Wittenauer commented on HDFS-7204: Umm, I think Jenkins has gone nuts...

[jira] [Commented] (HDFS-7175) Client-side SocketTimeoutException during Fsck

2014-10-08 Thread Bob Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164290#comment-14164290 ] Bob Liu commented on HDFS-7175: --- I understand the complexity of adding the time based

[jira] [Commented] (HDFS-6673) Add Delimited format supports for PB OIV tool

2014-10-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164292#comment-14164292 ] Hadoop QA commented on HDFS-6673: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6743: -- Status: Patch Available (was: Open) Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6743: -- Status: Open (was: Patch Available) Put IP address into a new column on the new NN webUI

[jira] [Updated] (HDFS-6743) Put IP address into a new column on the new NN webUI

2014-10-08 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siqi Li updated HDFS-6743: -- Attachment: HDFS-6743.v2.patch Put IP address into a new column on the new NN webUI

[jira] [Commented] (HDFS-7204) balancer doesn't run as a daemon

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164325#comment-14164325 ] Allen Wittenauer commented on HDFS-7204: Manual run gives the expected:

[jira] [Commented] (HDFS-7215) Add gc log to NFS gateway

2014-10-08 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164339#comment-14164339 ] Allen Wittenauer commented on HDFS-7215: Nope, just like we don't for the namenode

  1   2   >