[jira] [Commented] (HDFS-7142) Implement a 2Q eviction strategy for HDFS-6581

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148823#comment-14148823 ] Arpit Agarwal commented on HDFS-7142: - Thanks for writing this up. Feedback below. In

[jira] [Created] (HDFS-7150) MissingBlocks 0 when all replicas are on decomm-in-progress nodes

2014-09-26 Thread Ming Ma (JIRA)
Ming Ma created HDFS-7150: - Summary: MissingBlocks 0 when all replicas are on decomm-in-progress nodes Key: HDFS-7150 URL: https://issues.apache.org/jira/browse/HDFS-7150 Project: Hadoop HDFS

[jira] [Updated] (HDFS-7129) Metrics to track usage of memory for writes

2014-09-26 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7129: - Attachment: HDFS-7129.0.patch Adding memory storage related metrics to DataNodeMetrics. Metrics to track

[jira] [Commented] (HDFS-6606) Optimize HDFS Encrypted Transport performance

2014-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148946#comment-14148946 ] Hadoop QA commented on HDFS-6606: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6914) Resolve huge memory consumption Issue with OIV processing PB-based fsimages

2014-09-26 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14148963#comment-14148963 ] ASF GitHub Bot commented on HDFS-6914: -- GitHub user haoch opened a pull request:

[jira] [Commented] (HDFS-7131) During HA upgrade, JournalNode should create a new committedTxnId file in the current directory

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149054#comment-14149054 ] Hudson commented on HDFS-7131: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7148) TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage merge

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149042#comment-14149042 ] Hudson commented on HDFS-7148: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7077) Separate CipherSuite from crypto protocol version

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149052#comment-14149052 ] Hudson commented on HDFS-7077: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149046#comment-14149046 ] Hudson commented on HDFS-7127: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149048#comment-14149048 ] Hudson commented on HDFS-6808: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149043#comment-14149043 ] Hudson commented on HDFS-7118: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149045#comment-14149045 ] Hudson commented on HDFS-7119: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7111) TestSafeMode assumes Unix line endings in safe mode tip.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149047#comment-14149047 ] Hudson commented on HDFS-7111: -- FAILURE: Integrated in Hadoop-Yarn-trunk #692 (See

[jira] [Commented] (HDFS-7011) Implement basic utilities for libhdfs3

2014-09-26 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149098#comment-14149098 ] Zhanwei Wang commented on HDFS-7011: Hi Colin I do not block SIGPIPE in worker thread

[jira] [Commented] (HDFS-7011) Implement basic utilities for libhdfs3

2014-09-26 Thread Zhanwei Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149122#comment-14149122 ] Zhanwei Wang commented on HDFS-7011: Hi Colin It is ok to use std::tr1::shared_ptr My

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149188#comment-14149188 ] Hudson commented on HDFS-6808: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149185#comment-14149185 ] Hudson commented on HDFS-7119: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149186#comment-14149186 ] Hudson commented on HDFS-7127: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7131) During HA upgrade, JournalNode should create a new committedTxnId file in the current directory

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149195#comment-14149195 ] Hudson commented on HDFS-7131: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149183#comment-14149183 ] Hudson commented on HDFS-7118: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7111) TestSafeMode assumes Unix line endings in safe mode tip.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149187#comment-14149187 ] Hudson commented on HDFS-7111: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7077) Separate CipherSuite from crypto protocol version

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149193#comment-14149193 ] Hudson commented on HDFS-7077: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Commented] (HDFS-7148) TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage merge

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149182#comment-14149182 ] Hudson commented on HDFS-7148: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1883 (See

[jira] [Created] (HDFS-7151) DFSInputStream method seek works incorrectly on huge HDFS block size

2014-09-26 Thread Andrew Rewoonenco (JIRA)
Andrew Rewoonenco created HDFS-7151: --- Summary: DFSInputStream method seek works incorrectly on huge HDFS block size Key: HDFS-7151 URL: https://issues.apache.org/jira/browse/HDFS-7151 Project:

[jira] [Commented] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149228#comment-14149228 ] Yongjun Zhang commented on HDFS-7036: - Another point to emphasize, the *root cause* of

[jira] [Commented] (HDFS-7148) TestEncryptionZones#testIsEncryptedMethod fails on branch-2 after archival storage merge

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149262#comment-14149262 ] Hudson commented on HDFS-7148: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7077) Separate CipherSuite from crypto protocol version

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149272#comment-14149272 ] Hudson commented on HDFS-7077: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7127) TestLeaseRecovery leaks MiniDFSCluster instances.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149266#comment-14149266 ] Hudson commented on HDFS-7127: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-6808) Add command line option to ask DataNode reload configuration.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149268#comment-14149268 ] Hudson commented on HDFS-6808: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7118) Improve diagnostics on storage directory rename operations by using NativeIO#renameTo in Storage#rename.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149263#comment-14149263 ] Hudson commented on HDFS-7118: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7111) TestSafeMode assumes Unix line endings in safe mode tip.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149267#comment-14149267 ] Hudson commented on HDFS-7111: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7119) Split error checks in AtomicFileOutputStream#close into separate conditions to improve diagnostics.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149265#comment-14149265 ] Hudson commented on HDFS-7119: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7131) During HA upgrade, JournalNode should create a new committedTxnId file in the current directory

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149274#comment-14149274 ] Hudson commented on HDFS-7131: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1908 (See

[jira] [Commented] (HDFS-7036) HDFS-6776 fix requires to upgrade insecure cluster, which means quite some user pain

2014-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149283#comment-14149283 ] Yongjun Zhang commented on HDFS-7036: - My understanding is that the main point of

[jira] [Created] (HDFS-7152) add command-line or configuration options for balancer (tweak speed)

2014-09-26 Thread Andrew Rewoonenco (JIRA)
Andrew Rewoonenco created HDFS-7152: --- Summary: add command-line or configuration options for balancer (tweak speed) Key: HDFS-7152 URL: https://issues.apache.org/jira/browse/HDFS-7152 Project:

[jira] [Updated] (HDFS-7151) DFSInputStream method seek works incorrectly on huge HDFS block size

2014-09-26 Thread Andrew Rewoonenco (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rewoonenco updated HDFS-7151: Affects Version/s: 3.0.0 DFSInputStream method seek works incorrectly on huge HDFS block

[jira] [Updated] (HDFS-7152) add command-line or configuration options for balancer (tweak speed)

2014-09-26 Thread Andrew Rewoonenco (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Rewoonenco updated HDFS-7152: Affects Version/s: (was: 2.6.0) 3.0.0 add command-line or

[jira] [Assigned] (HDFS-6934) Move checksum computation off the hot path when writing to RAM disk

2014-09-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze reassigned HDFS-6934: - Assignee: Tsz Wo Nicholas Sze Move checksum computation off the hot path when

[jira] [Updated] (HDFS-6934) Move checksum computation off the hot path when writing to RAM disk

2014-09-26 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6934: -- Description: Since local RAM is considered reliable we can avoid writing checksums on

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-26 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149572#comment-14149572 ] Plamen Jeliazkov commented on HDFS-3107: Seems the bot only tried to apply the

[jira] [Commented] (HDFS-6584) Support Archival Storage

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149590#comment-14149590 ] Hudson commented on HDFS-6584: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6119 (See

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149604#comment-14149604 ] Yongjun Zhang commented on HDFS-7146: - Hi [~aw], Thanks a lot for your input. Will a

[jira] [Updated] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7124: --- Attachment: HDFS-7124.002.patch Hi Andrew, Here's the rebased patch. I ran TestEncryptionZones

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149631#comment-14149631 ] Brandon Li commented on HDFS-7146: -- It seems not trivial to set nscd to cache all entries

[jira] [Assigned] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey reassigned HDFS-6904: -- Assignee: Jitendra Nath Pandey (was: Haohui Mai) YARN unable to renew

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Attachment: HDFS-6904.1.patch The attached patch adds optional parameters to the

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Status: Patch Available (was: Open) YARN unable to renew delegation token fetched

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-26 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149667#comment-14149667 ] stack commented on HDFS-6956: - bq. ...I think the most usual configuration to trace HBase +

[jira] [Updated] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6956: --- Target Version/s: 2.6.0 Affects Version/s: 2.6.0 Allow dynamically changing the

[jira] [Updated] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6956: --- Resolution: Fixed Status: Resolved (was: Patch Available) Committed. Thanks,

[jira] [Commented] (HDFS-6956) Allow dynamically changing the tracing level in Hadoop servers

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149695#comment-14149695 ] Hudson commented on HDFS-6956: -- FAILURE: Integrated in Hadoop-trunk-Commit #6120 (See

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149714#comment-14149714 ] Yongjun Zhang commented on HDFS-7146: - HI [~brandonli], Many thanks for your comment

[jira] [Updated] (HDFS-7137) HDFS Federation -- Adding a new Namenode to an existing HDFS cluster Document Has an Error

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7137: --- Affects Version/s: (was: 2.5.1) Status: Open (was: Patch Available) HDFS

[jira] [Updated] (HDFS-7137) HDFS Federation -- Adding a new Namenode to an existing HDFS cluster Document Has an Error

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-7137: --- Fix Version/s: (was: 2.5.1) HDFS Federation -- Adding a new Namenode to an existing HDFS

[jira] [Updated] (HDFS-6687) nn.getNamesystem() may return NPE from JspHelper

2014-09-26 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated HDFS-6687: Target Version/s: 2.6.0 (was: 2.5.0) nn.getNamesystem() may return NPE from JspHelper

[jira] [Commented] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149751#comment-14149751 ] Andrew Wang commented on HDFS-7124: --- Hey Charles, could we just make the zone optional in

[jira] [Updated] (HDFS-3107) HDFS truncate

2014-09-26 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-3107: --- Attachment: HDFS-3107.patch HDFS truncate - Key: HDFS-3107

[jira] [Updated] (HDFS-3107) HDFS truncate

2014-09-26 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Plamen Jeliazkov updated HDFS-3107: --- Attachment: (was: HDFS-3107.patch) HDFS truncate - Key:

[jira] [Commented] (HDFS-6877) Avoid calling checkDisk when an HDFS volume is removed during a write.

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149799#comment-14149799 ] Lei (Eddy) Xu commented on HDFS-6877: - The above failures are not related. I also run

[jira] [Updated] (HDFS-6664) HDFS permissions guide documentation states incorrect default group mapping class.

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-6664: --- Resolution: Fixed Fix Version/s: 2.6.0 Status: Resolved (was: Patch

[jira] [Commented] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149846#comment-14149846 ] Hadoop QA commented on HDFS-7124: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6664) HDFS permissions guide documentation states incorrect default group mapping class.

2014-09-26 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149855#comment-14149855 ] Hudson commented on HDFS-6664: -- SUCCESS: Integrated in Hadoop-trunk-Commit #6124 (See

[jira] [Commented] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149869#comment-14149869 ] Hadoop QA commented on HDFS-6904: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6826) Plugin interface to enable delegation of HDFS authorization assertions

2014-09-26 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149886#comment-14149886 ] Alejandro Abdelnur commented on HDFS-6826: -- [~daryn], thanks for the detailed

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-26 Thread Jeff Buell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Buell updated HDFS-7122: - Attachment: copies_per_slave.jpg Very poor distribution of replication copies

[jira] [Commented] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149923#comment-14149923 ] Arpit Agarwal commented on HDFS-7153: - I'll post a patch later today. Add

[jira] [Created] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-7153: --- Summary: Add storagePolicy to NN edit log during file creation Key: HDFS-7153 URL: https://issues.apache.org/jira/browse/HDFS-7153 Project: Hadoop HDFS Issue

[jira] [Work started] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-7153 started by Arpit Agarwal. --- Add storagePolicy to NN edit log during file creation

[jira] [Commented] (HDFS-7122) Very poor distribution of replication copies

2014-09-26 Thread Jeff Buell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149926#comment-14149926 ] Jeff Buell commented on HDFS-7122: -- I reproduced the issue on a 31-slave physical cluster,

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-26 Thread Jeff Buell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Buell updated HDFS-7122: - Attachment: copies_per_slave.jpg Very poor distribution of replication copies

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-26 Thread Jeff Buell (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Buell updated HDFS-7122: - Attachment: (was: copies_per_slave.jpg) Very poor distribution of replication copies

[jira] [Commented] (HDFS-7011) Implement basic utilities for libhdfs3

2014-09-26 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149948#comment-14149948 ] Colin Patrick McCabe commented on HDFS-7011: bq. My suggestion is to introduce

[jira] [Updated] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7153: Attachment: HDFS-7153.01.patch Add storagePolicy to NN edit log during file creation

[jira] [Updated] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7153: Status: Patch Available (was: In Progress) Add storagePolicy to NN edit log during file creation

[jira] [Updated] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7153: Attachment: HDFS-7153.01.patch Add storagePolicy to NN edit log during file creation

[jira] [Updated] (HDFS-7153) Add storagePolicy to NN edit log during file creation

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7153: Attachment: (was: HDFS-7153.01.patch) Add storagePolicy to NN edit log during file creation

[jira] [Created] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
Lei (Eddy) Xu created HDFS-7154: --- Summary: Fix returning value of starting reconfiguration task Key: HDFS-7154 URL: https://issues.apache.org/jira/browse/HDFS-7154 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-7093) Allow unprivileged users to set storage policy

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7093: Summary: Allow unprivileged users to set storage policy (was: Allow unprivileged users to set

[jira] [Updated] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7154: Attachment: HDFS-7154.000.patch Upload patch to fix return value from

[jira] [Updated] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7154: Status: Patch Available (was: Open) Fix returning value of starting reconfiguration task

[jira] [Updated] (HDFS-7093) Allow unprivileged users to set storage policy

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7093: Attachment: HDFS-7093.01.patch Initial patch to open {{setStoragePolicy}} to all users. Currently we

[jira] [Updated] (HDFS-7093) Allow unprivileged users to set storage policy

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-7093: Status: Patch Available (was: Open) Allow unprivileged users to set storage policy

[jira] [Comment Edited] (HDFS-7093) Allow unprivileged users to set storage policy

2014-09-26 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14149989#comment-14149989 ] Arpit Agarwal edited comment on HDFS-7093 at 9/26/14 9:19 PM: --

[jira] [Commented] (HDFS-6519) Document oiv_legacy command

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150018#comment-14150018 ] Allen Wittenauer commented on HDFS-6519: It looks good, except for one thing.

[jira] [Commented] (HDFS-3107) HDFS truncate

2014-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150020#comment-14150020 ] Hadoop QA commented on HDFS-3107: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7125) Report failures during adding or removing volumes

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7125: Description: The details of the failures during hot swapping volumes should be reported through RPC

[jira] [Updated] (HDFS-7125) Report failures during adding or removing volumes

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-7125: Description: The details of the failures during hot swapping volumes should be reported through RPC

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-26 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150059#comment-14150059 ] Brandon Li commented on HDFS-7146: -- [~yzhangal], on MacOS you can do the following: To

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-26 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150061#comment-14150061 ] Hadoop QA commented on HDFS-7154: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-26 Thread Charles Lamb (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7124: --- Attachment: HDFS-7124.003.patch Good idea. I've attached a new patch. I couldn't get to the FB

[jira] [Updated] (HDFS-4227) Document dfs.namenode.resource.*

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4227: --- Status: Patch Available (was: Open) Document dfs.namenode.resource.*

[jira] [Updated] (HDFS-4227) Document dfs.namenode.resource.*

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4227: --- Status: Open (was: Patch Available) Document dfs.namenode.resource.*

[jira] [Updated] (HDFS-4641) dfsadmin command reference is missing documentation for multiple commands

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4641: --- Status: Open (was: Patch Available) dfsadmin command reference is missing documentation for

[jira] [Updated] (HDFS-4641) dfsadmin command reference is missing documentation for multiple commands

2014-09-26 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated HDFS-4641: --- Status: Patch Available (was: Open) dfsadmin command reference is missing documentation for

[jira] [Commented] (HDFS-7124) Remove EncryptionZoneManager.NULL_EZ

2014-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150078#comment-14150078 ] Andrew Wang commented on HDFS-7124: --- Yea, the findbugs link is just broken, try this:

[jira] [Updated] (HDFS-7122) Very poor distribution of replication copies

2014-09-26 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-7122: -- Attachment: hdfs-7122-cdh5.1.2-testing.001.patch So the community is kept in the loop, I just gave Jeff

[jira] [Commented] (HDFS-7146) NFS ID/Group lookup requires SSSD enumeration on the server

2014-09-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150090#comment-14150090 ] Yongjun Zhang commented on HDFS-7146: - Thank you so much [~brandonli]! that's very

[jira] [Assigned] (HDFS-4324) Track and report out-of-date blocks separately from corrupt blocks

2014-09-26 Thread Juan Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Yu reassigned HDFS-4324: - Assignee: (was: Juan Yu) Track and report out-of-date blocks separately from corrupt blocks

[jira] [Commented] (HDFS-7154) Fix returning value of starting reconfiguration task

2014-09-26 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14150099#comment-14150099 ] Lei (Eddy) Xu commented on HDFS-7154: - The findbugs are all related to using System.out

[jira] [Updated] (HDFS-6904) YARN unable to renew delegation token fetched via webhdfs due to incorrect service port

2014-09-26 Thread Jitendra Nath Pandey (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jitendra Nath Pandey updated HDFS-6904: --- Status: Open (was: Patch Available) YARN unable to renew delegation token fetched

  1   2   >