[jira] [Commented] (HDFS-6621) Hadoop Balancer prematurely exits iterations

[ https://issues.apache.org/jira/browse/HDFS-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058496#comment-14058496 ] Rafal Wojdyla commented on HDFS-6621: - We have also experience this problem with

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058629#comment-14058629 ] Hudson commented on HDFS-6631: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

[ https://issues.apache.org/jira/browse/HDFS-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058627#comment-14058627 ] Hudson commented on HDFS-6647: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (HDFS-6640) [ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).

[ https://issues.apache.org/jira/browse/HDFS-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058625#comment-14058625 ] Hudson commented on HDFS-6640: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (HDFS-6630) Unable to fetch the block information by Browsing the file system on Namenode UI through IE9

[ https://issues.apache.org/jira/browse/HDFS-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058626#comment-14058626 ] Hudson commented on HDFS-6630: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (HDFS-5202) Support Centralized Cache Management on Windows.

[ https://issues.apache.org/jira/browse/HDFS-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058624#comment-14058624 ] Hudson commented on HDFS-5202: -- FAILURE: Integrated in Hadoop-Yarn-trunk #610 (See

[jira] [Commented] (HDFS-6376) Distcp data between two HA clusters requires another configuration

[ https://issues.apache.org/jira/browse/HDFS-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058686#comment-14058686 ] Dave Marion commented on HDFS-6376: --- I don't like the behavior of the change in DFSUtil

[jira] [Commented] (HDFS-5202) Support Centralized Cache Management on Windows.

[ https://issues.apache.org/jira/browse/HDFS-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058764#comment-14058764 ] Hudson commented on HDFS-5202: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

[ https://issues.apache.org/jira/browse/HDFS-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058767#comment-14058767 ] Hudson commented on HDFS-6647: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (HDFS-6640) [ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).

[ https://issues.apache.org/jira/browse/HDFS-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058765#comment-14058765 ] Hudson commented on HDFS-6640: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058769#comment-14058769 ] Hudson commented on HDFS-6631: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (HDFS-6630) Unable to fetch the block information by Browsing the file system on Namenode UI through IE9

[ https://issues.apache.org/jira/browse/HDFS-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058766#comment-14058766 ] Hudson commented on HDFS-6630: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1828 (See

[jira] [Commented] (HDFS-6640) [ Web HDFS ] Syntax for MKDIRS, CREATESYMLINK, and SETXATTR are given wrongly(missed webhdfs/v1).).

[ https://issues.apache.org/jira/browse/HDFS-6640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058803#comment-14058803 ] Hudson commented on HDFS-6640: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (HDFS-5202) Support Centralized Cache Management on Windows.

[ https://issues.apache.org/jira/browse/HDFS-5202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058802#comment-14058802 ] Hudson commented on HDFS-5202: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (HDFS-6630) Unable to fetch the block information by Browsing the file system on Namenode UI through IE9

[ https://issues.apache.org/jira/browse/HDFS-6630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058804#comment-14058804 ] Hudson commented on HDFS-6630: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (HDFS-6647) Edit log corruption when pipeline recovery occurs for deleted file present in snapshot

[ https://issues.apache.org/jira/browse/HDFS-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058805#comment-14058805 ] Hudson commented on HDFS-6647: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (HDFS-6631) TestPread#testHedgedReadLoopTooManyTimes fails intermittently.

[ https://issues.apache.org/jira/browse/HDFS-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058807#comment-14058807 ] Hudson commented on HDFS-6631: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #1801 (See

[jira] [Commented] (HDFS-6569) OOB message can't be sent to the client when DataNode shuts down for upgrade

[ https://issues.apache.org/jira/browse/HDFS-6569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058836#comment-14058836 ] Kihwal Lee commented on HDFS-6569: -- Sorry for the delay. I looked at the patch and the

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058997#comment-14058997 ] Todd Lipcon commented on HDFS-6560: --- Nice benchmark results. Worth noting that your

[jira] [Commented] (HDFS-5624) Add tests for ACLs in combination with viewfs.

[ https://issues.apache.org/jira/browse/HDFS-5624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059018#comment-14059018 ] Stephen Chu commented on HDFS-5624: --- The above failing unit tests are unrelated to this

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059035#comment-14059035 ] Tsz Wo Nicholas Sze commented on HDFS-6560: --- For CRC32C, I have no problem to use

[jira] [Moved] (HDFS-6667) In HDFS HA mode, Distcp/SLive with webhdfs on secure cluster fails with Client cannot authenticate via:[TOKEN, KERBEROS] error

[ https://issues.apache.org/jira/browse/HDFS-6667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao moved HADOOP-10519 to HDFS-6667: -- Component/s: (was: security) security Key:

[jira] [Created] (HDFS-6668) Add and expose KeyProvider-related metrics on NameNode

Andrew Wang created HDFS-6668: - Summary: Add and expose KeyProvider-related metrics on NameNode Key: HDFS-6668 URL: https://issues.apache.org/jira/browse/HDFS-6668 Project: Hadoop HDFS Issue

[jira] [Updated] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6474: -- Attachment: hdfs-6474.002.patch Thanks for the reviews all. New patch attached incorporating Charles'

[jira] [Commented] (HDFS-2976) Remove unnecessary method (tokenRefetchNeeded) in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059156#comment-14059156 ] Chris Nauroth commented on HDFS-2976: - This patch was only committed to trunk and not

[jira] [Commented] (HDFS-3851) Make DFSOuputSteram$Packet default constructor reuse the other constructor

[ https://issues.apache.org/jira/browse/HDFS-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059158#comment-14059158 ] Chris Nauroth commented on HDFS-3851: - This patch was committed to trunk only and not

[jira] [Updated] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6474: -- Attachment: hdfs-6474.002.patch new patch, fixed a small typo Namenode needs to get the actual keys

[jira] [Updated] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6474: -- Attachment: (was: hdfs-6474.002.patch) Namenode needs to get the actual keys and iv from the

[jira] [Created] (HDFS-6669) Fix 1 space misalignment in FileSystem class

Henry Saputra created HDFS-6669: --- Summary: Fix 1 space misalignment in FileSystem class Key: HDFS-6669 URL: https://issues.apache.org/jira/browse/HDFS-6669 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated HDFS-6669: Attachment: HDFS-6669.patch Proposed patch attached. Fix 1 space misalignment in FileSystem class

[jira] [Commented] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059238#comment-14059238 ] Henry Saputra commented on HDFS-6669: - Working on this one. Fix 1 space misalignment

[jira] [Updated] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated HDFS-6669: Priority: Trivial (was: Major) Fix 1 space misalignment in FileSystem class

[jira] [Updated] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henry Saputra updated HDFS-6669: Status: Patch Available (was: Open) Fix 1 space misalignment in FileSystem class

[jira] [Commented] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059262#comment-14059262 ] Charles Lamb commented on HDFS-6474: I think this comment in EZM.java: @return if the

[jira] [Commented] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059289#comment-14059289 ] Hadoop QA commented on HDFS-6669: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059302#comment-14059302 ] Henry Saputra commented on HDFS-6669: - No need to add new tests since this is just

[jira] [Updated] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6474: -- Attachment: hdfs-6474.003.patch New patch attached with doc fix, will commit shortly. Namenode needs

[jira] [Resolved] (HDFS-6474) Namenode needs to get the actual keys and iv from the KeyProvider

[ https://issues.apache.org/jira/browse/HDFS-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6474. --- Resolution: Fixed Fix Version/s: fs-encryption (HADOOP-10150 and HDFS-6134) Namenode needs to

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059358#comment-14059358 ] Todd Lipcon commented on HDFS-6560: --- Sure, makes sense. I just think that discussion

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059362#comment-14059362 ] Todd Lipcon commented on HDFS-6560: --- BTW, I'd add that, per your findings, native is

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059392#comment-14059392 ] Tsz Wo Nicholas Sze commented on HDFS-6560: --- Hi Todd, for bytesPerChecksum ==

[jira] [Commented] (HDFS-6560) Byte array native checksumming on DN side

[ https://issues.apache.org/jira/browse/HDFS-6560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059413#comment-14059413 ] Todd Lipcon commented on HDFS-6560: --- I think using GetPrimitiveArrayCritical, our

[jira] [Commented] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059417#comment-14059417 ] Andrew Wang commented on HDFS-6669: --- Hi Henry, This is the kind of thing we'd actually

[jira] [Commented] (HDFS-2976) Remove unnecessary method (tokenRefetchNeeded) in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059420#comment-14059420 ] Hudson commented on HDFS-2976: -- FAILURE: Integrated in Hadoop-trunk-Commit #5871 (See

[jira] [Updated] (HDFS-2976) Remove unnecessary method (tokenRefetchNeeded) in DFSClient

[ https://issues.apache.org/jira/browse/HDFS-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2976: Target Version/s: 0.24.0, 2.6.0 (was: 0.24.0) Fix Version/s: 2.6.0 I merged this to

[jira] [Commented] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059438#comment-14059438 ] Henry Saputra commented on HDFS-6669: - Hi [~andrew.wang], thanks for the update. Ah ok

[jira] [Updated] (HDFS-6669) Fix 1 space misalignment in FileSystem class

[ https://issues.apache.org/jira/browse/HDFS-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6669: -- Resolution: Won't Fix Status: Resolved (was: Patch Available) After discussion with Henry, we

[jira] [Created] (HDFS-6670) Archival Storage: Add block storage policy

Tsz Wo Nicholas Sze created HDFS-6670: - Summary: Archival Storage: Add block storage policy Key: HDFS-6670 URL: https://issues.apache.org/jira/browse/HDFS-6670 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-6671) Archival Storage: Consider block storage policy in replicaiton

Tsz Wo Nicholas Sze created HDFS-6671: - Summary: Archival Storage: Consider block storage policy in replicaiton Key: HDFS-6671 URL: https://issues.apache.org/jira/browse/HDFS-6671 Project: Hadoop

[jira] [Updated] (HDFS-3851) Make DFSOuputSteram$Packet default constructor reuse the other constructor

[ https://issues.apache.org/jira/browse/HDFS-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-3851: Fix Version/s: 2.6.0 I merged this to branch-2. Make DFSOuputSteram$Packet default constructor

[jira] [Commented] (HDFS-6584) Support archival storage

[ https://issues.apache.org/jira/browse/HDFS-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059448#comment-14059448 ] Tsz Wo Nicholas Sze commented on HDFS-6584: --- I just have created a branch

[jira] [Updated] (HDFS-6670) Archival Storage: Add block storage policy

[ https://issues.apache.org/jira/browse/HDFS-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6670: -- Description: Support block storage policy such as the table below. ||ID||Policy Name ||

[jira] [Commented] (HDFS-3851) Make DFSOuputSteram$Packet default constructor reuse the other constructor

[ https://issues.apache.org/jira/browse/HDFS-3851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059453#comment-14059453 ] Hudson commented on HDFS-3851: -- FAILURE: Integrated in Hadoop-trunk-Commit #5873 (See

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Attachment: HDFS-2856-branch-2.7.patch Fix block protocol so that Datanodes don't require root or

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Status: Open (was: Patch Available) Fix block protocol so that Datanodes don't require root or

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Attachment: HDFS-2856.7.patch I'm attaching a v7 trunk patch, and also a v7 branch-2 patch. I

[jira] [Updated] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-2856: Status: Patch Available (was: Open) Fix block protocol so that Datanodes don't require root or

[jira] [Created] (HDFS-6672) Regression with hdfs oiv tool

Lei (Eddy) Xu created HDFS-6672: --- Summary: Regression with hdfs oiv tool Key: HDFS-6672 URL: https://issues.apache.org/jira/browse/HDFS-6672 Project: Hadoop HDFS Issue Type: Bug Affects

[jira] [Created] (HDFS-6673) Add Delimited format supports for PB OIV tool

Lei (Eddy) Xu created HDFS-6673: --- Summary: Add Delimited format supports for PB OIV tool Key: HDFS-6673 URL: https://issues.apache.org/jira/browse/HDFS-6673 Project: Hadoop HDFS Issue Type:

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059617#comment-14059617 ] Hadoop QA commented on HDFS-2856: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6670) Archival Storage: Add block storage policy

[ https://issues.apache.org/jira/browse/HDFS-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-6670: -- Attachment: h6670_20140711.patch h6670_20140711.patch: 1st patch. Archival Storage:

[jira] [Commented] (HDFS-2856) Fix block protocol so that Datanodes don't require root or jsvc

[ https://issues.apache.org/jira/browse/HDFS-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14059656#comment-14059656 ] Chris Nauroth commented on HDFS-2856: - The most recent round of test failures look