[jira] [Updated] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6262: Release Note: HDFS's rename(src, dst) throws FileNotFoundException instead of returning false if

[jira] [Updated] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6262: Attachment: HDFS-6262.2.patch HDFS doesn't raise FileNotFoundException if the source of a rename()

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976444#comment-13976444 ] Akira AJISAKA commented on HDFS-6262: - Thanks [~ste...@apache.org] for the review. I

[jira] [Updated] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-6262: Release Note: HDFS's rename(src, dst) throws FileNotFoundException instead of logging warn message

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976468#comment-13976468 ] Tsz Wo Nicholas Sze commented on HDFS-6262: --- HADOOP-6240 is a closely related

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976469#comment-13976469 ] Tsz Wo Nicholas Sze commented on HDFS-6262: --- The problematic rename methods were

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976497#comment-13976497 ] Akira AJISAKA commented on HDFS-6262: - [~szetszwo], I agree with you. I'll update the

[jira] [Commented] (HDFS-6267) Upgrade Jetty6 to Jetty9

2014-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976523#comment-13976523 ] Haohui Mai commented on HDFS-6267: -- It's important to split the patch to facilitate

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976529#comment-13976529 ] Steve Loughran commented on HDFS-6262: -- Nicholas -problem exists in trunk; the

[jira] [Commented] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976531#comment-13976531 ] Hadoop QA commented on HDFS-6268: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6267) Upgrade Jetty6 to Jetty9

2014-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976541#comment-13976541 ] Steve Loughran commented on HDFS-6267: -- This is a duplicate of HADOOP-10075 ... that

[jira] [Updated] (HDFS-6267) Upgrade Jetty6 to Jetty9

2014-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-6267: - Resolution: Duplicate Status: Resolved (was: Patch Available) marking as duplicate of

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976606#comment-13976606 ] Akira AJISAKA commented on HDFS-6262: - I'm thinking the problem is rename(src, dst)

[jira] [Updated] (HDFS-2006) ability to support storing extended attributes per file

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-2006: -- Affects Version/s: HDFS XAttrs ability to support storing extended attributes per file

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976655#comment-13976655 ] Uma Maheswara Rao G commented on HDFS-2006: --- I have just create HDFS XAttrs

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976656#comment-13976656 ] Akira AJISAKA commented on HDFS-6262: - bq. I suggest rename(src, dst) to call

[jira] [Updated] (HDFS-6259) Support extended attributes via WebHDFS/HttpFS

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6259: -- Affects Version/s: HDFS XAttrs Support extended attributes via WebHDFS/HttpFS

[jira] [Updated] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6258: -- Affects Version/s: HDFS XAttrs Support XAttrs from NameNode and implements XAttr APIs

[jira] [Updated] (HDFS-6260) Support extended attributes via libHDFS

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-6260: -- Affects Version/s: HDFS XAttrs Support extended attributes via libHDFS

[jira] [Commented] (HDFS-6266) Identify full path for a given INode

2014-04-22 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976721#comment-13976721 ] Daryn Sharp commented on HDFS-6266: --- I'm only moderately familiar with snapshot handling,

[jira] [Commented] (HDFS-6262) HDFS doesn't raise FileNotFoundException if the source of a rename() is missing

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976741#comment-13976741 ] Hadoop QA commented on HDFS-6262: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6265) Prepare HDFS codebase for JUnit 4.11.

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976755#comment-13976755 ] Hudson commented on HDFS-6265: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #548 (See

[jira] [Commented] (HDFS-6178) Decommission on standby NN couldn't finish

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976757#comment-13976757 ] Hudson commented on HDFS-6178: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #548 (See

[jira] [Commented] (HDFS-6178) Decommission on standby NN couldn't finish

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976803#comment-13976803 ] Hudson commented on HDFS-6178: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1740 (See

[jira] [Commented] (HDFS-6265) Prepare HDFS codebase for JUnit 4.11.

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976801#comment-13976801 ] Hudson commented on HDFS-6265: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1740 (See

[jira] [Commented] (HDFS-6178) Decommission on standby NN couldn't finish

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976885#comment-13976885 ] Hudson commented on HDFS-6178: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1765 (See

[jira] [Commented] (HDFS-6265) Prepare HDFS codebase for JUnit 4.11.

2014-04-22 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976883#comment-13976883 ] Hudson commented on HDFS-6265: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #1765 (See

[jira] [Created] (HDFS-6269) NameNode Audit Log should differentiate between webHDFS open and HDFS open.

2014-04-22 Thread Eric Payne (JIRA)
Eric Payne created HDFS-6269: Summary: NameNode Audit Log should differentiate between webHDFS open and HDFS open. Key: HDFS-6269 URL: https://issues.apache.org/jira/browse/HDFS-6269 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-2734) Even if we configure the property fs.checkpoint.size in both core-site.xml and hdfs-site.xml the values are not been considered

2014-04-22 Thread Mit Desai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai resolved HDFS-2734. - Resolution: Not a Problem Target Version/s: 0.23.0, 0.20.1 (was: 0.20.1, 0.23.0) I think this

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-04-22 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13976941#comment-13976941 ] Yi Liu commented on HDFS-2006: -- [~cnauroth], thanks for so many valuable comments. {quote} Is

[jira] [Updated] (HDFS-6258) Support XAttrs from NameNode and implements XAttr APIs for DistributedFileSystem

2014-04-22 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated HDFS-6258: - Attachment: HDFS-6258.1.patch The update is together with update of HADOOP-10520. The new patch contains

[jira] [Updated] (HDFS-6266) Identify full path for a given INode

2014-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6266: Status: Patch Available (was: Open) Identify full path for a given INode

[jira] [Commented] (HDFS-6266) Identify full path for a given INode

2014-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977079#comment-13977079 ] Jing Zhao commented on HDFS-6266: - Thanks for the comments, [~daryn]. bq. how is a deleted

[jira] [Commented] (HDFS-2006) ability to support storing extended attributes per file

2014-04-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977113#comment-13977113 ] Chris Nauroth commented on HDFS-2006: - bq. I think any committer can make a branch, so

[jira] [Commented] (HDFS-3103) HA NN should be able to handle some cases of storage dir recovery on start

2014-04-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977242#comment-13977242 ] Chen He commented on HDFS-3103: --- CLOSE IT AND REOPEN IF NECESSARY HA NN should be able to

[jira] [Resolved] (HDFS-3103) HA NN should be able to handle some cases of storage dir recovery on start

2014-04-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HDFS-3103. --- Resolution: Later Target Version/s: 0.23.4, 0.24.0 (was: 0.24.0, 0.23.4) HA NN should be able to

[jira] [Commented] (HDFS-2951) Block reported as corrupt while running multi threaded client program that performs write and read operation on a set of files

2014-04-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977247#comment-13977247 ] Chen He commented on HDFS-2951: --- CLOSE IT AND REOPEN IF NECESSARY Block reported as corrupt

[jira] [Resolved] (HDFS-2951) Block reported as corrupt while running multi threaded client program that performs write and read operation on a set of files

2014-04-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen He resolved HDFS-2951. --- Resolution: Later Block reported as corrupt while running multi threaded client program that performs

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977302#comment-13977302 ] Arpit Agarwal commented on HDFS-5851: - Hi Colin, a call sounds like a good idea and we

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-22 Thread Enis Soztutar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977317#comment-13977317 ] Enis Soztutar commented on HDFS-6264: - Correction: For HBase, it is not only a unit

[jira] [Updated] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-22 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated HDFS-6264: - Attachment: hdfs-6264-v1.txt Patch v1 un-deprecates createNonRecursive(). Provide FileSystem#create() variant

[jira] [Commented] (HDFS-6266) Identify full path for a given INode

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977327#comment-13977327 ] Hadoop QA commented on HDFS-6266: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6264) Provide FileSystem#create() variant which throws exception if parent directory doesn't exist

2014-04-22 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977359#comment-13977359 ] Steve Loughran commented on HDFS-6264: -- If we're targeting 2.5.0 here, I wouldn't do

[jira] [Updated] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6268: -- Attachment: hdfs-6268-2.patch New patch to fix the test failure, turned out that FSN code wasn't dead.

[jira] [Commented] (HDFS-5693) Few NN metrics data points were collected via JMX when NN is under heavy load

2014-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977434#comment-13977434 ] Jing Zhao commented on HDFS-5693: - Thanks for working on this, [~mingma]! The patch looks

[jira] [Commented] (HDFS-5477) Block manager as a service

2014-04-22 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977450#comment-13977450 ] Milind Bhandarkar commented on HDFS-5477: - Hello again, Sorry to repeat my

[jira] [Commented] (HDFS-3828) Block Scanner rescans blocks too frequently

2014-04-22 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977481#comment-13977481 ] Eric Payne commented on HDFS-3828: -- [~adi2] and [~eli] I am working through the backlog

[jira] [Created] (HDFS-6270) The secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
Benoy Antony created HDFS-6270: -- Summary: The secondary namenode status page shows transaction count in bytes Key: HDFS-6270 URL: https://issues.apache.org/jira/browse/HDFS-6270 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6270: --- Summary: Secondary namenode status page shows transaction count in bytes (was: The secondary

[jira] [Work started] (HDFS-6270) The secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6270 started by Benoy Antony. The secondary namenode status page shows transaction count in bytes

[jira] [Updated] (HDFS-6270) The secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6270: --- Attachment: HDFS-6270.patch Attaching the patch which prints Checkpoint Transactions: 100 The

[jira] [Commented] (HDFS-4114) Remove the BackupNode and CheckpointNode from trunk

2014-04-22 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977567#comment-13977567 ] Suresh Srinivas commented on HDFS-4114: --- [~shv], the comment I was talking about was

[jira] [Commented] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977569#comment-13977569 ] Andrew Wang commented on HDFS-6270: --- Looks good, thanks for the patch Benoy. Can you also

[jira] [Created] (HDFS-6271) Rename JournalProtocol to BackupNodeJournalProtocol

2014-04-22 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-6271: - Summary: Rename JournalProtocol to BackupNodeJournalProtocol Key: HDFS-6271 URL: https://issues.apache.org/jira/browse/HDFS-6271 Project: Hadoop HDFS

[jira] [Commented] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977571#comment-13977571 ] Andrew Wang commented on HDFS-6270: --- Also, this JIRA is in the In Progress state and I

[jira] [Resolved] (HDFS-6223) Using the command setrep to set the replication factor more than the number of datanodes with the -w parameter, the command gets in a infinite loop.

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6223. --- Resolution: Not a Problem I agree with [~sureshms] on the behavior of the -w flag with setrep, so

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-22 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977604#comment-13977604 ] Colin Patrick McCabe commented on HDFS-5851: Thanks, Aprit. Would be nice to

[jira] [Created] (HDFS-6272) Improve FSNamesystem.listCorruptFileBlocks so that it doesn't need to acquire the readLock.

2014-04-22 Thread Ming Ma (JIRA)
Ming Ma created HDFS-6272: - Summary: Improve FSNamesystem.listCorruptFileBlocks so that it doesn't need to acquire the readLock. Key: HDFS-6272 URL: https://issues.apache.org/jira/browse/HDFS-6272 Project:

[jira] [Assigned] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6213: - Assignee: Andrew Wang TestDataNodeConfig failing on Jenkins runs due to DN web port in use

[jira] [Updated] (HDFS-5693) Few NN metrics data points were collected via JMX when NN is under heavy load

2014-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ming Ma updated HDFS-5693: -- Attachment: HDFS-5693-2.patch Thanks, Jing. Here is the update.

[jira] [Updated] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6213: -- Status: Patch Available (was: Open) TestDataNodeConfig failing on Jenkins runs due to DN web port in

[jira] [Updated] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6213: -- Attachment: hdfs-6213-1.patch Patch attached. Another test case in the file starts a DN and doesn't

[jira] [Resolved] (HDFS-6199) WebHdfsFileSystem does not treat UnresolvedLinkException

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang resolved HDFS-6199. --- Resolution: Duplicate WebHdfsFileSystem does not treat UnresolvedLinkException

[jira] [Commented] (HDFS-6199) WebHdfsFileSystem does not treat UnresolvedLinkException

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977627#comment-13977627 ] Andrew Wang commented on HDFS-6199: --- Hi Gera, WebHdfsFileSystem doesn't have support for

[jira] [Commented] (HDFS-5693) Few NN metrics data points were collected via JMX when NN is under heavy load

2014-04-22 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977628#comment-13977628 ] Jing Zhao commented on HDFS-5693: - The new patch actually still includes the quick check in

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977631#comment-13977631 ] Haohui Mai commented on HDFS-6213: -- {code} +

[jira] [Commented] (HDFS-5757) Decommisson lots of nodes at the same time could slow down NN

2014-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977632#comment-13977632 ] Ming Ma commented on HDFS-5757: --- It seems property

[jira] [Commented] (HDFS-2975) Rename with overwrite flag true can make NameNode to stuck in safemode on NN (crash + restart).

2014-04-22 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977636#comment-13977636 ] Tsz Wo Nicholas Sze commented on HDFS-2975: --- Is this still a problem? Rename

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977638#comment-13977638 ] Andrew Wang commented on HDFS-6213: --- Hmm, interesting. 0.0.0.0 is in DFSConfigKeys for

[jira] [Commented] (HDFS-6250) TestBalancerWithNodeGroup.testBalancerWithRackLocality fails

2014-04-22 Thread Chen He (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977645#comment-13977645 ] Chen He commented on HDFS-6250: --- In this test case, program starts a minicluster composed of

[jira] [Commented] (HDFS-6268) Better sorting in NetworkTopology#pseudoSortByDistance when no local node is found

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977644#comment-13977644 ] Hadoop QA commented on HDFS-6268: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6270: --- Attachment: HDFS-6270.patch Secondary namenode status page shows transaction count in bytes

[jira] [Commented] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977648#comment-13977648 ] Benoy Antony commented on HDFS-6270: Thanks for the comments [~andrew.wang]. Added

[jira] [Updated] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Benoy Antony (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benoy Antony updated HDFS-6270: --- Status: Patch Available (was: In Progress) Secondary namenode status page shows transaction count

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977659#comment-13977659 ] Haohui Mai commented on HDFS-6213: -- bq. Hmm, interesting. 0.0.0.0 is in DFSConfigKeys for

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977664#comment-13977664 ] Andrew Wang commented on HDFS-6213: --- My point is that this is a broad issue. We either

[jira] [Updated] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6213: -- Attachment: hdfs-6213-2.patch New patch specifying localhost rather than 0.0.0.0 TestDataNodeConfig

[jira] [Commented] (HDFS-5693) Few NN metrics data points were collected via JMX when NN is under heavy load

2014-04-22 Thread Ming Ma (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977706#comment-13977706 ] Ming Ma commented on HDFS-5693: --- Thanks, Jing. Yes, this can be done as part of

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977726#comment-13977726 ] Haohui Mai commented on HDFS-6213: -- +1 pending jenkins. TestDataNodeConfig failing on

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977765#comment-13977765 ] Hadoop QA commented on HDFS-6213: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6270) Secondary namenode status page shows transaction count in bytes

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1390#comment-1390 ] Hadoop QA commented on HDFS-6270: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5693) Few NN metrics data points were collected via JMX when NN is under heavy load

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5693?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1391#comment-1391 ] Hadoop QA commented on HDFS-5693: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5442) Zero loss HDFS data replication for multiple datacenters

2014-04-22 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-5442: -- Assignee: Dian Fu Zero loss HDFS data replication for multiple datacenters

[jira] [Commented] (HDFS-6213) TestDataNodeConfig failing on Jenkins runs due to DN web port in use

2014-04-22 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977798#comment-13977798 ] Hadoop QA commented on HDFS-6213: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6273: --- Summary: Option to allow wildcard endpoints for namenode HTTP and HTTPS servers Key: HDFS-6273 URL: https://issues.apache.org/jira/browse/HDFS-6273 Project: Hadoop

[jira] [Commented] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977804#comment-13977804 ] Arpit Agarwal commented on HDFS-6273: - These endpoints do bind the wildcard address by

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Attachment: HDFS-6273.01.patch Patch to add the options as described above. Also added unit tests

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Status: Patch Available (was: Open) Option to allow wildcard endpoints for namenode HTTP and