[jira] [Commented] (HDFS-6102) Lower the default maximum items per directory to fix PB fsimage loading

2014-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934617#comment-13934617 ] Hudson commented on HDFS-6102: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5327 (See [https:

[jira] [Commented] (HDFS-5997) TestHASafeMode#testBlocksAddedWhileStandbyIsDown fails in trunk

2014-03-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934611#comment-13934611 ] Akira AJISAKA commented on HDFS-5997: - Thanks [~yuzhih...@gmail.com] for reporting! Thi

[jira] [Updated] (HDFS-6102) Lower the default maximum items per directory to fix PB fsimage loading

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6102: -- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch Available) Commit

[jira] [Resolved] (HDFS-5997) TestHASafeMode#testBlocksAddedWhileStandbyIsDown fails in trunk

2014-03-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5997?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA resolved HDFS-5997. - Resolution: Duplicate > TestHASafeMode#testBlocksAddedWhileStandbyIsDown fails in trunk >

[jira] [Commented] (HDFS-6102) Lower the default maximum items per directory to fix PB fsimage loading

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934598#comment-13934598 ] Andrew Wang commented on HDFS-6102: --- Thanks for the review Haohui, will commit shortly.

[jira] [Updated] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6094: Attachment: HDFS-6904.01.patch Prototype patch with Jing's suggested fix with the additional change

[jira] [Updated] (HDFS-6102) Lower the default maximum items per directory to fix PB fsimage loading

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6102: -- Summary: Lower the default maximum items per directory to fix PB fsimage loading (was: Cannot load an f

[jira] [Commented] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-13 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934586#comment-13934586 ] Vinayakumar B commented on HDFS-6103: - Hi [~jaoki], bq. When upgrading hdfs, say from

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934567#comment-13934567 ] Arpit Agarwal commented on HDFS-6094: - Hi Jing, thanks for taking a look at this! I ag

[jira] [Commented] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934541#comment-13934541 ] Hadoop QA commented on HDFS-6100: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934497#comment-13934497 ] Hadoop QA commented on HDFS-6099: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934492#comment-13934492 ] Hadoop QA commented on HDFS-6102: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6087) Unify HDFS write/append/truncate

2014-03-13 Thread Guo Ruijing (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934485#comment-13934485 ] Guo Ruijing commented on HDFS-6087: --- I plan to remove snapshot part and add one work-flow

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934472#comment-13934472 ] Jing Zhao commented on HDFS-6094: - Maybe another issue with the current code is that when a

[jira] [Created] (HDFS-6103) FSImage file system image version check throw a (slightly) wrong parameter.

2014-03-13 Thread jun aoki (JIRA)
jun aoki created HDFS-6103: -- Summary: FSImage file system image version check throw a (slightly) wrong parameter. Key: HDFS-6103 URL: https://issues.apache.org/jira/browse/HDFS-6103 Project: Hadoop HDFS

[jira] [Updated] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6094: Attachment: TestHASafeMode-output.txt Attach the log of the test that reproduced the failure. I injected an

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934407#comment-13934407 ] Jing Zhao commented on HDFS-6094: - Another option is to add new storage id even for increme

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934398#comment-13934398 ] Hudson commented on HDFS-6084: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5325 (See [https:

[jira] [Resolved] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-6084. -- Resolution: Fixed > Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage > -

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934388#comment-13934388 ] Haohui Mai commented on HDFS-6084: -- I've committed the patch to trunk, branch-2 and branch

[jira] [Commented] (HDFS-6094) The same block can be counted twice towards safe mode threshold

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934384#comment-13934384 ] Jing Zhao commented on HDFS-6094: - I can also reproduce the issue on my local machine. Look

[jira] [Commented] (HDFS-5516) WebHDFS does not require user name when anonymous http requests are disallowed.

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934376#comment-13934376 ] Hadoop QA commented on HDFS-5516: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934370#comment-13934370 ] Hadoop QA commented on HDFS-6038: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934365#comment-13934365 ] Haohui Mai commented on HDFS-6084: -- The failure is irrelevant. I'll commit shortly. > Nam

[jira] [Commented] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934360#comment-13934360 ] Haohui Mai commented on HDFS-6100: -- The v0 patch overloads the meaning of the URL paramete

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934349#comment-13934349 ] Hadoop QA commented on HDFS-6084: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6100: - Description: In {{DataNodeWebHdfsMethods}}, the code creates a {{DFSClient}} to connect to the NN, so that

[jira] [Updated] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6100: - Status: Patch Available (was: Open) > DataNodeWebHdfsMethods does not failover in HA mode > -

[jira] [Updated] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6100: - Summary: DataNodeWebHdfsMethods does not failover in HA mode (was: webhdfs filesystem does not failover i

[jira] [Updated] (HDFS-6100) DataNodeWebHdfsMethods does not failover in HA mode

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6100: - Attachment: HDFS-6100.000.patch > DataNodeWebHdfsMethods does not failover in HA mode > --

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934331#comment-13934331 ] Hudson commented on HDFS-6097: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5324 (See [https:

[jira] [Commented] (HDFS-6087) Unify HDFS write/append/truncate

2014-03-13 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934316#comment-13934316 ] Konstantin Shvachko commented on HDFS-6087: --- Not sure I fully understood what you

[jira] [Commented] (HDFS-6007) Update documentation about short-circuit local reads

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934314#comment-13934314 ] Hadoop QA commented on HDFS-6007: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934307#comment-13934307 ] Haohui Mai commented on HDFS-6102: -- +1 pending jenkins > Cannot load an fsimage with a ve

[jira] [Updated] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6102: -- Attachment: hdfs-6102-2.patch Good idea Haohui, new patch adds some precondition checks and removes that

[jira] [Updated] (HDFS-5516) WebHDFS does not require user name when anonymous http requests are disallowed.

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-5516: Target Version/s: 3.0.0, 1-win, 1.3.0, 2.4.0 (was: 3.0.0, 1-win, 1.3.0) Hadoop Flags: Review

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934262#comment-13934262 ] Haohui Mai commented on HDFS-6102: -- It looks mostly good to me. The only comment I have is

[jira] [Updated] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6102: -- Status: Patch Available (was: Open) > Cannot load an fsimage with a very large directory >

[jira] [Updated] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-6102: -- Attachment: hdfs-6102-1.patch Patch attached. It's dead simple, just ups the default in DFSConfigKeys an

[jira] [Updated] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6099: Attachment: HDFS-6099.2.patch I'm attaching patch v2 with one more small change. I added {{PathCom

[jira] [Commented] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934254#comment-13934254 ] Akira AJISAKA commented on HDFS-5978: - The test failure is reported by HDFS-5997 and lo

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934255#comment-13934255 ] Haohui Mai commented on HDFS-6084: -- Looks good to me. +1 pending jenkins. > Namenode UI -

[jira] [Issue Comment Deleted] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-6084: -- Comment: was deleted (was: I've committed the patch to trunk, branch-2, and branch-2.4. Thanks

[jira] [Reopened] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas reopened HDFS-6084: --- Sorry for accidentally resolving this jira. Reopening it. > Namenode UI - "Hadoop" logo link shou

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Resolution: Fixed Fix Version/s: 2.4.0 Status: Resolved (was: Patch

[jira] [Updated] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6099: Status: Patch Available (was: Reopened) > HDFS file system limits not enforced on renames. > --

[jira] [Updated] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-6099: -- Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Reso

[jira] [Issue Comment Deleted] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-6099: -- Comment: was deleted (was: I've committed the patch to trunk, branch-2, and branch-2.4. Thanks

[jira] [Reopened] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas reopened HDFS-6099: --- Sorry, accidentally resolved this. > HDFS file system limits not enforced on renames. > -

[jira] [Updated] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6099: Status: Patch Available (was: Open) > HDFS file system limits not enforced on renames. > --

[jira] [Updated] (HDFS-6099) HDFS file system limits not enforced on renames.

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-6099: Attachment: HDFS-6099.1.patch The attached patch checks max path component length and max children d

[jira] [Commented] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934201#comment-13934201 ] Hadoop QA commented on HDFS-5978: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-6084: -- Resolution: Fixed Fix Version/s: 2.4.0 Hadoop Flags: Reviewed Status: Reso

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Attachment: HDFS-6038.008.patch Update the patch to address Todd's comments. The main change is to add a new

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Status: Patch Available (was: Open) > Allow JournalNode to handle editlog produced by new release with futu

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934129#comment-13934129 ] Hadoop QA commented on HDFS-6097: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Travis Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Travis Thompson updated HDFS-6084: -- Attachment: HDFS-6084.2.patch.txt Version with all external links removed. > Namenode UI - "Had

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934091#comment-13934091 ] Andrew Wang commented on HDFS-6102: --- Thanks for the comments, Haohui and Suresh. I think

[jira] [Updated] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6080: - Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) > Improv

[jira] [Commented] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934069#comment-13934069 ] Hudson commented on HDFS-6080: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5323 (See [https:

[jira] [Updated] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6080: - Fix Version/s: 2.4.0 > Improve NFS gateway performance by making rtmax and wtmax configurable > --

[jira] [Updated] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brandon Li updated HDFS-6080: - Attachment: HDFS-6080.patch Uploaded the committed patch. > Improve NFS gateway performance by making rtm

[jira] [Commented] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934066#comment-13934066 ] Brandon Li commented on HDFS-6080: -- There are some format issues with the doc change. I've

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934062#comment-13934062 ] Hadoop QA commented on HDFS-6097: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934058#comment-13934058 ] Haohui Mai commented on HDFS-6084: -- Let's just remove all the links but leave the text. It

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934044#comment-13934044 ] Hadoop QA commented on HDFS-6097: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-6084) Namenode UI - "Hadoop" logo link shouldn't go to hadoop homepage

2014-03-13 Thread Travis Thompson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934031#comment-13934031 ] Travis Thompson commented on HDFS-6084: --- Yeah, having external links on intranet site

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13934026#comment-13934026 ] Suresh Srinivas commented on HDFS-6102: --- bq. Enforce a configurable maximum on the #

[jira] [Updated] (HDFS-6007) Update documentation about short-circuit local reads

2014-03-13 Thread Masatake Iwasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-6007: --- Attachment: HDFS-6007-4.patch attaching updated patch. - removed the section about ZCR, - adde

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933985#comment-13933985 ] Haohui Mai commented on HDFS-6102: -- It might be sufficient to putting it into the release

[jira] [Updated] (HDFS-5516) WebHDFS does not require user name when anonymous http requests are disallowed.

2014-03-13 Thread Miodrag Radulovic (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miodrag Radulovic updated HDFS-5516: Attachment: HDFS-5516.patch I have added two basic tests for simple auth configuration. > W

[jira] [Updated] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-5978: Attachment: HDFS-5978.3.patch Separated {{GETFILESTATUS}} support and fixed findbug warnings. > Cre

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933876#comment-13933876 ] Andrew Wang commented on HDFS-6102: --- I also did a quick audit of the rest of fsimage.prot

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933874#comment-13933874 ] Colin Patrick McCabe commented on HDFS-6097: bq. \[try-finally\] That's a good

[jira] [Commented] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-13 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933868#comment-13933868 ] Akira AJISAKA commented on HDFS-5978: - bq. I appreciate if you can separate it into a n

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933864#comment-13933864 ] Chris Nauroth commented on HDFS-6097: - +1 for v5 pending Jenkins. Thanks again, Colin.

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Status: Open (was: Patch Available) > zero-copy reads are incorrectly disabled on fil

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Status: Patch Available (was: Open) > zero-copy reads are incorrectly disabled on fil

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Attachment: HDFS-6097.005.patch * Add a comment about the curPos optimization * add a

[jira] [Commented] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933856#comment-13933856 ] Andrew Wang commented on HDFS-6102: --- Doing some back of the envelope math while looking a

[jira] [Assigned] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang reassigned HDFS-6102: - Assignee: Andrew Wang > Cannot load an fsimage with a very large directory > -

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933832#comment-13933832 ] Chris Nauroth commented on HDFS-6097: - Thanks for posting v4. Were you also going to p

[jira] [Created] (HDFS-6102) Cannot load an fsimage with a very large directory

2014-03-13 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-6102: - Summary: Cannot load an fsimage with a very large directory Key: HDFS-6102 URL: https://issues.apache.org/jira/browse/HDFS-6102 Project: Hadoop HDFS Issue Type: Bu

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933822#comment-13933822 ] Chris Nauroth commented on HDFS-6097: - Thanks, Colin. I also meant to add that it's a

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933818#comment-13933818 ] Chris Nauroth commented on HDFS-6097: - bq. This is actually an optimization I made. I

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Status: Open (was: Patch Available) > zero-copy reads are incorrectly disabled on fil

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Attachment: HDFS-6097.004.patch > zero-copy reads are incorrectly disabled on file off

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Status: Patch Available (was: Open) > zero-copy reads are incorrectly disabled on fil

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Attachment: (was: HDFS-6097.004.patch) > zero-copy reads are incorrectly disabled

[jira] [Updated] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-6097: --- Attachment: HDFS-6097.004.patch > zero-copy reads are incorrectly disabled on file off

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933668#comment-13933668 ] Colin Patrick McCabe commented on HDFS-6097: Thanks for the review, Chris. I'm

[jira] [Commented] (HDFS-5978) Create a tool to take fsimage and expose read-only WebHDFS API

2014-03-13 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933664#comment-13933664 ] Haohui Mai commented on HDFS-5978: -- bq. I updated the patch to reflect the comment, and ad

[jira] [Commented] (HDFS-6097) zero-copy reads are incorrectly disabled on file offsets above 2GB

2014-03-13 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933643#comment-13933643 ] Colin Patrick McCabe commented on HDFS-6097: bq. DFSInputStream#tryReadZeroCopy

[jira] [Commented] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-13 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933627#comment-13933627 ] haosdent commented on HDFS-6092: [~te...@apache.org] I upload HDFS-6092-v4.patch. Could you

[jira] [Updated] (HDFS-6092) DistributedFileSystem#getCanonicalServiceName() and DistributedFileSystem#getUri() may return inconsistent results w.r.t. port

2014-03-13 Thread haosdent (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] haosdent updated HDFS-6092: --- Attachment: HDFS-6092-v4.patch > DistributedFileSystem#getCanonicalServiceName() and > DistributedFileSystem#

[jira] [Updated] (HDFS-6038) Allow JournalNode to handle editlog produced by new release with future layoutversion

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Summary: Allow JournalNode to handle editlog produced by new release with future layoutversion (was: Journa

[jira] [Commented] (HDFS-6080) Improve NFS gateway performance by making rtmax and wtmax configurable

2014-03-13 Thread Brandon Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933590#comment-13933590 ] Brandon Li commented on HDFS-6080: -- +1 > Improve NFS gateway performance by making rtmax

[jira] [Updated] (HDFS-6038) JournalNode hardcodes NameNodeLayoutVersion in the edit log file

2014-03-13 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-6038: Description: In HA setup, the JNs receive edit logs (blob) from the NN and write into edit log files. In or

[jira] [Commented] (HDFS-5244) TestNNStorageRetentionManager#testPurgeMultipleDirs fails

2014-03-13 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13933594#comment-13933594 ] Hudson commented on HDFS-5244: -- SUCCESS: Integrated in Hadoop-trunk-Commit #5321 (See [https:

[jira] [Updated] (HDFS-5244) TestNNStorageRetentionManager#testPurgeMultipleDirs fails

2014-03-13 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas updated HDFS-5244: -- Resolution: Fixed Target Version/s: 2.4.0 (was: 3.0.0, 2.1.1-beta) Hadoop Flag

  1   2   >