[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568560#comment-13568560 ] Hadoop QA commented on HDFS-4462: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4151) Passing INodesInPath instead of INode[] in FSDirectory

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568647#comment-13568647 ] Hudson commented on HDFS-4151: -- Integrated in Hadoop-Yarn-trunk #114 (See

[jira] [Commented] (HDFS-4451) hdfs balancer command returns exit code 1 on success instead of 0

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568651#comment-13568651 ] Hudson commented on HDFS-4451: -- Integrated in Hadoop-Yarn-trunk #114 (See

[jira] [Commented] (HDFS-347) DFS read performance suboptimal when client co-located on nodes with data

2013-02-01 Thread Liang Xie (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568655#comment-13568655 ] Liang Xie commented on HDFS-347: Hi [~cmccabe], would you mind giving a patch against

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Attachment: getAdditionalBlock.patch The same chamges now with the test case which

[jira] [Commented] (HDFS-395) DFS Scalability: Incremental block reports

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568706#comment-13568706 ] Hudson commented on HDFS-395: - Integrated in Hadoop-Hdfs-0.23-Build #512 (See

[jira] [Commented] (HDFS-2477) Optimize computing the diff between a block report and the namenode state.

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568710#comment-13568710 ] Hudson commented on HDFS-2477: -- Integrated in Hadoop-Hdfs-0.23-Build #512 (See

[jira] [Commented] (HDFS-2495) Increase granularity of write operations in ReplicationMonitor thus reducing contention for write lock

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568711#comment-13568711 ] Hudson commented on HDFS-2495: -- Integrated in Hadoop-Hdfs-0.23-Build #512 (See

[jira] [Commented] (HDFS-4151) Passing INodesInPath instead of INode[] in FSDirectory

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568725#comment-13568725 ] Hudson commented on HDFS-4151: -- Integrated in Hadoop-Hdfs-trunk #1303 (See

[jira] [Commented] (HDFS-4451) hdfs balancer command returns exit code 1 on success instead of 0

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568729#comment-13568729 ] Hudson commented on HDFS-4451: -- Integrated in Hadoop-Hdfs-trunk #1303 (See

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568733#comment-13568733 ] Hadoop QA commented on HDFS-4452: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4189) rename getter method getMutableX and getXMutable to getXAndEnsureMutable

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568734#comment-13568734 ] Hudson commented on HDFS-4189: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #88 (See

[jira] [Commented] (HDFS-4361) When listing snapshottable directories, only return those where the user has permission to take snapshots

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568735#comment-13568735 ] Hudson commented on HDFS-4361: -- Integrated in Hadoop-Hdfs-Snapshots-Branch-build #88 (See

[jira] [Commented] (HDFS-4151) Passing INodesInPath instead of INode[] in FSDirectory

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568746#comment-13568746 ] Hudson commented on HDFS-4151: -- Integrated in Hadoop-Mapreduce-trunk #1331 (See

[jira] [Commented] (HDFS-4451) hdfs balancer command returns exit code 1 on success instead of 0

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568750#comment-13568750 ] Hudson commented on HDFS-4451: -- Integrated in Hadoop-Mapreduce-trunk #1331 (See

[jira] [Commented] (HDFS-2476) More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks

2013-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568767#comment-13568767 ] Kihwal Lee commented on HDFS-2476: -- Committed to the current branch-0.23.

[jira] [Updated] (HDFS-2476) More CPU efficient data structure for under-replicated/over-replicated/invalidate blocks

2013-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-2476: - Target Version/s: 0.23.3, 0.24.0 (was: 0.24.0, 0.23.3) Fix Version/s: 0.23.7 More CPU

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568901#comment-13568901 ] Suresh Srinivas commented on HDFS-4461: --- bq. This has been causing out-of-memory

TYCHUN�]T.Y. CHUN ���}���^ is out of the office.

2013-02-01 Thread tychun
I will be out of the office starting 2013/02/02 and will not return until 2013/02/19. I will respond to your message when I return. --- TSMC PROPERTY This

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568920#comment-13568920 ] Colin Patrick McCabe commented on HDFS-4461: bq. I doubt that the directory

[jira] [Commented] (HDFS-4450) Duplicate data node on the name node after formatting data node

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568924#comment-13568924 ] Suresh Srinivas commented on HDFS-4450: --- bq. Can you post the lines from the logs

[jira] [Commented] (HDFS-4457) WebHDFS obtains/sets delegation token service hostname using wrong config leading to issues when NN is configured with 0.0.0.0 RPC IP

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568929#comment-13568929 ] Aaron T. Myers commented on HDFS-4457: -- Daryn, does Tucu's explanation address your

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568930#comment-13568930 ] Suresh Srinivas commented on HDFS-4461: --- bq. we analyzed a DN heap dump from a

[jira] [Moved] (HDFS-4463) ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe moved HADOOP-9275 to HDFS-4463: Component/s: (was: ha) ha

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568937#comment-13568937 ] Arun C Murthy commented on HDFS-4462: - [~atm] Is this a 2.0.3 blocker? Tx.

[jira] [Commented] (HDFS-4463) ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568938#comment-13568938 ] Colin Patrick McCabe commented on HDFS-4463: moving to HDFS, since it's about

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568946#comment-13568946 ] Aaron T. Myers commented on HDFS-4462: -- [~acmurthy] Blocker? Probably not. Pretty good

[jira] [Updated] (HDFS-1765) Block Replication should respect under-replication block priority

2013-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-1765: - Target Version/s: 0.23.3, 0.24.0 (was: 0.24.0, 0.23.3) Fix Version/s: 0.23.7 Committed to

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568959#comment-13568959 ] Colin Patrick McCabe commented on HDFS-4461: If someone is running with around

[jira] [Commented] (HDFS-4450) Duplicate data node on the name node after formatting data node

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568973#comment-13568973 ] Suresh Srinivas commented on HDFS-4450: --- Also please provide from your configuration,

[jira] [Updated] (HDFS-4459) command manual dfsadmin missing entry for restoreFailedStorage option

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Isaacson updated HDFS-4459: Status: Patch Available (was: Open) command manual dfsadmin missing entry for

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568979#comment-13568979 ] Suresh Srinivas commented on HDFS-4461: --- bq. If someone is running with around

[jira] [Commented] (HDFS-4456) Add concat to WebHDFS REST API

2013-02-01 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568982#comment-13568982 ] Plamen Jeliazkov commented on HDFS-4456: Are you saying you would like to push the

[jira] [Commented] (HDFS-4463) ActiveStandbyElector can join election even before Service HEALTHY, and results in null data at ActiveBreadCrumb

2013-02-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568983#comment-13568983 ] Todd Lipcon commented on HDFS-4463: --- Good work figuring this one out. I've seen it once

[jira] [Commented] (HDFS-4456) Add concat to WebHDFS REST API

2013-02-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568985#comment-13568985 ] Alejandro Abdelnur commented on HDFS-4456: -- No the other way around, the one that

[jira] [Commented] (HDFS-4456) Add concat to WebHDFS REST API

2013-02-01 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568984#comment-13568984 ] Plamen Jeliazkov commented on HDFS-4456: The unit test failure associated with the

[jira] [Updated] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-4461: --- Description: In the {{DirectoryScanner}}, we create a class {{ScanInfo}} for every

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568989#comment-13568989 ] Todd Lipcon commented on HDFS-4461: --- Looks like we can cut the memory usage in half again

[jira] [Commented] (HDFS-4456) Add concat to WebHDFS REST API

2013-02-01 Thread Plamen Jeliazkov (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13568994#comment-13568994 ] Plamen Jeliazkov commented on HDFS-4456: The one that introduces the extra warning

[jira] [Commented] (HDFS-4456) Add concat to WebHDFS REST API

2013-02-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569001#comment-13569001 ] Alejandro Abdelnur commented on HDFS-4456: -- got it, +1 for

[jira] [Updated] (HDFS-4456) Add concat to HttpFS and WebHDFS REST API docs

2013-02-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-4456: - Summary: Add concat to HttpFS and WebHDFS REST API docs (was: Add concat to WebHDFS REST

[jira] [Commented] (HDFS-4459) command manual dfsadmin missing entry for restoreFailedStorage option

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569009#comment-13569009 ] Hadoop QA commented on HDFS-4459: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4456) Add concat to HttpFS and WebHDFS REST API docs

2013-02-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur updated HDFS-4456: - Resolution: Fixed Fix Version/s: (was: 3.0.0) Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569013#comment-13569013 ] Andy Isaacson commented on HDFS-4461: - bq. A server generally has a lot of String

[jira] [Commented] (HDFS-4456) Add concat to HttpFS and WebHDFS REST API docs

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569018#comment-13569018 ] Hudson commented on HDFS-4456: -- Integrated in Hadoop-trunk-Commit #3311 (See

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569063#comment-13569063 ] Chris Nauroth commented on HDFS-4462: - Hi, Aaron. The code looks good. I applied the

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Andy Isaacson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569083#comment-13569083 ] Andy Isaacson commented on HDFS-4461: - The actual OOM backtrace is on the DN thread:

[jira] [Updated] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4462: - Attachment: HDFS-4462.patch Thanks a lot for the review, Chris, and for running those additional

[jira] [Updated] (HDFS-4404) Create file failure when the machine of first attempted NameNode is down

2013-02-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4404: -- Attachment: hdfs-4404.txt Attached patch adds a unit test and addresses some of the feedback above.

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569151#comment-13569151 ] Chris Nauroth commented on HDFS-4462: - +1 for the new patch Tests pass with the new

[jira] [Created] (HDFS-4464) Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot

2013-02-01 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-4464: Summary: Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot Key: HDFS-4464 URL: https://issues.apache.org/jira/browse/HDFS-4464

[jira] [Updated] (HDFS-4444) Add space between total transaction time and number of transactions in FSEditLog#printStatistics

2013-02-01 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated HDFS-: Fix Version/s: 0.23.7 Add space between total transaction time and number of transactions in

[jira] [Updated] (HDFS-4444) Add space between total transaction time and number of transactions in FSEditLog#printStatistics

2013-02-01 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated HDFS-: Fix Version/s: (was: 0.23.7) Add space between total transaction time and number of

[jira] [Commented] (HDFS-4457) WebHDFS obtains/sets delegation token service hostname using wrong config leading to issues when NN is configured with 0.0.0.0 RPC IP

2013-02-01 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569183#comment-13569183 ] Daryn Sharp commented on HDFS-4457: --- Ignoring the issue of the client relying on the

[jira] [Updated] (HDFS-4444) Add space between total transaction time and number of transactions in FSEditLog#printStatistics

2013-02-01 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated HDFS-: Fix Version/s: 0.23.7 Add space between total transaction time and number of transactions in

[jira] [Created] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

2013-02-01 Thread Suresh Srinivas (JIRA)
Suresh Srinivas created HDFS-4465: - Summary: Optimize datanode ReplicasMap and ReplicaInfo Key: HDFS-4465 URL: https://issues.apache.org/jira/browse/HDFS-4465 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-4461) DirectoryScanner: volume path prefix takes up memory for every block that is scanned

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569198#comment-13569198 ] Suresh Srinivas commented on HDFS-4461: --- I think my earlier comments perhaps are not

[jira] [Updated] (HDFS-4464) Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot

2013-02-01 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4464: - Attachment: h4464_20120201.patch h4464_20120201.patch: combine those methods to

[jira] [Updated] (HDFS-3119) Overreplicated block is not deleted even after the replication factor is reduced after sync follwed by closing that file

2013-02-01 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-3119: - Fix Version/s: 0.23.7 Committed to branch-0.23. Overreplicated block is not deleted

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569213#comment-13569213 ] Konstantin Boudnik commented on HDFS-4452: -- The patch looks mostly good. A few

[jira] [Updated] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4465: - Attachment: dn-memory-improvements.patch Hey Suresh, thanks a lot for filing this issue. A little

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569238#comment-13569238 ] Hadoop QA commented on HDFS-4462: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4404) Create file failure when the machine of first attempted NameNode is down

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569265#comment-13569265 ] Hadoop QA commented on HDFS-4404: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers updated HDFS-4462: - Attachment: HDFS-4462.patch Missed a test failure from the last patch. This patch should fix the

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Status: Open (was: Patch Available) getAdditionalBlock() can create multiple

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Attachment: getAdditionalBlock-branch2.patch Patch for branch 2. Somebody conveniently

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Attachment: getAdditionalBlock.patch Patch for trunk. Incorporated Cos's comments.

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Hadoop Flags: Reviewed Status: Patch Available (was: Open)

[jira] [Commented] (HDFS-4457) WebHDFS obtains/sets delegation token service hostname using wrong config leading to issues when NN is configured with 0.0.0.0 RPC IP

2013-02-01 Thread Alejandro Abdelnur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569307#comment-13569307 ] Alejandro Abdelnur commented on HDFS-4457: -- Daryn, Regarding your concern about

[jira] [Commented] (HDFS-4464) Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot

2013-02-01 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569326#comment-13569326 ] Jing Zhao commented on HDFS-4464: - The name of deleteSubtreeAndCollectBlocks may be a

[jira] [Commented] (HDFS-4453) Make a simple doc to describe the usage and design of the shortcircuit read feature

2013-02-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569328#comment-13569328 ] Todd Lipcon commented on HDFS-4453: --- Section 4: I think you have some typos there: - you

[jira] [Commented] (HDFS-4465) Optimize datanode ReplicasMap and ReplicaInfo

2013-02-01 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569329#comment-13569329 ] Suresh Srinivas commented on HDFS-4465: --- Aaron, given you have worked on it, if you

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569341#comment-13569341 ] Chris Nauroth commented on HDFS-4462: - +1 for the new patch I confirmed that it fixed

[jira] [Updated] (HDFS-4464) Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot

2013-02-01 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE updated HDFS-4464: - Attachment: h4464_20120201b.patch Sure, destroySubtreeAndCollectBlocks sounds

[jira] [Commented] (HDFS-4453) Make a simple doc to describe the usage and design of the shortcircuit read feature

2013-02-01 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569354#comment-13569354 ] Colin Patrick McCabe commented on HDFS-4453: bq. Regarding /var/lib/hadoop-hdfs

[jira] [Updated] (HDFS-4404) Create file failure when the machine of first attempted NameNode is down

2013-02-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated HDFS-4404: -- Attachment: hdfs-4404.txt Fix the javadoc warning (missed a '}' character) Create

[jira] [Commented] (HDFS-4404) Create file failure when the machine of first attempted NameNode is down

2013-02-01 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569366#comment-13569366 ] Aaron T. Myers commented on HDFS-4404: -- The latest patch looks good to me. +1 pending

[jira] [Resolved] (HDFS-4464) Combine collectSubtreeBlocksAndClear with deleteDiffsForSnapshot

2013-02-01 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-4464. -- Resolution: Fixed Fix Version/s: Snapshot (HDFS-2802) Hadoop Flags:

[jira] [Commented] (HDFS-4462) 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569371#comment-13569371 ] Hadoop QA commented on HDFS-4462: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569379#comment-13569379 ] Hadoop QA commented on HDFS-4452: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-4452: -- Resolution: Fixed Fix Version/s: 2.0.3-alpha Status: Resolved (was:

[jira] [Commented] (HDFS-4452) getAdditionalBlock() can create multiple blocks if the client times out and retries.

2013-02-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569385#comment-13569385 ] Hudson commented on HDFS-4452: -- Integrated in Hadoop-trunk-Commit #3314 (See

[jira] [Commented] (HDFS-4404) Create file failure when the machine of first attempted NameNode is down

2013-02-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13569413#comment-13569413 ] Hadoop QA commented on HDFS-4404: - {color:green}+1 overall{color}. Here are the results of