[jira] Commented: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12969857#action_12969857 ] Raghu Angadi commented on HDFS-1377: +1. Thanks Eli. The warning in contentSummary() is

[jira] Commented: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12965378#action_12965378 ] Raghu Angadi commented on HDFS-1377: Thanks Eli. will review the patch tonight (tomorrow

[jira] Commented: (HDFS-1377) Quota bug for partial blocks allows quotas to be violated

[ https://issues.apache.org/jira/browse/HDFS-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12933651#action_12933651 ] Raghu Angadi commented on HDFS-1377: I am still refreshing my memory of this NN

[jira] Commented: (HDFS-1414) HDFS federation : fix unit test cases

[ https://issues.apache.org/jira/browse/HDFS-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12915422#action_12915422 ] Raghu Angadi commented on HDFS-1414: If the existing upgrade test fails, that implies

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844620#action_12844620 ] Raghu Angadi commented on HDFS-918: --- RE: Netty, I'm not very knowledgeable about it beyond

[jira] Commented: (HDFS-918) Use single Selector and small thread pool to replace many instances of BlockSender for reads

[ https://issues.apache.org/jira/browse/HDFS-918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12844278#action_12844278 ] Raghu Angadi commented on HDFS-918: --- Thanks Jay. This is a well known limitation on

[jira] Commented: (HDFS-729) fsck option to list only corrupted files

[ https://issues.apache.org/jira/browse/HDFS-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12806459#action_12806459 ] Raghu Angadi commented on HDFS-729: --- As I understand, list of files returned in one call

[jira] Commented: (HDFS-755) Read multiple checksum chunks at once in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12793113#action_12793113 ] Raghu Angadi commented on HDFS-755: --- User code should use buffering for application

[jira] Commented: (HDFS-729) fsck option to list only corrupted files

[ https://issues.apache.org/jira/browse/HDFS-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12789653#action_12789653 ] Raghu Angadi commented on HDFS-729: --- Hi Dhruba, Patch looks good. What would be an

[jira] Commented: (HDFS-755) Read multiple checksum chunks at once in DFSInputStream

[ https://issues.apache.org/jira/browse/HDFS-755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12786788#action_12786788 ] Raghu Angadi commented on HDFS-755: --- The patch looks good except that BlockReader.in seems

[jira] Commented: (HDFS-767) Job failure due to BlockMissingException

[ https://issues.apache.org/jira/browse/HDFS-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12784390#action_12784390 ] Raghu Angadi commented on HDFS-767: --- I just briefly looked at it. Essentially, you are

[jira] Commented: (HDFS-767) Job failure due to BlockMissingException

[ https://issues.apache.org/jira/browse/HDFS-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12780765#action_12780765 ] Raghu Angadi commented on HDFS-767: --- I wasn't aware of limit on number of accessors for

[jira] Commented: (HDFS-767) Job failure due to BlockMissingException

[ https://issues.apache.org/jira/browse/HDFS-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12780813#action_12780813 ] Raghu Angadi commented on HDFS-767: --- There is a global limit on number of threads in

[jira] Commented: (HDFS-777) A zero size file is created when SpaceQuota exceeded

[ https://issues.apache.org/jira/browse/HDFS-777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12780353#action_12780353 ] Raghu Angadi commented on HDFS-777: --- To restate a comment in HDFS-172. The file is created

[jira] Commented: (HDFS-763) DataBlockScanner reporting of bad blocks is slightly misleading

[ https://issues.apache.org/jira/browse/HDFS-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12777605#action_12777605 ] Raghu Angadi commented on HDFS-763: --- +1. totalErrors shown on 'blockScannerReport' now

[jira] Commented: (HDFS-770) SocketTimeoutException: timeout while waiting for channel to be ready for read

[ https://issues.apache.org/jira/browse/HDFS-770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12777612#action_12777612 ] Raghu Angadi commented on HDFS-770: --- From the datanode log : 2009-11-13 06:18:21,965

[jira] Commented: (HDFS-763) DataBlockScanner reporting of bad blocks is slightly misleading

[ https://issues.apache.org/jira/browse/HDFS-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1215#action_1215 ] Raghu Angadi commented on HDFS-763: --- I don't think this needs an extra unit test. That

[jira] Commented: (HDFS-763) DataBlockScanner reporting of bad blocks is slightly misleading

[ https://issues.apache.org/jira/browse/HDFS-763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12776689#action_12776689 ] Raghu Angadi commented on HDFS-763: --- +1. yes. it should be incremented only for real

[jira] Commented: (HDFS-732) HDFS files are ending up truncated

[ https://issues.apache.org/jira/browse/HDFS-732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12771012#action_12771012 ] Raghu Angadi commented on HDFS-732: --- 0.20 seems to be setting 'closed' to true inside a

[jira] Commented: (HDFS-738) Improve the disk utilization of HDFS

[ https://issues.apache.org/jira/browse/HDFS-738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12770558#action_12770558 ] Raghu Angadi commented on HDFS-738: --- DN always picked disks in round-robin. Are you using

[jira] Commented: (HDFS-729) fsck option to list only corrupted files

[ https://issues.apache.org/jira/browse/HDFS-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12769356#action_12769356 ] Raghu Angadi commented on HDFS-729: --- Is this a regular fsck with less output? That might

[jira] Commented: (HDFS-729) fsck option to list only corrupted files

[ https://issues.apache.org/jira/browse/HDFS-729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12769480#action_12769480 ] Raghu Angadi commented on HDFS-729: --- Using -metaSave as the tell me what is broke option

[jira] Commented: (HDFS-127) DFSClient block read failures cause open DFSInputStream to become unusable

[ https://issues.apache.org/jira/browse/HDFS-127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12757371#action_12757371 ] Raghu Angadi commented on HDFS-127: --- Raghu Finally, I am mainly proposing an explicit

[jira] Commented: (HDFS-516) Low Latency distributed reads

[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12756214#action_12756214 ] Raghu Angadi commented on HDFS-516: --- When you get a change please point me to the

[jira] Commented: (HDFS-599) Improve Namenode robustness by prioritizing datanode heartbeats over client requests

[ https://issues.apache.org/jira/browse/HDFS-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12756267#action_12756267 ] Raghu Angadi commented on HDFS-599: --- true, essentially we need a simple way to find

[jira] Commented: (HDFS-516) Low Latency distributed reads

[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12755627#action_12755627 ] Raghu Angadi commented on HDFS-516: --- bq. somehow, from 213 seconds to 112 seconds to

[jira] Commented: (HDFS-516) Low Latency distributed reads

[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12755033#action_12755033 ] Raghu Angadi commented on HDFS-516: --- Hi Jay, will go through the patch. I hope a few

[jira] Commented: (HDFS-503) Implement erasure coding as a layer on HDFS

[ https://issues.apache.org/jira/browse/HDFS-503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12753349#action_12753349 ] Raghu Angadi commented on HDFS-503: --- This seems pretty useful. since this is done outside

[jira] Updated: (HDFS-173) Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

[ https://issues.apache.org/jira/browse/HDFS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HDFS-173: -- Hadoop Flags: [Reviewed] Recursively deleting a directory with millions of files makes NameNode

[jira] Commented: (HDFS-559) Work out the memory consumption of NN artifacts on a compressed pointer JVM

[ https://issues.apache.org/jira/browse/HDFS-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12747650#action_12747650 ] Raghu Angadi commented on HDFS-559: --- Thats why sizeof(BlockInfo) is only a partial picture.

[jira] Commented: (HDFS-15) All replicas of a block end up on only 1 rack

[ https://issues.apache.org/jira/browse/HDFS-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12747719#action_12747719 ] Raghu Angadi commented on HDFS-15: -- +1. Looks good. one nit : the check needs to consider

[jira] Commented: (HDFS-15) All replicas of a block end up on only 1 rack

[ https://issues.apache.org/jira/browse/HDFS-15?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12745640#action_12745640 ] Raghu Angadi commented on HDFS-15: -- I am in favor of not having another list. I looked at

[jira] Commented: (HDFS-173) Recursively deleting a directory with millions of files makes NameNode unresponsive for other commands until the deletion completes

[ https://issues.apache.org/jira/browse/HDFS-173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12744660#action_12744660 ] Raghu Angadi commented on HDFS-173: --- First the target directory to be deleted will be

[jira] Commented: (HDFS-516) Low Latency distributed reads

[ https://issues.apache.org/jira/browse/HDFS-516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12738565#action_12738565 ] Raghu Angadi commented on HDFS-516: --- Jay, random read is an (increasingly more) important

[jira] Commented: (HDFS-487) HDFS should expose a fileid to uniquely identify a file

[ https://issues.apache.org/jira/browse/HDFS-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12732045#action_12732045 ] Raghu Angadi commented on HDFS-487: --- Dhruba, can you describe _how_ fileid helps with

[jira] Updated: (HDFS-463) CreateEditsLog utility broken due to FSImage URL scheme check

[ https://issues.apache.org/jira/browse/HDFS-463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HDFS-463: -- Tags: CreateEditLog FSImage Resolution: Fixed Hadoop Flags: [Reviewed]

[jira] Commented: (HDFS-487) HDFS should expose a fileid to uniquely identify a file

[ https://issues.apache.org/jira/browse/HDFS-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731617#action_12731617 ] Raghu Angadi commented on HDFS-487: --- Given that there is mapping from id to the file, I am

[jira] Commented: (HDFS-487) HDFS should expose a fileid to uniquely identify a file

[ https://issues.apache.org/jira/browse/HDFS-487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731620#action_12731620 ] Raghu Angadi commented on HDFS-487: --- Given that there is mapping [...] should be 'there is

[jira] Commented: (HDFS-463) CreateEditsLog utility broken due to FSImage URL scheme check

[ https://issues.apache.org/jira/browse/HDFS-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731115#action_12731115 ] Raghu Angadi commented on HDFS-463: --- Looks like the fix might just be replacing 'new

[jira] Commented: (HDFS-463) CreateEditsLog utility broken due to FSImage URL scheme check

[ https://issues.apache.org/jira/browse/HDFS-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731141#action_12731141 ] Raghu Angadi commented on HDFS-463: --- Does it imply CreateEditLog works with non-file

[jira] Commented: (HDFS-463) CreateEditsLog utility broken due to FSImage URL scheme check

[ https://issues.apache.org/jira/browse/HDFS-463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12731148#action_12731148 ] Raghu Angadi commented on HDFS-463: --- Right, you need the first hunk in your patch as well..

[jira] Commented: (HDFS-397) Incorporate storage directories into EditLogFileInput/Output streams

[ https://issues.apache.org/jira/browse/HDFS-397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12730464#action_12730464 ] Raghu Angadi commented on HDFS-397: --- Regd 1) : What about 'STORAGE_JSPOOL_DIR' which

[jira] Commented: (HDFS-445) pread() fails when cached block locations are no longer valid

[ https://issues.apache.org/jira/browse/HDFS-445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729808#action_12729808 ] Raghu Angadi commented on HDFS-445: --- +1. This is an important fix for clients that keep a

[jira] Updated: (HDFS-439) HADOOP-5961 is incorrectly committed.

[ https://issues.apache.org/jira/browse/HDFS-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HDFS-439: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. HADOOP-5961

[jira] Commented: (HDFS-473) TestHdfsProxy fails in Linux

[ https://issues.apache.org/jira/browse/HDFS-473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12729818#action_12729818 ] Raghu Angadi commented on HDFS-473: --- HDFS-439 is committed. I think this jira can be

[jira] Commented: (HDFS-297) Implement a pure Java CRC32 calculator

[ https://issues.apache.org/jira/browse/HDFS-297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12728440#action_12728440 ] Raghu Angadi commented on HDFS-297: --- +1 for committing. pretty significant improvement in