[jira] Commented: (HADOOP-1194) map output should not do block level compression

[ https://issues.apache.org/jira/browse/HADOOP-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486249 ] Hadoop QA commented on HADOOP-1194: --- +1, because http://issues.apache.org/jira/secure/attachment/12354810/HADOOP-

[jira] Updated: (HADOOP-1127) Speculative Execution and output of Reduce tasks

[ https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1127: -- Status: Open (was: Patch Available) Nigel complains that tests hang with this patch... rechec

[jira] Commented: (HADOOP-1183) MapTask completion not recorded properly at the Reducer's end

[ https://issues.apache.org/jira/browse/HADOOP-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486268 ] Devaraj Das commented on HADOOP-1183: - I agree with Owen that the fetcher needs some redesigning on those lines.

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486289 ] Arun C Murthy commented on HADOOP-1181: --- Michael, I was going through your patch and conjured up an alterna

[jira] Resolved: (HADOOP-291) Hadoop Log Archiver/Analyzer utility

[ https://issues.apache.org/jira/browse/HADOOP-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-291. -- Resolution: Duplicate Duplicate of HADOOP-342 > Hadoop Log Archiver/Analyzer utility > ---

[jira] Commented: (HADOOP-1175) the user output/logs are broken from the web ui

[ https://issues.apache.org/jira/browse/HADOOP-1175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486304 ] Hadoop QA commented on HADOOP-1175: --- Integrated in Hadoop-Nightly #46 (See http://lucene.zones.apache.org:8080/hu

[jira] Commented: (HADOOP-1191) MapTask should wait for the status reporting thread to die before invoking the TaskUmbilicalProtocol.done(taskid)

[ https://issues.apache.org/jira/browse/HADOOP-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486303 ] Hadoop QA commented on HADOOP-1191: --- Integrated in Hadoop-Nightly #46 (See http://lucene.zones.apache.org:8080/hu

[jira] Created: (HADOOP-1196) StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark

StreamXmlRecordReader throws java.io.IOException: Resetting to invalid mark --- Key: HADOOP-1196 URL: https://issues.apache.org/jira/browse/HADOOP-1196 Project: Hadoop I

[jira] Created: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

The misleading Configuration.set(String, Object) should be removed -- Key: HADOOP-1197 URL: https://issues.apache.org/jira/browse/HADOOP-1197 Project: Hadoop Issue Type: Bug

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486407 ] Doug Cutting commented on HADOOP-1181: -- Related to this, it would be great to have an InputFormat implementatio

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486411 ] Doug Cutting commented on HADOOP-1134: -- > 3) If there is no existing CRC data available for some reason, we gen

[jira] Updated: (HADOOP-1127) Speculative Execution and output of Reduce tasks

[ https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1127: -- Attachment: HADOOP-1127_20070403_4.patch Fixed some minor bugs which caused test cases to fail

[jira] Created: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases -- Key: HADOOP-1198 URL: https://iss

[jira] Updated: (HADOOP-1127) Speculative Execution and output of Reduce tasks

[ https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1127: -- Status: Patch Available (was: Open) > Speculative Execution and output of Reduce tasks >

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486432 ] Raghu Angadi commented on HADOOP-1198: -- Just curious, why is 5 seconds ok? Is this based on some expected serve

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486433 ] Doug Cutting commented on HADOOP-1134: -- > After the upgrade, I think it is cleaner and simpler to treat this as

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj Das updated HADOOP-1105: Attachment: 1105.new1.patch Thanks Owen for pointing out the flaw with the patch!! I was too conce

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486436 ] Doug Cutting commented on HADOOP-1198: -- It was 1 second for many months, until I increased it to 2 seconds in

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486435 ] Arun C Murthy commented on HADOOP-1181: --- Actually (we probably should take this discussion elsewhere, so +1 fo

[jira] Commented: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486425 ] Doug Cutting commented on HADOOP-1197: -- +1 for deprecating these methods, and removing them in a subsequent rel

[jira] Commented: (HADOOP-1127) Speculative Execution and output of Reduce tasks

[ https://issues.apache.org/jira/browse/HADOOP-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486426 ] Hadoop QA commented on HADOOP-1127: --- +1, because http://issues.apache.org/jira/secure/attachment/12354863/HADOOP-

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486429 ] Raghu Angadi commented on HADOOP-1134: -- > I think we should handle this the same way we'll handle things if/wh

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486441 ] Arun C Murthy commented on HADOOP-1198: --- On my gentoo (2.6.16.11) with 1GB of ram I see too many timeouts with

[jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1198: -- Attachment: HADOOP-1198_20070403_1.patch Increasing it to 5000ms... thoughts? > ipc.client.ti

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486431 ] Raghu Angadi commented on HADOOP-1134: -- > Since CRC is served inline on the connection, [...] This is for hand

Re: [jira] Updated: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

Seems right. I've seen lots of IPC timeouts on our Solaris build machine. On Apr 3, 2007, at 10:26 AM, Arun C Murthy (JIRA) wrote: [ https://issues.apache.org/jira/browse/HADOOP-1198? page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated HADOOP-1

[jira] Created: (HADOOP-1199) want InputFormat for task logs

want InputFormat for task logs -- Key: HADOOP-1199 URL: https://issues.apache.org/jira/browse/HADOOP-1199 Project: Hadoop Issue Type: New Feature Components: mapred Reporter: Doug Cutting W

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486442 ] Raghu Angadi commented on HADOOP-1198: -- 5 sec is obviously an improvement I think. Doug answered my concern..

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486444 ] Raghu Angadi commented on HADOOP-1134: -- > If the only copy of a block has no CRC, shouldn't we still permit fol

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486445 ] Doug Cutting commented on HADOOP-1181: -- > Actually (we probably should take this discussion elsewhere, so +1 fo

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486448 ] Doug Cutting commented on HADOOP-1181: -- > Get all tasklogs for a given jobid > $ hadoop job -tasklogs The nat

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486450 ] Doug Cutting commented on HADOOP-1198: -- > Total test time on my box: ~22mins. That's with a 5 second timeout?

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486451 ] Doug Cutting commented on HADOOP-1134: -- > I wanted to imply if CRC file does not exist, it will be treated just

[jira] Commented: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486452 ] Arun C Murthy commented on HADOOP-1181: --- I misunderstood the feature you were proposing Doug; I agree HADOOP-1

[jira] Commented: (HADOOP-968) Reduce shuffle and merge should be done a child JVM

[ https://issues.apache.org/jira/browse/HADOOP-968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486453 ] Devaraj Das commented on HADOOP-968: The salient points of the design: On the TaskTracker 1) The TaskTracker main

[jira] Updated: (HADOOP-1192) Du command takes a noticable longer time to execute on a large dfs than the 0.11 release

[ https://issues.apache.org/jira/browse/HADOOP-1192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1192: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Commented: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

[ https://issues.apache.org/jira/browse/HADOOP-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486455 ] Andrzej Bialecki commented on HADOOP-1197: --- These methods were added to support caching of transient Obje

Re: [jira] Commented: (HADOOP-1197) The misleading Configuration.set(String, Object) should be removed

Perhaps a clarification in the javadoc would be sufficient? That would certainly help. See HADOOP-742. On Apr 3, 2007, at 11:21 AM, Andrzej Bialecki (JIRA) wrote: [ https://issues.apache.org/jira/browse/HADOOP-1197? page=com.atlassian.jira.plugin.system.issuetabpanels:comment- tabpane

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486458 ] Raghu Angadi commented on HADOOP-1134: -- Doing so implies that we should implement improved treatment of corrup

[jira] Created: (HADOOP-1200) Datanode should periodically do a disk check

Datanode should periodically do a disk check Key: HADOOP-1200 URL: https://issues.apache.org/jira/browse/HADOOP-1200 Project: Hadoop Issue Type: Bug Components: dfs Affects Versions:

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486459 ] Doug Cutting commented on HADOOP-1134: -- > Doing so implies that we should implement improved treatment of corru

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486461 ] Arun C Murthy commented on HADOOP-1198: --- Yes, that was with a 5s timeout. I ran without ipc.client.timeout in

[jira] Commented: (HADOOP-1200) Datanode should periodically do a disk check

[ https://issues.apache.org/jira/browse/HADOOP-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486465 ] Koji Noguchi commented on HADOOP-1200: -- I've seen many occasions when one of the disks become read-only and Tas

[jira] Commented: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486471 ] dhruba borthakur commented on HADOOP-971: - +1. I have been running this code successfully on a 1800 node dfs

[jira] Commented: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486472 ] dhruba borthakur commented on HADOOP-1093: -- I am not too inclined to check if the last block has achieved i

[jira] Commented: (HADOOP-1149) DFS Scalability: high cpu usage in addStoredBlock

[ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486475 ] dhruba borthakur commented on HADOOP-1149: -- +1. Code reviewed. > DFS Scalability: high cpu usage in addSt

[jira] Updated: (HADOOP-1136) exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required

[ https://issues.apache.org/jira/browse/HADOOP-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1136: - Component/s: dfs > exception in UnderReplicatedBlocks:add when ther are more replicas of

[jira] Updated: (HADOOP-1055) Decommission/exclude only recognizes IP addresses in hosts and exclude files

[ https://issues.apache.org/jira/browse/HADOOP-1055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1055: - Component/s: dfs > Decommission/exclude only recognizes IP addresses in hosts and exclud

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486480 ] Sameer Paranjpye commented on HADOOP-1134: -- We should not generate new CRCs or do anything with blocks that

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486481 ] Doug Cutting commented on HADOOP-1134: -- > we should have some conventions like 'checksum of followed by so

[jira] Updated: (HADOOP-1081) JAVA_PLATFORM with spaces (i.e. Mac OS X-ppc-32) breaks bin/hadoop script

[ https://issues.apache.org/jira/browse/HADOOP-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1081: - Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available

[jira] Commented: (HADOOP-1189) Still seeing some unexpected 'No space left on device' exceptions

[ https://issues.apache.org/jira/browse/HADOOP-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486487 ] Hairong Kuang commented on HADOOP-1189: --- +1 This patch is intended for identifying the problem. So we probabl

[jira] Updated: (HADOOP-1045) Code for HBase

[ https://issues.apache.org/jira/browse/HADOOP-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1045: - Resolution: Fixed Fix Version/s: 0.13.0 Status: Resolved (was: Patch Available

[jira] Updated: (HADOOP-1156) NullPointerException in MiniDFSCluster

[ https://issues.apache.org/jira/browse/HADOOP-1156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1156: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486492 ] Raghu Angadi commented on HADOOP-1134: -- Not generating missing CRCs sounds fine and in the initial release dat

[jira] Updated: (HADOOP-1189) Still seeing some unexpected 'No space left on device' exceptions

[ https://issues.apache.org/jira/browse/HADOOP-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-1189: - Status: Patch Available (was: Open) Thanks Hairong. Yes, this only improves log message. I'm no

[jira] Commented: (HADOOP-1149) DFS Scalability: high cpu usage in addStoredBlock

[ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486494 ] Raghu Angadi commented on HADOOP-1149: -- will make patch available after HADOOP-702 and friends are checked in.

[jira] Updated: (HADOOP-1181) userlogs reader

[ https://issues.apache.org/jira/browse/HADOOP-1181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] [EMAIL PROTECTED] updated HADOOP-1181: -- Attachment: hadoop1181-v3.patch I like both of the above suggestions. Arun's integrate

[jira] Commented: (HADOOP-1189) Still seeing some unexpected 'No space left on device' exceptions

[ https://issues.apache.org/jira/browse/HADOOP-1189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486499 ] Hadoop QA commented on HADOOP-1189: --- +1, because http://issues.apache.org/jira/secure/attachment/12354781/HADOOP-

[jira] Updated: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-702: --- Attachment: (was: FSStateTransition.patch) > DFS Upgrade Proposal > -

[jira] Updated: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-702: --- Attachment: FSStateTransitionApr03.patch Multiple patches have been committed that su

[jira] Updated: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-702: --- Status: Patch Available (was: Open) > DFS Upgrade Proposal > >

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486501 ] Doug Cutting commented on HADOOP-1134: -- This issue should implement (1). (2) is desirable long-term, since it

[jira] Commented: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486503 ] Hadoop QA commented on HADOOP-702: -- +1, because http://issues.apache.org/jira/secure/attachment/12354886/FSStateTra

[jira] Commented: (HADOOP-1198) ipc.client.timeout of 2000ms for test cases seems too small; causes too many timeouts and leads to hung test cases

[ https://issues.apache.org/jira/browse/HADOOP-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486505 ] Raghu Angadi commented on HADOOP-1198: -- In my test time went from 12 min with 2 sec to 13 min with 60 sec time

[jira] Updated: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-702: Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thanks,

Re: slip 0.13 release to May?

Nigel Daley wrote: +1 for May 0.13.0 release following the new process. I updated Jira accordingly. Doug

[jira] Commented: (HADOOP-702) DFS Upgrade Proposal

[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486511 ] Owen O'Malley commented on HADOOP-702: -- My objections have been addressed and I think this should be committed.

[jira] Updated: (HADOOP-1187) DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks

[ https://issues.apache.org/jira/browse/HADOOP-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1187: - Attachment: clientPendingCreate2.patch Merged with latest code. > DFS Scalability: avoi

[jira] Updated: (HADOOP-1187) DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks

[ https://issues.apache.org/jira/browse/HADOOP-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1187: - Attachment: (was: clientPendingCreate.patch) > DFS Scalability: avoid scanning entir

[jira] Updated: (HADOOP-1187) DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks

[ https://issues.apache.org/jira/browse/HADOOP-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1187: - Status: Patch Available (was: Open) > DFS Scalability: avoid scanning entire list of da

[jira] Commented: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486516 ] Hairong Kuang commented on HADOOP-1093: --- The check is only to see if the # of replicas has reached the minimun

[jira] Updated: (HADOOP-1133) Tools to analyze and debug namenode on a production cluster

[ https://issues.apache.org/jira/browse/HADOOP-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1133: - Attachment: metasave3.patch Merged with latest trunk. > Tools to analyze and debug name

[jira] Updated: (HADOOP-1133) Tools to analyze and debug namenode on a production cluster

[ https://issues.apache.org/jira/browse/HADOOP-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1133: - Attachment: (was: metasave.patch) > Tools to analyze and debug namenode on a product

[jira] Updated: (HADOOP-1133) Tools to analyze and debug namenode on a production cluster

[ https://issues.apache.org/jira/browse/HADOOP-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dhruba borthakur updated HADOOP-1133: - Status: Patch Available (was: Open) A tools that dumps namenode data structures into a

[jira] Updated: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang updated HADOOP-971: - Fix Version/s: 0.13.0 Affects Version/s: (was: 0.11.0) 0.12.2

[jira] Commented: (HADOOP-1187) DFS Scalability: avoid scanning entire list of datanodes in getAdditionalBlocks

[ https://issues.apache.org/jira/browse/HADOOP-1187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486522 ] Hadoop QA commented on HADOOP-1187: --- +1, because http://issues.apache.org/jira/secure/attachment/12354888/clientP

[jira] Assigned: (HADOOP-1118) NullPointerException in DistributedFileSystem$RawDistributedFileSystem.reportChecksumFailure

[ https://issues.apache.org/jira/browse/HADOOP-1118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hairong Kuang reassigned HADOOP-1118: - Assignee: Hairong Kuang > NullPointerException in > DistributedFileSystem$RawDistribute

[jira] Commented: (HADOOP-1133) Tools to analyze and debug namenode on a production cluster

[ https://issues.apache.org/jira/browse/HADOOP-1133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486523 ] Hadoop QA commented on HADOOP-1133: --- +1, because http://issues.apache.org/jira/secure/attachment/12354889/metasav

[jira] Updated: (HADOOP-988) Namenode should use single map for block to its meta data.

[ https://issues.apache.org/jira/browse/HADOOP-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-988: Attachment: HADOOP-988-5.patch Update patch for conflicts. > Namenode should use single map for b

[jira] Updated: (HADOOP-988) Namenode should use single map for block to its meta data.

[ https://issues.apache.org/jira/browse/HADOOP-988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-988: Fix Version/s: 0.13.0 Status: Patch Available (was: Open) > Namenode should use single

[jira] Updated: (HADOOP-1149) DFS Scalability: high cpu usage in addStoredBlock

[ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-1149: - Fix Version/s: 0.13.0 Status: Patch Available (was: Open) > DFS Scalability: high cp

[jira] Updated: (HADOOP-1073) DFS Scalability: high CPU usage in choosing replication targets and file open

[ https://issues.apache.org/jira/browse/HADOOP-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-1073: - Status: Patch Available (was: Open) The patch applies with the latest trunk. > DFS Scalability

[jira] Updated: (HADOOP-1136) exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required

[ https://issues.apache.org/jira/browse/HADOOP-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi updated HADOOP-1136: - Status: Patch Available (was: Open) > exception in UnderReplicatedBlocks:add when ther are more

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1105: -- Status: Patch Available (was: Open) > Reducers don't make "progress" while iterating through

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1105: -- Attachment: 1105-3.patch I think that we should limit this patch to just the bugfix to prevent

[jira] Assigned: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-1105: - Assignee: Owen O'Malley (was: Devaraj Das) > Reducers don't make "progress" while itera

[jira] Commented: (HADOOP-971) DFS Scalabilty: Improve name node performance by adding a hostname to datanodes map

[ https://issues.apache.org/jira/browse/HADOOP-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486532 ] Hadoop QA commented on HADOOP-971: -- +1, because http://issues.apache.org/jira/secure/attachment/12354797/Host2Nodes

[jira] Commented: (HADOOP-988) Namenode should use single map for block to its meta data.

[ https://issues.apache.org/jira/browse/HADOOP-988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486536 ] Hadoop QA commented on HADOOP-988: -- +1, because http://issues.apache.org/jira/secure/attachment/12354892/HADOOP-988

[jira] Commented: (HADOOP-620) replication factor should be calucalated based on actual dfs block sizes at the NameNode.

[ https://issues.apache.org/jira/browse/HADOOP-620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486537 ] Raghu Angadi commented on HADOOP-620: - Test. Please ignore: | | > replication factor should be c

[jira] Commented: (HADOOP-1073) DFS Scalability: high CPU usage in choosing replication targets and file open

[ https://issues.apache.org/jira/browse/HADOOP-1073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486538 ] Hadoop QA commented on HADOOP-1073: --- +1, because http://issues.apache.org/jira/secure/attachment/12353899/getDist

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486539 ] Raghu Angadi commented on HADOOP-1134: -- Proposed protocol for data transfers. Use for 'OPs' e.g OP_WRITE_BLOCK

[jira] Commented: (HADOOP-1149) DFS Scalability: high cpu usage in addStoredBlock

[ https://issues.apache.org/jira/browse/HADOOP-1149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486541 ] Hadoop QA commented on HADOOP-1149: --- +1, because http://issues.apache.org/jira/secure/attachment/12354802/HADOOP-

[jira] Commented: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486542 ] Hadoop QA commented on HADOOP-1105: --- +1, because http://issues.apache.org/jira/secure/attachment/12354893/1105-3.

[jira] Commented: (HADOOP-1093) NNBench generates millions of NotReplicatedYetException in Namenode log

[ https://issues.apache.org/jira/browse/HADOOP-1093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486546 ] Konstantin Shvachko commented on HADOOP-1093: - 0. This patch does not apply since it has Index: src/test

[jira] Commented: (HADOOP-1136) exception in UnderReplicatedBlocks:add when ther are more replicas of a block than required

[ https://issues.apache.org/jira/browse/HADOOP-1136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12486547 ] Hadoop QA commented on HADOOP-1136: --- +1, because http://issues.apache.org/jira/secure/attachment/12353893/neededR

[jira] Created: (HADOOP-1201) Progress reporting can be improved for both Map/Reduce tasks

Progress reporting can be improved for both Map/Reduce tasks Key: HADOOP-1201 URL: https://issues.apache.org/jira/browse/HADOOP-1201 Project: Hadoop Issue Type: Improvement

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1105: -- Status: Open (was: Patch Available) Devaraj pointed out that I shouldn't have added IOExcepti

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1105: -- Attachment: 1105-4.patch This version of the patch removes the IOException from informReducePr

[jira] Updated: (HADOOP-1105) Reducers don't make "progress" while iterating through values

[ https://issues.apache.org/jira/browse/HADOOP-1105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1105: -- Status: Patch Available (was: Open) > Reducers don't make "progress" while iterating through

  1   2   >