[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484347 ] Tom White commented on HADOOP-1161: --- +1 Can we take "code freeze" to mean "code freeze in a particular branch"? S

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484431 ] James P. White commented on HADOOP-1161: Owen said that he thinks bug fixes go on the branches first, which

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Attachment: 1001.patch Patch to check the type of keys and values generated by the mapper agains

[jira] Updated: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Tahir Hashmi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tahir Hashmi updated HADOOP-1001: - Status: Patch Available (was: Open) > the output of the map is not type checked against the spe

[jira] Commented: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_1248 ] Hadoop QA commented on HADOOP-1001: --- +1, because http://issues.apache.org/jira/secure/attachment/12354321/1001.pat

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484517 ] Arun C Murthy commented on HADOOP-1161: --- Actually I'd like to propose a small variation of Tom's thoughts: St

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484520 ] Milind Bhandarkar commented on HADOOP-1162: --- I agree that the unit test needs to be enhanced. However, I h

[jira] Commented: (HADOOP-1130) Remove unused ClientFinalizer in DFSClient

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484500 ] Owen O'Malley commented on HADOOP-1130: --- Jira keeps eating my comments on this issue. *sigh* > As hadoop may

[jira] Commented: (HADOOP-1153) DataNode and FSNamesystem don't shutdown cleanly

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484522 ] Hadoop QA commented on HADOOP-1153: --- +1, because http://issues.apache.org/jira/secure/attachment/12354285/Interru

[jira] Commented: (HADOOP-1153) DataNode and FSNamesystem don't shutdown cleanly

2007-03-27 Thread dhruba borthakur (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484512 ] dhruba borthakur commented on HADOOP-1153: -- +1 Code reviewed. > DataNode and FSNamesystem don't shutdown

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484524 ] Milind Bhandarkar commented on HADOOP-1162: --- I found the bug. It is in Buffer.toString. However, I am in t

[jira] Updated: (HADOOP-1130) Remove unused ClientFinalizer in DFSClient

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1130: -- Status: Open (was: Patch Available) > Remove unused ClientFinalizer in DFSClient > --

[jira] Updated: (HADOOP-1153) DataNode and FSNamesystem don't shutdown cleanly

2007-03-27 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HADOOP-1153: Status: Patch Available (was: Open) > DataNode and FSNamesystem don't shutdown cl

[jira] Created: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread David Bowen (JIRA)
Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16. - Key: HADOOP-1162 URL: https://issues.apache.org/jira/browse/HADOOP-1162

[jira] Updated: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HADOOP-1162: -- Attachment: jute-patch.txt This bug also affects the XML serialization of buffers. Thi

[jira] Assigned: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar reassigned HADOOP-1162: - Assignee: Milind Bhandarkar > Record IO: seariliizing a byte buffer to CSV fails

[jira] Updated: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HADOOP-1162: -- Fix Version/s: 0.12.3 Affects Version/s: 0.12.2 Status: Patch Av

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484530 ] Doug Cutting commented on HADOOP-1161: -- > I'd strongly vote for a code-freeze [ ... ] I think "code freeze" mi

[jira] Updated: (HADOOP-702) DFS Upgrade Proposal

2007-03-27 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-702: --- Status: Open (was: Patch Available) I'll reworking some of the tests to address Owen's concerns. The

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484537 ] Hadoop QA commented on HADOOP-1162: --- +1, because http://issues.apache.org/jira/secure/attachment/12354338/jute-pa

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Arun C Murthy (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484539 ] Arun C Murthy commented on HADOOP-1161: --- >The alternative is to simply to stall patches that add new features

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484538 ] Doug Cutting commented on HADOOP-1134: -- > 64KB is only for new blocks. I thought we'd benchmark before we chan

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484541 ] Raghu Angadi commented on HADOOP-1134: -- Upgrade from previous versions requires quite a bit of interaction wit

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484544 ] Doug Cutting commented on HADOOP-1134: -- > I propose to clearly mark such code as temporary and remove it in nex

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484545 ] Raghu Angadi commented on HADOOP-1134: -- >> 64KB is only for new blocks. > I thought we'd benchmark before we c

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484547 ] Doug Cutting commented on HADOOP-1134: -- > If source datanode does not check for errors, how would you propose w

[jira] Commented: (HADOOP-1134) Block level CRCs in HDFS

2007-03-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484548 ] Raghu Angadi commented on HADOOP-1134: -- > It's worth noting that, if a .crc file cannot be found for a block, t

[jira] Created: (HADOOP-1163) Ganglia metrics reporting is misconfigured

2007-03-27 Thread Michael Bieniosek (JIRA)
Ganglia metrics reporting is misconfigured -- Key: HADOOP-1163 URL: https://issues.apache.org/jira/browse/HADOOP-1163 Project: Hadoop Issue Type: Bug Components: metrics Affects Versions:

[jira] Commented: (HADOOP-1163) Ganglia metrics reporting is misconfigured

2007-03-27 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484564 ] Michael Bieniosek commented on HADOOP-1163: --- My patch (I can't attach in the standard way since this issue

[jira] Commented: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Tom White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484570 ] Tom White commented on HADOOP-1159: --- By catching Exception, InterruptedException is also caught so it can no longe

[jira] Updated: (HADOOP-1153) DataNode and FSNamesystem don't shutdown cleanly

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1153: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484577 ] David Bowen commented on HADOOP-1162: - +1. Code reviewed and looks fine. A small safe fix. > Record IO: sear

[jira] Updated: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Doug Cutting (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Doug Cutting updated HADOOP-1162: - Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this. Thank

[jira] Commented: (HADOOP-1081) JAVA_PLATFORM with spaces (i.e. Mac OS X-ppc-32) breaks bin/hadoop script

2007-03-27 Thread Michael Bieniosek (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484583 ] Michael Bieniosek commented on HADOOP-1081: --- +1 > JAVA_PLATFORM with spaces (i.e. Mac OS X-ppc-32) breaks

[jira] Updated: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1159: -- Status: Open (was: Patch Available) Good catch, Tom. I'll upload a patch shortly. > Reducers

[jira] Created: (HADOOP-1164) TestReplicationPolicy doesn't use port 0 for the NameNode

2007-03-27 Thread Owen O'Malley (JIRA)
TestReplicationPolicy doesn't use port 0 for the NameNode - Key: HADOOP-1164 URL: https://issues.apache.org/jira/browse/HADOOP-1164 Project: Hadoop Issue Type: Bug Components:

[jira] Created: (HADOOP-1165) Code for toString in code generated by Record I/O Compiler can be generic

2007-03-27 Thread Milind Bhandarkar (JIRA)
Code for toString in code generated by Record I/O Compiler can be generic - Key: HADOOP-1165 URL: https://issues.apache.org/jira/browse/HADOOP-1165 Project: Hadoop Issue

[jira] Work started: (HADOOP-1165) Code for toString in code generated by Record I/O Compiler can be generic

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-1165 started by Milind Bhandarkar. > Code for toString in code generated by Record I/O Compiler can be generic > -

[jira] Updated: (HADOOP-1165) Code for toString in code generated by Record I/O Compiler can be generic

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HADOOP-1165: -- Attachment: jute-patch.txt Patch attached. > Code for toString in code generated by R

[jira] Updated: (HADOOP-1165) Code for toString in code generated by Record I/O Compiler can be generic

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Milind Bhandarkar updated HADOOP-1165: -- Status: Patch Available (was: In Progress) > Code for toString in code generated by R

[jira] Updated: (HADOOP-1164) TestReplicationPolicy doesn't use port 0 for the NameNode

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1164: -- Attachment: h1164.patch This changes the port to be "0" which causes the system to pick a port

[jira] Updated: (HADOOP-1164) TestReplicationPolicy doesn't use port 0 for the NameNode

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1164: -- Status: Patch Available (was: Open) > TestReplicationPolicy doesn't use port 0 for the NameNo

[jira] Updated: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1159: -- Attachment: h1159-2.patch This patch moves the catch of InterruptedException before the catch

[jira] Commented: (HADOOP-1165) Code for toString in code generated by Record I/O Compiler can be generic

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484601 ] Hadoop QA commented on HADOOP-1165: --- +1, because http://issues.apache.org/jira/secure/attachment/12354351/jute-pa

[jira] Updated: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1159: -- Status: Patch Available (was: Open) > Reducers hang when map output file has a checksum error

[jira] Updated: (HADOOP-1123) LocalFileSystem gets a NullPointerException when tries to recover from ChecksumError

2007-03-27 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-1123: Attachment: 1123_with_test.patch New patch with a test case. > LocalFileSystem gets a NullPointer

[jira] Updated: (HADOOP-1123) LocalFileSystem gets a NullPointerException when tries to recover from ChecksumError

2007-03-27 Thread Nigel Daley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nigel Daley updated HADOOP-1123: Status: Patch Available (was: Open) > LocalFileSystem gets a NullPointerException when tries to r

[jira] Created: (HADOOP-1166) Pull the NullOutputFormat into the lib package

2007-03-27 Thread Owen O'Malley (JIRA)
Pull the NullOutputFormat into the lib package -- Key: HADOOP-1166 URL: https://issues.apache.org/jira/browse/HADOOP-1166 Project: Hadoop Issue Type: Improvement Components: mapred Af

[jira] Commented: (HADOOP-1164) TestReplicationPolicy doesn't use port 0 for the NameNode

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484608 ] Hadoop QA commented on HADOOP-1164: --- +1, because http://issues.apache.org/jira/secure/attachment/12354353/h1164.p

[jira] Commented: (HADOOP-1163) Ganglia metrics reporting is misconfigured

2007-03-27 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484609 ] David Bowen commented on HADOOP-1163: - +1 code reviewed. Looks good. > Ganglia metrics reporting is misconf

[jira] Updated: (HADOOP-1166) Pull the NullOutputFormat into the lib package

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1166: -- Status: Patch Available (was: Open) > Pull the NullOutputFormat into the lib package > --

[jira] Updated: (HADOOP-1166) Pull the NullOutputFormat into the lib package

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1166: -- Attachment: h1166.patch This patch adds a NullOutputFormat and pulls the code out of RandomWri

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread David Bowen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484611 ] David Bowen commented on HADOOP-1162: - Not quite two times, I think. Are you switching to base-64 encoding? -

[jira] Commented: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484617 ] Hadoop QA commented on HADOOP-1159: --- +1, because http://issues.apache.org/jira/secure/attachment/12354356/h1159-2

[jira] Commented: (HADOOP-1123) LocalFileSystem gets a NullPointerException when tries to recover from ChecksumError

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484622 ] Owen O'Malley commented on HADOOP-1123: --- +1 > LocalFileSystem gets a NullPointerException when tries to recov

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484623 ] Milind Bhandarkar commented on HADOOP-1162: --- No, I use hex pairs. So, one byte is serialized as two chars

[jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread Milind Bhandarkar (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484625 ] Milind Bhandarkar commented on HADOOP-1162: --- Oh, i misunderstood your question. I am switching buffer seri

[jira] Commented: (HADOOP-1166) Pull the NullOutputFormat into the lib package

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484626 ] Hadoop QA commented on HADOOP-1166: --- +1, because http://issues.apache.org/jira/secure/attachment/12354367/h1166.p

[jira] Created: (HADOOP-1167) InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways

2007-03-27 Thread Owen O'Malley (JIRA)
InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways --- Key: HADOOP-1167 URL: https://issues.apache.org/jira/browse/HADOOP-1167 Project: Hadoop I

[jira] Updated: (HADOOP-1167) InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1167: -- Status: Patch Available (was: Open) > InMemoryFileSystem uses synchronizedtMaps with maps tha

[jira] Updated: (HADOOP-1167) InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-1167: -- Attachment: h1167.patch > InMemoryFileSystem uses synchronizedtMaps with maps that are locked

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484629 ] Raghu Angadi commented on HADOOP-1161: -- > We already do have a branch for each major release. The question is

[jira] Commented: (HADOOP-1123) LocalFileSystem gets a NullPointerException when tries to recover from ChecksumError

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484633 ] Hadoop QA commented on HADOOP-1123: --- +1, because http://issues.apache.org/jira/secure/attachment/12354361/1123_wi

[jira] Commented: (HADOOP-1167) InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484638 ] Hadoop QA commented on HADOOP-1167: --- +1, because http://issues.apache.org/jira/secure/attachment/12354373/h1167.p

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484647 ] Owen O'Malley commented on HADOOP-1161: --- > I do not like the idea of applying the same patch more than one pla

[jira] Created: (HADOOP-1168) Not able to refresh file cache

2007-03-27 Thread Hairong Kuang (JIRA)
Not able to refresh file cache -- Key: HADOOP-1168 URL: https://issues.apache.org/jira/browse/HADOOP-1168 Project: Hadoop Issue Type: Bug Components: mapred Affects Versions: 0.12.2 Repor

[jira] Created: (HADOOP-1169) CopyFiles skips src files of s3 urls

2007-03-27 Thread [EMAIL PROTECTED] (JIRA)
CopyFiles skips src files of s3 urls Key: HADOOP-1169 URL: https://issues.apache.org/jira/browse/HADOOP-1169 Project: Hadoop Issue Type: Bug Components: util Affects Versions: 0.12.2

Re: [jira] Commented: (HADOOP-1162) Record IO: seariliizing a byte buffer to CSV fails if buffer contains bytes less than 16.

2007-03-27 Thread David Bowen
> > Oh, i misunderstood your question. I am switching buffer serialization to > just plain bytes except for 5 characters that are escaped (essentially > similar to string serialization as if the string were iso-8859-1.) > I'm not sure I follow. I think string serialization implies UTF-8 enco

[jira] Updated: (HADOOP-1169) CopyFiles skips src files of s3 urls

2007-03-27 Thread [EMAIL PROTECTED] (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] [EMAIL PROTECTED] updated HADOOP-1169: -- Attachment: hadoop1169.patch > CopyFiles skips src files of s3 urls >

[jira] Updated: (HADOOP-1169) CopyFiles skips src files of s3 urls

2007-03-27 Thread [EMAIL PROTECTED] (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] [EMAIL PROTECTED] updated HADOOP-1169: -- Status: Patch Available (was: Open) Patch attached. > CopyFiles skips src files of s

[jira] Commented: (HADOOP-1161) need improved release process

2007-03-27 Thread James P. White (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484665 ] James P. White commented on HADOOP-1161: >> I do not like the idea of applying the same patch more than one

[jira] Commented: (HADOOP-1169) CopyFiles skips src files of s3 urls

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484668 ] Hadoop QA commented on HADOOP-1169: --- +1, because http://issues.apache.org/jira/secure/attachment/12354378/hadoop1

Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Igor Bolotin
While investigating performance issues in our Hadoop DFS/MapReduce cluster I saw very high CPU usage by DataNode processes. Stack trace showed following on most of the data nodes: "[EMAIL PROTECTED]" daemon prio=1 tid=0x2aaacb5b7bd0 nid=0x5940 runnable [0x4166a000..0x4166ac

Re: Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Raghu Angadi
We should file a Jira on it. I agree CheckDir() is called too many times and too expensive. I don't think it serves anything important or essential purpose. I vote for removing it. Anyone ever seen this check fail and/or the failure being useful for cluster functionality? Raghu. Igor Boloti

Re: [jira] Commented: (HADOOP-958) Building Hadoop results in a lot of warnings

2007-03-27 Thread Nigel Daley
if a series of patches like this one are committed, is it OK to do them all under one Jira issue? As long as they all make it in a single release, this is fine with me. In theory we can even map issues to multiple releases, each in which they're partially fixed, but that could get confusin

[jira] Created: (HADOOP-1170) Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Igor Bolotin (JIRA)
Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect -- Key: HADOOP-1170 URL: https://issues.apache.org/jira/browse/HADOOP-1170 Proj

[jira] Updated: (HADOOP-1170) Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Igor Bolotin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Bolotin updated HADOOP-1170: - Attachment: 1170.patch Attached patch removes checkDataDir() calls from DataXceiveServer.run() m

[jira] Updated: (HADOOP-1170) Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Igor Bolotin (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Igor Bolotin updated HADOOP-1170: - Status: Patch Available (was: Open) > Very high CPU usage on data nodes because of FSDataset.ch

[jira] Commented: (HADOOP-1170) Very high CPU usage on data nodes because of FSDataset.checkDataDir() on every connect

2007-03-27 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484711 ] Hadoop QA commented on HADOOP-1170: --- +1, because http://issues.apache.org/jira/secure/attachment/12354393/1170.pat

[jira] Commented: (HADOOP-1167) InMemoryFileSystem uses synchronizedtMaps with maps that are locked anyways

2007-03-27 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484712 ] Devaraj Das commented on HADOOP-1167: - +1 > InMemoryFileSystem uses synchronizedtMaps with maps that are locked

[jira] Commented: (HADOOP-1001) the output of the map is not type checked against the specified types

2007-03-27 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484713 ] Devaraj Das commented on HADOOP-1001: - +1 > the output of the map is not type checked against the specified typ

[jira] Commented: (HADOOP-1159) Reducers hang when map output file has a checksum error

2007-03-27 Thread Devaraj Das (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484721 ] Devaraj Das commented on HADOOP-1159: - Sorry, should have looked at this patch earlier. The problem with this pa

[jira] Created: (HADOOP-1171) NPE in TaskTracker RenitTrackerAction

2007-03-27 Thread Koji Noguchi (JIRA)
NPE in TaskTracker RenitTrackerAction -- Key: HADOOP-1171 URL: https://issues.apache.org/jira/browse/HADOOP-1171 Project: Hadoop Issue Type: Bug Components: mapred Reporter: Koji Nog

[jira] Commented: (HADOOP-1130) Remove unused ClientFinalizer in DFSClient

2007-03-27 Thread Philippe Gassmann (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12484749 ] Philippe Gassmann commented on HADOOP-1130: --- The closeAll() method should also remove ClientFinalizer from