[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Status: Patch Available (was: Open) Get representative hprof information from tasks

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Status: Open (was: Patch Available) Get representative hprof information from tasks

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Attachment: profile-4.patch I addressed Chris' concerns, including create a unit test of the

[jira] Commented: (HADOOP-2404) HADOOP-2185 breaks compatibility with hadoop-0.15.0

2008-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12560524#action_12560524 ] Owen O'Malley commented on HADOOP-2404: --- We've dealt with this case before in

[jira] Commented: (HADOOP-2404) HADOOP-2185 breaks compatibility with hadoop-0.15.0

2008-01-18 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12560527#action_12560527 ] Owen O'Malley commented on HADOOP-2404: --- Konst just pointed out that we want to

[jira] Created: (HADOOP-2644) Remove the warning for attempting to override a final parameter

2008-01-17 Thread Owen O'Malley (JIRA)
Remove the warning for attempting to override a final parameter --- Key: HADOOP-2644 URL: https://issues.apache.org/jira/browse/HADOOP-2644 Project: Hadoop Issue Type: Bug

[jira] Reopened: (HADOOP-2477) Unit test fails on Windows: TestCopyFiles.testCopyFromLocalToDfs

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reopened HADOOP-2477: --- Unit test fails on Windows: TestCopyFiles.testCopyFromLocalToDfs

[jira] Updated: (HADOOP-2188) RPC should send a ping rather than use client timeouts

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2188: -- Fix Version/s: (was: 0.16.0) RPC should send a ping rather than use client timeouts

[jira] Resolved: (HADOOP-2477) Unit test fails on Windows: TestCopyFiles.testCopyFromLocalToDfs

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-2477. --- Resolution: Fixed This HADOOP-2476 fixed this issue. Unit test fails on Windows:

[jira] Updated: (HADOOP-2603) SequenceFileAsBinaryInputFormat

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2603: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Updated: (HADOOP-2469) WritableUtils.clone should take Configuration rather than JobConf

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2469: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Updated: (HADOOP-2572) TaskLogServlet returns 410 when trying to access log early in task life

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2572: -- Status: Open (was: Patch Available) This should be re-written to test if the file exists

[jira] Commented: (HADOOP-2284) BasicTypeSorterBase.compare calls progress on each compare

2008-01-17 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12560236#action_12560236 ] Owen O'Malley commented on HADOOP-2284: --- +1, as long as the unit test is fine

[jira] Created: (HADOOP-2627) the map task output servlet doesn't protect against .. attacks

2008-01-16 Thread Owen O'Malley (JIRA)
the map task output servlet doesn't protect against .. attacks Key: HADOOP-2627 URL: https://issues.apache.org/jira/browse/HADOOP-2627 Project: Hadoop Issue Type: Bug

[jira] Created: (HADOOP-2628) the combiner output counter is really counting number of input keys to the combiner

2008-01-16 Thread Owen O'Malley (JIRA)
the combiner output counter is really counting number of input keys to the combiner --- Key: HADOOP-2628 URL: https://issues.apache.org/jira/browse/HADOOP-2628 Project:

[jira] Updated: (HADOOP-2610) [HQL] Clarify the return policy

2008-01-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2610: -- Description: Current ReturnMsg class and the return policy are problematic. Let's clarify

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Status: Patch Available (was: Open) This patch is fixed with regard to trunk. Get

[jira] Commented: (HADOOP-2431) Test HDFS File Permissions

2008-01-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12559145#action_12559145 ] Owen O'Malley commented on HADOOP-2431: --- I'm with Doug on this one. I think that dfs

[jira] Commented: (HADOOP-2614) dfs web interfaces should run as a configurable user account

2008-01-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12559286#action_12559286 ] Owen O'Malley commented on HADOOP-2614: --- My security hackles get raised by

[jira] Resolved: (HADOOP-2516) HADOOP-1819 removed a public api JobTracker.getTracker in 0.15.0

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-2516. --- Resolution: Won't Fix Assignee: Owen O'Malley (was: Arun C Murthy) I fixed the issue

[jira] Updated: (HADOOP-2603) SequenceFileAsBinaryInputFormat

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2603: -- Status: Open (was: Patch Available) This looks good, except you need to add java doc for the

[jira] Commented: (HADOOP-1985) Abstract node to switch mapping into a topology service class used by namenode and jobtracker

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12558834#action_12558834 ] Owen O'Malley commented on HADOOP-1985: --- I'm worried about the time and memory

[jira] Issue Comment Edited: (HADOOP-1985) Abstract node to switch mapping into a topology service class used by namenode and jobtracker

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12558834#action_12558834 ] owen.omalley edited comment on HADOOP-1985 at 1/14/08 3:09 PM:

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Status: Open (was: Patch Available) Updating to current trunk. Get representative hprof

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2008-01-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Attachment: profile-3.patch Updated to trunk. Get representative hprof information from

[jira] Commented: (HADOOP-2560) Combining multiple input blocks into one mapper

2008-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12558042#action_12558042 ] Owen O'Malley commented on HADOOP-2560: --- I like that approach, Doug. We should also

[jira] Commented: (HADOOP-2581) Counters and other useful stats should be logged into Job History log

2008-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12558101#action_12558101 ] Owen O'Malley commented on HADOOP-2581: --- The counters *are* logged in job history,

[jira] Commented: (HADOOP-2581) Counters and other useful stats should be logged into Job History log

2008-01-11 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12558154#action_12558154 ] Owen O'Malley commented on HADOOP-2581: --- It is already in trunk and therefore will

[jira] Updated: (HADOOP-2399) Input key and value to combiner and reducer should be reused

2008-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2399: -- Attachment: reuse-obj.patch This is a rough patch that isn't quite working yet. Input key

[jira] Commented: (HADOOP-2298) ant target without source and docs

2008-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12557855#action_12557855 ] Owen O'Malley commented on HADOOP-2298: --- +1 on binary target and bin filename

[jira] Commented: (HADOOP-2570) streaming jobs fail after HADOOP-2227

2008-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12557858#action_12557858 ] Owen O'Malley commented on HADOOP-2570: --- I agree with Milind that the best solution

[jira] Issue Comment Edited: (HADOOP-2116) Job.local.dir to be exposed to tasks

2008-01-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12557918#action_12557918 ] owen.omalley edited comment on HADOOP-2116 at 1/10/08 10:42 PM:

[jira] Updated: (HADOOP-2562) globPaths does not support {ab,cd} as it claims to

2008-01-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2562: -- Fix Version/s: (was: 0.16.0) 0.15.3 globPaths does not support

[jira] Updated: (HADOOP-2092) Pipes C++ task does not die even if the Java tasks die

2008-01-08 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2092: -- Status: Open (was: Patch Available) A couple of things bother me: 1. There is no locking

[jira] Commented: (HADOOP-2516) HADOOP-1819 removed a public api JobTracker.getTracker in 0.15.0

2008-01-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1285#action_1285 ] Owen O'Malley commented on HADOOP-2516: --- getTracker was removed, because the static

[jira] Commented: (HADOOP-2516) HADOOP-1819 removed a public api JobTracker.getTracker in 0.15.0

2008-01-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12555805#action_12555805 ] Owen O'Malley commented on HADOOP-2516: --- There isn't a way to get the old

[jira] Reopened: (HADOOP-308) Task Tracker does not handle the case of read only local dir case correctly

2008-01-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reopened HADOOP-308: -- Task Tracker does not handle the case of read only local dir case correctly

[jira] Resolved: (HADOOP-308) Task Tracker does not handle the case of read only local dir case correctly

2008-01-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-308. -- Resolution: Duplicate Jiras that are fixed as part of other jiras should be marked duplicates,

[jira] Commented: (HADOOP-2501) Implement utility-tools for working with SequenceFiles

2007-12-29 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554923 ] Owen O'Malley commented on HADOOP-2501: --- The data can be extracted via: {code} bin/hadoop fs -text blah.seq

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2285: -- Attachment: fast-line.patch Ok, here is a patch that does: 1. Avoids encoding the data as a

[jira] Updated: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2285: -- Status: Patch Available (was: Open) TextInputFormat is slow compared to reading files.

[jira] Commented: (HADOOP-2284) BasicTypeSorterBase.compare calls progress on each compare

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554528 ] Owen O'Malley commented on HADOOP-2284: --- I agree with Devaraj. The cost of gettimeofday is huge when put into

[jira] Commented: (HADOOP-2469) WritableUtils.clone should take Configuration rather than JobConf

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554537 ] Owen O'Malley commented on HADOOP-2469: --- I think so. It is an unlikely method for users to call...

[jira] Resolved: (HADOOP-1661) TextOutputFormat should ignore NullWritables like null values.

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1661. --- Resolution: Duplicate Fix Version/s: 0.16.0 This was fixed by HADOOP-2425.

[jira] Updated: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-26 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2425: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Assigned: (HADOOP-2285) TextInputFormat is slow compared to reading files.

2007-12-23 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-2285: - Assignee: Owen O'Malley TextInputFormat is slow compared to reading files.

[jira] Commented: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-21 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12554092 ] Owen O'Malley commented on HADOOP-2425: --- Chris ran a benchmark that writes 2g of data through before and

[jira] Commented: (HADOOP-2228) Jobs fail because job.xml exists

2007-12-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552095 ] Owen O'Malley commented on HADOOP-2228: --- +1 this makes sense. If the submit failed on the client, but not the

[jira] Updated: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2425: -- Attachment: text-out-format-2.patch I forgot NullWritable last time, which I made

[jira] Updated: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-15 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2425: -- Status: Patch Available (was: Open) TextOutputFormat should special case Text

[jira] Created: (HADOOP-2428) we should add a wait for non-safe mode and call dfsadmin -report in start-dfs

2007-12-14 Thread Owen O'Malley (JIRA)
we should add a wait for non-safe mode and call dfsadmin -report in start-dfs - Key: HADOOP-2428 URL: https://issues.apache.org/jira/browse/HADOOP-2428 Project: Hadoop

[jira] Updated: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2425: -- Attachment: text-out-format.patch This patch changes: 1. TextOutputFormat detects Text and

[jira] Updated: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2425: -- Status: Patch Available (was: Open) TextOutputFormat should special case Text

[jira] Commented: (HADOOP-2433) Streaming: org.apache.hadoop.mapred.lib.IdentityMapper should not inserted unnecessary keys

2007-12-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552032 ] Owen O'Malley commented on HADOOP-2433: --- The problem of course is that TextInputFormat returns the offset as

[jira] Resolved: (HADOOP-2213) Job submission gets Job tracker still initializing message while Namenode is in safemode

2007-12-14 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-2213. --- Resolution: Won't Fix Job submission gets Job tracker still initializing message while

[jira] Updated: (HADOOP-2248) Word count example is spending 24% of the time in incrCounter

2007-12-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2248: -- Status: Open (was: Patch Available) Word count example is spending 24% of the time in

[jira] Updated: (HADOOP-2248) Word count example is spending 24% of the time in incrCounter

2007-12-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2248: -- Status: Patch Available (was: Open) Resubmitting for QA. Word count example is spending

[jira] Updated: (HADOOP-2248) Word count example is spending 24% of the time in incrCounter

2007-12-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2248: -- Attachment: counter-speedup-3.patch I found and fixed the problem. The last problem I had

[jira] Created: (HADOOP-2425) TextOutputFormat should special case Text

2007-12-13 Thread Owen O'Malley (JIRA)
TextOutputFormat should special case Text - Key: HADOOP-2425 URL: https://issues.apache.org/jira/browse/HADOOP-2425 Project: Hadoop Issue Type: Improvement Components: mapred

[jira] Resolved: (HADOOP-1827) Reducer.reduce method's OutputCollector is too strict, it shoudn't need the key to be WritableComparable

2007-12-13 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1827. --- Resolution: Won't Fix Reducer.reduce method's OutputCollector is too strict, it shoudn't

[jira] Updated: (HADOOP-2248) Word count example is spending 24% of the time in incrCounter

2007-12-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2248: -- Attachment: counter-speedup-2.patch Fixes the parts that went out of date, while waiting for

[jira] Updated: (HADOOP-2248) Word count example is spending 24% of the time in incrCounter

2007-12-10 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2248: -- Status: Patch Available (was: Open) Word count example is spending 24% of the time in

[jira] Created: (HADOOP-2399) Input key and value to combiner and reducer should be reused

2007-12-10 Thread Owen O'Malley (JIRA)
Input key and value to combiner and reducer should be reused Key: HADOOP-2399 URL: https://issues.apache.org/jira/browse/HADOOP-2399 Project: Hadoop Issue Type: Bug

[jira] Commented: (HADOOP-2385) Validate configuration parameters

2007-12-09 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549926 ] Owen O'Malley commented on HADOOP-2385: --- I can see the motivation/frustration for this, but it doesn't work

[jira] Updated: (HADOOP-2359) PendingReplicationMonitor thread received exception. java.lang.InterruptedException

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2359: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Updated: (HADOOP-2271) chmod in ant package target fails

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2271: -- Resolution: Fixed Fix Version/s: 0.16.0 Status: Resolved (was: Patch

[jira] Updated: (HADOOP-2085) Map-side joins on sorted, equally-partitioned datasets

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2085?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2085: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Updated: (HADOOP-2158) hdfsListDirectory in libhdfs does not scale

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2158: -- Status: Patch Available (was: Open) Promoting this for Christian. hdfsListDirectory in

[jira] Commented: (HADOOP-2232) Add option to disable nagles algorithm in the IPC Server

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549578 ] Owen O'Malley commented on HADOOP-2232: --- Makund, Can you please run a 500 node sort and look for task

[jira] Updated: (HADOOP-2313) build does not fail when libhdfs build fails

2007-12-07 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2313: -- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed this.

[jira] Created: (HADOOP-2383) The combiner in pipes is closed before the last values are passed in.

2007-12-07 Thread Owen O'Malley (JIRA)
The combiner in pipes is closed before the last values are passed in. - Key: HADOOP-2383 URL: https://issues.apache.org/jira/browse/HADOOP-2383 Project: Hadoop Issue Type:

[jira] Created: (HADOOP-2367) Get representative hprof information from tasks

2007-12-06 Thread Owen O'Malley (JIRA)
Get representative hprof information from tasks --- Key: HADOOP-2367 URL: https://issues.apache.org/jira/browse/HADOOP-2367 Project: Hadoop Issue Type: New Feature Components: mapred

[jira] Resolved: (HADOOP-1327) Doc on Streaming

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-1327. --- Resolution: Fixed Fix Version/s: 0.16.0 I just committed this. Thanks, Rob! Doc on

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Attachment: profile.patch This patch adds a config variable to enable profiling of the tasks.

[jira] Created: (HADOOP-2375) Task tracker should wait for the process to exit before declaring the task successful or failed.

2007-12-06 Thread Owen O'Malley (JIRA)
Task tracker should wait for the process to exit before declaring the task successful or failed. Key: HADOOP-2375 URL:

[jira] Commented: (HADOOP-2367) Get representative hprof information from tasks

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549326 ] Owen O'Malley commented on HADOOP-2367: --- The race condition between the subprocess finishing and the event

[jira] Updated: (HADOOP-2376) The sort example shouldn't override the number of maps

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2376: -- Attachment: sort-no-maps.patch This just pulls out the code from the example that is trying

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Attachment: profile-2.patch This patch is the previous one where the client gets the profile

[jira] Created: (HADOOP-2376) The sort example shouldn't override the number of maps

2007-12-06 Thread Owen O'Malley (JIRA)
The sort example shouldn't override the number of maps -- Key: HADOOP-2376 URL: https://issues.apache.org/jira/browse/HADOOP-2376 Project: Hadoop Issue Type: Bug Components:

[jira] Updated: (HADOOP-2367) Get representative hprof information from tasks

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2367: -- Status: Patch Available (was: Open) Get representative hprof information from tasks

[jira] Updated: (HADOOP-2376) The sort example shouldn't override the number of maps

2007-12-06 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2376: -- Status: Patch Available (was: Open) The sort example shouldn't override the number of maps

[jira] Updated: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2342: -- Attachment: throughput.patch This benchmark reads and writes files using java.io,

[jira] Created: (HADOOP-2359) PendingReplicationMonitor thread received exception. java.lang.InterruptedException

2007-12-05 Thread Owen O'Malley (JIRA)
PendingReplicationMonitor thread received exception. java.lang.InterruptedException --- Key: HADOOP-2359 URL: https://issues.apache.org/jira/browse/HADOOP-2359 Project:

[jira] Updated: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2342: -- Status: Patch Available (was: Open) create a micro-benchmark for measure local-file versus

[jira] Assigned: (HADOOP-1327) Doc on Streaming

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley reassigned HADOOP-1327: - Assignee: Rob Weltman Doc on Streaming Key:

[jira] Updated: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2342: -- Status: Open (was: Patch Available) create a micro-benchmark for measure local-file versus

[jira] Updated: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2342: -- Status: Patch Available (was: Open) Need to be re-reviewed by QA. create a micro-benchmark

[jira] Updated: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-05 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2342: -- Attachment: (was: throughput.patch) create a micro-benchmark for measure local-file

[jira] Commented: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-04 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12548351 ] Owen O'Malley commented on HADOOP-2342: --- The numbers I'm seeing for reads and writes on 10GB are: Raw Local

[jira] Commented: (HADOOP-1327) Doc on Streaming

2007-12-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547769 ] Owen O'Malley commented on HADOOP-1327: --- This looks good, but there are some typos: chararacter - character

[jira] Commented: (HADOOP-1327) Doc on Streaming

2007-12-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547928 ] Owen O'Malley commented on HADOOP-1327: --- When I run forrest on this patch, it fails when processing the new

[jira] Updated: (HADOOP-2229) Provide a simple login implementation

2007-12-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley updated HADOOP-2229: -- Status: Open (was: Patch Available) This looks pretty good. You need to fix the findbugs

[jira] Commented: (HADOOP-2231) ShellCommand, in particular 'df -k', sometimes hang

2007-12-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12548013 ] Owen O'Malley commented on HADOOP-2231: --- Since we are going to Java 1.6 (ala HADOOP-2325), we can and should

[jira] Commented: (HADOOP-2325) Require Java 6 for release 0.16.

2007-12-03 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12548046 ] Owen O'Malley commented on HADOOP-2325: --- Has anyone tried out the java 6 from

[jira] Created: (HADOOP-2342) create a micro-benchmark for measure local-file versus hdfs read

2007-12-03 Thread Owen O'Malley (JIRA)
create a micro-benchmark for measure local-file versus hdfs read Key: HADOOP-2342 URL: https://issues.apache.org/jira/browse/HADOOP-2342 Project: Hadoop Issue Type: Test

[jira] Commented: (HADOOP-2327) Streaming: need to be able to re-run specific map tasks (when -reducer NONE)

2007-12-02 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547625 ] Owen O'Malley commented on HADOOP-2327: --- I think this should more general that streaming and be in the

[jira] Commented: (HADOOP-2300) mapred.tasktracker.tasks.maximum is completely ignored

2007-12-02 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547627 ] Owen O'Malley commented on HADOOP-2300: --- +1 mapred.tasktracker.tasks.maximum is completely ignored

[jira] Commented: (HADOOP-496) Expose HDFS as a WebDAV store

2007-12-02 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547628 ] Owen O'Malley commented on HADOOP-496: -- Actually, HADOOP-4 would be a better jira for this. *smile* I _love_

[jira] Commented: (HADOOP-2227) wrong usage of mapred.local.dir.minspacestart

2007-12-02 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547629 ] Owen O'Malley commented on HADOOP-2227: --- The local directory handling of multiple directories has been an

[jira] Commented: (HADOOP-2323) JobTracker.close() prints stack traces for exceptions that are not errors

2007-12-02 Thread Owen O'Malley (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12547630 ] Owen O'Malley commented on HADOOP-2323: --- You've made a lot more changes than the jira description suggests.

  1   2   3   4   5   6   7   8   9   10   >