[jira] Resolved: (HADOOP-826) job tracker WI doesnt display shuffle finish time correctly.

[ https://issues.apache.org/jira/browse/HADOOP-826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya resolved HADOOP-826. -- Resolution: Duplicate > job tracker WI doesnt display shuffle finish time correctly. >

[jira] Commented: (HADOOP-878) reducer NONE does not work with multiple maps

[ https://issues.apache.org/jira/browse/HADOOP-878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12471251 ] Sanjay Dahiya commented on HADOOP-878: -- This seems to be working for multiple maps after recent patches HADOOP-

[jira] Updated: (HADOOP-476) Streaming should check for correctness of the task

[ https://issues.apache.org/jira/browse/HADOOP-476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-476: - Attachment: Hadoop-476_1.patch Sorry this patch got hung up for long. Here is an updated version.

[jira] Updated: (HADOOP-491) streaming jobs should allow programs that don't do any IO for a long time

[ https://issues.apache.org/jira/browse/HADOOP-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-491: - Status: Patch Available (was: Open) > streaming jobs should allow programs that don't do any IO

[jira] Updated: (HADOOP-788) Streaming should use a subclass of TextInputFormat for reading text inputs.

[ https://issues.apache.org/jira/browse/HADOOP-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-788: - Status: Patch Available (was: Open) > Streaming should use a subclass of TextInputFormat for rea

[jira] Updated: (HADOOP-881) job history web/ui does not count task failures correctly

[ https://issues.apache.org/jira/browse/HADOOP-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-881: - Status: Patch Available (was: Open) > job history web/ui does not count task failures correctly

[jira] Updated: (HADOOP-929) PhasedFileSystem should implement get/set configuration

[ https://issues.apache.org/jira/browse/HADOOP-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-929: - Status: Patch Available (was: Open) > PhasedFileSystem should implement get/set configuration >

[jira] Updated: (HADOOP-929) PhasedFileSystem should implement get/set configuration

[ https://issues.apache.org/jira/browse/HADOOP-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-929: - Attachment: Hadoop-929.patch Patch attached. > PhasedFileSystem should implement get/set configu

[jira] Assigned: (HADOOP-929) PhasedFileSystem should implement get/set configuration

[ https://issues.apache.org/jira/browse/HADOOP-929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya reassigned HADOOP-929: Assignee: Sanjay Dahiya > PhasedFileSystem should implement get/set configuration > --

[jira] Created: (HADOOP-929) PhasedFileSystem should implement get/set configuration

PhasedFileSystem should implement get/set configuration Key: HADOOP-929 URL: https://issues.apache.org/jira/browse/HADOOP-929 Project: Hadoop Issue Type: Bug Components: map

[jira] Commented: (HADOOP-788) Streaming should use a subclass of TextInputFormat for reading text inputs.

[ https://issues.apache.org/jira/browse/HADOOP-788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12465134 ] Sanjay Dahiya commented on HADOOP-788: -- patch is attached for review. > Streaming should use a subclass of Tex

[jira] Updated: (HADOOP-788) Streaming should use a subclass of TextInputFormat for reading text inputs.

[ https://issues.apache.org/jira/browse/HADOOP-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-788: - Attachment: Hadoop-788.patch > Streaming should use a subclass of TextInputFormat for reading tex

[jira] Commented: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12465133 ] Sanjay Dahiya commented on HADOOP-801: -- Fixed javadoc warnings. > job tracker should keep a log of task complet

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: Hadoop-801.patch > job tracker should keep a log of task completion and failure > ---

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Status: Patch Available (was: Open) > job tracker should keep a log of task completion and failu

[jira] Commented: (HADOOP-881) job history web/ui does not count task failures correctly

[ https://issues.apache.org/jira/browse/HADOOP-881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12465079 ] Sanjay Dahiya commented on HADOOP-881: -- This patch changes the history to display the number of failed task atte

[jira] Updated: (HADOOP-881) job history web/ui does not count task failures correctly

[ https://issues.apache.org/jira/browse/HADOOP-881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-881: - Attachment: Hadoop-881.patch > job history web/ui does not count task failures correctly > --

[jira] Updated: (HADOOP-864) bin/hadoop jar throws file creation exception for temp files

[ https://issues.apache.org/jira/browse/HADOOP-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-864: - Attachment: Hadoop-864.patch > bin/hadoop jar throws file creation exception for temp files > ---

[jira] Updated: (HADOOP-864) bin/hadoop jar throws file creation exception for temp files

[ https://issues.apache.org/jira/browse/HADOOP-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-864: - Assignee: Sanjay Dahiya Status: Patch Available (was: Open) > bin/hadoop jar throws file c

[jira] Commented: (HADOOP-864) bin/hadoop jar throws file creation exception for temp files

[ https://issues.apache.org/jira/browse/HADOOP-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462947 ] Sanjay Dahiya commented on HADOOP-864: -- Patch attached. > bin/hadoop jar throws file creation exception for te

[jira] Created: (HADOOP-864) bin/hadoop jar throws file creation exception for temp files

bin/hadoop jar throws file creation exception for temp files Key: HADOOP-864 URL: https://issues.apache.org/jira/browse/HADOOP-864 Project: Hadoop Issue Type: Bug Compone

[jira] Commented: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462482 ] Sanjay Dahiya commented on HADOOP-801: -- Updated patch with review comments, Thanks Owen for the review. > 3. J

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: Hadoop-801.patch > job tracker should keep a log of task completion and failure > ---

[jira] Commented: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462254 ] Sanjay Dahiya commented on HADOOP-801: -- This patch adds functionality to download task logs from respective tas

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: Hadoop-801.patch > job tracker should keep a log of task completion and failure > ---

[jira] Commented: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12461941 ] Sanjay Dahiya commented on HADOOP-801: -- This patch includes - New method in jobtracker, IntertrackerProtocol, J

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ https://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: Hadoop-801.patch > job tracker should keep a log of task completion and failure > ---

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ http://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Comment: was deleted > job tracker should keep a log of task completion and failure >

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ http://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: (was: Hadoop-801.patch) > job tracker should keep a log of task completion and fai

[jira] Commented: (HADOOP-801) job tracker should keep a log of task completion and failure

[ http://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12461759 ] Sanjay Dahiya commented on HADOOP-801: -- This patch includes fixes for HADOOP-801 and HADOOP-805. up for review.

[jira] Updated: (HADOOP-801) job tracker should keep a log of task completion and failure

[ http://issues.apache.org/jira/browse/HADOOP-801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-801: - Attachment: Hadoop-801.patch > job tracker should keep a log of task completion and failure >

[jira] Commented: (HADOOP-804) Cut down on the "mumbling" in the Task process' stdout/stderr

[ http://issues.apache.org/jira/browse/HADOOP-804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12461694 ] Sanjay Dahiya commented on HADOOP-804: -- this patch 1. changes some of the log levels to DEBUG in tasks. 2. chan

[jira] Updated: (HADOOP-804) Cut down on the "mumbling" in the Task process' stdout/stderr

[ http://issues.apache.org/jira/browse/HADOOP-804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sanjay Dahiya updated HADOOP-804: - Attachment: Hadoop-804.patch > Cut down on the "mumbling" in the Task process' stdout/stderr > ---

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12461692 ] Sanjay Dahiya commented on HADOOP-619: -- >One other thing I just noticed is that it looks like globbed paths are n

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_3.patch Updated patch, with spacing changes. >Finally, it looks like globPaths() still calls Path#toString() instead of >Path#toUri(

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=comments#action_12460057 ] Sanjay Dahiya commented on HADOOP-619: -- Why can't validateInput() simply call globPaths() and check that the results exist? The current implementation is not

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Status: Patch Available (was: Open) > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_2.patch Updated patch with Doug's comments thanks Doug for the review. > Unify Map-Reduce and Streaming to take the same globbed inpu

[jira] Updated: (HADOOP-817) Streaming reducers throw OutOfMemory for not so large inputs

[ http://issues.apache.org/jira/browse/HADOOP-817?page=all ] Sanjay Dahiya updated HADOOP-817: - Attachment: NetbeansProfie.png > Streaming reducers throw OutOfMemory for not so large inputs > >

[jira] Commented: (HADOOP-817) Streaming reducers throw OutOfMemory for not so large inputs

[ http://issues.apache.org/jira/browse/HADOOP-817?page=comments#action_12459274 ] Sanjay Dahiya commented on HADOOP-817: -- After a bit of profiling i see 4 buffers of size 20971520 (FSDataInputStream.Buffer) and 11 buffers of size 9532509. T

[jira] Commented: (HADOOP-817) Streaming reducers throw OutOfMemory for not so large inputs

[ http://issues.apache.org/jira/browse/HADOOP-817?page=comments#action_12458930 ] Sanjay Dahiya commented on HADOOP-817: -- tracked it down to MergeQueue.merge(), after a couple of iterations of that loop it runs out of memory. > Streaming

[jira] Updated: (HADOOP-596) TaskTracker taskstatus's phase doesnt get updated on phase transition causing wrong values displayed in WI

[ http://issues.apache.org/jira/browse/HADOOP-596?page=all ] Sanjay Dahiya updated HADOOP-596: - Attachment: Hadoop-596.patch Patch Attached. > TaskTracker taskstatus's phase doesnt get updated on phase transition causing > wrong values displayed in WI

[jira] Updated: (HADOOP-596) TaskTracker taskstatus's phase doesnt get updated on phase transition causing wrong values displayed in WI

[ http://issues.apache.org/jira/browse/HADOOP-596?page=all ] Sanjay Dahiya updated HADOOP-596: - Status: Patch Available (was: Open) > TaskTracker taskstatus's phase doesnt get updated on phase transition causing > wrong values displayed in WI > ---

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Status: Patch Available (was: Open) > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_2.patch > Unify Map-Reduce and Streaming to take the same globbed input specification > ---

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: (was: Hadoop-619_1.patch) > Unify Map-Reduce and Streaming to take the same globbed input specification >

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_1.patch Thanks owen for review. This patch includes review comments and removes hidden files in directory listing on jobtracker end w

[jira] Resolved: (HADOOP-718) JobTracker history should link to failed task attemps for tasks that succeeded eventually.

[ http://issues.apache.org/jira/browse/HADOOP-718?page=all ] Sanjay Dahiya resolved HADOOP-718. -- Resolution: Duplicate I think fix for HADOOP-796 should take care of this. I doesnt clone the live WI in history but provides easy access to failed tasks.

[jira] Created: (HADOOP-826) job tracker WI doesnt display shuffle finish time correctly.

job tracker WI doesnt display shuffle finish time correctly. - Key: HADOOP-826 URL: http://issues.apache.org/jira/browse/HADOOP-826 Project: Hadoop Issue Type: Bug Compon

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Status: Patch Available (was: Open) > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_1.patch Thanks Owen for review. I hadn't looked at glob impl in FileSystem. This patch uses Filesystem.glob. also fixes an issue whic

[jira] Created: (HADOOP-817) Streaming reducers throw OutOfMemory for not so large inputs

Streaming reducers throw OutOfMemory for not so large inputs Key: HADOOP-817 URL: http://issues.apache.org/jira/browse/HADOOP-817 Project: Hadoop Issue Type: Bug Componen

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_1.patch > Unify Map-Reduce and Streaming to take the same globbed input specification > ---

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: (was: Hadoop-619_1.patch) > Unify Map-Reduce and Streaming to take the same globbed input specification >

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619_1.patch Updated patch, it moves all changes to InputFormatBase and doesnt change the API. Glob expansion is done twice as discussed be

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=comments#action_12457340 ] Sanjay Dahiya commented on HADOOP-619: -- thanks Doug for the review. For using InputFormatBase for validating and expanding globs, i think it would be a good

[jira] Updated: (HADOOP-476) Streaming should check for correctness of the task

[ http://issues.apache.org/jira/browse/HADOOP-476?page=all ] Sanjay Dahiya updated HADOOP-476: - Attachment: Hadoop-476.patch Updated patch, now it doesnt check for -mapper/reducer/combiner on localdisk of submit node. it runs chmod 0777 on -files and if

[jira] Commented: (HADOOP-476) Streaming should check for correctness of the task

[ http://issues.apache.org/jira/browse/HADOOP-476?page=comments#action_12456750 ] Sanjay Dahiya commented on HADOOP-476: -- Yoram: This patch doesnt take care of the fact that mapper and reducer are not shipped along. There are couple of othe

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch Updated patch with current trunk. > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-796) Node failing tasks and failed tasks should be more easily accessible through jobtracker history.

[ http://issues.apache.org/jira/browse/HADOOP-796?page=all ] Sanjay Dahiya updated HADOOP-796: - Status: Patch Available (was: Open) > Node failing tasks and failed tasks should be more easily accessible through > jobtracker history. > -

[jira] Commented: (HADOOP-797) Streaming throws out a nullpointer exception if the mapper/reducer is not specified correctly.

[ http://issues.apache.org/jira/browse/HADOOP-797?page=comments#action_12456610 ] Sanjay Dahiya commented on HADOOP-797: -- HADOOP-476 should prevent incorrect mapper/reducer values for being accepted. That said it would be a good idea to rec

[jira] Updated: (HADOOP-796) Node failing tasks and failed tasks should be more easily accessible through jobtracker history.

[ http://issues.apache.org/jira/browse/HADOOP-796?page=all ] Sanjay Dahiya updated HADOOP-796: - Attachment: failedtasks.patch This patch adds a snapshot of nodes that failed tasks and failed tasks on jobdetails page. > Node failing tasks and failed ta

[jira] Assigned: (HADOOP-796) Node failing tasks and failed tasks should be more easily accessible through jobtracker history.

[ http://issues.apache.org/jira/browse/HADOOP-796?page=all ] Sanjay Dahiya reassigned HADOOP-796: Assignee: Sanjay Dahiya > Node failing tasks and failed tasks should be more easily accessible through > jobtracker history. >

[jira] Created: (HADOOP-796) Node failing tasks and failed tasks should be more easily accessible through jobtracker history.

Node failing tasks and failed tasks should be more easily accessible through jobtracker history. - Key: HADOOP-796 URL: http://issues.apache.org/jira/browse/HADOOP-79

[jira] Updated: (HADOOP-770) When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs)

[ http://issues.apache.org/jira/browse/HADOOP-770?page=all ] Sanjay Dahiya updated HADOOP-770: - Status: Patch Available (was: Open) > When JobTracker gets restarted, Job Tracker History doesn't show the jobs > that were running. (incomplete jobs) > ---

[jira] Updated: (HADOOP-770) When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs)

[ http://issues.apache.org/jira/browse/HADOOP-770?page=all ] Sanjay Dahiya updated HADOOP-770: - Attachment: Hadoop-770.patch This patch fixes issue of incomplete tasks not appearing in history WI. > When JobTracker gets restarted, Job Tracker History d

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: (was: Hadoop-619.patch) > Unify Map-Reduce and Streaming to take the same globbed input specification > --

[jira] Updated: (HADOOP-476) Streaming should check for correctness of the task

[ http://issues.apache.org/jira/browse/HADOOP-476?page=all ] Sanjay Dahiya updated HADOOP-476: - Attachment: Hadoop-476.patch This patch replaces commandline processing with apache CLI2. Input validation is not done as part of this patch as thats moved t

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch Updating patch with javadoc for JobConf setInputPath and addInputPath, which now include glob patterns. > Unify Map-Reduce and

[jira] Resolved: (HADOOP-778) Path.toString() should retain trailing '/' if passed in constructor

[ http://issues.apache.org/jira/browse/HADOOP-778?page=all ] Sanjay Dahiya resolved HADOOP-778. -- Resolution: Won't Fix Not needed anymore, marking Resolved. > Path.toString() should retain trailing '/' if passed in constructor > --

[jira] Commented: (HADOOP-778) Path.toString() should retain trailing '/' if passed in constructor

[ http://issues.apache.org/jira/browse/HADOOP-778?page=comments#action_12456209 ] Sanjay Dahiya commented on HADOOP-778: -- Doug: I didn't run tests with this, also we don't need it anymore with the new glob format spec. I agree that one mus

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-786) PhasedFileSystem should use debug level log for ignored exception.

[ http://issues.apache.org/jira/browse/HADOOP-786?page=all ] Sanjay Dahiya updated HADOOP-786: - Status: Patch Available (was: Open) > PhasedFileSystem should use debug level log for ignored exception. > --

[jira] Updated: (HADOOP-786) PhasedFileSystem should use debug level log for ignored exception.

[ http://issues.apache.org/jira/browse/HADOOP-786?page=all ] Sanjay Dahiya updated HADOOP-786: - Attachment: Hadoop-786.patch Patch attached. > PhasedFileSystem should use debug level log for ignored exception. >

[jira] Assigned: (HADOOP-786) PhasedFileSystem should use debug level log for ignored exception.

[ http://issues.apache.org/jira/browse/HADOOP-786?page=all ] Sanjay Dahiya reassigned HADOOP-786: Assignee: Sanjay Dahiya > PhasedFileSystem should use debug level log for ignored exception. > -

[jira] Created: (HADOOP-786) PhasedFileSystem should use debug level log for ignored exception.

PhasedFileSystem should use debug level log for ignored exception. -- Key: HADOOP-786 URL: http://issues.apache.org/jira/browse/HADOOP-786 Project: Hadoop Issue Type: Bug

[jira] Updated: (HADOOP-676) JobClient should print user friendly messages for standard errors

[ http://issues.apache.org/jira/browse/HADOOP-676?page=all ] Sanjay Dahiya updated HADOOP-676: - Status: Patch Available (was: In Progress) > JobClient should print user friendly messages for standard errors >

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: (was: Hadoop-619.patch) > Unify Map-Reduce and Streaming to take the same globbed input specification > --

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Status: Patch Available (was: Open) > Unify Map-Reduce and Streaming to take the same globbed input specification > -

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch This patch makes following changes : 1. Accept empty input directories only if not specified as glob. 2. Remove validation code

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: (was: Hadoop-619.patch) > Unify Map-Reduce and Streaming to take the same globbed input specification > --

[jira] Updated: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya updated HADOOP-619: - Attachment: Hadoop-619.patch Here is a patch which adds gobbing support to JobClient. its not commit ready yet as it breaks unit tests as I mentioned in prev

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=comments#action_12455739 ] Sanjay Dahiya commented on HADOOP-619: -- These changes cause TestEmptyJobWithDFS test to fail as in that no of input files is 0. with new changes Job fails if

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=comments#action_12455648 ] Sanjay Dahiya commented on HADOOP-619: -- Runping: The patterns you mentioned work, basically it breaks the input path in parts and matches files/directories a

[jira] Created: (HADOOP-778) Path.toString() should retain trailing '/' if passed in constructor

Path.toString() should retain trailing '/' if passed in constructor --- Key: HADOOP-778 URL: http://issues.apache.org/jira/browse/HADOOP-778 Project: Hadoop Issue Type: Bug

[jira] Resolved: (HADOOP-769) Error in crc file after a FileSystem.rename operation.

[ http://issues.apache.org/jira/browse/HADOOP-769?page=all ] Sanjay Dahiya resolved HADOOP-769. -- Resolution: Later This problem is not appearing anymore, I presume it was something to do with file closing. Marking resolved. > Error in crc file after

[jira] Commented: (HADOOP-476) Streaming should check for correctness of the task

[ http://issues.apache.org/jira/browse/HADOOP-476?page=comments#action_12455355 ] Sanjay Dahiya commented on HADOOP-476: -- Moved input path ( glob pattern ) checks and errors to JobClient as part of HADOOP-619 and removed from streaming. Als

[jira] Assigned: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=all ] Sanjay Dahiya reassigned HADOOP-619: Assignee: Sanjay Dahiya > Unify Map-Reduce and Streaming to take the same globbed input specification >

[jira] Commented: (HADOOP-619) Unify Map-Reduce and Streaming to take the same globbed input specification

[ http://issues.apache.org/jira/browse/HADOOP-619?page=comments#action_12454880 ] Sanjay Dahiya commented on HADOOP-619: -- If we have patterns in input path to MR, do we still check for existence of files matching that pattern in dfs while v

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Status: Patch Available (was: Open) > Map-reduce task does not produce correct results when -reducer NONE is > specified through streaming > ---

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Attachment: Hadoop-728_1.patch Fixed another issue in PipeMapRed where output file may not get closed properly. > Map-reduce task does not produce correct re

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Attachment: (was: Hadoop-728_1.patch) > Map-reduce task does not produce correct results when -reducer NONE is > specified through streaming > --

[jira] Assigned: (HADOOP-770) When JobTracker gets restarted, Job Tracker History doesn't show the jobs that were running. (incomplete jobs)

[ http://issues.apache.org/jira/browse/HADOOP-770?page=all ] Sanjay Dahiya reassigned HADOOP-770: Assignee: Sanjay Dahiya > When JobTracker gets restarted, Job Tracker History doesn't show the jobs > that were running. (incomplete jobs) > --

[jira] Created: (HADOOP-769) Error in crc file after a FileSystem.rename operation.

Error in crc file after a FileSystem.rename operation. --- Key: HADOOP-769 URL: http://issues.apache.org/jira/browse/HADOOP-769 Project: Hadoop Issue Type: Bug Components: dfs

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Attachment: Hadoop-728_1.patch > Map-reduce task does not produce correct results when -reducer NONE is > specified through streaming > -

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Attachment: (was: Hadoop-728.patch) > Map-reduce task does not produce correct results when -reducer NONE is > specified through streaming >

[jira] Updated: (HADOOP-728) Map-reduce task does not produce correct results when -reducer NONE is specified through streaming

[ http://issues.apache.org/jira/browse/HADOOP-728?page=all ] Sanjay Dahiya updated HADOOP-728: - Attachment: Hadoop-728.patch This patch fixes a few other issues as well - 1. Some map tasks writing to DFS were generating incomplete files, added flush()

[jira] Commented: (HADOOP-476) Streaming should check for correctness of the task

[ http://issues.apache.org/jira/browse/HADOOP-476?page=comments#action_12454343 ] Sanjay Dahiya commented on HADOOP-476: -- I have the cli2 implementation in place, there is one issue with cli2 which is holding it back. Command line arguments

[jira] Updated: (HADOOP-761) Unit tests should cleanup created files in /tmp. It causes tests to fail if more than one users run tests on same machine.

[ http://issues.apache.org/jira/browse/HADOOP-761?page=all ] Sanjay Dahiya updated HADOOP-761: - Summary: Unit tests should cleanup created files in /tmp. It causes tests to fail if more than one users run tests on same machine. (was: Unit tests should

  1   2   3   >