[jira] [Updated] (MAPREDUCE-4978) Add a updateJobWithSplit() method for new-api job

[ https://issues.apache.org/jira/browse/MAPREDUCE-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-4978: -- Target Version/s: 1.3.0 Fix Version/s: (was: 1.3.0) Moved to 1.3.0 upon release

[jira] [Updated] (MAPREDUCE-4978) Add a updateJobWithSplit() method for new-api job

[ https://issues.apache.org/jira/browse/MAPREDUCE-4978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-4978: -- Fix Version/s: (was: 1.2.0) 1.3.0 Add a updateJobWithSplit()

[jira] [Updated] (MAPREDUCE-4906) testJobTrackerRestartsWithMissingJobFile failed in branch-1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-4906: -- Target Version/s: 1.3.0 Fix Version/s: (was: 1.2.0) Moved to 1.3.0 upon release

[jira] [Updated] (MAPREDUCE-4878) JobID.forName() isn't strict enough

[ https://issues.apache.org/jira/browse/MAPREDUCE-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Foley updated MAPREDUCE-4878: -- Target Version/s: 2.0.5-beta, 1.3.0 Fix Version/s: (was: 2.0.5-beta)

[jira] [Created] (MAPREDUCE-5210) Job submission has strict permission validation

Amareshwari Sriramadasu created MAPREDUCE-5210: -- Summary: Job submission has strict permission validation Key: MAPREDUCE-5210 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5210

[jira] [Assigned] (MAPREDUCE-5210) Job submission has strict permission validation

[ https://issues.apache.org/jira/browse/MAPREDUCE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] samar reassigned MAPREDUCE-5210: Assignee: samar Job submission has strict permission validation

[jira] [Updated] (MAPREDUCE-5206) JT can show the same job multiple times in Retired Jobs section

[ https://issues.apache.org/jira/browse/MAPREDUCE-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-5206: - Resolution: Fixed Fix Version/s: 1.2.0 Status: Resolved (was:

[jira] [Updated] (MAPREDUCE-4838) Add extra info to JH files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy updated MAPREDUCE-4838: - Attachment: TestRumenJobTraces.patch Addendum patch to fix TestRumenJobTraces for

[jira] [Commented] (MAPREDUCE-4838) Add extra info to JH files

[ https://issues.apache.org/jira/browse/MAPREDUCE-4838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13649791#comment-13649791 ] Arun C Murthy commented on MAPREDUCE-4838: -- I just committed the addendum

[jira] [Resolved] (MAPREDUCE-5064) TestRumenJobTraces failing on 1.3.x and 1.2

[ https://issues.apache.org/jira/browse/MAPREDUCE-5064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved MAPREDUCE-5064. -- Resolution: Not A Problem Fixed via an addendum patch to MAPREDUCE-4838.

[jira] [Commented] (MAPREDUCE-5168) Reducer can OOM during shuffle because on-disk output stream not released

[ https://issues.apache.org/jira/browse/MAPREDUCE-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13649844#comment-13649844 ] Karthik Kambatla commented on MAPREDUCE-5168: - Looks good to me. +1.

[jira] [Commented] (MAPREDUCE-5210) Job submission has strict permission validation

[ https://issues.apache.org/jira/browse/MAPREDUCE-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13649933#comment-13649933 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5210: bq. For file

[jira] [Commented] (MAPREDUCE-5168) Reducer can OOM during shuffle because on-disk output stream not released

[ https://issues.apache.org/jira/browse/MAPREDUCE-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13649954#comment-13649954 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5168: +1, harmless

[jira] [Created] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

Jason Lowe created MAPREDUCE-5211: - Summary: Reducer intermediate files can collide during merge Key: MAPREDUCE-5211 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5211 Project: Hadoop

[jira] [Updated] (MAPREDUCE-5204) Handle YarnRemoteException separately from IOException in MR api

[ https://issues.apache.org/jira/browse/MAPREDUCE-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5204: --- Attachment: YARN-629-branch-2.txt Minor conflict on branch-2,

[jira] [Resolved] (MAPREDUCE-5204) Handle YarnRemoteException separately from IOException in MR api

[ https://issues.apache.org/jira/browse/MAPREDUCE-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved MAPREDUCE-5204. Resolution: Fixed Fix Version/s: 2.0.5-beta Hadoop

[jira] [Updated] (MAPREDUCE-5204) Handle YarnRemoteException separately from IOException in MR api

[ https://issues.apache.org/jira/browse/MAPREDUCE-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-5204: --- Hadoop Flags: Reviewed (was: Incompatible change,Reviewed)

[jira] [Updated] (MAPREDUCE-5208) SpillRecord and ShuffleHandler should use SecureIOUtils for reading index file and map output

[ https://issues.apache.org/jira/browse/MAPREDUCE-5208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omkar Vinit Joshi updated MAPREDUCE-5208: - Attachment: MAPREDUCE-5208-20130506.patch File ownership will be verified

[jira] [Commented] (MAPREDUCE-4362) If possible, we should get back the feature of propagating task logs back to JobClient

[ https://issues.apache.org/jira/browse/MAPREDUCE-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650077#comment-13650077 ] Sandy Ryza commented on MAPREDUCE-4362: --- Test failures are unrelated, and I

[jira] [Updated] (MAPREDUCE-4362) If possible, we should get back the feature of propagating task logs back to JobClient

[ https://issues.apache.org/jira/browse/MAPREDUCE-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated MAPREDUCE-4362: -- Attachment: MAPREDUCE-4362.patch If possible, we should get back the feature of

[jira] [Commented] (MAPREDUCE-858) NPE in heartbeat if mapred.job.tracker.history.completed.location is not writable

[ https://issues.apache.org/jira/browse/MAPREDUCE-858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650090#comment-13650090 ] Steve Loughran commented on MAPREDUCE-858: -- Ramya, can you see this in

[jira] [Updated] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5211: -- Affects Version/s: (was: 2.0.3-alpha) This is not an issue on branch-2 or trunk

[jira] [Created] (MAPREDUCE-5212) Change ClientRMProtocol api to throw IOException and YarnRemoteException in MR api

Xuan Gong created MAPREDUCE-5212: Summary: Change ClientRMProtocol api to throw IOException and YarnRemoteException in MR api Key: MAPREDUCE-5212 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5212

[jira] [Updated] (MAPREDUCE-5212) Change ClientRMProtocol api to throw IOException and YarnRemoteException in MR api

[ https://issues.apache.org/jira/browse/MAPREDUCE-5212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated MAPREDUCE-5212: - Attachment: MR-5212.1.patch Change ClientRMProtocol api to throw IOException and

[jira] [Commented] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650136#comment-13650136 ] Mayank Bansal commented on MAPREDUCE-4305: -- Thanks Arun and Karthik for your

[jira] [Updated] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-4305: - Attachment: PATCH-MAPREDUCE-4305-MR1-6.patch Implement delay scheduling in

[jira] [Commented] (MAPREDUCE-5208) SpillRecord and ShuffleHandler should use SecureIOUtils for reading index file and map output

-20130506.patch ShuffleHandler (map output file) and SpillRecord (index file) are reading file using unsecured input stream. There exists a possibility for symlink attack. related to YARN-578 . Creating this issue to track map reduce changes. -- This message is automatically generated by JIRA

[jira] [Updated] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5211: -- Attachment: MAPREDUCE-5211.branch-0.23.patch Patch for branch-0.23 that adds the reduce

[jira] [Updated] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-5211: -- Target Version/s: 0.23.8 Status: Patch Available (was: Open) Reducer

[jira] [Commented] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650185#comment-13650185 ] Karthik Kambatla commented on MAPREDUCE-4305: - Thanks Mayank. +1 on the

[jira] [Commented] (MAPREDUCE-5168) Reducer can OOM during shuffle because on-disk output stream not released

[ https://issues.apache.org/jira/browse/MAPREDUCE-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650237#comment-13650237 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5168: bq. If

[jira] [Updated] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mayank Bansal updated MAPREDUCE-4305: - Attachment: PATCH-MAPREDUCE-4305-MR1-7.patch Thanks Karthik for the review. Updated

[jira] [Commented] (MAPREDUCE-4305) Implement delay scheduling in capacity scheduler for improving data locality

[ https://issues.apache.org/jira/browse/MAPREDUCE-4305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650264#comment-13650264 ] Karthik Kambatla commented on MAPREDUCE-4305: - Thanks Mayank. +1.

[jira] [Resolved] (MAPREDUCE-858) NPE in heartbeat if mapred.job.tracker.history.completed.location is not writable

[ https://issues.apache.org/jira/browse/MAPREDUCE-858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ramya Sunil resolved MAPREDUCE-858. --- Resolution: Fixed This is no longer an issue. JT gracefully shuts down if

[jira] [Commented] (MAPREDUCE-4366) mapred metrics shows negative count of waiting maps and reduces

[ https://issues.apache.org/jira/browse/MAPREDUCE-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650285#comment-13650285 ] Hadoop QA commented on MAPREDUCE-4366: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5130) Add missing job config options to mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-5130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650307#comment-13650307 ] Hadoop QA commented on MAPREDUCE-5130: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5036) Default shuffle handler port should not be 8080

[ https://issues.apache.org/jira/browse/MAPREDUCE-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650321#comment-13650321 ] Hudson commented on MAPREDUCE-5036: --- Integrated in Hadoop-trunk-Commit #3712 (See

[jira] [Commented] (MAPREDUCE-5205) Apps fail in secure cluster setup

[ https://issues.apache.org/jira/browse/MAPREDUCE-5205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650324#comment-13650324 ] Hudson commented on MAPREDUCE-5205: --- Integrated in Hadoop-trunk-Commit #3712 (See

[jira] [Commented] (MAPREDUCE-5204) Handle YarnRemoteException separately from IOException in MR api

[ https://issues.apache.org/jira/browse/MAPREDUCE-5204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650325#comment-13650325 ] Hudson commented on MAPREDUCE-5204: --- Integrated in Hadoop-trunk-Commit #3712 (See

[jira] [Commented] (MAPREDUCE-4362) If possible, we should get back the feature of propagating task logs back to JobClient

[ https://issues.apache.org/jira/browse/MAPREDUCE-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650347#comment-13650347 ] Hadoop QA commented on MAPREDUCE-4362: -- {color:green}+1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5211) Reducer intermediate files can collide during merge

[ https://issues.apache.org/jira/browse/MAPREDUCE-5211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650349#comment-13650349 ] Hadoop QA commented on MAPREDUCE-5211: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn

[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650357#comment-13650357 ] Vinod Kumar Vavilapalli commented on MAPREDUCE-5156: bq. Yes, I've

[jira] [Created] (MAPREDUCE-5213) Annotate TokenCache methods as Public or LimitedPrivate

Karthik Kambatla created MAPREDUCE-5213: --- Summary: Annotate TokenCache methods as Public or LimitedPrivate Key: MAPREDUCE-5213 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5213 Project:

[jira] [Created] (MAPREDUCE-5214) Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin

Karthik Kambatla created MAPREDUCE-5214: --- Summary: Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin Key: MAPREDUCE-5214 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5214

[jira] [Updated] (MAPREDUCE-4362) If possible, we should get back the feature of propagating task logs back to JobClient

[ https://issues.apache.org/jira/browse/MAPREDUCE-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated MAPREDUCE-4362: --- Status: Open (was: Patch Available) Sandy, please file a YARN

[jira] [Updated] (MAPREDUCE-5214) Compatibility: Add a deprecated MRAdmin that wraps around RMAdmin

[ https://issues.apache.org/jira/browse/MAPREDUCE-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated MAPREDUCE-5214: Attachment: mr-5214-v0.patch Preliminary patch that adds a wrapper around

[jira] [Commented] (MAPREDUCE-5156) Hadoop-examples-1.x.x.jar cannot run on Yarn

[ https://issues.apache.org/jira/browse/MAPREDUCE-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650460#comment-13650460 ] Hadoop QA commented on MAPREDUCE-5156: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4362) If possible, we should get back the feature of propagating task logs back to JobClient

[ https://issues.apache.org/jira/browse/MAPREDUCE-4362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650476#comment-13650476 ] Sandy Ryza commented on MAPREDUCE-4362: --- Filed and submitted patch to YARN-649

[jira] [Updated] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4942: - Status: Patch Available (was: Open) mapreduce.Job has a bunch of methods that

[jira] [Updated] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-4942: - Attachment: MAPREDUCE-4942.patch I saw that in JobClient, there were methods which

[jira] [Commented] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650511#comment-13650511 ] Hadoop QA commented on MAPREDUCE-4942: -- {color:red}-1 overall{color}. Here are

[jira] [Commented] (MAPREDUCE-4942) mapreduce.Job has a bunch of methods that throw InterruptedException so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-4942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650520#comment-13650520 ] Robert Kanter commented on MAPREDUCE-4942: -- Test failure is unrelated; it

[jira] [Created] (MAPREDUCE-5215) mapreduce.Job is missing getJobClient() so its incompatible with MR1

Robert Kanter created MAPREDUCE-5215: Summary: mapreduce.Job is missing getJobClient() so its incompatible with MR1 Key: MAPREDUCE-5215 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5215

[jira] [Updated] (MAPREDUCE-5215) mapreduce.Job is missing getJobClient() so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-5215: - Attachment: MAPREDUCE-5215.patch mapreduce.Job is missing getJobClient() so its

[jira] [Updated] (MAPREDUCE-5215) mapreduce.Job is missing getJobClient() so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated MAPREDUCE-5215: - Status: Patch Available (was: Open) mapreduce.Job is missing getJobClient() so

[jira] [Commented] (MAPREDUCE-5215) mapreduce.Job is missing getJobClient() so its incompatible with MR1

[ https://issues.apache.org/jira/browse/MAPREDUCE-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650533#comment-13650533 ] Hadoop QA commented on MAPREDUCE-5215: -- {color:red}-1 overall{color}. Here are