[jira] [Updated] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7159: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[jira] [Commented] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16712010#comment-16712010 ] Jason Lowe commented on MAPREDUCE-7159: --- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Commented] (MAPREDUCE-7159) FrameworkUploader: ensure proper permissions of generated framework tar.gz if restrictive umask is used

[ https://issues.apache.org/jira/browse/MAPREDUCE-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711728#comment-16711728 ] Jason Lowe commented on MAPREDUCE-7159: --- Looks good overall, just a few nits. The program will

[jira] [Commented] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16706018#comment-16706018 ] Jason Lowe commented on MAPREDUCE-7167: --- I also think this is not going to be an incompatible

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703379#comment-16703379 ] Jason Lowe commented on MAPREDUCE-7164: --- This case occurred when the namenode was being

[jira] [Updated] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7164: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16702377#comment-16702377 ] Jason Lowe commented on MAPREDUCE-7164: --- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Commented] (MAPREDUCE-7164) FileOutputCommitter does not report progress while merging paths.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701077#comment-16701077 ] Jason Lowe commented on MAPREDUCE-7164: --- Thanks for the patch! I think it would be fine to

[jira] [Updated] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7148: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678291#comment-16678291 ] Jason Lowe commented on MAPREDUCE-7148: --- Unit test failures are unrelated. surefire is

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678274#comment-16678274 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Updated] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7156: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.9.3

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677428#comment-16677428 ] Jason Lowe commented on MAPREDUCE-7156: --- According to some stuff I could scrape from the

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677036#comment-16677036 ] Jason Lowe commented on MAPREDUCE-7156: --- Thanks for updating the patch! Weird, the unit tests

[jira] [Commented] (MAPREDUCE-7156) NullPointerException when reaching max shuffle connections

[ https://issues.apache.org/jira/browse/MAPREDUCE-7156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16676898#comment-16676898 ] Jason Lowe commented on MAPREDUCE-7156: --- Thanks for the report and patch! Curious, is there a

[jira] [Assigned] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7148: - Assignee: Wang Yan (was: Jason Lowe) Thanks for updating the patch! Apologies for

[jira] [Assigned] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7148: - Assignee: Wang Yan (was: Jason Lowe) > Fast fail jobs when exceeds dfs quota

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16668838#comment-16668838 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for updating the patch! Looks good overall,

[jira] [Commented] (MAPREDUCE-7152) LD_LIBRARY_PATH is always passed from MR AM to tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16667178#comment-16667178 ] Jason Lowe commented on MAPREDUCE-7152: --- Can this be solved by simply changing: {noformat}

[jira] [Commented] (MAPREDUCE-7155) TestHSAdminServer is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659744#comment-16659744 ] Jason Lowe commented on MAPREDUCE-7155: --- Per my comment on HADOOP-15836 I don't think we should

[jira] [Commented] (MAPREDUCE-7155) TestHSAdminServer is failing

[ https://issues.apache.org/jira/browse/MAPREDUCE-7155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16659083#comment-16659083 ] Jason Lowe commented on MAPREDUCE-7155: --- {noformat} [INFO] Running

[jira] [Created] (MAPREDUCE-7155) TestHSAdminServer is failing

Jason Lowe created MAPREDUCE-7155: - Summary: TestHSAdminServer is failing Key: MAPREDUCE-7155 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7155 Project: Hadoop Map/Reduce Issue Type:

[jira] [Updated] (MAPREDUCE-7149) javadocs for FileInputFormat and OutputFormat to mention DT collection

[ https://issues.apache.org/jira/browse/MAPREDUCE-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7149: -- Fix Version/s: 3.3.0 > javadocs for FileInputFormat and OutputFormat to mention DT

[jira] [Commented] (MAPREDUCE-7149) javadocs for FileInputFormat and OutputFormat to mention DT collection

[ https://issues.apache.org/jira/browse/MAPREDUCE-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646697#comment-16646697 ] Jason Lowe commented on MAPREDUCE-7149: --- Thanks for the patch! Other than the whitespace nit,

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16645034#comment-16645034 ] Jason Lowe commented on MAPREDUCE-7148: --- Unrecoverable works as long as the reader understands

[jira] [Commented] (MAPREDUCE-7148) Fast fail jobs when exceeds dfs quota limitation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16644118#comment-16644118 ] Jason Lowe commented on MAPREDUCE-7148: --- Thanks for the patch! Seems like a reasonable request

[jira] [Updated] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7130: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643914#comment-16643914 ] Jason Lowe commented on MAPREDUCE-7130: --- Thanks for the patch! +1 lgtm. Committing this. >

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641819#comment-16641819 ] Jason Lowe commented on MAPREDUCE-7130: --- +1. This seems the most likely to fix the issue

[jira] [Commented] (MAPREDUCE-7130) Rumen crashes trying to handle MRAppMaster recovery events

[ https://issues.apache.org/jira/browse/MAPREDUCE-7130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634684#comment-16634684 ] Jason Lowe commented on MAPREDUCE-7130: --- I'm not a Rumen expert and I haven't dug into the

[jira] [Moved] (MAPREDUCE-7147) Review of LocalContainerAllocator

[ https://issues.apache.org/jira/browse/MAPREDUCE-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-8831 to MAPREDUCE-7147: - Affects Version/s: (was: 3.2.0) 3.2.0

[jira] [Moved] (MAPREDUCE-7146) Review of RMCommunicator Class

[ https://issues.apache.org/jira/browse/MAPREDUCE-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-8832 to MAPREDUCE-7146: - Affects Version/s: (was: 3.2.0) 3.2.0

[jira] [Updated] (MAPREDUCE-7138) ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7138: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Updated] (MAPREDUCE-7137) MRAppBenchmark.benchmark1() fails with NullPointerException

[ https://issues.apache.org/jira/browse/MAPREDUCE-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7137: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Commented] (MAPREDUCE-7138) ThrottledContainerAllocator in MRAppBenchmark should implement RMHeartbeatHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619790#comment-16619790 ] Jason Lowe commented on MAPREDUCE-7138: --- Thanks for the report and patch! +1 lgtm. Committing

[jira] [Commented] (MAPREDUCE-7137) MRAppBenchmark.benchmark1() fails with NullPointerException

[ https://issues.apache.org/jira/browse/MAPREDUCE-7137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619783#comment-16619783 ] Jason Lowe commented on MAPREDUCE-7137: --- Thanks for the report and patch! +1 for the patch,

[jira] [Commented] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619457#comment-16619457 ] Jason Lowe commented on MAPREDUCE-3801: --- No unit test since this is fixing the code to get an

[jira] [Updated] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3801: -- Attachment: MAPREDUCE-3801.001.patch >

[jira] [Updated] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-3801: -- Target Version/s: 2.10.0, 3.2.0, 3.0.4, 2.9.2, 3.1.2, 2.8.6 Status: Patch

[jira] [Assigned] (MAPREDUCE-3801) org.apache.hadoop.mapreduce.v2.app.TestRuntimeEstimators.testExponentialEstimator fails intermittently

[ https://issues.apache.org/jira/browse/MAPREDUCE-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-3801: - Assignee: Jason Lowe Ran into this again, as it started failing semi-reliably on

[jira] [Updated] (MAPREDUCE-7140) Refactoring TaskAttemptInfo to separate Map and Reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7140: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (MAPREDUCE-7140) Refactoring TaskAttemptInfo to separate Map and Reduce tasks

[ https://issues.apache.org/jira/browse/MAPREDUCE-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615317#comment-16615317 ] Jason Lowe commented on MAPREDUCE-7140: --- Thanks for the patch! +1 lgtm. Committing this. >

[jira] [Resolved] (MAPREDUCE-6440) Duplicate Key in Json Output for Job details

[ https://issues.apache.org/jira/browse/MAPREDUCE-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6440. --- Resolution: Duplicate Target Version/s: (was: ) This has been fixed by

[jira] [Updated] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7133: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.6

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613971#comment-16613971 ] Jason Lowe commented on MAPREDUCE-7133: --- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16612812#comment-16612812 ] Jason Lowe commented on MAPREDUCE-7133: --- The problem with doing too much code cleanup in a fix

[jira] [Commented] (MAPREDUCE-7133) History Server task attempts REST API returns invalid data

[ https://issues.apache.org/jira/browse/MAPREDUCE-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611219#comment-16611219 ] Jason Lowe commented on MAPREDUCE-7133: --- Thanks for the nice analysis and patch!

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611160#comment-16611160 ] Jason Lowe commented on MAPREDUCE-7136: --- I would recommend opening a single ticket per maven

[jira] [Updated] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7136: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16611032#comment-16611032 ] Jason Lowe commented on MAPREDUCE-7136: --- I'm fine with making a small improvement to the tests

[jira] [Commented] (MAPREDUCE-7136) TestMRAppMetrics should shutdown DefaultMetricsSystem after completion

[ https://issues.apache.org/jira/browse/MAPREDUCE-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610894#comment-16610894 ] Jason Lowe commented on MAPREDUCE-7136: --- Thanks for the report and patch!

[jira] [Updated] (MAPREDUCE-7135) TestTaskAttemptContainerRequest should reset UserGroupInformation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7135: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (MAPREDUCE-7135) TestTaskAttemptContainerRequest should reset UserGroupInformation

[ https://issues.apache.org/jira/browse/MAPREDUCE-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610866#comment-16610866 ] Jason Lowe commented on MAPREDUCE-7135: --- Thanks for the report and patches! +1 for patch v2.

[jira] [Updated] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7131: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.2

[jira] [Commented] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16606285#comment-16606285 ] Jason Lowe commented on MAPREDUCE-7131: --- Thanks for updating the patch! +1 lgtm. Committing

[jira] [Commented] (MAPREDUCE-7131) Job History Server has race condition where it moves files from intermediate to finished but thinks file is in intermediate

[ https://issues.apache.org/jira/browse/MAPREDUCE-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603658#comment-16603658 ] Jason Lowe commented on MAPREDUCE-7131: --- Thanks for the report and patch! Are the timezone

[jira] [Commented] (MAPREDUCE-7126) Error communicating with RM: Resource Manager doesn't recognize AttemptId: appattempt_idxx

[ https://issues.apache.org/jira/browse/MAPREDUCE-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584113#comment-16584113 ] Jason Lowe commented on MAPREDUCE-7126: --- There needs to be more information on this report to

[jira] [Resolved] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-6948. --- Resolution: Cannot Reproduce I agree as well. I have not seen any recent precommit

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7118: -- Status: Patch Available (was: Open) Attaching a patch that essentially ports the fix for

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7118: -- Attachment: MAPREDUCE-7118.001.patch > Distributed cache conflicts breaks backwards

[jira] [Created] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

Jason Lowe created MAPREDUCE-7118: - Summary: Distributed cache conflicts breaks backwards compatability Key: MAPREDUCE-7118 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7118 Project: Hadoop

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Fix Version/s: 3.1.1 I committed this to branch-3.1 as well. > Add config to allow

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (MAPREDUCE-7086) Add config to allow FileInputFormat to ignore directories when recursive=false

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7086: -- Summary: Add config to allow FileInputFormat to ignore directories when recursive=false

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460170#comment-16460170 ] Jason Lowe commented on MAPREDUCE-7086: --- My apologies for the delay. +1 lgtm, committing this.

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450120#comment-16450120 ] Jason Lowe commented on MAPREDUCE-7086: --- Thanks for updating the patch! Would it be clearer if

[jira] [Commented] (MAPREDUCE-7026) Shuffle Fetcher does not log the actual error message thrown by ShuffleHandler

[ https://issues.apache.org/jira/browse/MAPREDUCE-7026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450052#comment-16450052 ] Jason Lowe commented on MAPREDUCE-7026: --- Thanks for the report and the patch! The error posted

[jira] [Assigned] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-7086: - Assignee: Sergey Shelukhin > FileInputFormat recursive=false fails instead of

[jira] [Commented] (MAPREDUCE-7084) MRAppmaster still running after hadoop job -kill

[ https://issues.apache.org/jira/browse/MAPREDUCE-7084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16444347#comment-16444347 ] Jason Lowe commented on MAPREDUCE-7084: --- Looks like the AM was not able to successfully

[jira] [Updated] (MAPREDUCE-7081) Default speculator won't speculate the last several submitted reduced task if the total task num is large

[ https://issues.apache.org/jira/browse/MAPREDUCE-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7081: -- Summary: Default speculator won't speculate the last several submitted reduced task if the

[jira] [Resolved] (MAPREDUCE-7080) Default speculator won't sepculate the last several submitted reduced task if the total task num is large

[ https://issues.apache.org/jira/browse/MAPREDUCE-7080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved MAPREDUCE-7080. --- Resolution: Duplicate Closing as a duplicate of MAPREDUCE-7081. > Default speculator

[jira] [Updated] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7069: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Release Note:

[jira] [Updated] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7069: -- Release Note: Environment variables for MapReduce tasks can now be specified as separate

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16435838#comment-16435838 ] Jason Lowe commented on MAPREDUCE-7069: --- +1 lgtm as well. The two unit tests that are failing

[jira] [Created] (MAPREDUCE-7079) TestMRIntermediateDataEncryption is failing in precommit builds

Jason Lowe created MAPREDUCE-7079: - Summary: TestMRIntermediateDataEncryption is failing in precommit builds Key: MAPREDUCE-7079 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7079 Project:

[jira] [Created] (MAPREDUCE-7078) TestPipeApplication is failing in precommit builds

Jason Lowe created MAPREDUCE-7078: - Summary: TestPipeApplication is failing in precommit builds Key: MAPREDUCE-7078 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7078 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434021#comment-16434021 ] Jason Lowe commented on MAPREDUCE-7069: --- Given this is XML and not HTML I think we should avoid

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433021#comment-16433021 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for updating the patch! We're getting close.

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16431378#comment-16431378 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for updating the patch! Looks like

[jira] [Commented] (MAPREDUCE-7069) Add ability to specify user environment variables individually

[ https://issues.apache.org/jira/browse/MAPREDUCE-7069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16425770#comment-16425770 ] Jason Lowe commented on MAPREDUCE-7069: --- Thanks for the patch! It's a bit odd and inefficient

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409763#comment-16409763 ] Jason Lowe commented on MAPREDUCE-7068: --- Is there a real problem here or a theoretical one? The

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409685#comment-16409685 ] Jason Lowe commented on MAPREDUCE-7068: --- Errors are much more severe than Exceptions. If we're

[jira] [Commented] (MAPREDUCE-7068) Fix Reduce Exception was overwrited by ReduceTask

[ https://issues.apache.org/jira/browse/MAPREDUCE-7068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409561#comment-16409561 ] Jason Lowe commented on MAPREDUCE-7068: --- Is this reported against 2.7 or something else?

[jira] [Commented] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408655#comment-16408655 ] Jason Lowe commented on MAPREDUCE-6948: --- It looks like this was reported against 3.0.0-alpha4.

[jira] [Updated] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7064: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399209#comment-16399209 ] Jason Lowe commented on MAPREDUCE-7064: --- +1 lgtm. I'll clean up the unused import on the

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398694#comment-16398694 ] Jason Lowe commented on MAPREDUCE-7064: --- Thanks for updating the patch! Just noticed one more

[jira] [Commented] (MAPREDUCE-7064) Flaky test TestTaskAttempt#testReducerCustomResourceTypes

[ https://issues.apache.org/jira/browse/MAPREDUCE-7064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16397175#comment-16397175 ] Jason Lowe commented on MAPREDUCE-7064: --- Thanks for the patch! Looks like a reasonable approach

[jira] [Updated] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-6930: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.2

[jira] [Commented] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393129#comment-16393129 ] Jason Lowe commented on MAPREDUCE-6930: --- Thanks for the patch! +1 lgtm. Committing this. >

[jira] [Assigned] (MAPREDUCE-6930) mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are both present twice in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reassigned MAPREDUCE-6930: - Assignee: Sen Zhao > mapreduce.map.cpu.vcores and mapreduce.reduce.cpu.vcores are

[jira] [Commented] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382079#comment-16382079 ] Jason Lowe commented on MAPREDUCE-7059: --- Should this go into branch-3.0 as well given

[jira] [Updated] (MAPREDUCE-7060) Cherry Pick PathOutputCommitter class/factory to branch-3.0 & 2.10

[ https://issues.apache.org/jira/browse/MAPREDUCE-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7060: -- Description: It's easier for downstream apps like Spark to pick up the new

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380330#comment-16380330 ] Jason Lowe commented on MAPREDUCE-7059: --- +1 lgtm. > Compatibility issue: job submission fails

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16376919#comment-16376919 ] Jason Lowe commented on MAPREDUCE-7059: --- Thanks for the report! This was introduced by

[jira] [Moved] (MAPREDUCE-7059) Compatibility issue: throw RpcNoSuchMethodException when run mapreduce job

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe moved YARN-7970 to MAPREDUCE-7059: - Affects Version/s: (was: 3.0.0) 3.0.0

[jira] [Updated] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7059: -- Summary: Compatibility issue: job submission fails with RpcNoSuchMethodException when

[jira] [Updated] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7053: -- Affects Version/s: (was: 2.7.6) Target Version/s: 3.1.0, 3.0.1, 2.10.0, 2.9.1,

[jira] [Updated] (MAPREDUCE-7052) TestFixedLengthInputFormat#testFormatCompressedIn is flaky

[ https://issues.apache.org/jira/browse/MAPREDUCE-7052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated MAPREDUCE-7052: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.6

[jira] [Commented] (MAPREDUCE-7053) Timed out tasks can fail to produce thread dump

[ https://issues.apache.org/jira/browse/MAPREDUCE-7053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366266#comment-16366266 ] Jason Lowe commented on MAPREDUCE-7053: --- Thanks for the reviews! Here's the equivalent patch for

  1   2   3   4   5   6   7   8   9   10   >