[jira] [Commented] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17237689#comment-17237689 ] Wangda Tan commented on MAPREDUCE-7309: --- Thanks [~pbacsko], the latest patch looks better than

[jira] [Assigned] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7309: - Assignee: Peter Bacsko (was: Wangda Tan) > Improve performance of reading resource

[jira] [Commented] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236497#comment-17236497 ] Wangda Tan commented on MAPREDUCE-7309: --- Attached ver.2 patch, [~snemeth], [~shuzirra] can you

[jira] [Updated] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7309: -- Attachment: MAPREDUCE-7309.002.patch > Improve performance of reading resource request for

[jira] [Created] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

Wangda Tan created MAPREDUCE-7309: - Summary: Improve performance of reading resource request for mapper/reducers from config Key: MAPREDUCE-7309 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7309

[jira] [Updated] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7309: -- Attachment: MAPREDUCE-7309.001.patch > Improve performance of reading resource request for

[jira] [Updated] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7309: -- Status: Patch Available (was: Open) > Improve performance of reading resource request for

[jira] [Assigned] (MAPREDUCE-7309) Improve performance of reading resource request for mapper/reducers from config

[ https://issues.apache.org/jira/browse/MAPREDUCE-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7309: - Assignee: Wangda Tan > Improve performance of reading resource request for

[jira] [Commented] (MAPREDUCE-7298) Distcp doesn't close the job after the job is completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205866#comment-17205866 ] Wangda Tan commented on MAPREDUCE-7298: --- Thanks [~aasha], I just added you to contributor list.

[jira] [Assigned] (MAPREDUCE-7298) Distcp doesn't close the job after the job is completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7298: - Assignee: Aasha Medhi > Distcp doesn't close the job after the job is completed >

[jira] [Commented] (MAPREDUCE-7298) Distcp doesn't close the job after the job is completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17205770#comment-17205770 ] Wangda Tan commented on MAPREDUCE-7298: --- +1, thanks for the patch. > Distcp doesn't close the

[jira] [Commented] (MAPREDUCE-7172) Wildcard functionality of -libjar is broken when jars are located in same remote FS

[ https://issues.apache.org/jira/browse/MAPREDUCE-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719260#comment-16719260 ] Wangda Tan commented on MAPREDUCE-7172: --- Thanks [~templedf] for trying this.   Per my

[jira] [Created] (MAPREDUCE-7172) Wildcard functionality of -libjar is broken when jars are located in same remote FS

Wangda Tan created MAPREDUCE-7172: - Summary: Wildcard functionality of -libjar is broken when jars are located in same remote FS Key: MAPREDUCE-7172 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7172

[jira] [Commented] (MAPREDUCE-7172) Wildcard functionality of -libjar is broken when jars are located in same remote FS

[ https://issues.apache.org/jira/browse/MAPREDUCE-7172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16718010#comment-16718010 ] Wangda Tan commented on MAPREDUCE-7172: --- [~templedf], [~sjlee0], if you got chance, could u

[jira] [Commented] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705006#comment-16705006 ] Wangda Tan commented on MAPREDUCE-7167: --- Thanks [~saurabhpant], I couldn't see this diff from

[jira] [Assigned] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7167: - Assignee: Saurabh > Extra LF ("\n") pushed directly to storage >

[jira] [Commented] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703898#comment-16703898 ] Wangda Tan commented on MAPREDUCE-7167: --- [~saurabhpant], sorry I couldn't find the empty lines

[jira] [Commented] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703566#comment-16703566 ] Wangda Tan commented on MAPREDUCE-7167: --- [~saurabhpant], thanks for filing the JIRA. Could u

[jira] [Updated] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7167: -- Fix Version/s: (was: 3.2.1) (was: 3.3.0)

[jira] [Updated] (MAPREDUCE-7167) Extra LF ("\n") pushed directly to storage

[ https://issues.apache.org/jira/browse/MAPREDUCE-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7167: -- Target Version/s: 3.3.0, 3.2.1 > Extra LF ("\n") pushed directly to storage >

[jira] [Commented] (MAPREDUCE-7162) TestEvents#testEvents fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-7162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16700685#comment-16700685 ] Wangda Tan commented on MAPREDUCE-7162: --- Apologize for introducing the issue, Thanks [~uranus],

[jira] [Updated] (MAPREDUCE-7158) Inefficient Flush Logic in JobHistory EventWriter

[ https://issues.apache.org/jira/browse/MAPREDUCE-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7158: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.1

[jira] [Commented] (MAPREDUCE-7158) Inefficient Flush Logic in JobHistory EventWriter

[ https://issues.apache.org/jira/browse/MAPREDUCE-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685550#comment-16685550 ] Wangda Tan commented on MAPREDUCE-7158: --- +1, patch LGTM, thanks [~zichensun]. Also added you

[jira] [Assigned] (MAPREDUCE-7158) Inefficient Flush Logic in JobHistory EventWriter

[ https://issues.apache.org/jira/browse/MAPREDUCE-7158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7158: - Assignee: Zichen Sun > Inefficient Flush Logic in JobHistory EventWriter >

[jira] [Updated] (MAPREDUCE-7125) JobResourceUploader creates LocalFileSystem when it's not necessary

[ https://issues.apache.org/jira/browse/MAPREDUCE-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7125: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to

[jira] [Updated] (MAPREDUCE-7125) JobResourceUploader creates LocalFileSystem when it's not necessary

[ https://issues.apache.org/jira/browse/MAPREDUCE-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7125: -- Fix Version/s: 3.1.2 3.2.0 > JobResourceUploader creates

[jira] [Commented] (MAPREDUCE-7125) JobResourceUploader creates LocalFileSystem when it's not necessary

[ https://issues.apache.org/jira/browse/MAPREDUCE-7125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626420#comment-16626420 ] Wangda Tan commented on MAPREDUCE-7125: --- Fix looks good, +1, committing the patch. >

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7118: -- Fix Version/s: 3.1.1 3.2.0 > Distributed cache conflicts breaks

[jira] [Updated] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7118: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Commented] (MAPREDUCE-7118) Distributed cache conflicts breaks backwards compatability

[ https://issues.apache.org/jira/browse/MAPREDUCE-7118?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16545608#comment-16545608 ] Wangda Tan commented on MAPREDUCE-7118: --- Thanks [~jlowe], to me this is a valid issue and we

[jira] [Commented] (MAPREDUCE-7101) Add config parameter to allow JHS to alway scan user dir irrespective of modTime

[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514312#comment-16514312 ] Wangda Tan commented on MAPREDUCE-7101: --- Pushed to branch-3.1 as well. > Add config parameter

[jira] [Updated] (MAPREDUCE-7101) Add config parameter to allow JHS to alway scan user dir irrespective of modTime

[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7101: -- Fix Version/s: 3.1.1 > Add config parameter to allow JHS to alway scan user dir

[jira] [Commented] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16508468#comment-16508468 ] Wangda Tan commented on MAPREDUCE-7101: --- Reported offline by [~deepesh]:  After remove the

[jira] [Commented] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16507097#comment-16507097 ] Wangda Tan commented on MAPREDUCE-7101: --- [~ste...@apache.org] / [~ehiggs] / [~rohithsharma]

[jira] [Commented] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

[ https://issues.apache.org/jira/browse/MAPREDUCE-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16496959#comment-16496959 ] Wangda Tan commented on MAPREDUCE-7101: --- Regarding to semantics of directory's modification

[jira] [Created] (MAPREDUCE-7101) Revisit behavior of JHS scan file behavior

Wangda Tan created MAPREDUCE-7101: - Summary: Revisit behavior of JHS scan file behavior Key: MAPREDUCE-7101 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7101 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448926#comment-16448926 ] Wangda Tan commented on MAPREDUCE-7086: --- [~sershe], oh that's my bad, moving the JIRA somehow

[jira] [Assigned] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7086: - Assignee: (was: Sergey Shelukhin) Key: MAPREDUCE-7086 (was:

[jira] [Commented] (MAPREDUCE-7086) FileInputFormat recursive=false fails instead of ignoring the directories.

[ https://issues.apache.org/jira/browse/MAPREDUCE-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448750#comment-16448750 ] Wangda Tan commented on MAPREDUCE-7086: --- I just moved this project to MAPREDUCE. >

[jira] [Updated] (MAPREDUCE-7077) Pipe mapreduce job fails with Permission denied for jobTokenPassword

[ https://issues.apache.org/jira/browse/MAPREDUCE-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7077: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.1

[jira] [Commented] (MAPREDUCE-7077) Pipe mapreduce job fails with Permission denied for jobTokenPassword

[ https://issues.apache.org/jira/browse/MAPREDUCE-7077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436338#comment-16436338 ] Wangda Tan commented on MAPREDUCE-7077: --- +1, will commit shortly.  Thanks [~ajisakaa] for the

[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client

[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16436337#comment-16436337 ] Wangda Tan commented on MAPREDUCE-7036: --- Thanks [~tasanuma0829] / [~ajisakaa].  > ASF License

[jira] [Commented] (MAPREDUCE-7036) ASF License warning in hadoop-mapreduce-client

[ https://issues.apache.org/jira/browse/MAPREDUCE-7036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16434516#comment-16434516 ] Wangda Tan commented on MAPREDUCE-7036: --- Thanks [~suma.shivaprasad] and offline help from

[jira] [Commented] (MAPREDUCE-6823) FileOutputFormat to support configurable PathOutputCommitter factory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16409057#comment-16409057 ] Wangda Tan commented on MAPREDUCE-6823: --- While doing Jira scan, I could not find the commit

[jira] [Updated] (MAPREDUCE-7059) Downward Compatibility issue: MR job fails because of unknown setErasureCodingPolicy method from 3.x client to HDFS 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7059: -- Fix Version/s: (was: 3.2.0) > Downward Compatibility issue: MR job fails because of

[jira] [Updated] (MAPREDUCE-7061) SingleCluster setup document needs to be updated

[ https://issues.apache.org/jira/browse/MAPREDUCE-7061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7061: -- Fix Version/s: (was: 3.2.0) 3.1.0 > SingleCluster setup document

[jira] [Updated] (MAPREDUCE-7047) Make HAR tool support IndexedLogAggregtionController

[ https://issues.apache.org/jira/browse/MAPREDUCE-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7047: -- Fix Version/s: (was: 3.2.0) 3.1.0 > Make HAR tool support

[jira] [Updated] (MAPREDUCE-7047) Make HAR tool support IndexedLogAggregtionController

[ https://issues.apache.org/jira/browse/MAPREDUCE-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7047: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Commented] (MAPREDUCE-7047) Make HAR tool support IndexedLogAggregtionController

[ https://issues.apache.org/jira/browse/MAPREDUCE-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399541#comment-16399541 ] Wangda Tan commented on MAPREDUCE-7047: --- Thanks  [~xgong]/[~rkanter], will commit tomorrow if no

[jira] [Commented] (MAPREDUCE-7047) Make HAR tool support IndexedLogAggregtionController

[ https://issues.apache.org/jira/browse/MAPREDUCE-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16393879#comment-16393879 ] Wangda Tan commented on MAPREDUCE-7047: --- +1, thanks [~xgong]. [~rkanter], do you want to take a

[jira] [Commented] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379344#comment-16379344 ] Wangda Tan commented on MAPREDUCE-7059: --- [~yangjiandan], thanks for reporting the issue and

[jira] [Assigned] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7059: - Assignee: Jiandan Yang > Compatibility issue: job submission fails with

[jira] [Updated] (MAPREDUCE-7059) Compatibility issue: job submission fails with RpcNoSuchMethodException when submitting to 2.x cluster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-7059: -- Target Version/s: 3.1.0 > Compatibility issue: job submission fails with

[jira] [Commented] (MAPREDUCE-7055) MR jobs are failing with Could not find or load main class for MRAppMaster

[ https://issues.apache.org/jira/browse/MAPREDUCE-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368761#comment-16368761 ] Wangda Tan commented on MAPREDUCE-7055: --- Thanks [~rohithsharma] for reporting this issue, I can

[jira] [Updated] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6654: -- Target Version/s: 3.2.0 (was: 3.1.0) > Possible NPE in JobHistoryEventHandler#handleEvent

[jira] [Commented] (MAPREDUCE-6315) Implement retrieval of logs for crashed MR-AM via jhist in the staging directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16361777#comment-16361777 ] Wangda Tan commented on MAPREDUCE-6315: --- Thanks [~jira.shegalov], I temporarily moved it to

[jira] [Updated] (MAPREDUCE-6315) Implement retrieval of logs for crashed MR-AM via jhist in the staging directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6315: -- Target Version/s: 3.2.0 (was: 3.1.0) > Implement retrieval of logs for crashed MR-AM via

[jira] [Commented] (MAPREDUCE-6654) Possible NPE in JobHistoryEventHandler#handleEvent

[ https://issues.apache.org/jira/browse/MAPREDUCE-6654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353295#comment-16353295 ] Wangda Tan commented on MAPREDUCE-6654: --- We plan to start merge vote of 3.1.0 on Feb 18, please

[jira] [Commented] (MAPREDUCE-6315) Implement retrieval of logs for crashed MR-AM via jhist in the staging directory

[ https://issues.apache.org/jira/browse/MAPREDUCE-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16353294#comment-16353294 ] Wangda Tan commented on MAPREDUCE-6315: --- We plan to start merge vote of 3.1.0 on Feb 18, please

[jira] [Assigned] (MAPREDUCE-7017) Too many times of meaningless invocation in TaskAttemptImpl#resolveHosts

[ https://issues.apache.org/jira/browse/MAPREDUCE-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned MAPREDUCE-7017: - Assignee: jiayuhan-it > Too many times of meaningless invocation in

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16043083#comment-16043083 ] Wangda Tan commented on MAPREDUCE-6895: --- I just realized Jason might be traveling, I'm going to

[jira] [Commented] (MAPREDUCE-6895) Job end notification not send due to YarnRuntimeException

[ https://issues.apache.org/jira/browse/MAPREDUCE-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037542#comment-16037542 ] Wangda Tan commented on MAPREDUCE-6895: --- Thanks [~zhaoyunjiong], however I'm not sure if this

[jira] [Updated] (MAPREDUCE-6803) MR AppMaster should assign container that is closest to the data

[ https://issues.apache.org/jira/browse/MAPREDUCE-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6803: -- Summary: MR AppMaster should assign container that is closest to the data (was: YARN shoud

[jira] [Commented] (MAPREDUCE-6803) MR AppMaster should assign container that is closest to the data

[ https://issues.apache.org/jira/browse/MAPREDUCE-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612792#comment-15612792 ] Wangda Tan commented on MAPREDUCE-6803: --- Moved to MR. [~djp] if you have chance, could you look

[jira] [Updated] (MAPREDUCE-6803) YARN shoud allocate container that is closest to the data

[ https://issues.apache.org/jira/browse/MAPREDUCE-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6803: -- Labels: oct16-medium (was: oct16-hard) > YARN shoud allocate container that is closest to

[jira] [Moved] (MAPREDUCE-6803) YARN shoud allocate container that is closest to the data

[ https://issues.apache.org/jira/browse/MAPREDUCE-6803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan moved YARN-3856 to MAPREDUCE-6803: - Affects Version/s: (was: 2.7.0) Component/s: (was:

[jira] [Updated] (MAPREDUCE-6310) Add jdiff support to MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6310: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status:

[jira] [Commented] (MAPREDUCE-6310) Add jdiff support to MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15428813#comment-15428813 ] Wangda Tan commented on MAPREDUCE-6310: --- +1 to latest patch, unit test failures are not related,

[jira] [Updated] (MAPREDUCE-6310) Add jdiff support to MapReduce

[ https://issues.apache.org/jira/browse/MAPREDUCE-6310?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6310: -- Target Version/s: 2.8.0, 3.0.0-alpha1 (was: 2.8.0) > Add jdiff support to MapReduce >

[jira] [Commented] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15283210#comment-15283210 ] Wangda Tan commented on MAPREDUCE-6513: --- Credit to [~varun_saxena] for working on this patch! >

[jira] [Resolved] (MAPREDUCE-6108) ShuffleError OOM while reserving memory by MergeManagerImpl

[ https://issues.apache.org/jira/browse/MAPREDUCE-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved MAPREDUCE-6108. --- Resolution: Cannot Reproduce No responses, close as cannot reproduce, please reopen it if

[jira] [Commented] (MAPREDUCE-6108) ShuffleError OOM while reserving memory by MergeManagerImpl

[ https://issues.apache.org/jira/browse/MAPREDUCE-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15281053#comment-15281053 ] Wangda Tan commented on MAPREDUCE-6108: --- [~kasha], [~vinodkv] is this still an issue in existing

[jira] [Commented] (MAPREDUCE-6689) MapReduce job can infinitely increase number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15274660#comment-15274660 ] Wangda Tan commented on MAPREDUCE-6689: --- Yeah this is majorly caused by inaccurate headroom

[jira] [Commented] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15273364#comment-15273364 ] Wangda Tan commented on MAPREDUCE-6514: --- [~vinodkv], This behavior is commented by

[jira] [Updated] (MAPREDUCE-6689) MapReduce job can infinitely increase number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6689: -- Attachment: MAPREDUCE-6689.1.patch > MapReduce job can infinitely increase number of

[jira] [Commented] (MAPREDUCE-6689) MapReduce job can infinitely increase number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272988#comment-15272988 ] Wangda Tan commented on MAPREDUCE-6689: --- Uploaded patch for this (on top of MAPREDUCE-6514) >

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Target Version/s: 2.6.4, 2.8.0, 2.7.3 (was: 2.8.0) > Job hangs as ask is not updated after

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Status: Patch Available (was: Open) > Job hangs as ask is not updated after ramping down

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Affects Version/s: (was: 2.7.1) 2.7.2

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Affects Version/s: (was: 2.6.3) (was: 2.7.2) > Job hangs as

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Priority: Blocker (was: Critical) > Job hangs as ask is not updated after ramping down of

[jira] [Updated] (MAPREDUCE-6514) Job hangs as ask is not updated after ramping down of all reducers

[ https://issues.apache.org/jira/browse/MAPREDUCE-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6514: -- Attachment: MAPREDUCE-6514.02.patch Rebased patch to latest trunk, and addressed comments

[jira] [Commented] (MAPREDUCE-6689) MapReduce job can infinitely increase number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15272774#comment-15272774 ] Wangda Tan commented on MAPREDUCE-6689: --- Thanks [~haibochen] pointing MAPREDUCE-6514.

[jira] [Updated] (MAPREDUCE-6689) MapReduce job can infinitely increase number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6689: -- Summary: MapReduce job can infinitely increase number of reducer resource requests (was:

[jira] [Commented] (MAPREDUCE-6689) MapReduce job can infinitely increasing number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271713#comment-15271713 ] Wangda Tan commented on MAPREDUCE-6689: --- And also, following logic seems not correct to me:

[jira] [Commented] (MAPREDUCE-6689) MapReduce job can infinitely increasing number of reducer resource requests

[ https://issues.apache.org/jira/browse/MAPREDUCE-6689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15271710#comment-15271710 ] Wangda Tan commented on MAPREDUCE-6689: --- One of the quick solution for this issue is: modify

[jira] [Created] (MAPREDUCE-6689) MapReduce job can infinitely increasing number of reducer resource requests

Wangda Tan created MAPREDUCE-6689: - Summary: MapReduce job can infinitely increasing number of reducer resource requests Key: MAPREDUCE-6689 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6689

[jira] [Updated] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-5817: -- Fix Version/s: (was: 2.8.0) 2.7.3 > Mappers get rescheduled on node

[jira] [Commented] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15248114#comment-15248114 ] Wangda Tan commented on MAPREDUCE-5817: --- Updated fix version. > Mappers get rescheduled on node

[jira] [Updated] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6513: -- Attachment: MAPREDUCE-6513.3_1.branch-2.7.patch Rebased branch-2.7 patch. Since

[jira] [Commented] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247181#comment-15247181 ] Wangda Tan commented on MAPREDUCE-5817: --- Thanks [~sjlee0], committing now. > Mappers get

[jira] [Commented] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242220#comment-15242220 ] Wangda Tan commented on MAPREDUCE-6513: --- Committed to branch-2.8. We need to backport

[jira] [Commented] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242217#comment-15242217 ] Wangda Tan commented on MAPREDUCE-5817: --- Forgot to mention: MAPREDUCE-6513 depends on this

[jira] [Commented] (MAPREDUCE-5817) Mappers get rescheduled on node transition even after all reducers are completed

[ https://issues.apache.org/jira/browse/MAPREDUCE-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242211#comment-15242211 ] Wangda Tan commented on MAPREDUCE-5817: --- [~sjlee0]/[~kasha], Should we backport this patch to

[jira] [Updated] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6513: -- Attachment: MAPREDUCE-6513.3_1.branch-2.8.patch Committed MAPREDUCE-4785 to

[jira] [Commented] (MAPREDUCE-4785) TestMRApp occasionally fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15242000#comment-15242000 ] Wangda Tan commented on MAPREDUCE-4785: --- Backported this issue to branch-2.8 and branch-2.7,

[jira] [Updated] (MAPREDUCE-4785) TestMRApp occasionally fails

[ https://issues.apache.org/jira/browse/MAPREDUCE-4785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-4785: -- Fix Version/s: (was: 2.9.0) 2.7.3 > TestMRApp occasionally fails >

[jira] [Updated] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6513: -- Attachment: MAPREDUCE-6513.3.branch-2.8.patch > MR job got hanged forever when one NM

[jira] [Updated] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6513: -- Attachment: (was: MAPREDUCE-6513-1-branch-2.8.patch) > MR job got hanged forever when

[jira] [Updated] (MAPREDUCE-6513) MR job got hanged forever when one NM unstable for some time

[ https://issues.apache.org/jira/browse/MAPREDUCE-6513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated MAPREDUCE-6513: -- Attachment: MAPREDUCE-6513-1-branch-2.8.patch Committed to branch-2 / trunk. Thanks

  1   2   >