[jira] [Updated] (MAPREDUCE-4669) MRAM web UI does not work with HTTPS

[ https://issues.apache.org/jira/browse/MAPREDUCE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-4669: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (MAPREDUCE-4669) MRAM web UI does not work with HTTPS

[ https://issues.apache.org/jira/browse/MAPREDUCE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-4669: -- Fix Version/s: 3.3.0 > MRAM web UI does not work with HTTPS >

[jira] [Commented] (MAPREDUCE-4669) MRAM web UI does not work with HTTPS

[ https://issues.apache.org/jira/browse/MAPREDUCE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661391#comment-16661391 ] Haibo Chen commented on MAPREDUCE-4669: --- +1 on the latest patch. Checking it in shortly. >

[jira] [Commented] (MAPREDUCE-4669) MRAM web UI does not work with HTTPS

[ https://issues.apache.org/jira/browse/MAPREDUCE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657337#comment-16657337 ] Haibo Chen commented on MAPREDUCE-4669: --- Thanks [~rkanter] for the patch! I have a few

[jira] [Updated] (MAPREDUCE-7150) Optimize collections used by MR JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7150: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.3.0

[jira] [Commented] (MAPREDUCE-7150) Optimize collections used by MR JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652407#comment-16652407 ] Haibo Chen commented on MAPREDUCE-7150: --- +1 on the latest patch. Will check it in shortly. >

[jira] [Commented] (MAPREDUCE-7150) Optimize collections used by MR JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648621#comment-16648621 ] Haibo Chen commented on MAPREDUCE-7150: --- Thanks for the detailed explaination,

[jira] [Commented] (MAPREDUCE-7150) Optimize collections used by MR JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648559#comment-16648559 ] Haibo Chen commented on MAPREDUCE-7150: --- Thanks [~mi...@cloudera.com] for the patch! {quote}The 

[jira] [Updated] (MAPREDUCE-7150) Optimize collections used by MR JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7150: -- Summary: Optimize collections used by MR JHS to reduce its memory (was: Optimize

[jira] [Assigned] (MAPREDUCE-7150) Optimize collections used by Yarn JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-7150: - Assignee: Misha Dmitriev > Optimize collections used by Yarn JHS to reduce its

[jira] [Assigned] (MAPREDUCE-7150) Optimize collections used by Yarn JHS to reduce its memory

[ https://issues.apache.org/jira/browse/MAPREDUCE-7150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-7150: - Assignee: (was: Misha Dmitriev) Component/s: (was: yarn)

[jira] [Updated] (MAPREDUCE-6861) Add metrics tags for ShuffleClientMetrics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6861: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0

[jira] [Commented] (MAPREDUCE-6861) Add metrics tags for ShuffleClientMetrics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593716#comment-16593716 ] Haibo Chen commented on MAPREDUCE-6861: --- +1 on the latest 02 patch pending jenkins. > Add

[jira] [Commented] (MAPREDUCE-6861) Add metrics tags for ShuffleClientMetrics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16593651#comment-16593651 ] Haibo Chen commented on MAPREDUCE-6861: --- Thanks [~zsiegl] for the patch. The patch looks good

[jira] [Assigned] (MAPREDUCE-6861) Add metrics tags for ShuffleClientMetrics

[ https://issues.apache.org/jira/browse/MAPREDUCE-6861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6861: - Assignee: Zoltan Siegl > Add metrics tags for ShuffleClientMetrics >

[jira] [Commented] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546895#comment-16546895 ] Haibo Chen commented on MAPREDUCE-6948: --- I am okay with closing this for now. >

[jira] [Commented] (MAPREDUCE-7095) Race conditions in closing FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470841#comment-16470841 ] Haibo Chen commented on MAPREDUCE-7095: --- Thanks [~miklos.szeg...@cloudera.com] for the fix. I

[jira] [Updated] (MAPREDUCE-7095) Race conditions in closing FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7095: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.2.0 Status:

[jira] [Updated] (MAPREDUCE-7095) Race conditions in closing FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7095: -- Summary: Race conditions in closing FadvisedChunkedFile (was: Race conditions in

[jira] [Commented] (MAPREDUCE-7095) Race conditions in FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16470818#comment-16470818 ] Haibo Chen commented on MAPREDUCE-7095: --- +1. Checking this in shortly. > Race conditions in

[jira] [Commented] (MAPREDUCE-7095) Race conditions in FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16469342#comment-16469342 ] Haibo Chen commented on MAPREDUCE-7095: --- [~miklos.szeg...@cloudera.com] can you address the

[jira] [Updated] (MAPREDUCE-7095) Race conditions in FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7095: -- Status: Patch Available (was: Open) > Race conditions in FadvisedChunkedFile >

[jira] [Moved] (MAPREDUCE-7095) Race conditions in FadvisedChunkedFile

[ https://issues.apache.org/jira/browse/MAPREDUCE-7095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen moved YARN-8090 to MAPREDUCE-7095: - Affects Version/s: (was: 3.1.0) 3.1.0

[jira] [Commented] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16408722#comment-16408722 ] Haibo Chen commented on MAPREDUCE-6948: --- This was observed in alpha4, so I suspect there is

[jira] [Updated] (MAPREDUCE-7065) Improve information stored in ATSv2 for MR jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7065: -- Description: While exploring the possibility of retrieving every piece of information that

[jira] [Commented] (MAPREDUCE-7065) Improve information stored in ATSv2 for MR jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396248#comment-16396248 ] Haibo Chen commented on MAPREDUCE-7065: --- CC [~rohithsharma] [~vrushalic]. Is it OK at this point

[jira] [Updated] (MAPREDUCE-7065) Improve information stored in ATSv2 for MR jobs

[ https://issues.apache.org/jira/browse/MAPREDUCE-7065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7065: -- Description: While exploring the possibility of retrieving every piece of information that

[jira] [Created] (MAPREDUCE-7065) Improve information stored in ATSv2 for MR jobs

Haibo Chen created MAPREDUCE-7065: - Summary: Improve information stored in ATSv2 for MR jobs Key: MAPREDUCE-7065 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7065 Project: Hadoop Map/Reduce

[jira] [Updated] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6441: -- Attachment: MAPREDUCE-6441.011.patch > Improve temporary directory name generation in

[jira] [Updated] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6441: -- Attachment: MAPREDUCE-6441.010.patch > Improve temporary directory name generation in

[jira] [Updated] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6441: -- Attachment: MAPREDUCE-6441.009.patch > Improve temporary directory name generation in

[jira] [Updated] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6441: -- Attachment: (was: MAPREDUCE-6441.009.patch) > Improve temporary directory name

[jira] [Assigned] (MAPREDUCE-4669) MRAM web UI does not work with HTTPS

[ https://issues.apache.org/jira/browse/MAPREDUCE-4669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-4669: - Assignee: (was: Haibo Chen) > MRAM web UI does not work with HTTPS >

[jira] [Commented] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16363021#comment-16363021 ] Haibo Chen commented on MAPREDUCE-6441: --- [~rchiang] Do you plan to work on this? I can take it

[jira] [Updated] (MAPREDUCE-7041) MR should not try to clean up at first job attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7041: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0

[jira] [Updated] (MAPREDUCE-7041) MR should not try to clean up at first job attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-7041: -- Summary: MR should not try to clean up at first job attempt (was: Several unit tests in

[jira] [Commented] (MAPREDUCE-7041) Several unit tests in hadoop-mapreduce-client-jobclient are failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-7041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16340329#comment-16340329 ] Haibo Chen commented on MAPREDUCE-7041: --- +1. Check this in shortly. > Several unit tests in

[jira] [Updated] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt in case of no recovery

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6984: -- Fix Version/s: 2.10.0 > MR AM to clean up temporary files from previous attempt in case of

[jira] [Updated] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt in case of no recovery

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6984: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.1

[jira] [Updated] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt in case of no recovery

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6984: -- Summary: MR AM to clean up temporary files from previous attempt in case of no recovery

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332761#comment-16332761 ] Haibo Chen commented on MAPREDUCE-6984: --- +1 pending Jenkins. > MR AM to clean up temporary

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16332679#comment-16332679 ] Haibo Chen commented on MAPREDUCE-6984: --- Thanks [~grepas] for the update! Please address the

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328901#comment-16328901 ] Haibo Chen commented on MAPREDUCE-6984: --- In TestRecovery, we always create an instance MRApp and

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327558#comment-16327558 ] Haibo Chen commented on MAPREDUCE-6984: --- Thanks [~grepas] for the updated patch! A few more

[jira] [Commented] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16321295#comment-16321295 ] Haibo Chen commented on MAPREDUCE-6926: --- Thanks [~miklos.szeg...@cloudera.com] for your reviews!

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Attachment: MAPREDUCE-6926-YARN-1011.04.patch Good catch. I updated the patch to address

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Attachment: MAPREDUCE-6926-YARN-1011.03.patch > Allow MR jobs to opt out of

[jira] [Commented] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16310315#comment-16310315 ] Haibo Chen commented on MAPREDUCE-6926: --- I have instead rebased YARN-1011 branch and manually

[jira] [Commented] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308813#comment-16308813 ] Haibo Chen commented on MAPREDUCE-6926: --- As pointed by Miklos offiline, HADOOP-15122 should fix

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Attachment: MAPREDUCE-6926-YARN-1011.02.patch > Allow MR jobs to opt out of

[jira] [Commented] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308705#comment-16308705 ] Haibo Chen commented on MAPREDUCE-6926: --- Good catch. I updated the message in the new patch. >

[jira] [Commented] (MAPREDUCE-7015) Possible race condition in JHS if the job is not loaded

[ https://issues.apache.org/jira/browse/MAPREDUCE-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308511#comment-16308511 ] Haibo Chen commented on MAPREDUCE-7015: --- [~pbacsko] I think you meant to say step #6 is slow

[jira] [Commented] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16308413#comment-16308413 ] Haibo Chen commented on MAPREDUCE-6926: --- Thanks [~miklos.szeg...@cloudera.com] for the review! I

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Attachment: MAPREDUCE-6926-YARN-1011.01.patch Updated the patch to address the unit test

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Status: Patch Available (was: Open) > Allow MR jobs to opt out of oversubscription >

[jira] [Updated] (MAPREDUCE-6926) Allow MR jobs to opt out of oversubscription

[ https://issues.apache.org/jira/browse/MAPREDUCE-6926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6926: -- Attachment: MAPREDUCE-6926-YARN-1011.00.patch > Allow MR jobs to opt out of

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16221178#comment-16221178 ] Haibo Chen commented on MAPREDUCE-6984: --- Thanks [~grepas] for the patch! A few high level

[jira] [Commented] (MAPREDUCE-6992) Race for temp dir in LocalDistributedCacheManager.java

[ https://issues.apache.org/jira/browse/MAPREDUCE-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16220977#comment-16220977 ] Haibo Chen commented on MAPREDUCE-6992: --- I believe this is a duplicate of MAPREDUCE-6441 > Race

[jira] [Commented] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16215975#comment-16215975 ] Haibo Chen commented on MAPREDUCE-6984: --- Manually trigger the jenkins job. > MR AM to clean up

[jira] [Assigned] (MAPREDUCE-6631) shuffle handler would benefit from per-local-dir threads

[ https://issues.apache.org/jira/browse/MAPREDUCE-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6631: - Assignee: (was: Haibo Chen) > shuffle handler would benefit from per-local-dir

[jira] [Assigned] (MAPREDUCE-5124) AM lacks flow control for task events

[ https://issues.apache.org/jira/browse/MAPREDUCE-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-5124: - Assignee: Peter Bacsko (was: Haibo Chen) > AM lacks flow control for task events >

[jira] [Assigned] (MAPREDUCE-6984) MR AM to clean up temporary files from previous attempt

[ https://issues.apache.org/jira/browse/MAPREDUCE-6984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6984: - Assignee: Gergo Repas > MR AM to clean up temporary files from previous attempt >

[jira] [Commented] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16193551#comment-16193551 ] Haibo Chen commented on MAPREDUCE-6441: --- Thanks for the update, [~rchiang]. We probably should

[jira] [Updated] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Release Note: This adds some new job counters, the number of failed MAP/REDUCE tasks and

[jira] [Commented] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16162181#comment-16162181 ] Haibo Chen commented on MAPREDUCE-6441: --- I see. Talking with Daniel, there is really no good way

[jira] [Resolved] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

[ https://issues.apache.org/jira/browse/MAPREDUCE-6955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6955. --- Resolution: Not A Problem > remove unnecessary dependency from

[jira] [Created] (MAPREDUCE-6955) remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle

Haibo Chen created MAPREDUCE-6955: - Summary: remove unnecessary dependency from hadoop-mapreduce-client-app to hadoop-mapreduce-client-shuffle Key: MAPREDUCE-6955 URL:

[jira] [Commented] (MAPREDUCE-6441) Improve temporary directory name generation in LocalDistributedCacheManager for concurrent processes

[ https://issues.apache.org/jira/browse/MAPREDUCE-6441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16153860#comment-16153860 ] Haibo Chen commented on MAPREDUCE-6441: --- bq. but I haven't managed to get it to fail with the

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149756#comment-16149756 ] Haibo Chen commented on MAPREDUCE-6937: --- Ah. Thanks [~djp]! > Backport MAPREDUCE-6870 to

[jira] [Updated] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6937: -- Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch

[jira] [Updated] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6937: -- Fix Version/s: 2.8.2 > Backport MAPREDUCE-6870 to branch-2 while preserving compatibility >

[jira] [Updated] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6937: -- Fix Version/s: 2.9.0 > Backport MAPREDUCE-6870 to branch-2 while preserving compatibility >

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16149184#comment-16149184 ] Haibo Chen commented on MAPREDUCE-6937: --- The unit tests always fail with error message

[jira] [Assigned] (MAPREDUCE-4955) NM container diagnostics for excess resource usage can be lost if task fails while being killed

[ https://issues.apache.org/jira/browse/MAPREDUCE-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-4955: - Assignee: (was: Haibo Chen) > NM container diagnostics for excess resource usage

[jira] [Assigned] (MAPREDUCE-6636) Clean up argument parsing in mapred CLI

[ https://issues.apache.org/jira/browse/MAPREDUCE-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned MAPREDUCE-6636: - Assignee: (was: Haibo Chen) > Clean up argument parsing in mapred CLI >

[jira] [Resolved] (MAPREDUCE-6949) yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml

[ https://issues.apache.org/jira/browse/MAPREDUCE-6949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved MAPREDUCE-6949. --- Resolution: Duplicate > yarn.app.mapreduce.am.log.level is not documented in

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147977#comment-16147977 ] Haibo Chen commented on MAPREDUCE-6937: --- Never mind my comments on the patch for 2.9. It's still

[jira] [Created] (MAPREDUCE-6949) yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml

Haibo Chen created MAPREDUCE-6949: - Summary: yarn.app.mapreduce.am.log.level is not documented in mapred-default.xml Key: MAPREDUCE-6949 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6949

[jira] [Updated] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed (was: Incompatible

[jira] [Updated] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6937: -- Fix Version/s: 2.7.5 > Backport MAPREDUCE-6870 to branch-2 while preserving compatibility >

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147615#comment-16147615 ] Haibo Chen commented on MAPREDUCE-6892: --- +1 on the latest patch. Will commit it shortly. >

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147567#comment-16147567 ] Haibo Chen commented on MAPREDUCE-6937: --- [~pbacsko] Can you also upload a patch for 2.9? >

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147554#comment-16147554 ] Haibo Chen commented on MAPREDUCE-6937: --- +1 on the branch-2.7-v5 patch. I have filed

[jira] [Updated] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

[ https://issues.apache.org/jira/browse/MAPREDUCE-6948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6948: -- Description: *Error Message* expected: but was: *Stacktrace* java.lang.AssertionError:

[jira] [Created] (MAPREDUCE-6948) TestJobImpl.testUnusableNodeTransition failed

Haibo Chen created MAPREDUCE-6948: - Summary: TestJobImpl.testUnusableNodeTransition failed Key: MAPREDUCE-6948 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6948 Project: Hadoop Map/Reduce

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147536#comment-16147536 ] Haibo Chen commented on MAPREDUCE-6937: --- branch-2.8 jenkins job failed due to time out. I have

[jira] [Updated] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Tags: (was: incom) > Issues with the count of failed/killed tasks in the jhist file >

[jira] [Updated] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Tags: incom Hadoop Flags: Incompatible change > Issues with the count of

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143964#comment-16143964 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks for the update [~pbacsko]! The patch is very

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143883#comment-16143883 ] Haibo Chen commented on MAPREDUCE-6937: --- Seems like the patch is not picked up by Jenkins. Can

[jira] [Commented] (MAPREDUCE-6937) Backport MAPREDUCE-6870 to branch-2 while preserving compatibility

[ https://issues.apache.org/jira/browse/MAPREDUCE-6937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16143857#comment-16143857 ] Haibo Chen commented on MAPREDUCE-6937: --- [~pbacsko], the default value for

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140481#comment-16140481 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks @Peter for the update, I'll wait for you to fix

[jira] [Commented] (MAPREDUCE-6936) Remove unnecessary dependency of hadoop-yarn-server-common from hadoop-mapreduce-client-common

[ https://issues.apache.org/jira/browse/MAPREDUCE-6936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16129637#comment-16129637 ] Haibo Chen commented on MAPREDUCE-6936: --- Thanks [~rkanter] for the review! > Remove unnecessary

[jira] [Updated] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6870: -- Hadoop Flags: Incompatible change,Reviewed (was: Reviewed) > Add configuration for MR job

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124114#comment-16124114 ] Haibo Chen commented on MAPREDUCE-6870: --- Agreed. > Add configuration for MR job to finish when

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123984#comment-16123984 ] Haibo Chen commented on MAPREDUCE-6870: --- In some cases, the single mapper can take hours to

[jira] [Commented] (MAPREDUCE-6870) Add configuration for MR job to finish when all reducers are complete (even with unfinished mappers)

[ https://issues.apache.org/jira/browse/MAPREDUCE-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123624#comment-16123624 ] Haibo Chen commented on MAPREDUCE-6870: --- Thanks [~xkrogen] for pointing out the incompatibility!

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123608#comment-16123608 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks [~pbacsko] for updating the patch! A few more

[jira] [Issue Comment Deleted] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated MAPREDUCE-6892: -- Comment: was deleted (was: Thanks [~pbacsko] for updating the patch! A few more comments:

[jira] [Commented] (MAPREDUCE-6892) Issues with the count of failed/killed tasks in the jhist file

[ https://issues.apache.org/jira/browse/MAPREDUCE-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123520#comment-16123520 ] Haibo Chen commented on MAPREDUCE-6892: --- Thanks [~pbacsko] for updating the patch! A few more

  1   2   3   4   5   6   7   >