[jira] [Commented] (YARN-5396) YARN large file broadcast service

2017-07-07 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078630#comment-16078630 ] Zhiyuan Yang commented on YARN-5396: [~elgoiri] Thanks for your interest! Please refer to Spark

[jira] [Comment Edited] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982066#comment-15982066 ] Zhiyuan Yang edited comment on YARN-5007 at 4/24/17 10:58 PM: -- This change

[jira] [Comment Edited] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982066#comment-15982066 ] Zhiyuan Yang edited comment on YARN-5007 at 4/24/17 10:58 PM: -- This change

[jira] [Commented] (YARN-5007) Remove deprecated constructors of MiniYARNCluster and MiniMRYarnCluster

2017-04-24 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15982066#comment-15982066 ] Zhiyuan Yang commented on YARN-5007: This change breaks Tez and possibly many other downstream

[jira] [Updated] (YARN-5835) NoClassDefFoundError when reading ATS v1.5

2016-11-03 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5835: --- Description: LevelDBCacheTimelineStore requires jackson-databind-2.2.3.jar which is in

[jira] [Updated] (YARN-5835) NoClassDefFoundError when reading ATS v1.5

2016-11-03 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5835: --- Description: LevelDBCacheTimelineStore requires jackson-databind-2.2.3.jar which is in

[jira] [Commented] (YARN-5835) NoClassDefFoundError when reading ATS v1.5

2016-11-03 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15634846#comment-15634846 ] Zhiyuan Yang commented on YARN-5835: Thanks [~gtCarrera9] for helping debug on this! [~hitesh],

[jira] [Created] (YARN-5835) NoClassDefFoundError when reading ATS v1.5

2016-11-03 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created YARN-5835: -- Summary: NoClassDefFoundError when reading ATS v1.5 Key: YARN-5835 URL: https://issues.apache.org/jira/browse/YARN-5835 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-5396) YARN large file broadcast service

2016-08-01 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5396: --- Attachment: YARNFileTransferService-prototype.pdf Attached documentation, including some background,

[jira] [Updated] (YARN-5396) YARN large file broadcast service

2016-08-01 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5396: --- Attachment: slides-prototype.pdf Attach the slides which explains the big picture. > YARN large file

[jira] [Updated] (YARN-5396) YARN large file broadcast service

2016-08-01 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5396: --- Attachment: YARN-broadcast-prototype.patch Attach the hacky prototype of my last year's internship

[jira] [Commented] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-28 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397739#comment-15397739 ] Zhiyuan Yang commented on YARN-5436: [~rohithsharma] Thanks for reviewing! You are right in the sense

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: YARN-5436.4.patch Uploaded the patch that doesn't use java 8 feature for branch-2 sake. >

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: YARN-5436.3.patch > Race in AsyncDispatcher can cause random test failures in Tez(probably

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: (was: YARN-5436.3.patch) > Race in AsyncDispatcher can cause random test failures in

[jira] [Comment Edited] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396514#comment-15396514 ] Zhiyuan Yang edited comment on YARN-5436 at 7/27/16 10:23 PM: -- Thanks

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: YARN-5436.3.patch Thanks [~gtCarrera9] for review the patch. Sorry for misusing the term

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: YARN-5436.2.patch > Race in AsyncDispatcher can cause random test failures in Tez(probably

[jira] [Commented] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396345#comment-15396345 ] Zhiyuan Yang commented on YARN-5436: Upload the patch that fixes problems only in DrainDispatcher and

[jira] [Commented] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396348#comment-15396348 ] Zhiyuan Yang commented on YARN-5436: Race in AsyncDispatcher has been found and ignored in YARN-3887.

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Attachment: YARN-5436.1.patch > Race in AsyncDispatcher can cause random test failures in Tez(probably

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Description: In YARN-2264, a race in DrainDispatcher was fixed. Unfortunately, it also exists in

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Description: In YARN-2264, a race in DrainDispatcher was fixed. Unfortunately, it also exists in

[jira] [Issue Comment Deleted] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Comment: was deleted (was: Data race can cause RM stop without handling last enqueued event.) > Race

[jira] [Commented] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396054#comment-15396054 ] Zhiyuan Yang commented on YARN-5436: Data race can cause RM stop without handling last enqueued event.

[jira] [Commented] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-27 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396052#comment-15396052 ] Zhiyuan Yang commented on YARN-5436: Data race can cause RM stop without handling last enqueued event.

[jira] [Updated] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-26 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-5436: --- Description: In YARN-2264, a race in DrainDispatcher was fixed. Unfortunately, it also exists in

[jira] [Created] (YARN-5436) Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also )

2016-07-26 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created YARN-5436: -- Summary: Race in AsyncDispatcher can cause random test failures in Tez(probably YARN also ) Key: YARN-5436 URL: https://issues.apache.org/jira/browse/YARN-5436 Project:

[jira] [Assigned] (YARN-5396) YARN large file broadcast service

2016-07-18 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned YARN-5396: -- Assignee: Zhiyuan Yang > YARN large file broadcast service > -

[jira] [Created] (YARN-5396) YARN large file broadcast service

2016-07-18 Thread Zhiyuan Yang (JIRA)
Zhiyuan Yang created YARN-5396: -- Summary: YARN large file broadcast service Key: YARN-5396 URL: https://issues.apache.org/jira/browse/YARN-5396 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-4956) findbug issue on LevelDBCacheTimelineStore

2016-04-26 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15259376#comment-15259376 ] Zhiyuan Yang commented on YARN-4956: Console output shows jenkins did findbugs check before building

[jira] [Updated] (YARN-4956) findbug issue on LevelDBCacheTimelineStore

2016-04-26 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-4956: --- Attachment: YARN-4956-trunk.000.patch Fixed by adding synchronized to serviceInit > findbug issue on

[jira] [Assigned] (YARN-4956) findbug issue on LevelDBCacheTimelineStore

2016-04-26 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned YARN-4956: -- Assignee: Zhiyuan Yang (was: Li Lu) > findbug issue on LevelDBCacheTimelineStore >

[jira] [Updated] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

2015-06-21 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-1427: --- Attachment: YARN-1427-trunk.4.patch re-submit original patch to get debug info yarn-env.cmd should

[jira] [Commented] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

2015-06-21 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14594987#comment-14594987 ] Zhiyuan Yang commented on YARN-1427: Attached patch.Thanks yarn-env.cmd should have

[jira] [Updated] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

2015-06-21 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang updated YARN-1427: --- Attachment: YARN-1427-trunk.3.patch yarn-env.cmd should have the analog comments that are in

[jira] [Assigned] (YARN-1427) yarn-env.cmd should have the analog comments that are in yarn-env.sh

2015-06-19 Thread Zhiyuan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhiyuan Yang reassigned YARN-1427: -- Assignee: Zhiyuan Yang yarn-env.cmd should have the analog comments that are in yarn-env.sh