[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13759722#comment-13759722 ] Junping Du commented on YARN-311: - [~tucu00], would you help to review it again? Thx!

[jira] [Created] (YARN-1163) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

2013-09-06 Thread Junping Du (JIRA)
Junping Du created YARN-1163: Summary: Cleanup code for AssignMapsWithLocality() in RMContainerAllocator Key: YARN-1163 URL: https://issues.apache.org/jira/browse/YARN-1163 Project: Hadoop YARN

[jira] [Updated] (YARN-1163) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1163: - Issue Type: Sub-task (was: Improvement) Parent: YARN-18 Cleanup code for

[jira] [Updated] (YARN-1163) Cleanup code for AssignMapsWithLocality() in RMContainerAllocator

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1163: - Attachment: YARN-1163-v1.patch Attach the first patch. Cleanup code for

[jira] [Assigned] (YARN-921) Consider adding clone methods to protocol objects

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-921: --- Assignee: Junping Du Consider adding clone methods to protocol objects

[jira] [Commented] (YARN-921) Consider adding clone methods to protocol objects

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762661#comment-13762661 ] Junping Du commented on YARN-921: - Hi Bikas, Thanks for your good suggestions here. I would

[jira] [Updated] (YARN-291) [Umbrella] Dynamic resource configuration

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-291: Summary: [Umbrella] Dynamic resource configuration (was: Dynamic resource configuration) [Umbrella]

[jira] [Updated] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1042: - Attachment: YARN-1042-demo.patch add ability to specify affinity/anti-affinity in container requests

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762779#comment-13762779 ] Junping Du commented on YARN-1042: -- Attach a patch to showcase above proposal. This is

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762928#comment-13762928 ] Junping Du commented on YARN-1042: -- BTW, it seems the effort is more on application side.

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763080#comment-13763080 ] Junping Du commented on YARN-1042: -- Hi [~ste...@apache.org], as you are the creator of

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-10 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13763848#comment-13763848 ] Junping Du commented on YARN-1042: -- Thanks for comments. Luke! bq. Although you can do a

[jira] [Commented] (YARN-1042) add ability to specify affinity/anti-affinity in container requests

2013-09-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764142#comment-13764142 ] Junping Du commented on YARN-1042: -- Are you mean YARN-624? I didn't follow up this JIRA

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766141#comment-13766141 ] Junping Du commented on YARN-311: - Thanks Luke for review and comments!

[jira] [Commented] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13767095#comment-13767095 ] Junping Du commented on YARN-311: - Sure. Thanks for review. Arun! Dynamic

[jira] [Assigned] (YARN-149) ResourceManager (RM) High-Availability (HA)

2013-09-15 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-149: --- Assignee: Bikas Saha ResourceManager (RM) High-Availability (HA)

[jira] [Commented] (YARN-1200) Provide a central view for rack topologies

2013-09-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768826#comment-13768826 ] Junping Du commented on YARN-1200: -- Hi Vinod, thanks for pointing to YARN-435. I like the

[jira] [Updated] (YARN-311) Dynamic node resource configuration: core scheduler changes

2013-09-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-311: Attachment: YARN-311-v7.patch Sync up patch with Trunk in v7 patch. Dynamic node resource

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063381#comment-14063381 ] Junping Du commented on YARN-1341: -- Thanks [~jlowe] for reply above and document work on

[jira] [Updated] (YARN-2045) Data persisted in NM should be versioned

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2045: - Attachment: YARN-2045-v5.patch Thanks [~jlowe] for comments! Sorry. I forget to update visibility after

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064427#comment-14064427 ] Junping Du commented on YARN-1341: -- Agree. The test failure shouldn't be related to the

[jira] [Commented] (YARN-2242) Improve exception information on AM launch crashes

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064445#comment-14064445 ] Junping Du commented on YARN-2242: -- +1. Latest patch LGTM. Improve exception information

[jira] [Commented] (YARN-668) TokenIdentifier serialization should consider Unknown fields

2014-07-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064530#comment-14064530 ] Junping Du commented on YARN-668: - Hi [~vinodkv], I think here we are talking about to

[jira] [Created] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-17 Thread Junping Du (JIRA)
Junping Du created YARN-2316: Summary: TestNMWebServices* get failed on trunk Key: YARN-2316 URL: https://issues.apache.org/jira/browse/YARN-2316 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065705#comment-14065705 ] Junping Du commented on YARN-2316: -- I suspect some new added tests recently on

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065716#comment-14065716 ] Junping Du commented on YARN-1341: -- +1. Patch looks good. Will commit it shortly.

[jira] [Commented] (YARN-1341) Recover NMTokens upon nodemanager restart

2014-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065715#comment-14065715 ] Junping Du commented on YARN-1341: -- I can confirm test failure is not related to the patch

[jira] [Updated] (YARN-2045) Data persisted in NM should be versioned

2014-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2045: - Attachment: YARN-2045-v6.patch Address [~jlowe]'s comments in v6 patch. Data persisted in NM should be

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14065868#comment-14065868 ] Junping Du commented on YARN-1342: -- Yes. The patch is not get sync for sometime. [~jlowe],

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-19 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14067790#comment-14067790 ] Junping Du commented on YARN-2013: -- Thank you for updating the patch, [~ozawa]! Patch

[jira] [Commented] (YARN-2013) The diagnostics is always the ExitCodeException stack when the container crashes

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14068363#comment-14068363 ] Junping Du commented on YARN-2013: -- Agree that the test failure is not related as it

[jira] [Commented] (YARN-2316) TestNMWebServices* get failed on trunk

2014-07-21 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14069593#comment-14069593 ] Junping Du commented on YARN-2316: -- +1 on resolving it as duplicated. It looks like these

[jira] [Commented] (YARN-1342) Recover container tokens upon nodemanager restart

2014-07-22 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14071272#comment-14071272 ] Junping Du commented on YARN-1342: -- Thanks [~jlowe] for updating the patch. I'd like to

[jira] [Created] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-23 Thread Junping Du (JIRA)
Junping Du created YARN-2347: Summary: Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common Key: YARN-2347 URL: https://issues.apache.org/jira/browse/YARN-2347

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347.patch Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v2.patch The findbug issue is not related to this patch. However, fix it in v2

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v3.patch Sync patch with latest trunk. Consolidate RMStateVersion and

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14073115#comment-14073115 ] Junping Du commented on YARN-1354: -- Just like [~devaraj.k]'s above comments, [~jlowe],

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

2014-07-24 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14074010#comment-14074010 ] Junping Du commented on YARN-1336: -- Good work, [~jlowe]! Thanks for sharing.

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075518#comment-14075518 ] Junping Du commented on YARN-2347: -- Thanks for review and comments, [~zjshen]! Nice catch

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14075538#comment-14075538 ] Junping Du commented on YARN-2347: -- bq. On the other side, timeline server is a stateless

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-26 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v4.patch Update patch in v4 as [~zjshen]'s comments. Consolidate RMStateVersion

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-27 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v5.patch Looks like some changes happen on trunk today. Sync patch to latest trunk

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076048#comment-14076048 ] Junping Du commented on YARN-2209: -- Thanks [~jianhe] for the patch and [~rohithsharma] for

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

2014-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14076296#comment-14076296 ] Junping Du commented on YARN-1354: -- Thanks [~jlowe] for updating the patch! A few quick

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077192#comment-14077192 ] Junping Du commented on YARN-2209: -- bq. I think users are expected to handle two types of

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077198#comment-14077198 ] Junping Du commented on YARN-2347: -- [~zjshen], can you help to review it again? Thx!

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077235#comment-14077235 ] Junping Du commented on YARN-2209: -- bq. Previously, AM doesn't do re-register. Re-register

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14077580#comment-14077580 ] Junping Du commented on YARN-2209: -- Thanks [~zjshen] for more details! I have similar

[jira] [Commented] (YARN-2209) Replace AM resync/shutdown command with corresponding exceptions

2014-07-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14078727#comment-14078727 ] Junping Du commented on YARN-2209: -- bq. I think the essential problem here is whether

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

2014-07-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080415#comment-14080415 ] Junping Du commented on YARN-1354: -- Thanks [~jlowe] for additional explanation which

[jira] [Commented] (YARN-2370) Made comment more accurate in AppSchedulingInfo.java

2014-07-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080417#comment-14080417 ] Junping Du commented on YARN-2370: -- Nice catch, [~gujilangzi]! +1. Will commit it shortly.

[jira] [Updated] (YARN-2370) Made comment more accurate in AppSchedulingInfo.java

2014-07-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2370: - Labels: newbie (was: ) Made comment more accurate in AppSchedulingInfo.java

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080602#comment-14080602 ] Junping Du commented on YARN-2347: -- Thanks for review and comments, [~zjshen]! That's good

[jira] [Assigned] (YARN-1572) Low chance to hit NPE issue in AppSchedulingInfo#allocateNodeLocal

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reassigned YARN-1572: Assignee: Wenwu Peng (was: Junping Du) [~gujilangzi], are you working on this? If so, assign this

[jira] [Commented] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080613#comment-14080613 ] Junping Du commented on YARN-2347: -- Sounds good. Will upload a new patch soon. Thx!

[jira] [Updated] (YARN-2347) Consolidate RMStateVersion and NMDBSchemaVersion into StateVersion in yarn-server-common

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2347: - Attachment: YARN-2347-v6.patch Address latest comments from [~zjshen] in v6 patch. Consolidate

[jira] [Commented] (YARN-2051) Fix code bug and add more unit tests for PBImpls

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080716#comment-14080716 ] Junping Du commented on YARN-2051: -- Hi [~decster], thanks for working on this. I will

[jira] [Commented] (YARN-2051) Fix code bug and add more unit tests for PBImpls

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080719#comment-14080719 ] Junping Du commented on YARN-2051: -- Forget to mention, +1 on the idea for testing these PB

[jira] [Commented] (YARN-2051) Fix code bug and add more unit tests for PBImpls

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080727#comment-14080727 ] Junping Du commented on YARN-2051: -- Not sure if patch is still updated, manually kick off

[jira] [Commented] (YARN-2372) There are Chinese Characters in the FairScheduler's document

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080735#comment-14080735 ] Junping Du commented on YARN-2372: -- Nice catch, [~azuryy]! Actually, these are special

[jira] [Commented] (YARN-2051) Fix code bug and add more unit tests for PBImpls

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080780#comment-14080780 ] Junping Du commented on YARN-2051: -- Again, good work, [~decster]! Some comments below,

[jira] [Commented] (YARN-2371) Wrong NMToken is issued when NM preserving restarts with containers running

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080925#comment-14080925 ] Junping Du commented on YARN-2371: -- Nice finding, [~zhiguohong]! The fix here looks

[jira] [Commented] (YARN-2371) Wrong NMToken is issued when NM preserving restarts with containers running

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080931#comment-14080931 ] Junping Du commented on YARN-2371: -- Look at the code on trunk again. It looks like the

[jira] [Commented] (YARN-2051) Fix code bug and add more unit tests for PBImpls

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14080934#comment-14080934 ] Junping Du commented on YARN-2051: -- +1. Patch looks good to me. Will commit it tomorrow if

[jira] [Updated] (YARN-2288) Data persistent in timelinestore should be versioned

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2288: - Attachment: YARN-2288.patch Upload the patch to version timelinestore. Data persistent in timelinestore

[jira] [Updated] (YARN-2051) Fix bug in PBimpls and add more unit tests with reflection

2014-07-31 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2051: - Summary: Fix bug in PBimpls and add more unit tests with reflection (was: Fix code in PBimpls and add

[jira] [Updated] (YARN-2370) Fix comment in AppSchedulingInfo.java

2014-08-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2370: - Summary: Fix comment in AppSchedulingInfo.java (was: Made comment more accurate in

[jira] [Updated] (YARN-2370) Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo

2014-08-03 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2370: - Summary: Fix comment in o.a.h.y.server.resourcemanager.schedulerAppSchedulingInfo (was: Fix comment in

[jira] [Commented] (YARN-1354) Recover applications upon nodemanager restart

2014-08-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084554#comment-14084554 ] Junping Du commented on YARN-1354: -- bq. It's possible if they explicitly handle it

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-08-04 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14084670#comment-14084670 ] Junping Du commented on YARN-2033: -- Thanks [~zjshen] for uploading a proposal and keep

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086129#comment-14086129 ] Junping Du commented on YARN-1336: -- [~jlowe], YARN-1354 just get in to the trunk. Do we

[jira] [Commented] (YARN-2374) YARN trunk build failing TestDistributedShell.testDSShell

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086270#comment-14086270 ] Junping Du commented on YARN-2374: -- I found the same issue in

[jira] [Commented] (YARN-2033) Investigate merging generic-history into the Timeline Store

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087066#comment-14087066 ] Junping Du commented on YARN-2033: -- bq. I prefer not to do it right now, because moving

[jira] [Commented] (YARN-2298) Move TimelineClient to yarn-common

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087087#comment-14087087 ] Junping Du commented on YARN-2298: -- Agree that cyclic dependencies between projects are

[jira] [Commented] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087118#comment-14087118 ] Junping Du commented on YARN-2288: -- Thanks [~zjshen] for review and comments! bq. Should

[jira] [Updated] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2288: - Attachment: YARN-2288-v2.patch Update patch in v2 with addressing [~zjshen]'s comments. Data persistent

[jira] [Updated] (YARN-2298) Move TimelineClient to yarn-common project

2014-08-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2298: - Summary: Move TimelineClient to yarn-common project (was: Move TimelineClient to yarn-common) Move

[jira] [Commented] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087357#comment-14087357 ] Junping Du commented on YARN-2288: -- The test failure seems to be related to configuration

[jira] [Commented] (YARN-1336) Work-preserving nodemanager restart

2014-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14087360#comment-14087360 ] Junping Du commented on YARN-1336: -- Got it. Will help to review YARN-1337. Thanks

[jira] [Updated] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2288: - Attachment: YARN-2288-v3.patch Data persistent in timelinestore should be versioned

[jira] [Commented] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088655#comment-14088655 ] Junping Du commented on YARN-2288: -- Thanks for review, [~zjshen]! Please see my reply

[jira] [Commented] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-06 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088657#comment-14088657 ] Junping Du commented on YARN-2288: -- Address [~zjshen]'s comments in v3 patch. Data

[jira] [Updated] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2288: - Attachment: YARN-2288-v5.patch Forget to change to lower case in test for checking messages, update in v5

[jira] [Commented] (YARN-2288) Data persistent in timelinestore should be versioned

2014-08-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088903#comment-14088903 ] Junping Du commented on YARN-2288: -- Jenkins still use v4 patch, kick off test manually

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090254#comment-14090254 ] Junping Du commented on YARN-1337: -- Thanks [~jlowe] for contributing a patch! I have some

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14090707#comment-14090707 ] Junping Du commented on YARN-2302: -- Thanks for the patch, [~zjshen]! A couple of comments

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-08-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091522#comment-14091522 ] Junping Du commented on YARN-2302: -- Thanks for updating the patch, [~zjshen]! The patch

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-08-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091958#comment-14091958 ] Junping Du commented on YARN-2302: -- Sounds good. I don't have additional comments except

[jira] [Commented] (YARN-2302) Refactor TimelineWebServices

2014-08-09 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092008#comment-14092008 ] Junping Du commented on YARN-2302: -- Latest patch LGTM. +1 pending on Jenkins. Refactor

[jira] [Updated] (YARN-2403) TestNodeManagerResync fails occasionally in trunk

2014-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2403: - Attachment: YARN-2403.patch TestNodeManagerResync fails occasionally in trunk

[jira] [Commented] (YARN-2403) TestNodeManagerResync fails occasionally in trunk

2014-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092615#comment-14092615 ] Junping Du commented on YARN-2403: -- The variable of registrationCount should be protected

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092916#comment-14092916 ] Junping Du commented on YARN-1337: -- Thanks [~jlowe] for updating the patch. Some trivial

[jira] [Commented] (YARN-2331) Distinguish shutdown during supervision vs. shutdown for rolling upgrade

2014-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093655#comment-14093655 ] Junping Du commented on YARN-2331: -- [~jlowe], for rollup when NM is not supervised, I

[jira] [Commented] (YARN-1337) Recover containers upon nodemanager restart

2014-08-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14093684#comment-14093684 ] Junping Du commented on YARN-1337: -- Latest patch looks good to me. +1 pending on Jenkins'

[jira] [Updated] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

2014-08-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1506: - Attachment: YARN-1506-v11.patch Replace set resource change on RMNode/SchedulerNode directly with event

[jira] [Commented] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

2014-08-13 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096407#comment-14096407 ] Junping Du commented on YARN-1506: -- Thanks [~bikassaha] and [~jianhe] for review and

[jira] [Updated] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

2014-08-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1506: - Attachment: YARN-1506-v12.patch In v12 patch, - fix unit test failure for node reconnecting with resource

[jira] [Updated] (YARN-1506) Replace set resource change on RMNode/SchedulerNode directly with event notification.

2014-08-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-1506: - Attachment: YARN-1506-v13.patch Fix the test failure and rebase to latest trunk. Replace set resource

[jira] [Resolved] (YARN-667) Data persisted in RM should be versioned

2014-08-17 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du resolved YARN-667. - Resolution: Duplicate Data persisted in RM should be versioned

<    1   2   3   4   5   6   7   8   9   10   >