[jira] [Commented] (YARN-573) Shared data structures in Public Localizer and Private Localizer are not Thread safe.

2013-07-31 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13725571#comment-13725571 ] Sangjin Lee commented on YARN-573: -- +1 on wrapping the list with

[jira] [Commented] (YARN-573) Shared data structures in Public Localizer and Private Localizer are not Thread safe.

2013-08-01 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726619#comment-13726619 ] Sangjin Lee commented on YARN-573: -- The new patch looks good to me. Thanks!

[jira] [Created] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-07 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1044: - Summary: used/min/max resources do not display info in the scheduler page Key: YARN-1044 URL: https://issues.apache.org/jira/browse/YARN-1044 Project: Hadoop YARN

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: screenshot.png If you look at the source html, the values are there. They are like

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Description: Go to the scheduler page in RM, and click any queue to display the detailed info. You'll

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13733019#comment-13733019 ] Sangjin Lee commented on YARN-1044: --- I think all the places where the resource info is

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-08-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737497#comment-13737497 ] Sangjin Lee commented on YARN-451: -- I think some information about the app size can be

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-08-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13737518#comment-13737518 ] Sangjin Lee commented on YARN-451: -- For sorting, it would be good to expose a number. How

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-08-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739213#comment-13739213 ] Sangjin Lee commented on YARN-451: -- I think showing this information on the app list page

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-08-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739801#comment-13739801 ] Sangjin Lee commented on YARN-451: -- I agree that hadoop 1 was different as the notion of

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13739802#comment-13739802 ] Sangjin Lee commented on YARN-1044: --- Sounds good. I'll submit a patch soon.

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044.patch Proposed patch for escaping invalid characters for html.

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13740437#comment-13740437 ] Sangjin Lee commented on YARN-1044: --- By the way, the xml issue with the capacity

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: (was: yarn-1044.patch) used/min/max resources do not display info in the scheduler

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044.patch used/min/max resources do not display info in the scheduler page

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: (was: yarn-1044.patch) used/min/max resources do not display info in the scheduler

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044.patch used/min/max resources do not display info in the scheduler page

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: (was: yarn-1044.patch) used/min/max resources do not display info in the scheduler

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044.patch used/min/max resources do not display info in the scheduler page

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741286#comment-13741286 ] Sangjin Lee commented on YARN-1044: --- I didn't add a new test because it is a small UI

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741309#comment-13741309 ] Sangjin Lee commented on YARN-1044: --- Hmm, do you want to just remove the element from the

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741327#comment-13741327 ] Sangjin Lee commented on YARN-1044: --- Oh I see. The memory and vcores are there instead? I

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044.patch Updated the patch to remove the unnecessary usedResources field.

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741460#comment-13741460 ] Sangjin Lee commented on YARN-1044: --- Oh OK... I've been following the suggestions in this

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13741474#comment-13741474 ] Sangjin Lee commented on YARN-1044: --- It looks like some tests are broken. Let me look at

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044-20130815.3.patch used/min/max resources do not display info in the scheduler

[jira] [Commented] (YARN-1020) Resource Localization using Groups as a new Localization Type

2013-08-19 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13743946#comment-13743946 ] Sangjin Lee commented on YARN-1020: --- This is an interesting problem/challenge. I kind of

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-09-05 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13759424#comment-13759424 ] Sangjin Lee commented on YARN-1044: --- Ping? Could someone look at the proposed patch?

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-09-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13766759#comment-13766759 ] Sangjin Lee commented on YARN-451: -- I am pretty close to getting a patch ready for review

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13768989#comment-13768989 ] Sangjin Lee commented on YARN-451: -- I am going to upload a single patch to get your

[jira] [Updated] (YARN-451) Add more metrics to RM page

2013-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-451: - Attachment: yarn-451-trunk-20130916.1.patch Add more metrics to RM page ---

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-451-trunk-20130916.1.patch used/min/max resources do not display info in the

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: (was: yarn-451-trunk-20130916.1.patch) used/min/max resources do not display info

[jira] [Updated] (YARN-451) Add more metrics to RM page

2013-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-451: - Attachment: in_progress_2x.png A screenshot from this patch. Total memory and Total cores have been added.

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-09-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13775603#comment-13775603 ] Sangjin Lee commented on YARN-451: -- That is another approach. However, I think being able

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098728#comment-14098728 ] Sangjin Lee commented on YARN-2238: --- Any update on this? A lot of our users are stumbling

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-08-15 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099368#comment-14099368 ] Sangjin Lee commented on YARN-2238: --- There is another sequence of events that reproduces

[jira] [Commented] (YARN-2440) Cgroups should allow YARN containers to be limited to allocated cores

2014-08-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14109856#comment-14109856 ] Sangjin Lee commented on YARN-2440: --- It might be good to use several fairly

[jira] [Updated] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1530: -- Attachment: ATS-meet-up-8-28-2014-notes.pdf Some members of the Hadoop open source community that are

[jira] [Commented] (YARN-1530) [Umbrella] Store, manage and serve per-framework application-timeline data

2014-09-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14125908#comment-14125908 ] Sangjin Lee commented on YARN-1530: --- {quote} The bottleneck is still there. Essentially I

[jira] [Commented] (YARN-2363) Submitted applications occasionally lack a tracking URL

2014-09-16 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14135777#comment-14135777 ] Sangjin Lee commented on YARN-2363: --- LGTM. We also see this quite a bit, and it would be

[jira] [Commented] (YARN-2180) In-memory backing store for cache manager

2014-09-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14142228#comment-14142228 ] Sangjin Lee commented on YARN-2180: --- bq. Synchronization is missing from the

[jira] [Created] (YARN-2600) if the container is killed during localization outstanding public cache localization tasks should be cancelled

2014-09-24 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-2600: - Summary: if the container is killed during localization outstanding public cache localization tasks should be cancelled Key: YARN-2600 URL:

[jira] [Commented] (YARN-2180) In-memory backing store for cache manager

2014-10-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167039#comment-14167039 ] Sangjin Lee commented on YARN-2180: --- Thanks [~kasha]! In-memory backing store for cache

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167105#comment-14167105 ] Sangjin Lee commented on YARN-2183: --- The release audit warning is unrelated. It is about

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-10 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167496#comment-14167496 ] Sangjin Lee commented on YARN-2183: --- Thanks much for great feedback Karthik! I'm going

[jira] [Commented] (YARN-2314) ContainerManagementProtocolProxy can create thousands of threads for a large cluster

2014-10-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14170045#comment-14170045 ] Sangjin Lee commented on YARN-2314: --- We have been running with the proposed patch

[jira] [Updated] (YARN-2183) Cleaner service for cache manager

2014-10-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2183: -- Attachment: YARN-2183-trunk-v5.patch Patch v.5 posted. To help see the overall diffs, you can use this

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14172007#comment-14172007 ] Sangjin Lee commented on YARN-2183: --- Thanks Karthik for the review. We have addressed

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181502#comment-14181502 ] Sangjin Lee commented on YARN-2183: --- Thanks for the review [~kasha]! {quote} I

[jira] [Commented] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14181723#comment-14181723 ] Sangjin Lee commented on YARN-2183: --- You mean, moving the method to SCMStore but mark it

[jira] [Updated] (YARN-2183) Cleaner service for cache manager

2014-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2183: -- Attachment: YARN-2183-trunk-v6.patch v.6 patch posted. To see the patch in context, go to

[jira] [Created] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-02-28 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1771: - Summary: many getFileStatus calls made from node manager for localizing a public distributed cache resource Key: YARN-1771 URL: https://issues.apache.org/jira/browse/YARN-1771

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-02-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13916658#comment-13916658 ] Sangjin Lee commented on YARN-1771: --- Thanks [~sandyr], I'll consider doing a similar fix.

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918247#comment-13918247 ] Sangjin Lee commented on YARN-1771: --- Would it be a little weaker condition than the

[jira] [Resolved] (YARN-1466) implement the cleaner service for the shared cache

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1466?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee resolved YARN-1466. --- Resolution: Invalid I'll close out these JIRAs for YARN-1492, as the design has changed from the

[jira] [Resolved] (YARN-1467) implement checksum verification for resource localization service for the shared cache

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee resolved YARN-1467. --- Resolution: Invalid I'll close out these JIRAs for YARN-1492, as the design has changed from the

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923176#comment-13923176 ] Sangjin Lee commented on YARN-1771: --- I have been looking into this from the perspective

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1771: -- Attachment: yarn-1771.patch many getFileStatus calls made from node manager for localizing a public

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13923226#comment-13923226 ] Sangjin Lee commented on YARN-1771: --- I have created a status cache at the

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1771: -- Attachment: yarn-1771.patch Fixed javadoc. many getFileStatus calls made from node manager for

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1771: -- Attachment: yarn-1771.patch A new patch is uploaded. I found that a test in

[jira] [Commented] (YARN-1800) YARN NodeManager with java.util.concurrent.RejectedExecutionException

2014-03-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924117#comment-13924117 ] Sangjin Lee commented on YARN-1800: --- I meant replacing the RejectedExecutionException

[jira] [Commented] (YARN-1800) YARN NodeManager with java.util.concurrent.RejectedExecutionException

2014-03-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13924225#comment-13924225 ] Sangjin Lee commented on YARN-1800: --- Acknowledged. Catching a throwable and eating it is

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13930487#comment-13930487 ] Sangjin Lee commented on YARN-1771: --- Thoughts on the patch? Thanks! many getFileStatus

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932441#comment-13932441 ] Sangjin Lee commented on YARN-1771: --- Good point about making isPublic() package-private.

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-12 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1771: -- Attachment: yarn-1771.patch I have submitted a new patch. I'm now using FutureFileStatus as the value

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-13 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13934426#comment-13934426 ] Sangjin Lee commented on YARN-1771: --- Thanks Chris! It would be great if you could commit

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935315#comment-13935315 ] Sangjin Lee commented on YARN-1771: --- Thanks! many getFileStatus calls made from node

[jira] [Commented] (YARN-1914) Test TestFSDownload.testDownloadPublicWithStatCache fails on Windows

2014-04-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963681#comment-13963681 ] Sangjin Lee commented on YARN-1914: --- LGTM. Sorry for missing the windows build. Test

[jira] [Commented] (YARN-1945) Adding description for each pool in Fair Scheduler Page from fair-scheduler.xml

2014-05-02 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13988000#comment-13988000 ] Sangjin Lee commented on YARN-1945: --- You got more java compiler warnings than the trunk

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007281#comment-14007281 ] Sangjin Lee commented on YARN-2092: --- +1 on exploring the OSGi option. Until/unless it

[jira] [Commented] (YARN-2092) Incompatible org.codehaus.jackson* dependencies when moving from 2.4.0 to 2.5.0-SNAPSHOT

2014-05-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007284#comment-14007284 ] Sangjin Lee commented on YARN-2092: --- ... user code or any code that needs to run in

[jira] [Created] (YARN-2210) resource manager fails to start if core-site.xml contains an xi:include

2014-06-25 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-2210: - Summary: resource manager fails to start if core-site.xml contains an xi:include Key: YARN-2210 URL: https://issues.apache.org/jira/browse/YARN-2210 Project: Hadoop YARN

[jira] [Commented] (YARN-2210) resource manager fails to start if core-site.xml contains an xi:include

2014-06-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043099#comment-14043099 ] Sangjin Lee commented on YARN-2210: --- This is because core-site.xml is added in the

[jira] [Commented] (YARN-1741) XInclude support broken for YARN ResourceManager

2014-06-25 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14043620#comment-14043620 ] Sangjin Lee commented on YARN-1741: --- +1 with the idea for the ConfigurationProvider to

[jira] [Updated] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-06-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-2238: -- Attachment: filtered.png Screenshot of such a filtered page. Note that it clearly says it's showing 2

[jira] [Created] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-06-30 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-2238: - Summary: filtering on UI sticks even if I move away from the page Key: YARN-2238 URL: https://issues.apache.org/jira/browse/YARN-2238 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-06-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048365#comment-14048365 ] Sangjin Lee commented on YARN-2238: --- Could this be related to YARN-237? filtering on UI

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-06-30 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14048379#comment-14048379 ] Sangjin Lee commented on YARN-2238: --- A minor clarification: if the filtering was done via

[jira] [Created] (YARN-2245) AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used

2014-07-01 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-2245: - Summary: AM throws ClassNotFoundException with job classloader enabled if custom output format/committer is used Key: YARN-2245 URL: https://issues.apache.org/jira/browse/YARN-2245

[jira] [Commented] (YARN-2131) Add a way to nuke the RMStateStore

2014-07-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051584#comment-14051584 ] Sangjin Lee commented on YARN-2131: --- Looks good to me. Just curious, does this need to be

[jira] [Commented] (YARN-2131) Add a way to nuke the RMStateStore

2014-07-03 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14051866#comment-14051866 ] Sangjin Lee commented on YARN-2131: --- LGTM. I'd let committers chime in though. Add a

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-07-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053850#comment-14053850 ] Sangjin Lee commented on YARN-2238: --- Ping? I'd like to find out more about this. Is this

[jira] [Commented] (YARN-2270) TestFSDownload#testDownloadPublicWithStatCache fails in trunk

2014-07-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14058831#comment-14058831 ] Sangjin Lee commented on YARN-2270: --- YARN-1914 might be instructive.

[jira] [Commented] (YARN-2238) filtering on UI sticks even if I move away from the page

2014-07-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14061250#comment-14061250 ] Sangjin Lee commented on YARN-2238: --- Any comments on this? I understand the rationale

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13788269#comment-13788269 ] Sangjin Lee commented on YARN-1044: --- Sure Arun. I'll update the patch. used/min/max

[jira] [Updated] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-1044: -- Attachment: yarn-1044-20131007.patch used/min/max resources do not display info in the scheduler page

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-10-09 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13790895#comment-13790895 ] Sangjin Lee commented on YARN-451: -- I agree. Even for mappers and reducers container

[jira] [Commented] (YARN-1044) used/min/max resources do not display info in the scheduler page

2013-10-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792819#comment-13792819 ] Sangjin Lee commented on YARN-1044: --- Ping? used/min/max resources do not display info

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-10-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13792818#comment-13792818 ] Sangjin Lee commented on YARN-451: -- [~jlowe] Although I like the idea of showing both types

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-10-22 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13802398#comment-13802398 ] Sangjin Lee commented on YARN-451: -- {quote} Quick question on the estimate – is it a

[jira] [Commented] (YARN-451) Add more metrics to RM page

2013-10-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13803113#comment-13803113 ] Sangjin Lee commented on YARN-451: -- Forgot to answer this: {quote} I took a look at the

[jira] [Commented] (YARN-1388) fair share do not display info in the scheduler page

2013-11-04 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13813118#comment-13813118 ] Sangjin Lee commented on YARN-1388: --- Looks good to me. Thanks for the patch! fair share

[jira] [Created] (YARN-1465) define and add shared constants and utilities for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1465: - Summary: define and add shared constants and utilities for the shared cache Key: YARN-1465 URL: https://issues.apache.org/jira/browse/YARN-1465 Project: Hadoop YARN

[jira] [Created] (YARN-1466) implement the cleaner service for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1466: - Summary: implement the cleaner service for the shared cache Key: YARN-1466 URL: https://issues.apache.org/jira/browse/YARN-1466 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-1467) implement checksum verification for resource localization service for the shared cache

2013-12-02 Thread Sangjin Lee (JIRA)
Sangjin Lee created YARN-1467: - Summary: implement checksum verification for resource localization service for the shared cache Key: YARN-1467 URL: https://issues.apache.org/jira/browse/YARN-1467

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2013-12-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13845575#comment-13845575 ] Sangjin Lee commented on YARN-1492: --- [~vinodkv] I'm fine with that. The main reason that

[jira] [Commented] (YARN-1492) truly shared cache for jars (jobjar/libjar)

2014-01-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13864557#comment-13864557 ] Sangjin Lee commented on YARN-1492: --- Thanks for the comments [~kkambatl]! bq. In the

[jira] [Commented] (YARN-1692) ConcurrentModificationException in fair scheduler AppSchedulable

2014-02-06 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13894112#comment-13894112 ] Sangjin Lee commented on YARN-1692: --- It seems that all access to the map that is returned

  1   2   3   4   5   6   7   8   9   10   >