[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510492#comment-14510492 ] Inigo Goiri commented on YARN-3481: --- It requires the implementation of ResourceUtilizatio

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510490#comment-14510490 ] Inigo Goiri commented on YARN-3481: --- YARN-3534 will be the patch providing ResourceUtiliz

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510473#comment-14510473 ] Zhijie Shen commented on YARN-3431: --- bq. Can we make YARN-3276 to go first which I just t

[jira] [Commented] (YARN-3511) Add errors and warnings page to ATS

2015-04-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510446#comment-14510446 ] Xuan Gong commented on YARN-3511: - Thanks for working on this, [~vvasudev] Just one nit: {c

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510416#comment-14510416 ] zhihai xu commented on YARN-3516: - [~xgong], thanks for the review and commit. > killing C

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510386#comment-14510386 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510375#comment-14510375 ] Hadoop QA commented on YARN-3458: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-4.patch Removing white spaces from the end of the line. > CPU resource monitoring

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-3.patch Updating trunk before it goes ahead. > Report node resource utilization >

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-3.patch Removing spaces at the end of the line; Jenkins doesn't seem to like them

[jira] [Commented] (YARN-3536) ZK exception occur when updating AppAttempt status, then NPE thrown when RM do recover

2015-04-23 Thread gu-chi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510320#comment-14510320 ] gu-chi commented on YARN-3536: -- Thx, as the exception trace stack is almost, I once looked int

[jira] [Commented] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510216#comment-14510216 ] Hadoop QA commented on YARN-3541: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (YARN-3458) CPU resource monitoring in Windows

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-3458: - Assignee: Inigo Goiri > CPU resource monitoring in Windows > -- >

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510207#comment-14510207 ] Hadoop QA commented on YARN-2498: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510205#comment-14510205 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510181#comment-14510181 ] Wangda Tan commented on YARN-2498: -- Failed test is not related to the patch, white space c

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510177#comment-14510177 ] Hadoop QA commented on YARN-2498: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3472: -- Target Version/s: 2.7.1 (was: 2.8.0) This seems like an important fix. I merged

[jira] [Updated] (YARN-3472) Possible leak in DelegationTokenRenewer#allTokens

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3472: -- Target Version/s: 2.8.0 (was: 2.7.1) Fix Version/s: (was: 2.8.0)

[jira] [Updated] (YARN-3351) AppMaster tracking URL is broken in HA

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3351: -- Fix Version/s: (was: 2.8.0) 2.7.1 This seems like an impor

[jira] [Updated] (YARN-3382) Some of UserMetricsInfo metrics are incorrectly set to root queue metrics

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3382: -- Fix Version/s: (was: 2.8.0) 2.7.1 This seems like an impor

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-23 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510163#comment-14510163 ] Gera Shegalov commented on YARN-2893: - Hi [~zxu], for me personally it's easier to revi

[jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3438: - Issue Type: Bug (was: Sub-task) Parent: (was: YARN-3378) > add a mode to replay MR job history

[jira] [Commented] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510150#comment-14510150 ] Junping Du commented on YARN-3438: -- Thanks [~sjlee0] for uploading a patch! Given 90% work

[jira] [Updated] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3541: -- Attachment: YARN-3541.1.patch Upload a patch: 1. Include version info in /ws/v1/timeline of timeline API

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510143#comment-14510143 ] Junping Du commented on YARN-3431: -- Thanks [~zjshen] for updating the patch! Sorry that my

[jira] [Created] (YARN-3541) Add version info on timeline service / generic history web UI and RES API

2015-04-23 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3541: - Summary: Add version info on timeline service / generic history web UI and RES API Key: YARN-3541 URL: https://issues.apache.org/jira/browse/YARN-3541 Project: Hadoop YARN

[jira] [Commented] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510142#comment-14510142 ] Hadoop QA commented on YARN-3438: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3438) add a mode to replay MR job history files to the timeline service

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3438: -- Attachment: YARN-3438.000.patch A preliminary patch based on MAPREDUCE-6355.005.patch to solicit reviews.

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-2.patch Merged to trunk. > Report node resource utilization >

[jira] [Commented] (YARN-3534) Report node resource utilization

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510105#comment-14510105 ] Hadoop QA commented on YARN-3534: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3534) Report node resource utilization

2015-04-23 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-1.patch No unit tests yet. > Report node resource utilization > --

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510099#comment-14510099 ] Vinod Kumar Vavilapalli commented on YARN-3492: --- [~kasha], can you try this o

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510092#comment-14510092 ] Hudson commented on YARN-3516: -- FAILURE: Integrated in Hadoop-trunk-Commit #7656 (See [https:

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510080#comment-14510080 ] Xuan Gong commented on YARN-3516: - Committed into trunk/branch-2. Thanks, zhihai ! > killi

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-23 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510058#comment-14510058 ] Xuan Gong commented on YARN-3516: - +1 LGTM. Will commit > killing ContainerLocalizer actio

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.4.patch Attached ver.4, updated test to make sure ignore_partition_exclusivity conta

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510053#comment-14510053 ] Sangjin Lee commented on YARN-3390: --- [~zjshen], you might want to check out [~djp]'s comm

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.3.patch > Respect labels in preemption policy of capacity scheduler for inter-queue

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510043#comment-14510043 ] Wangda Tan commented on YARN-2498: -- Thanks for comments, [~jianhe]. Addressed all comments

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14510044#comment-14510044 ] Li Lu commented on YARN-3390: - Hi [~zjshen], the latest patch looks good to me. Just one note i

[jira] [Updated] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sangjin Lee updated YARN-3437: -- Issue Type: New Feature (was: Sub-task) Parent: (was: YARN-3378) > convert load test driver

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509967#comment-14509967 ] Jian He commented on YARN-2498: --- - remove below {code} NavigableSet ns = (NavigableSet)

[jira] [Updated] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3390: -- Attachment: YARN-3390.2.patch > Reuse TimelineCollectorManager for RM > -

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509962#comment-14509962 ] Zhijie Shen commented on YARN-3390: --- Thanks for the comments. I've addressed Sangjin and

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509961#comment-14509961 ] Li Lu commented on YARN-3411: - Oh, and one thing to add, in the added pom file, maybe we can ce

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509951#comment-14509951 ] Li Lu commented on YARN-3411: - Hi [~vrushalic], thanks for the patch! I'm OK with the major par

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509934#comment-14509934 ] Zhijie Shen commented on YARN-3437: --- Oh, previously I said TimelineServicePerformanceTest

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509932#comment-14509932 ] Zhijie Shen commented on YARN-3437: --- bq. How's that sound? It's also good to me. bq. W

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509905#comment-14509905 ] Sangjin Lee commented on YARN-3437: --- Well it's not entirely true. It seems I still need t

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509890#comment-14509890 ] Hadoop QA commented on YARN-3517: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509864#comment-14509864 ] Junping Du commented on YARN-3509: -- [~zjshen], thanks for updating the patch. Shall we wai

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509862#comment-14509862 ] Sangjin Lee commented on YARN-3437: --- Thanks for your comments [~zjshen]. {quote} 1. The

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509841#comment-14509841 ] Jason Lowe commented on YARN-3476: -- I'm OK with deleting the logs upon error uploading. I

[jira] [Commented] (YARN-3536) ZK exception occur when updating AppAttempt status, then NPE thrown when RM do recover

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509802#comment-14509802 ] zhihai xu commented on YARN-3536: - Is This issue similar as YARN-2834? > ZK exception occ

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-23 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509774#comment-14509774 ] Li Lu commented on YARN-3431: - Hi [~zjshen], thanks for the update! The latest patch LGTM. >

[jira] [Commented] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509738#comment-14509738 ] Hadoop QA commented on YARN-3363: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2893) AMLaucher: sporadic job failures due to EOFException in readTokenStorageStream

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509722#comment-14509722 ] zhihai xu commented on YARN-2893: - Hi [~jianhe], Do you think any of my earlier suggestions

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509717#comment-14509717 ] Zhijie Shen commented on YARN-3437: --- Sorry for the late comments. This patch has half MR

[jira] [Created] (YARN-3540) Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler

2015-04-23 Thread Eric Payne (JIRA)
Eric Payne created YARN-3540: Summary: Fetcher#copyMapOutput is leaking usedMemory upon IOException during InMemoryMapOutput shuffle handler Key: YARN-3540 URL: https://issues.apache.org/jira/browse/YARN-3540

[jira] [Updated] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3517: Attachment: YARN-3517.005.patch Uploaded a new patch to fix the whitespace and checkstyle errors. The

[jira] [Commented] (YARN-3529) Add miniHBase cluster and Phoenix support to ATS v2 unit tests

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509689#comment-14509689 ] Zhijie Shen commented on YARN-3529: --- Previously, we met the compatibility issue of having

[jira] [Resolved] (YARN-2032) Implement a scalable, available TimelineStore using HBase

2015-04-23 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen resolved YARN-2032. --- Resolution: Won't Fix It will be covered in YARN-2928 > Implement a scalable, available TimelineStore

[jira] [Commented] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509674#comment-14509674 ] zhihai xu commented on YARN-3363: - Hi [~adhoot], thanks for the thorough review, Your sugge

[jira] [Updated] (YARN-3363) add localization and container launch time to ContainerMetrics at NM to show these timing information for each active container.

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3363: Attachment: YARN-3363.001.patch > add localization and container launch time to ContainerMetrics at NM to sho

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509648#comment-14509648 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509641#comment-14509641 ] Craig Welch commented on YARN-3319: --- Yes, it's configured in the capacity scheduler confi

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509630#comment-14509630 ] Vinod Kumar Vavilapalli commented on YARN-3319: --- Is FairOrderingPolicy.ENABLE

[jira] [Commented] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509591#comment-14509591 ] Hadoop QA commented on YARN-3517: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509559#comment-14509559 ] Wangda Tan commented on YARN-3413: -- Thanks Vinod for review & commit! > Node label attrib

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509556#comment-14509556 ] Hudson commented on YARN-3413: -- FAILURE: Integrated in Hadoop-trunk-Commit #7650 (See [https:

[jira] [Commented] (YARN-3522) DistributedShell uses the wrong user to put timeline data

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509508#comment-14509508 ] Hudson commented on YARN-3522: -- FAILURE: Integrated in Hadoop-trunk-Commit #7649 (See [https:

[jira] [Commented] (YARN-3413) Node label attributes (like exclusivity) should settable via addToClusterNodeLabels but shouldn't be changeable at runtime

2015-04-23 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509497#comment-14509497 ] Vinod Kumar Vavilapalli commented on YARN-3413: --- I tried running test-patch.s

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509470#comment-14509470 ] Hudson commented on YARN-3319: -- FAILURE: Integrated in Hadoop-trunk-Commit #7648 (See [https:

[jira] [Commented] (YARN-3522) DistributedShell uses the wrong user to put timeline data

2015-04-23 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509464#comment-14509464 ] Jian He commented on YARN-3522: --- lgtm, thanks zhijie ! > DistributedShell uses the wrong us

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509455#comment-14509455 ] Wangda Tan commented on YARN-2740: -- Seems like env issue, re-kicked Jenkins. > ResourceMa

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509452#comment-14509452 ] Hadoop QA commented on YARN-3537: - (!) The patch artifact directory on has been removed! T

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509451#comment-14509451 ] Hadoop QA commented on YARN-2740: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509449#comment-14509449 ] Wangda Tan commented on YARN-2740: -- Thanks [~Naganarasimha], will commit once Jenkins get

[jira] [Updated] (YARN-3154) Should not upload partial logs for MR jobs or other "short-running' applications

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3154: - Release Note: Applications which made use of the LogAggregationContext in their application will ne

[jira] [Commented] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509409#comment-14509409 ] Hadoop QA commented on YARN-3477: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3517: Attachment: YARN-3517.004.patch {quote} We don't need the isSecurityEnabled check, just keep the one

[jira] [Updated] (YARN-3517) RM web ui for dumping scheduler logs should be for admins only

2015-04-23 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3517: Affects Version/s: (was: 2.7.0) > RM web ui for dumping scheduler logs should be for admins only

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509366#comment-14509366 ] Brahma Reddy Battula commented on YARN-3537: Thanks again for your input..Updat

[jira] [Updated] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula updated YARN-3537: --- Attachment: YARN-3537-003.patch > NPE when NodeManager.serviceInit fails and stopRecove

[jira] [Resolved] (YARN-3190) NM can't aggregate logs: token can't be found in cache

2015-04-23 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu resolved YARN-3190. - Resolution: Duplicate issue is fixed by YARN-2964 > NM can't aggregate logs: token can't be found in cac

[jira] [Commented] (YARN-3505) Node's Log Aggregation Report with SUCCEED should not cached in RMApps

2015-04-23 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3505?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509330#comment-14509330 ] Junping Du commented on YARN-3505: -- Thanks for uploading a patch to fix this problem, [~xg

[jira] [Updated] (YARN-3477) TimelineClientImpl swallows exceptions

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3477: - Attachment: YARN-3477-001.patch Patch -001 # rethrows last received exception on a retry count fai

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150423-1.patch Hi [~wangda], Patch failed to apply on top of yest che

[jira] [Commented] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509313#comment-14509313 ] Hadoop QA commented on YARN-3539: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509303#comment-14509303 ] Jason Lowe commented on YARN-3537: -- If the store is not null then we want to close it rega

[jira] [Updated] (YARN-3539) Compatibility doc to state that ATS v1 is a stable REST API

2015-04-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-3539: - Attachment: YARN-3539-003.patch Patch -003 updates {{timelineserver.md}} # specify the REST API (n

[jira] [Commented] (YARN-3537) NPE when NodeManager.serviceInit fails and stopRecoveryStore invoked

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509288#comment-14509288 ] Hadoop QA commented on YARN-3537: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-23 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509276#comment-14509276 ] Jason Lowe commented on YARN-3535: -- The first item is to avoid containers failing due to a

[jira] [Commented] (YARN-3480) Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable

2015-04-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509263#comment-14509263 ] Hadoop QA commented on YARN-3480: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (YARN-3480) Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable

2015-04-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Summary: Make AM max attempts stored in RMAppImpl and RMStateStore to be configurable (was: Make AM max attemp

[jira] [Updated] (YARN-3480) Make AM max attempts stored in RMStateStore to be configurable

2015-04-23 Thread Jun Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-3480: --- Attachment: YARN-3480.01.patch Attach an initial patch. I will add test cases later. > Make AM max attempts st

[jira] [Commented] (YARN-3535) ResourceRequest should be restored back to scheduler when RMContainer is killed at ALLOCATED

2015-04-23 Thread Peng Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509256#comment-14509256 ] Peng Zhang commented on YARN-3535: -- As per [~jlowe]'s thoughts, I understand here are two

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

2015-04-23 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509237#comment-14509237 ] Sangjin Lee commented on YARN-3437: --- Thanks Junping. I initially went with ConcurrentHash

[jira] [Commented] (YARN-3528) Tests with 12345 as hard-coded port break jenkins

2015-04-23 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14509230#comment-14509230 ] Brahma Reddy Battula commented on YARN-3528: Planning to give "0" for all HTTP

  1   2   >