[jira] [Commented] (YARN-4920) ATS/NM should support a link to dowload/get the logs in text format

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263620#comment-15263620 ] Hadoop QA commented on YARN-4920: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263573#comment-15263573 ] Hudson commented on YARN-5009: -- FAILURE: Integrated in Hadoop-trunk-Commit #9690 (See [https:

[jira] [Commented] (YARN-4920) ATS/NM should support a link to dowload/get the logs in text format

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263543#comment-15263543 ] Xuan Gong commented on YARN-4920: - Thanks for the review, [~djp] bq. It is possible for an

[jira] [Updated] (YARN-4920) ATS/NM should support a link to dowload/get the logs in text format

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4920: Attachment: YARN-4920.2.patch > ATS/NM should support a link to dowload/get the logs in text format > ---

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263524#comment-15263524 ] Hadoop QA commented on YARN-4577: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263522#comment-15263522 ] Hudson commented on YARN-5008: -- FAILURE: Integrated in Hadoop-trunk-Commit #9689 (See [https:

[jira] [Updated] (YARN-3959) Store job configurations in Timeline Service v2

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3959: --- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-2928) > Store job configurations in Tim

[jira] [Updated] (YARN-3959) Store job configurations in Timeline Service v2

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3959: --- Summary: Store job configurations in Timeline Service v2 (was: Store application related configuration

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263511#comment-15263511 ] Varun Saxena commented on YARN-3959: bq. One advantage of having it in the YARN applica

[jira] [Commented] (YARN-5013) Allow applications to provide input on amount of locality delay to use

2016-04-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263505#comment-15263505 ] Rohith Sharma K S commented on YARN-5013: - Assigned to myself, please feel free to

[jira] [Assigned] (YARN-5013) Allow applications to provide input on amount of locality delay to use

2016-04-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reassigned YARN-5013: --- Assignee: Rohith Sharma K S > Allow applications to provide input on amount of localit

[jira] [Commented] (YARN-5006) ResourceManager quit due to ApplicationStateData exceed the limit size of znode in zk

2016-04-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263499#comment-15263499 ] Rohith Sharma K S commented on YARN-5006: - Ah..! In the [YARN-2962-comment|https:/

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263500#comment-15263500 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-04-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: AppRunningAndNoTimelineServer.png > [YARN-3368] App attempt page is not loading when timeline server

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-04-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: AppFinishedAndNoTimelineServer.png > [YARN-3368] App attempt page is not loading when timeline server

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-04-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: YARN-5000-YARN-3368.1.patch Attaching a clean version of the patch by fixing below mentioned issues:

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263483#comment-15263483 ] Xuan Gong commented on YARN-4577: - Uploaded a new patch: https://issues.apache.org/jira/se

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263481#comment-15263481 ] Xuan Gong commented on YARN-4577: - Thanks for the view, [~sjlee0] bq. in serviceInit(), se

[jira] [Updated] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4577: Attachment: YARN-4577.20160428.patch > Enable aux services to have their own custom classpath/jar file >

[jira] [Commented] (YARN-4995) Fair Scheduler: Display demand resource for queues on the scheduler page

2016-04-28 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263380#comment-15263380 ] xupeng commented on YARN-4995: -- Hi [~kasha] could you please review this patch and issue ?

[jira] [Commented] (YARN-4995) Fair Scheduler: Display demand resource for queues on the scheduler page

2016-04-28 Thread xupeng (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263375#comment-15263375 ] xupeng commented on YARN-4995: -- Hi Junping Du: Thanks a lot for your reply. > Fair Schedule

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263361#comment-15263361 ] Sangjin Lee commented on YARN-3959: --- [~Naganarasimha], [~varun_saxena], your thoughts? >

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263359#comment-15263359 ] Sangjin Lee commented on YARN-4734: --- >From the YARN-2928 (timeline service v.2) perspecti

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263339#comment-15263339 ] Hadoop QA commented on YARN-4390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263337#comment-15263337 ] Li Lu commented on YARN-3959: - bq. If there is no generic way of doing this, I think we might w

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263335#comment-15263335 ] Sangjin Lee commented on YARN-4577: --- Would you be able to come up with a unit test still?

[jira] [Commented] (YARN-4905) Improve "yarn logs" command-line to optionally show log metadata also

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263332#comment-15263332 ] Xuan Gong commented on YARN-4905: - The testcase failures are not related. > Improve "yarn

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263309#comment-15263309 ] Hadoop QA commented on YARN-4577: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4920) ATS/NM should support a link to dowload/get the logs in text format

2016-04-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263284#comment-15263284 ] Junping Du commented on YARN-4920: -- Quick go through current patch, some comments below: A

[jira] [Commented] (YARN-4905) Improve "yarn logs" command-line to optionally show log metadata also

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263246#comment-15263246 ] Hadoop QA commented on YARN-4905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263233#comment-15263233 ] Hadoop QA commented on YARN-4734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263234#comment-15263234 ] Sangjin Lee commented on YARN-3959: --- [~varun_saxena], one interesting thing about the con

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263174#comment-15263174 ] Sangjin Lee commented on YARN-3959: --- {quote} Are we posting configurations for all YARN a

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263172#comment-15263172 ] Wangda Tan commented on YARN-4390: -- One question to add: is the 1GB container requested by

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263169#comment-15263169 ] Wangda Tan commented on YARN-4390: -- [~eepayne], What's your idea about this case? Should

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263164#comment-15263164 ] Eric Payne commented on YARN-4390: -- [~leftnoteasy], I am seeing kind of corner case in my

[jira] [Resolved] (YARN-3052) [Data Serving] Provide a very simple POC html ATS UI

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-3052. --- Resolution: Duplicate Looks like this is a dup of YARN-4097, please reopen if y

[jira] [Commented] (YARN-4097) Create POC timeline web UI with new YARN web UI framework

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263161#comment-15263161 ] Vinod Kumar Vavilapalli commented on YARN-4097: --- I left a comment [here|http

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263153#comment-15263153 ] Vinod Kumar Vavilapalli commented on YARN-4734: --- [~leftnoteasy] and other con

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263144#comment-15263144 ] Wangda Tan commented on YARN-4734: -- [~aw], Thanks for comment. Discussed with [~vinodkv]

[jira] [Commented] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263137#comment-15263137 ] Hadoop QA commented on YARN-5009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4851) Metric improvements for ATS v1.5 storage components

2016-04-28 Thread Hitesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263118#comment-15263118 ] Hitesh Shah commented on YARN-4851: --- New entries look fine. And agree that the others can

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

2016-04-28 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263109#comment-15263109 ] Nathan Roberts commented on YARN-4963: -- Sorry it took so long to get back to this. I f

[jira] [Commented] (YARN-5013) Allow applications to provide input on amount of locality delay to use

2016-04-28 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263106#comment-15263106 ] Nathan Roberts commented on YARN-5013: -- Re-posting latest comment from [~Naganarasimha

[jira] [Created] (YARN-5013) Allow applications to provide input on amount of locality delay to use

2016-04-28 Thread Nathan Roberts (JIRA)
Nathan Roberts created YARN-5013: Summary: Allow applications to provide input on amount of locality delay to use Key: YARN-5013 URL: https://issues.apache.org/jira/browse/YARN-5013 Project: Hadoop YA

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263082#comment-15263082 ] Li Lu commented on YARN-3959: - Hi [~varun_saxena], thanks for the prompt work! Some of my comme

[jira] [Updated] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Description: We use int32 for memory now, if a cluster has 10k nodes, each node has 210G memory, we will g

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263066#comment-15263066 ] Wangda Tan commented on YARN-4844: -- [~hitesh], [~vinodkv], I'm convinced. :) Updated titl

[jira] [Updated] (YARN-5012) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-5012: - Priority: Blocker (was: Major) > Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 >

[jira] [Created] (YARN-5012) Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64

2016-04-28 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-5012: Summary: Upgrade fields of o.a.h.y.api.records.Resource from int32 to int64 Key: YARN-5012 URL: https://issues.apache.org/jira/browse/YARN-5012 Project: Hadoop YARN

[jira] [Updated] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Description: We use int32 for memory now, if a cluster has 10k nodes, each node has 210G memory, we will g

[jira] [Updated] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Summary: Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource (was: Upgrade fields of o.a

[jira] [Commented] (YARN-4984) LogAggregationService shouldn't swallow exception in handling createAppDir() which cause thread leak.

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15263041#comment-15263041 ] Wangda Tan commented on YARN-4984: -- Looks good, +1, thanks [~djp]. > LogAggregationServic

[jira] [Updated] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5009: - Attachment: YARN-5009.002.patch Nice catch! Yes, it should be using a long to avoid overflow in case someo

[jira] [Commented] (YARN-2928) YARN Timeline Service: Next generation

2016-04-28 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262963#comment-15262963 ] Sangjin Lee commented on YARN-2928: --- For those who are following this ticket, we are near

[jira] [Updated] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4390: - Attachment: YARN-4390.8.patch Attached ver.8 patch fixed UT failure. > Do surgical preemption based on res

[jira] [Commented] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262959#comment-15262959 ] Jian He commented on YARN-5009: --- minor nit: here the intervalMsec is using int, YARN-5008 is

[jira] [Commented] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262957#comment-15262957 ] Jian He commented on YARN-5008: --- lgtm, thanks Jason, will commit later today > LeveldbRMSta

[jira] [Commented] (YARN-4905) Improve "yarn logs" command-line to optionally show log metadata also

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262941#comment-15262941 ] Xuan Gong commented on YARN-4905: - Thanks for the review. Attached a new patch to address a

[jira] [Updated] (YARN-4905) Improve "yarn logs" command-line to optionally show log metadata also

2016-04-28 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4905: Attachment: YARN-4905.6.1.patch > Improve "yarn logs" command-line to optionally show log metadata also > ---

[jira] [Commented] (YARN-4447) Provide a mechanism to represent complex filters and parse them at the REST layer

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262929#comment-15262929 ] Varun Saxena commented on YARN-4447: I also need to fix some javadocs in TimelineReader

[jira] [Commented] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262927#comment-15262927 ] Varun Saxena commented on YARN-5011: [~sjlee0], kindly review > Support metric filters

[jira] [Commented] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262925#comment-15262925 ] Varun Saxena commented on YARN-5011: This patch is on top of YARN-4447. This patch matc

[jira] [Updated] (YARN-4905) Improve "yarn logs" command-line to optionally show log metadata also

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4905: -- Summary: Improve "yarn logs" command-line to optionally show log metadata also (

[jira] [Updated] (YARN-4842) "yarn logs" command should not require the appOwner argument

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4842: -- Summary: "yarn logs" command should not require the appOwner argument (was: yarn

[jira] [Updated] (YARN-4905) Improve "yarn log" command-line to optionally show log metadata also

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4905: -- Summary: Improve "yarn log" command-line to optionally show log metadata also (w

[jira] [Commented] (YARN-4842) yarn logs command should not require the appOwner argument

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262919#comment-15262919 ] Vinod Kumar Vavilapalli commented on YARN-4842: --- Thanks for taking this over,

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5011: --- Attachment: YARN-5011-YARN-2928.01.patch > Support metric filters for flow runs > -

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5011: --- Attachment: YARN-5011-YARN-2928.01.patch > Support metric filters for flow runs > -

[jira] [Updated] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-5011: --- Attachment: (was: YARN-5011-YARN-2928.01.patch) > Support metric filters for flow runs > --

[jira] [Commented] (YARN-5010) maxActiveApplications and maxActiveApplicationsPerUser are missing from REST API

2016-04-28 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262914#comment-15262914 ] Thomas Graves commented on YARN-5010: - we shouldn't just remove them as its an API comp

[jira] [Commented] (YARN-5002) getApplicationReport call may raise NPE

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262896#comment-15262896 ] Hadoop QA commented on YARN-5002: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4905) Improve Yarn log Command line option to show log metadata

2016-04-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262881#comment-15262881 ] Vinod Kumar Vavilapalli commented on YARN-4905: --- This looks very close. Few

[jira] [Created] (YARN-5011) Support metric filters for flow runs

2016-04-28 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-5011: -- Summary: Support metric filters for flow runs Key: YARN-5011 URL: https://issues.apache.org/jira/browse/YARN-5011 Project: Hadoop YARN Issue Type: Sub-task A

[jira] [Commented] (YARN-4692) [Umbrella] Simplified and first-class support for services in YARN

2016-04-28 Thread Manoj Samel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262807#comment-15262807 ] Manoj Samel commented on YARN-4692: --- Hi [~kasha] and team, I would like to add another t

[jira] [Created] (YARN-5010) maxActiveApplications and maxActiveApplicationsPerUser are missing from REST API

2016-04-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5010: Summary: maxActiveApplications and maxActiveApplicationsPerUser are missing from REST API Key: YARN-5010 URL: https://issues.apache.org/jira/browse/YARN-5010 Project: Hadoop

[jira] [Commented] (YARN-4390) Do surgical preemption based on reserved container in CapacityScheduler

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262733#comment-15262733 ] Hadoop QA commented on YARN-4390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4920) ATS/NM should support a link to dowload/get the logs in text format

2016-04-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262722#comment-15262722 ] Junping Du commented on YARN-4920: -- Thanks [~xgong] for uploading the patch! Can you rena

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262685#comment-15262685 ] Allen Wittenauer commented on YARN-4734: bq. Patch looks fine for me. Umm, it's pr

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

2016-04-28 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262659#comment-15262659 ] Eric Payne commented on YARN-3362: -- [~naganarasimha...@apache.org], is there any update?

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-04-28 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262586#comment-15262586 ] Varun Vasudev commented on YARN-3998: - I'm going to commit the latest patch tomorrow if

[jira] [Commented] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262555#comment-15262555 ] Hadoop QA commented on YARN-4325: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4734) Merge branch:YARN-3368 to trunk

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262552#comment-15262552 ] Hadoop QA commented on YARN-4734: - (!) A patch to the testing environment has been detected

[jira] [Commented] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262548#comment-15262548 ] Hadoop QA commented on YARN-5008: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4595) Add support for configurable read-only mounts

2016-04-28 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262539#comment-15262539 ] Billie Rinaldi commented on YARN-4595: -- [~aw], I tested mounting symlinks into docker

[jira] [Commented] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262535#comment-15262535 ] Hadoop QA commented on YARN-5009: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262472#comment-15262472 ] Nathan Roberts commented on YARN-5008: -- Thanks for the patch. LGTM. +1 non-binding >

[jira] [Updated] (YARN-4325) Purge app state from NM state-store should cover more LOG_HANDLING cases

2016-04-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4325: - Attachment: YARN-4325-v1.patch Add related unit test in v1 patch. > Purge app state from NM state-store sh

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15262400#comment-15262400 ] Varun Saxena commented on YARN-3959: Updated a patch. I am publishing all entities toge

[jira] [Updated] (YARN-3959) Store application related configurations in Timeline Service v2

2016-04-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3959: --- Attachment: YARN-3959-YARN-2928.01.patch > Store application related configurations in Timeline Service

[jira] [Updated] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5009: - Attachment: YARN-5009.001.patch Patch to add periodic manual compactions every hour by default. Compaction

[jira] [Updated] (YARN-5000) [YARN-3368] App attempt page is not loading when timeline server is not started

2016-04-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5000: -- Attachment: 0001-YARN-5000.patch Attaching an initial patch. While testing, I found some more issues in app attem

[jira] [Created] (YARN-5009) NMLeveldbStateStoreService database can grow substantially leading to longer recovery times

2016-04-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5009: Summary: NMLeveldbStateStoreService database can grow substantially leading to longer recovery times Key: YARN-5009 URL: https://issues.apache.org/jira/browse/YARN-5009 Proje

[jira] [Updated] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-5008: - Attachment: YARN-5008.001.patch I noticed that in the cases where the database was quite large a manual co

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-04-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5007: --- Priority: Minor (was: Major) > MiniYarnCluster contains deprecated constructor which is called by the

[jira] [Created] (YARN-5008) LeveldbRMStateStore database can grow substantially leading to long recovery times

2016-04-28 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-5008: Summary: LeveldbRMStateStore database can grow substantially leading to long recovery times Key: YARN-5008 URL: https://issues.apache.org/jira/browse/YARN-5008 Project: Hadoo

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-04-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5007: --- Hadoop Flags: (was: Reviewed) > MiniYarnCluster contains deprecated constructor which is called by th

[jira] [Updated] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-04-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-5007: --- Description: MiniYarnCluster has a deprecated constructor which is called by the other constructors and

[jira] [Assigned] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-04-28 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor reassigned YARN-5007: -- Assignee: Andras Bokor > MiniYarnCluster contains deprecated constructor which is called by the

[jira] [Created] (YARN-5007) MiniYarnCluster contains deprecated constructor which is called by the other constructors

2016-04-28 Thread Andras Bokor (JIRA)
Andras Bokor created YARN-5007: -- Summary: MiniYarnCluster contains deprecated constructor which is called by the other constructors Key: YARN-5007 URL: https://issues.apache.org/jira/browse/YARN-5007 Pro

  1   2   >