[jira] [Commented] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929367#comment-15929367 ] Hadoop QA commented on YARN-6217: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929341#comment-15929341 ] Arun Suresh commented on YARN-6345: --- [~vinodkv], I agree these looks similar to AllocationTags as

[jira] [Assigned] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-6217: Assignee: Miklos Szegedi > TestLocalCacheDirectoryManager test timeout is too aggressive >

[jira] [Updated] (YARN-6217) TestLocalCacheDirectoryManager test timeout is too aggressive

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6217: - Attachment: YARN-6217.000.patch Attaching suggested patch. > TestLocalCacheDirectoryManager test

[jira] [Commented] (YARN-6319) race condition between deleting app dir and deleting container dir

2017-03-16 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929330#comment-15929330 ] Hong Zhiguo commented on YARN-6319: --- [~haibochen], the post-callback will not linearize container

[jira] [Commented] (YARN-6229) resource manager web UI display BUG

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929318#comment-15929318 ] Miklos Szegedi commented on YARN-6229: -- [~gehaijiang], are you using fair scheduler or capacity

[jira] [Commented] (YARN-6242) [Umbrella] Miscellaneous Scheduler Performance Improvements

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929309#comment-15929309 ] Miklos Szegedi commented on YARN-6242: -- [~leftnoteasy], YARN-6361is a FS performance issue but not

[jira] [Updated] (YARN-6361) FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Summary: FairScheduler: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues (was:

[jira] [Commented] (YARN-6304) Skip rm.transitionToActive call to RM if RM is already active.

2017-03-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929308#comment-15929308 ] Karthik Kambatla commented on YARN-6304: This seems benign to me. +1. > Skip

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Attachment: dispatcherthread.png > FSLeafQueue.fetchAppsWithDemand CPU usage is high with big

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

2017-03-16 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929307#comment-15929307 ] Karthik Kambatla commented on YARN-5179: [~miklos.szeg...@cloudera.com] was looking into a similar

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Attachment: threads.png > FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues >

[jira] [Updated] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6361: - Description: FSLeafQueue.fetchAppsWithDemand sorts the applications by the current policy. Most of

[jira] [Created] (YARN-6361) FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues

2017-03-16 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-6361: Summary: FSLeafQueue.fetchAppsWithDemand CPU usage is high with big queues Key: YARN-6361 URL: https://issues.apache.org/jira/browse/YARN-6361 Project: Hadoop YARN

[jira] [Commented] (YARN-6244) Introduce AtomicResource in ResourceUsage to avoid read-write lock.

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929299#comment-15929299 ] Miklos Szegedi commented on YARN-6244: -- [~leftnoteasy], I have a question regarding AtomicResource. Is

[jira] [Created] (YARN-6360) Prevent FS state dump logger from inheriting parents' appenders.

2017-03-16 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6360: -- Summary: Prevent FS state dump logger from inheriting parents' appenders. Key: YARN-6360 URL: https://issues.apache.org/jira/browse/YARN-6360 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-6279) Scheduler rest api JSON is not providing all child queues names

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929266#comment-15929266 ] Miklos Szegedi edited comment on YARN-6279 at 3/17/17 1:03 AM: ---

[jira] [Commented] (YARN-6279) Scheduler rest api JSON is not providing all child queues names

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929266#comment-15929266 ] Miklos Szegedi commented on YARN-6279: -- [~ashishdoneriya], based on the JSON and the version did you

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929255#comment-15929255 ] Miklos Szegedi commented on YARN-6345: -- [~subru], [~kkaranasos], yes it does. Thank you for the

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929254#comment-15929254 ] Joep Rottinghuis commented on YARN-6357: bq. I can file a separate bug from this one dealing with

[jira] [Updated] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-6357: --- Description: As discovered and discussed in YARN-5269 the TimelineCollector#putEntitiesAsync

[jira] [Commented] (YARN-6359) TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929221#comment-15929221 ] Hadoop QA commented on YARN-6359: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6339) Improve performance for createAndGetApplicationReport

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929205#comment-15929205 ] Hadoop QA commented on YARN-6339: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6359) TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition

2017-03-16 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-6359: Attachment: YARN-6359.001.patch Despite running it over 1000 times, I wasn't able to reproduce this

[jira] [Created] (YARN-6359) TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition

2017-03-16 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-6359: --- Summary: TestRM#testApplicationKillAtAcceptedState fails rarely due to race condition Key: YARN-6359 URL: https://issues.apache.org/jira/browse/YARN-6359 Project:

[jira] [Created] (YARN-6358) Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost

2017-03-16 Thread Jose Miguel Arreola (JIRA)
Jose Miguel Arreola created YARN-6358: - Summary: Cache the resolved hosts prevent calls to InetAddress.getByName and normalizeHost Key: YARN-6358 URL: https://issues.apache.org/jira/browse/YARN-6358

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929048#comment-15929048 ] Varun Saxena commented on YARN-6357: bq. We have two separate methods on our API putEntities and

[jira] [Commented] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929037#comment-15929037 ] Varun Saxena commented on YARN-6357: Correct. This is what I was suspecting in the previous call. In

[jira] [Updated] (YARN-6339) Improve performance for createAndGetApplicationReport

2017-03-16 Thread yunjiong zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yunjiong zhao updated YARN-6339: Attachment: YARN-6339.002.patch Update patch for more improvement. Change

[jira] [Commented] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929026#comment-15929026 ] Varun Saxena commented on YARN-6352: [~Naganarasimha], did you try with latest trunk code? This issue

[jira] [Commented] (YARN-6319) race condition between deleting app dir and deleting container dir

2017-03-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15929009#comment-15929009 ] Haibo Chen commented on YARN-6319: -- Thanks [~zhiguohong] for more explanation on option 2. While I agree

[jira] [Created] (YARN-6357) Implement TimelineCollector#putEntitiesAsync

2017-03-16 Thread Joep Rottinghuis (JIRA)
Joep Rottinghuis created YARN-6357: -- Summary: Implement TimelineCollector#putEntitiesAsync Key: YARN-6357 URL: https://issues.apache.org/jira/browse/YARN-6357 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6342) Issues in async API of TimelineClient

2017-03-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-6342: --- Labels: yarn-5355-merge-blocker (was: ) > Issues in async API of TimelineClient >

[jira] [Commented] (YARN-6342) Issues in async API of TimelineClient

2017-03-16 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928977#comment-15928977 ] Joep Rottinghuis commented on YARN-6342: A possible other approach is to code / configure one

[jira] [Commented] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928954#comment-15928954 ] Hadoop QA commented on YARN-6326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6356) Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs

2017-03-16 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-6356: --- Summary: Allow different values of yarn.log-aggregation.retain-seconds for succeeded and failed jobs Key: YARN-6356 URL: https://issues.apache.org/jira/browse/YARN-6356

[jira] [Commented] (YARN-6355) Interceptor framework for the YARN ApplicationMasterService

2017-03-16 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928925#comment-15928925 ] Arun Suresh commented on YARN-6355: --- [~vinodkv] / [~subru] / [~leftnoteasy] Thoughts ? > Interceptor

[jira] [Created] (YARN-6355) Interceptor framework for the YARN ApplicationMasterService

2017-03-16 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-6355: - Summary: Interceptor framework for the YARN ApplicationMasterService Key: YARN-6355 URL: https://issues.apache.org/jira/browse/YARN-6355 Project: Hadoop YARN

[jira] [Commented] (YARN-6111) [SLS] The realtimetrack.json is empty

2017-03-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928897#comment-15928897 ] Yufei Gu commented on YARN-6111: Mostly like you don't run SLS successfully. There are several things to

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928896#comment-15928896 ] Subru Krishnan commented on YARN-6345: -- [~miklos.szeg...@cloudera.com], we are currently thinking of

[jira] [Assigned] (YARN-6346) Expose API in ApplicationSubmissionContext to specify placement constraints

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos reassigned YARN-6346: Assignee: Konstantinos Karanasos > Expose API in

[jira] [Updated] (YARN-6354) LeveldbRMStateStore can parse invalid keys when recovering reservations

2017-03-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6354: - Priority: Major (was: Critical) Summary: LeveldbRMStateStore can parse invalid keys when recovering

[jira] [Commented] (YARN-5468) Scheduling of long-running applications

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928880#comment-15928880 ] Konstantinos Karanasos commented on YARN-5468: -- Hi [~grey], we have a design doc but we are in

[jira] [Resolved] (YARN-4590) SLS(Scheduler Load Simulator) web pages can't load css and js resource

2017-03-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu resolved YARN-4590. Resolution: Duplicate > SLS(Scheduler Load Simulator) web pages can't load css and js resource >

[jira] [Commented] (YARN-6354) RM fails to upgrade to 2.8 with leveldb state store

2017-03-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928843#comment-15928843 ] Jason Lowe commented on YARN-6354: -- Sample stacktrace: {noformat} 2017-03-16 15:17:26,616 INFO [main]

[jira] [Commented] (YARN-6353) Clean up OrderingPolicy javadoc

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928833#comment-15928833 ] Hadoop QA commented on YARN-6353: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-16 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928811#comment-15928811 ] Haibo Chen commented on YARN-6146: -- Thanks for your comments [~varun_saxena]! bq. why not use the builder

[jira] [Created] (YARN-6354) RM fails to upgrade to 2.8 with leveldb state store

2017-03-16 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6354: Summary: RM fails to upgrade to 2.8 with leveldb state store Key: YARN-6354 URL: https://issues.apache.org/jira/browse/YARN-6354 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928825#comment-15928825 ] Konstantinos Karanasos commented on YARN-6345: -- [~miklos.szeg...@cloudera.com], my worry is

[jira] [Updated] (YARN-6326) Shouldn't use AppAttemptIds to fetch applications while AM Simulator tracks app in SLS

2017-03-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6326: --- Attachment: YARN-6326.004.patch Fixed one style issue. Added methods to delete metric output files once unit

[jira] [Commented] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928695#comment-15928695 ] Varun Saxena commented on YARN-6352: Apps#toAppId looks like a generic enough method which may not be

[jira] [Comment Edited] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928695#comment-15928695 ] Varun Saxena edited comment on YARN-6352 at 3/16/17 7:31 PM: - Apps#toAppId

[jira] [Updated] (YARN-6353) Clean up OrderingPolicy javadoc

2017-03-16 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6353: --- Attachment: YARN-6353.001.patch Fixed the javadocs and cleaned up some other minor stuff. >

[jira] [Created] (YARN-6353) Clean up OrderingPolicy javadoc

2017-03-16 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6353: -- Summary: Clean up OrderingPolicy javadoc Key: YARN-6353 URL: https://issues.apache.org/jira/browse/YARN-6353 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928671#comment-15928671 ] Hadoop QA commented on YARN-6352: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6273) TestAMRMClient#testAllocationWithBlacklist fails intermittently

2017-03-16 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928638#comment-15928638 ] Ray Chiang commented on YARN-6273: -- Test > TestAMRMClient#testAllocationWithBlacklist fails

[jira] [Updated] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6352: Attachment: YARN-6352.001.patch > Header injections are possible in the application proxy

[jira] [Commented] (YARN-3767) Yarn Scheduler Load Simulator does not work

2017-03-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928579#comment-15928579 ] Yufei Gu commented on YARN-3767: SLS is broken in some ways. We are trying to fix it in Umbrella JIRA

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928563#comment-15928563 ] Kuhu Shukla commented on YARN-6315: --- mvn install is marking a lot of hdfs files as duplicate. I have

[jira] [Resolved] (YARN-3767) Yarn Scheduler Load Simulator does not work

2017-03-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino resolved YARN-3767. Resolution: Won't Fix >From my read of the conversation, I think this is not an actual issue. I will

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928522#comment-15928522 ] Miklos Szegedi commented on YARN-6345: -- bq. How would it simplify the CLC though? There is no need to

[jira] [Created] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-6352: --- Summary: Header injections are possible in the application proxy servlet Key: YARN-6352 URL: https://issues.apache.org/jira/browse/YARN-6352 Project: Hadoop

[jira] [Updated] (YARN-6352) Header injections are possible in the application proxy servlet

2017-03-16 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6352: Attachment: headerInjection.png > Header injections are possible in the application proxy

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928479#comment-15928479 ] Hadoop QA commented on YARN-6315: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-6351) Have RM match relaxedLocality request via time instead of missedOpportunities

2017-03-16 Thread Roni Burd (JIRA)
Roni Burd created YARN-6351: --- Summary: Have RM match relaxedLocality request via time instead of missedOpportunities Key: YARN-6351 URL: https://issues.apache.org/jira/browse/YARN-6351 Project: Hadoop

[jira] [Created] (YARN-6350) Add JMX counters to track locality matching (node, rack, off_switch)

2017-03-16 Thread Roni Burd (JIRA)
Roni Burd created YARN-6350: --- Summary: Add JMX counters to track locality matching (node, rack, off_switch) Key: YARN-6350 URL: https://issues.apache.org/jira/browse/YARN-6350 Project: Hadoop YARN

[jira] [Updated] (YARN-6334) TestRMFailover#testAutomaticFailover always passes even when it should fail

2017-03-16 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6334: --- Summary: TestRMFailover#testAutomaticFailover always passes even when it should fail (was:

[jira] [Commented] (YARN-6146) Add Builder methods for TimelineEntityFilters

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928452#comment-15928452 ] Varun Saxena commented on YARN-6146: Thanks [~haibochen] for the patch. Looks straightforward. Couple

[jira] [Updated] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-6315: -- Attachment: YARN-6315.004.patch Thank you [~jlowe] for the feedback. I have made the changes

[jira] [Commented] (YARN-6335) Port slider's groovy unit tests to yarn native services

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928408#comment-15928408 ] Hadoop QA commented on YARN-6335: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6315) Improve LocalResourcesTrackerImpl#isResourcePresent to return false for corrupted files

2017-03-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928292#comment-15928292 ] Jason Lowe commented on YARN-6315: -- Thanks for updating the patch! Catching Exception is too wide of a

[jira] [Commented] (YARN-5468) Scheduling of long-running applications

2017-03-16 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928256#comment-15928256 ] Lei Guo commented on YARN-5468: --- [~kkaranasos], do we have a design document? I'd like to get more details

[jira] [Commented] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928249#comment-15928249 ] Hadoop QA commented on YARN-6309: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928239#comment-15928239 ] Hudson commented on YARN-4051: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11414 (See

[jira] [Commented] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928224#comment-15928224 ] sandflee commented on YARN-4051: Thanks [~jlowe] for your review and commit! > ContainerKillEvent lost

[jira] [Updated] (YARN-6309) Fair scheduler docs should have the queue and queuePlacementPolicy elements listed in bold so that they're easier to see

2017-03-16 Thread esmaeil mirzaee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] esmaeil mirzaee updated YARN-6309: -- Attachment: YARN-6309.patch I am sorry to be late. I have changed my branch to trunk, and I

[jira] [Created] (YARN-6349) Container kill request from AM can be lost if container is still recovering

2017-03-16 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-6349: Summary: Container kill request from AM can be lost if container is still recovering Key: YARN-6349 URL: https://issues.apache.org/jira/browse/YARN-6349 Project: Hadoop YARN

[jira] [Commented] (YARN-6349) Container kill request from AM can be lost if container is still recovering

2017-03-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928185#comment-15928185 ] Jason Lowe commented on YARN-6349: -- See YARN-4051 for related discussion. > Container kill request from

[jira] [Commented] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928139#comment-15928139 ] Jason Lowe commented on YARN-4051: -- +1 for the branch-2 patch as well. The unit test failure appears to

[jira] [Commented] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927948#comment-15927948 ] Hadoop QA commented on YARN-6141: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-16 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sonia Garudi updated YARN-6141: --- Attachment: YARN-6141.patch > ppc64le on Linux doesn't trigger __linux get_executable codepath >

[jira] [Updated] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-16 Thread Sonia Garudi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sonia Garudi updated YARN-6141: --- Attachment: (was: YARN-6141.diff) > ppc64le on Linux doesn't trigger __linux get_executable

[jira] [Commented] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927733#comment-15927733 ] sandflee commented on YARN-4051: update a patch for branch-2 > ContainerKillEvent lost when container is

[jira] [Commented] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927726#comment-15927726 ] Hadoop QA commented on YARN-4051: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927711#comment-15927711 ] Hadoop QA commented on YARN-2962: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2017-03-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927694#comment-15927694 ] Hadoop QA commented on YARN-2962: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4051) ContainerKillEvent lost when container is still recovering and application finishes

2017-03-16 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4051: --- Attachment: YARN-4051.08.patch-branch-2 > ContainerKillEvent lost when container is still recovering and

[jira] [Updated] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2962: --- Attachment: (was: YARN-2962.009.patch) > ZKRMStateStore: Limit the number of znodes under a znode

[jira] [Updated] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2017-03-16 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2962: --- Attachment: YARN-2962.009.patch > ZKRMStateStore: Limit the number of znodes under a znode >

[jira] [Comment Edited] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-16 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan edited comment on YARN-6141 at 3/16/17 7:02 AM: The predefined macros

[jira] [Comment Edited] (YARN-6141) ppc64le on Linux doesn't trigger __linux get_executable codepath

2017-03-16 Thread Ayappan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15924166#comment-15924166 ] Ayappan edited comment on YARN-6141 at 3/16/17 7:00 AM: The predefined macros

[jira] [Commented] (YARN-6346) Expose API in ApplicationSubmissionContext to specify placement constraints

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927586#comment-15927586 ] Konstantinos Karanasos commented on YARN-6346: -- Hi [~Naganarasimha]. If you don't mind, since

[jira] [Commented] (YARN-6347) Store container tags in ResourceManager

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927584#comment-15927584 ] Konstantinos Karanasos commented on YARN-6347: -- Oh I see. I meant storing them in memory. I

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927579#comment-15927579 ] Konstantinos Karanasos commented on YARN-6345: -- bq. Is there any value in using a key-value

[jira] [Updated] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-16 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huangkaixuan updated YARN-6289: --- Attachment: YARN-RackAwareness.docx > Fail to achieve data locality when runing MapReduce and Spark on

[jira] [Commented] (YARN-6289) Fail to achieve data locality when runing MapReduce and Spark on HDFS

2017-03-16 Thread Huangkaixuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927544#comment-15927544 ] Huangkaixuan commented on YARN-6289: Hi [~leftnoteasy] To verify whether rack awareness has any