[jira] [Commented] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088332#comment-15088332 ] Arun Suresh commented on YARN-4496: --- Hey [~jianhe], Feel free to take it up.. I can help with the

[jira] [Created] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Jian He (JIRA)
Jian He created YARN-4559: - Summary: Make leader elector and zk store share the same curator client Key: YARN-4559 URL: https://issues.apache.org/jira/browse/YARN-4559 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4560) Make scheduler error checking message more user friendly

2016-01-07 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4560: - Summary: Make scheduler error checking message more user friendly (was: Make ) > Make scheduler error

[jira] [Updated] (YARN-4560) Make scheduler error checking message more user friendly

2016-01-07 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4560: - Attachment: YARN-4560.001.patch Initial version. > Make scheduler error checking message more user

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2016-01-07 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088391#comment-15088391 ] Vrushali C commented on YARN-4200: -- + 1, thanks [~gtCarrera9] > Refactor reader classes in storage to

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2016-01-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088392#comment-15088392 ] Junping Du commented on YARN-4180: -- Thanks [~kasha] for help on this. > AMLauncher does not retry on

[jira] [Updated] (YARN-4553) Add cgroups support for docker containers

2016-01-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-4553: Attachment: YARN-4553.003.patch Uploaded a new patch based on review comments. > Add

[jira] [Created] (YARN-4560) Make

2016-01-07 Thread Ray Chiang (JIRA)
Ray Chiang created YARN-4560: Summary: Make Key: YARN-4560 URL: https://issues.apache.org/jira/browse/YARN-4560 Project: Hadoop YARN Issue Type: Bug Components: yarn Affects

[jira] [Updated] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4559: -- Description: After YARN-4438, we reuse the same curator client for leader elector and zk store > Make leader

[jira] [Updated] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4559: -- Description: After YARN-4438, we can reuse the same curator client for leader elector and zk store (was: After

[jira] [Updated] (YARN-3102) Decommisioned Nodes not listed in Web UI

2016-01-07 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-3102: -- Attachment: YARN-3102-v1.patch This patch adds semi-dummy entries to active RMNodes map

[jira] [Updated] (YARN-4560) Make scheduler error checking message more user friendly

2016-01-07 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4560: - Labels: supportability (was: ) > Make scheduler error checking message more user friendly >

[jira] [Commented] (YARN-4519) potential deadlock of CapacityScheduler between decrease container and assign containers

2016-01-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088361#comment-15088361 ] MENG DING commented on YARN-4519: - Please ignore the previous patch. I think there is way for improvement.

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2016-01-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088396#comment-15088396 ] Li Lu commented on YARN-4200: - If there are no further comments I'll commit this patch tomorrow morning.

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-01-07 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088472#comment-15088472 ] Vrushali C commented on YARN-4062: -- Thanks [~sjlee0], I will go over these and make the relevant changes.

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

2016-01-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088358#comment-15088358 ] Li Lu commented on YARN-4200: - Any other concerns on this patch? All check style issues appear to be

[jira] [Commented] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088371#comment-15088371 ] Arun Suresh commented on YARN-4335: --- Committed this to yarn-2877 after Fixing some of the whitespace

[jira] [Updated] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4335: -- Release Note: (was: Committed this to yarn-2877 after Fixing some of the whitespace warnings.) >

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-01-07 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088407#comment-15088407 ] Vrushali C commented on YARN-4062: -- Note: filed jira YARN-4561 for adding in enhancements like ability to

[jira] [Commented] (YARN-4062) Add the flush and compaction functionality via coprocessors and scanners for flow run table

2016-01-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088436#comment-15088436 ] Sangjin Lee commented on YARN-4062: --- Thanks [~vrushalic] for the work! She and I went over the patch

[jira] [Commented] (YARN-4476) Matcher for complex node label expresions

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088462#comment-15088462 ] Hadoop QA commented on YARN-4476: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4559: -- Attachment: YARN-4559.1.patch > Make leader elector and zk store share the same curator client >

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2016-01-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088346#comment-15088346 ] Karthik Kambatla commented on YARN-4180: Cherry-picked to 2.6.4 as well. Thanks for the ping,

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

2016-01-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4180: --- Fix Version/s: 2.6.4 > AMLauncher does not retry on failures when talking to NM >

[jira] [Commented] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088403#comment-15088403 ] Karthik Kambatla commented on YARN-4559: Quickly skimmed through the patch. High-level comments: #

[jira] [Created] (YARN-4561) Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting

2016-01-07 Thread Vrushali C (JIRA)
Vrushali C created YARN-4561: Summary: Compaction coprocessor enhancements: On/Off, whitelisting, blacklisting Key: YARN-4561 URL: https://issues.apache.org/jira/browse/YARN-4561 Project: Hadoop YARN

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

2016-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088458#comment-15088458 ] Wangda Tan commented on YARN-4304: -- Hi Sunil, Sorry for my late response, I thought I replied this

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088490#comment-15088490 ] Naganarasimha G R commented on YARN-3995: - bq. Instead of spawning multiple threads may be we can

[jira] [Updated] (YARN-4543) TestNodeStatusUpdater.testStopReentrant fails + JUnit misusage

2016-01-07 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akihiro Suda updated YARN-4543: --- Attachment: YARN-4543-1.patch Attached YARN-4543-1.patch. As with YARN-4548, I verified the patch

[jira] [Commented] (YARN-4393) TestResourceLocalizationService#testFailedDirsResourceRelease fails intermittently

2016-01-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087070#comment-15087070 ] Varun Saxena commented on YARN-4393: Thanks [~rohithsharma] for the review and commit. Thanks [~ozawa]

[jira] [Commented] (YARN-4306) Test failure: TestClientRMTokens

2016-01-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087109#comment-15087109 ] Rohith Sharma K S commented on YARN-4306: - After HADOOP-12687, this test case is passing. We can

[jira] [Commented] (YARN-4557) missed NonPartitioned Request Scheduling Opportunity is not correctly checking for all priorities of an app

2016-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087155#comment-15087155 ] Naganarasimha G R commented on YARN-4557: - Along with it there were two minor issues: * In

[jira] [Commented] (YARN-4371) "yarn application -kill" should take multiple application ids

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087154#comment-15087154 ] Hadoop QA commented on YARN-4371: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4318) Test failure: TestAMAuthorization

2016-01-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087117#comment-15087117 ] Rohith Sharma K S commented on YARN-4318: - After HADOOP-12687, this test case is passing. We can

[jira] [Resolved] (YARN-4318) Test failure: TestAMAuthorization

2016-01-07 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-4318. - Resolution: Duplicate Closing as duplicate, reopen if test case is still failing > Test

[jira] [Created] (YARN-4557) missed NonPartitioned Request Scheduling Opportunity is not correctly checking for all priorities of an app

2016-01-07 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-4557: --- Summary: missed NonPartitioned Request Scheduling Opportunity is not correctly checking for all priorities of an app Key: YARN-4557 URL:

[jira] [Updated] (YARN-4557) missed NonPartitioned Request Scheduling Opportunity is not correctly checking for all priorities of an app

2016-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4557: Attachment: YARN-4557.v1.001.patch Fixing the above issues ! > missed NonPartitioned

[jira] [Commented] (YARN-4549) Containers stuck in KILLING state

2016-01-07 Thread Danil Serdyuchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087217#comment-15087217 ] Danil Serdyuchenko commented on YARN-4549: -- We did some more digging and found that a few

[jira] [Commented] (YARN-4544) All the log messages about rolling monitoring interval are shown with the WARN level

2016-01-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087186#comment-15087186 ] Akira AJISAKA commented on YARN-4544: - Thanks [~bwtakacy] for reporting this and creating the patch. It

[jira] [Commented] (YARN-4548) TestCapacityScheduler.testRecoverRequestAfterPreemption fails with NPE

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087183#comment-15087183 ] Hadoop QA commented on YARN-4548: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4544) All the log messages about rolling monitoring interval are shown with the WARN level

2016-01-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4544: Assignee: Takashi Ohnishi > All the log messages about rolling monitoring interval are shown with

[jira] [Updated] (YARN-4548) TestCapacityScheduler.testRecoverRequestAfterPreemption fails with NPE

2016-01-07 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akihiro Suda updated YARN-4548: --- Attachment: YARN-4548-2.patch Fixed whitespaces. (YARN-4548-2.patch). The last JUnit failure in

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087074#comment-15087074 ] Hadoop QA commented on YARN-4545: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4544) All the log messages about rolling monitoring interval are shown with the WARN level

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087370#comment-15087370 ] Hadoop QA commented on YARN-4544: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

2016-01-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4538: --- Attachment: 0003-YARN-4538.patch Attaching patch after checkstyle fix > QueueMetrics pending

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2016-01-07 Thread Sreenath Somarajapuram (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087527#comment-15087527 ] Sreenath Somarajapuram commented on YARN-4238: -- Thanks [~varun_saxena] Also is it possible to

[jira] [Commented] (YARN-4555) TestDefaultContainerExecutor#testContainerLaunchError fails on non-englihsh locale environment

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087492#comment-15087492 ] Hadoop QA commented on YARN-4555: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2016-01-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087533#comment-15087533 ] Varun Saxena commented on YARN-4238: No. Entities will be returned in descending order i.e. most recent

[jira] [Updated] (YARN-4168) Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failing

2016-01-07 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated YARN-4168: -- Attachment: YARN-4168.1.patch > Test TestLogAggregationService.testLocalFileDeletionOnDiskFull

[jira] [Commented] (YARN-4544) All the log messages about rolling monitoring interval are shown with the WARN level

2016-01-07 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087325#comment-15087325 ] Takashi Ohnishi commented on YARN-4544: --- Sure! I will update the patch:) > All the log messages

[jira] [Updated] (YARN-4555) TestDefaultContainerExecutor#testContainerLaunchError fails on non-englihsh locale environment

2016-01-07 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takashi Ohnishi updated YARN-4555: -- Attachment: YARN-4555.1.patch I've created a patch which set LANG=C for container executor shell

[jira] [Commented] (YARN-4168) Test TestLogAggregationService.testLocalFileDeletionOnDiskFull failing

2016-01-07 Thread Takashi Ohnishi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087538#comment-15087538 ] Takashi Ohnishi commented on YARN-4168: --- I encountered, too. This seems to be caused by early

[jira] [Commented] (YARN-4549) Containers stuck in KILLING state

2016-01-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087548#comment-15087548 ] Jason Lowe commented on YARN-4549: -- If this only happens to long-running containers and the pid files are

[jira] [Commented] (YARN-3998) Add retry-times to let NM re-launch container when it fails to run

2016-01-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087392#comment-15087392 ] Varun Vasudev commented on YARN-3998: - Thanks for the patch [~hex108]! In your implementation, the

[jira] [Updated] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-01-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-3940: --- Attachment: 0005-YARN-3940.patch Thank you for looking into the patch [~sunilg] I have

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088614#comment-15088614 ] Hadoop QA commented on YARN-3102: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4560) Make scheduler error checking message more user friendly

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088611#comment-15088611 ] Hadoop QA commented on YARN-4560: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4559) Make leader elector and zk store share the same curator client

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088616#comment-15088616 ] Jian He commented on YARN-4559: --- bq. My preference would be for doing it in the RM yep, I can move the close

[jira] [Updated] (YARN-4562) YARN WebApp ignores the configuration passed to it for keystore settings

2016-01-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated YARN-4562: --- Attachment: YARN-4562.patch Trivial patch. [~vinodkv] [~sseth] can you take a look? > YARN

[jira] [Created] (YARN-4562) YARN WebApp ignores the configuration passed to it for keystore settings

2016-01-07 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created YARN-4562: -- Summary: YARN WebApp ignores the configuration passed to it for keystore settings Key: YARN-4562 URL: https://issues.apache.org/jira/browse/YARN-4562 Project:

[jira] [Commented] (YARN-4562) YARN WebApp ignores the configuration passed to it for keystore settings

2016-01-07 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088627#comment-15088627 ] Sergey Shelukhin commented on YARN-4562: Or [~hitesh]. I dunno who owns WebApp :) > YARN WebApp

[jira] [Commented] (YARN-4553) Add cgroups support for docker containers

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088594#comment-15088594 ] Hadoop QA commented on YARN-4553: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088636#comment-15088636 ] Naganarasimha G R commented on YARN-3995: - Oops my mistake... assumed the interface wrongly !. its

[jira] [Commented] (YARN-4238) createdTime and modifiedTime is not reported while publishing entities to ATSv2

2016-01-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087676#comment-15087676 ] Naganarasimha G R commented on YARN-4238: - In that case my opinion would be to remove the

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087686#comment-15087686 ] Hadoop QA commented on YARN-3940: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3995) Some of the NM events are not getting published due race condition when AM container finishes in NM

2016-01-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088549#comment-15088549 ] Sangjin Lee commented on YARN-3995: --- bq. Yes i wanted to address it as i was trying to point out earlier

[jira] [Commented] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-01-07 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088728#comment-15088728 ] Akihiro Suda commented on YARN-4556: {{AdminService.updateNodeResource()}} is asynchronous; it just

[jira] [Updated] (YARN-4556) TestFifoScheduler.testResourceOverCommit fails

2016-01-07 Thread Akihiro Suda (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akihiro Suda updated YARN-4556: --- Attachment: YARN-4556-1.patch Attached YARN-4556-1.patch > TestFifoScheduler.testResourceOverCommit

[jira] [Commented] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2016-01-07 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088804#comment-15088804 ] Xianyin Xin commented on YARN-4414: --- Hi [~lichangleo], need we also revisit the two layer retries in

[jira] [Updated] (YARN-4411) ResourceManager IllegalArgumentException error

2016-01-07 Thread yarntime (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yarntime updated YARN-4411: --- Attachment: (was: YARN-4411.001.patch) > ResourceManager IllegalArgumentException error >

[jira] [Commented] (YARN-3940) Application moveToQueue should check NodeLabel permission

2016-01-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088779#comment-15088779 ] Bibin A Chundatt commented on YARN-3940: Hi [~Naganarasimha] Thank you for review .I have already

[jira] [Updated] (YARN-2402) NM restart: Container recovery for Windows

2016-01-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-2402: Attachment: YARN-2402-v1.patch Attaching a patch for adding exit code script for Windows which is used to

[jira] [Updated] (YARN-4411) ResourceManager IllegalArgumentException error

2016-01-07 Thread yarntime (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yarntime updated YARN-4411: --- Attachment: YARN-4411.001.patch patch > ResourceManager IllegalArgumentException error >

[jira] [Updated] (YARN-2402) NM restart: Container recovery for Windows

2016-01-07 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-2402: Affects Version/s: (was: 2.5.0) 2.6.0 > NM restart: Container recovery for

[jira] [Commented] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088007#comment-15088007 ] Konstantinos Karanasos commented on YARN-4335: -- [~leftnoteasy], thanks again for the feedback.

[jira] [Commented] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088047#comment-15088047 ] Hadoop QA commented on YARN-4414: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4519) potential deadlock of CapacityScheduler between decrease container and assign containers

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088054#comment-15088054 ] Hadoop QA commented on YARN-4519: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2016-01-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088064#comment-15088064 ] Junping Du commented on YARN-3223: -- [~brookz], any feedback on my proposal above? > Resource update

[jira] [Assigned] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-2888: - Assignee: Arun Suresh > Corrective mechanisms for rebalancing NM container queues >

[jira] [Updated] (YARN-4544) All the log messages about rolling monitoring interval are shown with WARN level

2016-01-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated YARN-4544: Summary: All the log messages about rolling monitoring interval are shown with WARN level (was: All

[jira] [Commented] (YARN-4544) All the log messages about rolling monitoring interval are shown with the WARN level

2016-01-07 Thread Akira AJISAKA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087624#comment-15087624 ] Akira AJISAKA commented on YARN-4544: - Committing this. > All the log messages about rolling

[jira] [Updated] (YARN-4519) potential deadlock of CapacityScheduler between decrease container and assign containers

2016-01-07 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MENG DING updated YARN-4519: Attachment: YARN-4519.1.patch Attaching the latest patch that addresses this issue: bq. We need to make

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

2016-01-07 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15087811#comment-15087811 ] Sangjin Lee commented on YARN-3367: --- [~Naganarasimha] and I spoke offline about this, but wanted to

[jira] [Updated] (YARN-4438) Implement RM leader election with curator

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4438: -- Attachment: YARN-4438.6.patch thanks for the reviewing the patch ! attached a new patch > Implement RM leader

[jira] [Updated] (YARN-4414) Nodemanager connection errors are retried at multiple levels

2016-01-07 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4414: --- Attachment: YARN-4414.2.patch Thanks [~jlowe] for review! updated .2 patch to remove getNMProxy2 and

[jira] [Updated] (YARN-4476) Matcher for complex node label expresions

2016-01-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-4476: Attachment: YARN-4476-2.patch Fixed more checkstyle warnings. Diminishing returns on the

[jira] [Created] (YARN-4558) Yarn client retries on some non-retriable exceptions

2016-01-07 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created YARN-4558: -- Summary: Yarn client retries on some non-retriable exceptions Key: YARN-4558 URL: https://issues.apache.org/jira/browse/YARN-4558 Project: Hadoop YARN

[jira] [Resolved] (YARN-4032) Corrupted state from a previous version can still cause RM to fail with NPE due to same reasons as YARN-2834

2016-01-07 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-4032. Resolution: Duplicate YARN-4347 should fix this issue. Closing this as a duplicate. >

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088213#comment-15088213 ] Hadoop QA commented on YARN-4438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088220#comment-15088220 ] Xuan Gong commented on YARN-4438: - +1 lgtm. Checking this in. > Implement RM leader election with curator

[jira] [Commented] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088224#comment-15088224 ] Hadoop QA commented on YARN-4335: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088101#comment-15088101 ] Wangda Tan commented on YARN-4335: -- +1 to latest patch, thanks [~kkaranasos]! > Allow ResourceRequests to

[jira] [Commented] (YARN-3223) Resource update during NM graceful decommission

2016-01-07 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088097#comment-15088097 ] Brook Zhou commented on YARN-3223: -- Thanks [~djp] for the feedback. Those scenarios mentioned are indeed

[jira] [Updated] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4335: -- Description: YARN-2882 introduced container types that are internal (not user-facing) and are used by

[jira] [Commented] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088112#comment-15088112 ] Arun Suresh commented on YARN-4335: --- Thanks [~leftnoteasy] for the review and [~kkaranasos] for the

[jira] [Updated] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2016-01-07 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4335: -- Description: YARN-2882 introduced container types that are internal (not user-facing) and are used by

[jira] [Commented] (YARN-4496) Improve HA ResourceManager Failover detection on the client

2016-01-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088251#comment-15088251 ] Jian He commented on YARN-4496: --- +1, [~asuresh], are you working on this ? > Improve HA ResourceManager

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2016-01-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088281#comment-15088281 ] Varun Saxena commented on YARN-2962: [~kasha], [~jianhe], [~vinodkv], [~asuresh], kindly review. Will

[jira] [Commented] (YARN-4438) Implement RM leader election with curator

2016-01-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088285#comment-15088285 ] Xuan Gong commented on YARN-4438: - Committed into trunk/branch-2. Thanks, Jian. And thanks for the review,

[jira] [Commented] (YARN-4553) Add cgroups support for docker containers

2016-01-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15088302#comment-15088302 ] Sidharta Seethana commented on YARN-4553: - Thanks for the review, [~vvasudev]. The log lines

  1   2   >