[jira] [Comment Edited] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347236#comment-16347236 ] Manikandan R edited comment on YARN-4606 at 1/31/18 5:31 PM: - Thanks [~eepayne]

[jira] [Assigned] (YARN-4599) Set OOM control for memory cgroups

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi reassigned YARN-4599: Assignee: Miklos Szegedi (was: sandflee) > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-01-31 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347259#comment-16347259 ] Miklos Szegedi commented on YARN-4599: -- Thank you, [~sandflee]. I am working on a patch now. > Set

[jira] [Commented] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347258#comment-16347258 ] Sunil G commented on YARN-7862: --- bq.If you have obtained delegation token somehow, then you can forward the

[jira] [Commented] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347257#comment-16347257 ] Eric Yang commented on YARN-7862: - By the way, the above statements apply to AuthenticationFilter

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-01-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347329#comment-16347329 ] Eric Payne commented on YARN-4606: -- My understanding is that user limit would use {{activeUsers}} and

[jira] [Commented] (YARN-7863) Modify placement constraints to support node attributes

2018-01-31 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347372#comment-16347372 ] Konstantinos Karanasos commented on YARN-7863: -- Ideally there should be no API changes for

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347388#comment-16347388 ] Eric Yang commented on YARN-7516: - [~billie.rinaldi] [~shaneku...@gmail.com] How do we resolve the conflict

[jira] [Commented] (YARN-7815) Mount the filecache as read-only in Docker containers

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347439#comment-16347439 ] Eric Yang commented on YARN-7815: - {quote} I think that leaves us with this proposal which should

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347458#comment-16347458 ] genericqa commented on YARN-7446: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-31 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347469#comment-16347469 ] Billie Rinaldi commented on YARN-7516: -- bq. For example, a spark image that can run YARN cluster mode

[jira] [Commented] (YARN-2185) Use pipes when localizing archives

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347067#comment-16347067 ] Hudson commented on YARN-2185: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13588 (See

[jira] [Commented] (YARN-7677) HADOOP_CONF_DIR should not be automatically put in task environment

2018-01-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347158#comment-16347158 ] Eric Badger commented on YARN-7677: --- +1 (non-binding). Looks good to me. Thanks for fixing this

[jira] [Created] (YARN-7866) [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit

2018-01-31 Thread Sunil G (JIRA)
Sunil G created YARN-7866: - Summary: [UI2] Kerberizing the UI doesn't give any warning or content when UI is accessed without kinit Key: YARN-7866 URL: https://issues.apache.org/jira/browse/YARN-7866

[jira] [Commented] (YARN-7862) YARN native service REST endpoint needs user.name as query param

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347189#comment-16347189 ] Eric Yang commented on YARN-7862: - Hi [~sunilg], YARN Native service rest api already support hadoop

[jira] [Updated] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-01-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-7677: - Summary: Docker image cannot set HADOOP_CONF_DIR (was: HADOOP_CONF_DIR should not be automatically put in

[jira] [Updated] (YARN-6827) [ATS1/1.5] NPE exception while publishing recovering applications into ATS during RM restart.

2018-01-31 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6827: - Description: While recovering application, it is observed that NPE exception is thrown as below.

[jira] [Assigned] (YARN-7836) YARN Service component update PUT API should not use component name from JSON body

2018-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-7836: --- Assignee: Gour Saha Target Version/s: 3.1.0 I will work on a patch for this > YARN

[jira] [Updated] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7849: --- Attachment: YARN-7849-branch-2.8.v1.patch >

[jira] [Commented] (YARN-7516) Security check for trusted docker image

2018-01-31 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347441#comment-16347441 ] Shane Kumpf commented on YARN-7516: --- {quote}How do we resolve the conflict of having the same image exist

[jira] [Comment Edited] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347300#comment-16347300 ] Eric Yang edited comment on YARN-7446 at 1/31/18 6:13 PM: -- Hi

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347401#comment-16347401 ] Botong Huang commented on YARN-7849: The unit test failure for v1 patch is irrelevant. >

[jira] [Assigned] (YARN-7142) Support placement policy in yarn native services

2018-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reassigned YARN-7142: --- Assignee: Gour Saha Target Version/s: 3.1.0 YARN-6592 has been merged to trunk. I will

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347300#comment-16347300 ] Eric Yang commented on YARN-7446: - Hi [~shaneku...@gmail.com], to carry out the conversation on YARN-7516

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-01-31 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347382#comment-16347382 ] Shane Kumpf commented on YARN-7446: --- Thanks for the explanation. I do agree that this model would require

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347486#comment-16347486 ] genericqa commented on YARN-7849: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347514#comment-16347514 ] Konstantinos Karanasos commented on YARN-7778: -- Thanks for the patch, [~cheersyang]. A couple

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2018-01-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347289#comment-16347289 ] Manikandan R commented on YARN-6492: [~bibinchundatt] Thanks for your comments. Will take care in next

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2018-01-31 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6492: --- Attachment: PartitionQueueMetrics_y_partition.txt PartitionQueueMetrics_x_partition.txt

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Issue Type: Sub-task (was: Bug) Parent: YARN-7054 > YARN Service - Two different users are unable

[jira] [Commented] (YARN-7572) Make the service status output more readable

2018-01-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347526#comment-16347526 ] Chandni Singh commented on YARN-7572: - Should we change the status output to Application Report?

[jira] [Created] (YARN-7868) Provide improved error message when YARN service is disabled

2018-01-31 Thread Eric Yang (JIRA)
Eric Yang created YARN-7868: --- Summary: Provide improved error message when YARN service is disabled Key: YARN-7868 URL: https://issues.apache.org/jira/browse/YARN-7868 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-7833: --- Summary: [PERF/TEST] Extend SLS to support simulation of a Federated Environment (was: Extend SLS to

[jira] [Created] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7870: -- Summary: [PERF/TEST] Performance testing of ReservationSystem at high job submission rates Key: YARN-7870 URL: https://issues.apache.org/jira/browse/YARN-7870 Project:

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347707#comment-16347707 ] Botong Huang commented on YARN-7849: I see your concern, let me explain the nuance here. In the

[jira] [Commented] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347741#comment-16347741 ] Carlo Curino commented on YARN-7870: Yes! It is, in fact, already extended to support reservations

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347559#comment-16347559 ] Jason Lowe commented on YARN-7849: -- Thanks for the patch! I'm worried that this test is still fragile

[jira] [Created] (YARN-7869) [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues

2018-01-31 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-7869: -- Summary: [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues Key: YARN-7869 URL: https://issues.apache.org/jira/browse/YARN-7869 Project:

[jira] [Comment Edited] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347707#comment-16347707 ] Botong Huang edited comment on YARN-7849 at 1/31/18 10:34 PM: -- I see your

[jira] [Updated] (YARN-7868) Provide improved error message when YARN service is disabled

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7868: Attachment: YARN-7868.001.patch > Provide improved error message when YARN service is disabled >

[jira] [Assigned] (YARN-7868) Provide improved error message when YARN service is disabled

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7868: --- Assignee: Eric Yang > Provide improved error message when YARN service is disabled >

[jira] [Commented] (YARN-7835) [Atsv2] Race condition in NM while publishing events if second attempt launched on same node

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347584#comment-16347584 ] Haibo Chen commented on YARN-7835: -- Thanks [~rohithsharma] for the clarification! I agree that this needs

[jira] [Created] (YARN-7867) Enable YARN service by default

2018-01-31 Thread Eric Yang (JIRA)
Eric Yang created YARN-7867: --- Summary: Enable YARN service by default Key: YARN-7867 URL: https://issues.apache.org/jira/browse/YARN-7867 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Comment Edited] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347707#comment-16347707 ] Botong Huang edited comment on YARN-7849 at 1/31/18 10:39 PM: -- I see your

[jira] [Comment Edited] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347707#comment-16347707 ] Botong Huang edited comment on YARN-7849 at 1/31/18 10:38 PM: -- I see your

[jira] [Commented] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347717#comment-16347717 ] Vinod Kumar Vavilapalli commented on YARN-7870: --- Is there a way SLS can be enhanced for

[jira] [Commented] (YARN-7868) Provide improved error message when YARN service is disabled

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347790#comment-16347790 ] genericqa commented on YARN-7868: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7738) CapacityScheduler: Support refresh maximum allocation for multiple resource types

2018-01-31 Thread Xiang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347883#comment-16347883 ] Xiang Li commented on YARN-7738: [~leftnoteasy] thanks for taking care of this! I see. I will study it and

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347882#comment-16347882 ] Eric Yang commented on YARN-7816: - +1 looks good. I just committed this. Thank you [~gsaha]. > YARN

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347892#comment-16347892 ] genericqa commented on YARN-7840: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347785#comment-16347785 ] Botong Huang commented on YARN-7849: Actually I think we can remove the async heartbeat to avoid

[jira] [Commented] (YARN-7842) PB changes to carry node-attributes in NM heartbeat

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347796#comment-16347796 ] Naganarasimha G R commented on YARN-7842: - Oops, just missed to provide the comments on time. I had

[jira] [Assigned] (YARN-7865) Node attributes documentation

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-7865: --- Assignee: Naganarasimha G R > Node attributes documentation >

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-01-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347820#comment-16347820 ] Jian He commented on YARN-7781: --- Thanks Gour for the comments, bq. Don't we support a PUT URL –

[jira] [Updated] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7840: Attachment: YARN-7840-YARN-3409.003.patch > Update PB for prefix support of node attributes

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347829#comment-16347829 ] Naganarasimha G R commented on YARN-7757: - I would like to take look at the patch please hold... >

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347847#comment-16347847 ] Sunil G commented on YARN-7757: --- Sure [~Naganarasimha].  > Refactor NodeLabelsProvider to be more generic

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347845#comment-16347845 ] Sunil G commented on YARN-7840: --- Thanks [~Naganarasimha] for the detailed comment. I also had a concern of

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347877#comment-16347877 ] Sunil G commented on YARN-7840: --- Had a quick offline syncup with [~Naganarasimha]. I missed one thing where

[jira] [Assigned] (YARN-7870) [PERF/TEST] Performance testing of ReservationSystem at high job submission rates

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7870: -- Assignee: Xiaohua (Victor) Liang > [PERF/TEST] Performance testing of ReservationSystem at high

[jira] [Updated] (YARN-6578) Return container resource utilization from NM ContainerStatus call

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6578: - Issue Type: Improvement (was: New Feature) > Return container resource utilization from NM

[jira] [Updated] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-01-31 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-7781: -- Attachment: YARN-7781.02.patch > Update YARN-Services-Examples.md to be in sync with the latest code >

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347834#comment-16347834 ] Daniel Templeton commented on YARN-7819: Comments: * The write lock should be locked outside the

[jira] [Commented] (YARN-7446) Docker container privileged mode and --user flag contradict each other

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347865#comment-16347865 ] Eric Yang commented on YARN-7446: - [~shaneku...@gmail.com] I understand that docker can run as user defined

[jira] [Assigned] (YARN-7614) [RESERVATION] Support Reservation APIs in Federation Router

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7614: -- Assignee: Giovanni Matteo Fumarola > [RESERVATION] Support Reservation APIs in Federation

[jira] [Assigned] (YARN-7404) [GQ] propagate to GPG queue-level utilization/pending information

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7404: -- Assignee: Jose Miguel Arreola > [GQ] propagate to GPG queue-level utilization/pending

[jira] [Commented] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347904#comment-16347904 ] Hudson commented on YARN-7816: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13595 (See

[jira] [Commented] (YARN-5907) [Umbrella] [YARN-1042] add ability to specify affinity/anti-affinity in container requests

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347787#comment-16347787 ] Haibo Chen commented on YARN-5907: -- [~leftnoteasy] While reading YARN-6592, I wonder if this has been

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347810#comment-16347810 ] Naganarasimha G R commented on YARN-7840: - Thanks for the comments [~sunilg] , [~bibinchundatt] &

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347818#comment-16347818 ] Haibo Chen commented on YARN-7819: -- Thanks [~asuresh] for the patch. I took a quick look at YARN-6592

[jira] [Commented] (YARN-7840) Update PB for prefix support of node attributes

2018-01-31 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347825#comment-16347825 ] Naganarasimha G R commented on YARN-7840: - [~bibinchundatt] & [~cheersyang] Uploaded a patch fixing

[jira] [Commented] (YARN-7757) Refactor NodeLabelsProvider to be more generic and reusable for node attributes providers

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347863#comment-16347863 ] Weiwei Yang commented on YARN-7757: --- Sure [~Naganarasimha], please share your feedback and I'll look at

[jira] [Assigned] (YARN-7869) [PERF/TEST] Performance testing of CapacityScheudler at many-thousands of queues

2018-01-31 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-7869: -- Assignee: Abhishek Modi > [PERF/TEST] Performance testing of CapacityScheudler at

[jira] [Updated] (YARN-5848) public/crossdomain.xml is problematic

2018-01-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5848: --- Priority: Blocker (was: Major) > public/crossdomain.xml is problematic >

[jira] [Commented] (YARN-5848) public/crossdomain.xml is problematic

2018-01-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348049#comment-16348049 ] Allen Wittenauer commented on YARN-5848: I'm raising this to a blocker, now that these cross domain

[jira] [Updated] (YARN-5848) public/crossdomain.xml is problematic

2018-01-31 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-5848: --- Affects Version/s: 3.1.0 > public/crossdomain.xml is problematic >

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: YARN-7778.004.patch > Merging of constraints defined at different levels >

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348019#comment-16348019 ] Yufei Gu commented on YARN-7859: Hi [~wangwj], not sure I understand your propose. You seems introduce one

[jira] [Commented] (YARN-7864) YARN Federation document has error. spelling mistakes.

2018-01-31 Thread Yiran Wu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348038#comment-16348038 ] Yiran Wu commented on YARN-7864: Cc [~Naganarasimha], [~sunilg], [~bibinchundatt], [~leftnoteasy] and 

[jira] [Commented] (YARN-7864) YARN Federation document has error. spelling mistakes.

2018-01-31 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348048#comment-16348048 ] maobaolong commented on YARN-7864: -- What a big mistake. Thank you yiran, you did a great job. > YARN

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348055#comment-16348055 ] genericqa commented on YARN-7819: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348103#comment-16348103 ] genericqa commented on YARN-7859: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348106#comment-16348106 ] wangwj commented on YARN-7859: -- Hi [~yufeigu],Thank you for your reply. I think that no violation of

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2018-01-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348116#comment-16348116 ] Eric Yang commented on YARN-7221: - [~shaneku...@gmail.com] [~ebadger] Thanks for the review. I agree with

[jira] [Commented] (YARN-7677) Docker image cannot set HADOOP_CONF_DIR

2018-01-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347283#comment-16347283 ] Hudson commented on YARN-7677: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13591 (See

[jira] [Commented] (YARN-7849) TestMiniYarnClusterNodeUtilization#testUpdateNodeUtilization fails due to heartbeat sync error

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347360#comment-16347360 ] genericqa commented on YARN-7849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347913#comment-16347913 ] genericqa commented on YARN-7781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: (was: image-2018-02-01-10-16-33-248.png) > New feature: add queue scheduling deadLine in

[jira] [Comment Edited] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347916#comment-16347916 ] Weiwei Yang edited comment on YARN-7778 at 2/1/18 2:24 AM: --- Hi [~kkaranasos]

[jira] [Comment Edited] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347916#comment-16347916 ] Weiwei Yang edited comment on YARN-7778 at 2/1/18 2:23 AM: --- Hi [~kkaranasos]

[jira] [Updated] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-7778: -- Attachment: YARN-7778.003.patch > Merging of constraints defined at different levels >

[jira] [Updated] (YARN-7816) YARN Service - Two different users are unable to launch a service of the same name

2018-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7816: Fix Version/s: 3.1.0 > YARN Service - Two different users are unable to launch a service of the same > name

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-01-31 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347942#comment-16347942 ] Gour Saha commented on YARN-7781: - Thanks [~jianhe] . Patch 02 looks good. +1 for commit. > Update

[jira] [Updated] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7819: -- Attachment: YARN-7819.002.patch > Allow PlacementProcessor to be used with the FairScheduler >

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347990#comment-16347990 ] genericqa commented on YARN-7778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346762#comment-16346762 ] wangwj edited comment on YARN-7859 at 2/1/18 2:16 AM: -- In my cluster,I did an

[jira] [Updated] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwj updated YARN-7859: - Attachment: (was: image-2018-02-01-10-16-55-271.png) > New feature: add queue scheduling deadLine in

[jira] [Comment Edited] (YARN-7859) New feature: add queue scheduling deadLine in fairScheduler.

2018-01-31 Thread wangwj (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16346762#comment-16346762 ] wangwj edited comment on YARN-7859 at 2/1/18 2:17 AM: -- In my cluster,I did an

[jira] [Commented] (YARN-7778) Merging of constraints defined at different levels

2018-01-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347916#comment-16347916 ] Weiwei Yang commented on YARN-7778: --- Hi [~kkaranasos] Thanks for your comments, I agree with both #1 and

[jira] [Commented] (YARN-7819) Allow PlacementProcessor to be used with the FairScheduler

2018-01-31 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347983#comment-16347983 ] Arun Suresh commented on YARN-7819: --- Thanks for the review [~templedf] and [~haibochen]. Updated patch

<    1   2   3   >