[jira] [Commented] (YARN-8264) [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468471#comment-16468471 ] Rohith Sharma K S commented on YARN-8264: - +1 lgtm, committing shortly > [UI2 GPU]

[jira] [Commented] (YARN-8239) [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468468#comment-16468468 ] Rohith Sharma K S commented on YARN-8239: - +1 committing shortly > [UI2] Clicking

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468465#comment-16468465 ] Rohith Sharma K S commented on YARN-8130: - Updated the patch adding a test that ver

[jira] [Updated] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8130: Attachment: YARN-8130.02.patch > Race condition when container events are published for KILLE

[jira] [Commented] (YARN-8264) [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468460#comment-16468460 ] genericqa commented on YARN-8264: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-05-08 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468459#comment-16468459 ] Wilfred Spiegelenburg commented on YARN-8191: - [~grepas] I see you are still wo

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468458#comment-16468458 ] genericqa commented on YARN-4599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8264) [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers

2018-05-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8264: -- Attachment: YARN-8264.001.patch > [UI2 GPU] GPU Info tab disappears if we click any sub link under List of > App

[jira] [Updated] (YARN-8249) Few REST api's in RMWebServices are missing static user check

2018-05-08 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8249: -- Attachment: YARN-8249.003.patch > Few REST api's in RMWebServices are missing static user check > ---

[jira] [Commented] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468331#comment-16468331 ] Vrushali C commented on YARN-8247: -- Sounds good, thanks Rohith! I will try to commit thi

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468251#comment-16468251 ] genericqa commented on YARN-7654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8267) Service DELETE should have same behaviour between secure and non-secure cluster

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468240#comment-16468240 ] Rohith Sharma K S commented on YARN-8267: - Below are the screen shot of secure and

[jira] [Updated] (YARN-8267) Service DELETE should have same behaviour between secure and non-secure cluster

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8267: Attachment: Screen Shot 2018-05-08 at 10.27.06 PM.png > Service DELETE should have same behav

[jira] [Updated] (YARN-8267) Service DELETE should have same behaviour between secure and non-secure cluster

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-8267: Attachment: Screen Shot 2018-05-08 at 10.28.12 PM.png > Service DELETE should have same behav

[jira] [Created] (YARN-8267) Service DELETE should have same behaviour between secure and non-secure cluster

2018-05-08 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-8267: --- Summary: Service DELETE should have same behaviour between secure and non-secure cluster Key: YARN-8267 URL: https://issues.apache.org/jira/browse/YARN-8267 Pro

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468234#comment-16468234 ] Rohith Sharma K S commented on YARN-8130: - bq.  if it is possible to add in a small

[jira] [Commented] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-08 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468233#comment-16468233 ] Rohith Sharma K S commented on YARN-8247: - bq. is the response status being set whe

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468224#comment-16468224 ] genericqa commented on YARN-8202: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

2018-05-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468188#comment-16468188 ] Robert Kanter commented on YARN-8198: - Thanks for the patch [~kanwaljeets]. Some com

[jira] [Updated] (YARN-8266) Clicking on application from cluster view should redirect to application attempt page

2018-05-08 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora updated YARN-8266: - Attachment: YARN-8266.001.patch > Clicking on application from cluster view should redirect to application

[jira] [Assigned] (YARN-8266) Clicking on application from cluster view should redirect to application attempt page

2018-05-08 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yesha Vora reassigned YARN-8266: Assignee: Yesha Vora > Clicking on application from cluster view should redirect to application > a

[jira] [Created] (YARN-8266) Clicking on application from cluster view should redirect to application attempt page

2018-05-08 Thread Yesha Vora (JIRA)
Yesha Vora created YARN-8266: Summary: Clicking on application from cluster view should redirect to application attempt page Key: YARN-8266 URL: https://issues.apache.org/jira/browse/YARN-8266 Project: Ha

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.021.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468132#comment-16468132 ] Haibo Chen commented on YARN-8090: -- +1 on the patch pending  Jenkins. The precommit job (

[jira] [Commented] (YARN-8130) Race condition when container events are published for KILLED applications

2018-05-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468122#comment-16468122 ] Vrushali C commented on YARN-8130: -- Thanks for the patch Rohith! Looks like we will reuse

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468120#comment-16468120 ] genericqa commented on YARN-8250: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8247) Incorrect HTTP status code returned by ATSv2 for non-whitelisted users

2018-05-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468118#comment-16468118 ] Vrushali C commented on YARN-8247: -- Patch 002 looks good to me. Just one question: is th

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468117#comment-16468117 ] genericqa commented on YARN-8206: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468111#comment-16468111 ] Eric Yang commented on YARN-7654: - [~jlowe] {quote}I'll try to find time to take a closer l

[jira] [Commented] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-08 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468104#comment-16468104 ] Suma Shivaprasad commented on YARN-8243: [~gsaha] component.pendingInstances.remove

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-8090: - Attachment: YARN-8090.002.patch > Race conditions in FadvisedChunkedFile >

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468068#comment-16468068 ] Miklos Szegedi commented on YARN-8090: -- Thank you for the review [~haibochen]. I updat

[jira] [Updated] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-4599: - Attachment: YARN-4599.002.patch > Set OOM control for memory cgroups >

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468062#comment-16468062 ] Miklos Szegedi commented on YARN-4599: -- Fixing unit test. > Set OOM control for memor

[jira] [Commented] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468048#comment-16468048 ] Haibo Chen commented on YARN-8090: -- Thanks for the patch, [~miklos.szeg...@cloudera.com].

[jira] [Commented] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468047#comment-16468047 ] Eric Badger commented on YARN-8206: --- Attaching a new patch that uses the docker api for p

[jira] [Updated] (YARN-8206) Sending a kill does not immediately kill docker containers

2018-05-08 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8206: -- Attachment: YARN-8206.005.patch > Sending a kill does not immediately kill docker containers > --

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468041#comment-16468041 ] genericqa commented on YARN-4599: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8090: - Priority: Minor (was: Major) > Race conditions in FadvisedChunkedFile > --

[jira] [Updated] (YARN-8090) Race conditions in FadvisedChunkedFile

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8090: - Description: When a file is closed mutple times by multiple threads, all but the first close will generate

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468025#comment-16468025 ] genericqa commented on YARN-7715: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468020#comment-16468020 ] Miklos Szegedi commented on YARN-8250: -- Thanks for the patch, [~haibochen]. Container

[jira] [Commented] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468012#comment-16468012 ] Haibo Chen commented on YARN-7715: -- Makes sense. Can you add containerId to all the warnin

[jira] [Assigned] (YARN-8230) [UI2] Attempt Info page url shows NA for several fields for container info

2018-05-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-8230: --- Assignee: (was: Chandni Singh) > [UI2] Attempt Info page url shows NA for several fields f

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16468008#comment-16468008 ] Chandni Singh commented on YARN-7894: - Thanks [~billie.rinaldi] for reviewing and mergi

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-05-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467990#comment-16467990 ] Naganarasimha G R commented on YARN-7892: - Uploaded a patch to fix the check style

[jira] [Updated] (YARN-7892) Revisit NodeAttribute class structure

2018-05-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7892: Attachment: YARN-7892-YARN-3409.009.patch > Revisit NodeAttribute class structure > -

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467981#comment-16467981 ] Hudson commented on YARN-7894: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1414

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467977#comment-16467977 ] Jason Lowe commented on YARN-7654: -- I'll try to find time to take a closer look at this pa

[jira] [Commented] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467978#comment-16467978 ] Billie Rinaldi commented on YARN-8108: -- [~daryn], any additional thoughts? > RM metri

[jira] [Assigned] (YARN-8108) RM metrics rest API throws GSSException in kerberized environment

2018-05-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8108: Assignee: Eric Yang > RM metrics rest API throws GSSException in kerberized environment > --

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-08 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467967#comment-16467967 ] Szilard Nemeth commented on YARN-8202: -- Hi [~rkanter]! Thanks for your comments. # A

[jira] [Commented] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467966#comment-16467966 ] genericqa commented on YARN-8265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-08 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Attachment: YARN-8202-009.patch > DefaultAMSProcessor should properly check units of requested cust

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467958#comment-16467958 ] Hudson commented on YARN-8207: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1414

[jira] [Updated] (YARN-8250) Create another implementation of ContainerScheduler to support NM overallocation

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8250: - Attachment: YARN-8250-YARN-1011.00.patch > Create another implementation of ContainerScheduler to support N

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467950#comment-16467950 ] Eric Yang commented on YARN-8207: - [~jlowe] Thank you for the persistent reviews to make th

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467952#comment-16467952 ] Billie Rinaldi commented on YARN-7894: -- +1 for patch 4. Thanks, Chandni! > Improve AT

[jira] [Commented] (YARN-6675) Add NM support to launch opportunistic containers based on overallocation

2018-05-08 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467949#comment-16467949 ] Haibo Chen commented on YARN-6675: -- Per offline discussion with [~miklos.szeg...@cloudera.

[jira] [Updated] (YARN-7715) Update CPU and Memory cgroups params on container update as well.

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7715: - Attachment: YARN-7715.004.patch > Update CPU and Memory cgroups params on container update as well.

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467936#comment-16467936 ] Jason Lowe commented on YARN-8207: -- Thanks for updating the patch! +1 for patch v10. Tha

[jira] [Commented] (YARN-8256) Pluggable provider for node membership management

2018-05-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467929#comment-16467929 ] ASF GitHub Bot commented on YARN-8256: -- GitHub user functicons opened a pull request:

[jira] [Commented] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467877#comment-16467877 ] genericqa commented on YARN-8261: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8265: Attachment: YARN-8265.001.patch > AM should retrieve new IP for restarted container > ---

[jira] [Created] (YARN-8265) AM should retrieve new IP for restarted container

2018-05-08 Thread Eric Yang (JIRA)
Eric Yang created YARN-8265: --- Summary: AM should retrieve new IP for restarted container Key: YARN-8265 URL: https://issues.apache.org/jira/browse/YARN-8265 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467869#comment-16467869 ] genericqa commented on YARN-8207: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467853#comment-16467853 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 10 is posted. > Docker container launch

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467837#comment-16467837 ] genericqa commented on YARN-8207: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467832#comment-16467832 ] genericqa commented on YARN-7894: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8232) RMContainer lost queue name when RM HA happens

2018-05-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467829#comment-16467829 ] Hudson commented on YARN-8232: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #1414

[jira] [Created] (YARN-8264) [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers

2018-05-08 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-8264: Summary: [UI2 GPU] GPU Info tab disappears if we click any sub link under List of Applications or List of Containers Key: YARN-8264 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Commented] (YARN-8166) Service AppId page throws HTTP Error 401

2018-05-08 Thread Yesha Vora (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467800#comment-16467800 ] Yesha Vora commented on YARN-8166: -- [~sunilg], validated in secure environment. Links work

[jira] [Assigned] (YARN-8244) TestContainerSchedulerQueuing.testStartMultipleContainers failed

2018-05-08 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan reassigned YARN-8244: - Assignee: Jim Brennan > TestContainerSchedulerQueuing.testStartMultipleContainers failed > --

[jira] [Commented] (YARN-8175) Add support for Node Labels in SLS.

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467787#comment-16467787 ] genericqa commented on YARN-8175: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467783#comment-16467783 ] Jason Lowe commented on YARN-8207: -- {quote}One concern about the shallow copy, struct args

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.010.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Updated] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8261: - Attachment: YARN-8261.002.patch > Docker container launch fails due to .cmd file creation failure > ---

[jira] [Commented] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467770#comment-16467770 ] Jason Lowe commented on YARN-8261: -- Updating the patch to address the checkstyle issue. >

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467764#comment-16467764 ] Billie Rinaldi commented on YARN-7894: -- Okay. I started a new precommit build, so hope

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467762#comment-16467762 ] Eric Yang commented on YARN-8207: - [~jlowe] I see what you mean now, and patch 10 updated a

[jira] [Comment Edited] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467752#comment-16467752 ] Chandni Singh edited comment on YARN-7894 at 5/8/18 5:56 PM: - T

[jira] [Commented] (YARN-7894) Improve ATS response for DS_CONTAINER when container launch fails

2018-05-08 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467752#comment-16467752 ] Chandni Singh commented on YARN-7894: - The Distributes shell tests pass on my machine.

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467750#comment-16467750 ] Jason Lowe commented on YARN-8207: -- Additional comment on patch 9: extract_execv_args nee

[jira] [Commented] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467740#comment-16467740 ] genericqa commented on YARN-8261: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-05-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467731#comment-16467731 ] Robert Kanter commented on YARN-8202: - Thanks for the patch. A few comments: # Why is

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467727#comment-16467727 ] Eric Yang commented on YARN-8207: - [~jlowe] Patch 9 fixes most nits from your comments exce

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467725#comment-16467725 ] Jason Lowe commented on YARN-8207: -- init_args would not require the structure to be malloc

[jira] [Updated] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8207: Attachment: YARN-8207.009.patch > Docker container launch use popen have risk of shell expansion > --

[jira] [Commented] (YARN-4599) Set OOM control for memory cgroups

2018-05-08 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467721#comment-16467721 ] Miklos Szegedi commented on YARN-4599: -- The build issue seems to be unrelated. Restart

[jira] [Updated] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8263: - Labels: Docker (was: ) Description: The DockerClient constructor fails if hadoop.tmp.dir is not s

[jira] [Created] (YARN-8263) DockerClient still touches hadoop.tmp.dir

2018-05-08 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-8263: Summary: DockerClient still touches hadoop.tmp.dir Key: YARN-8263 URL: https://issues.apache.org/jira/browse/YARN-8263 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Updated] (YARN-8175) Add support for Node Labels in SLS.

2018-05-08 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi updated YARN-8175: Attachment: YARN-8175.005.patch > Add support for Node Labels in SLS. > -

[jira] [Created] (YARN-8262) get_executable in container-executor should provide meaningful error codes

2018-05-08 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-8262: Summary: get_executable in container-executor should provide meaningful error codes Key: YARN-8262 URL: https://issues.apache.org/jira/browse/YARN-8262 Project: Hadoo

[jira] [Commented] (YARN-8243) Flex down should first remove pending container requests (if any) and then kill running containers

2018-05-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467675#comment-16467675 ] Billie Rinaldi commented on YARN-8243: -- bq. Isn't that what we want? Yes, I'm saying t

[jira] [Commented] (YARN-8207) Docker container launch use popen have risk of shell expansion

2018-05-08 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467673#comment-16467673 ] Eric Yang commented on YARN-8207: - [~jlowe] {quote}At a bare minimum there should be a util

[jira] [Updated] (YARN-8256) Pluggable provider for node membership management

2018-05-08 Thread Dagang Wei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dagang Wei updated YARN-8256: - Description: h1. Background HDFS-7541 introduced a pluggable provider framework for node membership manag

[jira] [Updated] (YARN-8256) Pluggable provider for node membership management

2018-05-08 Thread Dagang Wei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dagang Wei updated YARN-8256: - Description: h1. Background HDFS-7541 introduced a pluggable provider framework for node membership manag

[jira] [Commented] (YARN-8239) [UI2] Clicking on Node Manager UI under AM container info / App Attempt page goes to old RM UI

2018-05-08 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467670#comment-16467670 ] genericqa commented on YARN-8239: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote |

[jira] [Updated] (YARN-8261) Docker container launch fails due to .cmd file creation failure

2018-05-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8261: - Attachment: YARN-8261.001.patch > Docker container launch fails due to .cmd file creation failure > ---

[jira] [Commented] (YARN-8255) Allow option to disable flex for a service component

2018-05-08 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16467635#comment-16467635 ] Billie Rinaldi commented on YARN-8255: -- I agree with Eric's suggestion as well. > All

  1   2   >