[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:41 AM: - [~leftnoteasy]

[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:40 AM: - [~leftnoteasy]

[jira] [Comment Edited] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang edited comment on YARN-8563 at 8/25/18 5:38 AM: - [~leftnoteasy]

[jira] [Commented] (YARN-8563) [Submarine] Support users to specify Python/TF package/version/dependencies for training job.

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592475#comment-16592475 ] Zhankun Tang commented on YARN-8563: [~leftnoteasy] One question: *When and how will the prebuilt

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592363#comment-16592363 ] Eric Yang commented on YARN-8642: - Overall, patch 2 looks promising.  I have a few basic questions.  YARN

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592331#comment-16592331 ] genericqa commented on YARN-8488: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592322#comment-16592322 ] genericqa commented on YARN-8642: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8713) [Submarine] Support deploy model serving for existing models

2018-08-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8713: Summary: [Submarine] Support deploy model serving for existing models Key: YARN-8713 URL: https://issues.apache.org/jira/browse/YARN-8713 Project: Hadoop YARN

[jira] [Created] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-08-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8714: Summary: [Submarine] Support files/tarballs to be localized for a training job. Key: YARN-8714 URL: https://issues.apache.org/jira/browse/YARN-8714 Project: Hadoop YARN

[jira] [Created] (YARN-8712) [Submarine] Support create models / versions for training result.

2018-08-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8712: Summary: [Submarine] Support create models / versions for training result. Key: YARN-8712 URL: https://issues.apache.org/jira/browse/YARN-8712 Project: Hadoop YARN

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-24 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592307#comment-16592307 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sorry for getting back late. I took some time to run SLS

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592302#comment-16592302 ] genericqa commented on YARN-8675: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592301#comment-16592301 ] Suma Shivaprasad commented on YARN-8488: Fixed remaining CS issues > YARN

[jira] [Updated] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.8.patch > YARN service/components/instances should have

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592244#comment-16592244 ] Jim Brennan commented on YARN-8675: --- [~suma.shivaprasad] thanks for updating.  Patch 3 looks good to me.

[jira] [Commented] (YARN-8705) Refactor the UAM heartbeat thread in preparation for YARN-8696

2018-08-24 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592242#comment-16592242 ] Botong Huang commented on YARN-8705: Thanks for the comment! I moved them so that fields about home

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8675: --- Attachment: YARN-8675.3.patch > Setting hostname of docker container breaks with "host"

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592209#comment-16592209 ] Suma Shivaprasad commented on YARN-8675: Thanks [~Jim_Brennan] [~billie.rinaldi] Have updated the

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8675: --- Attachment: (was: YARN-8675.3.patch) > Setting hostname of docker container breaks with

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8675: --- Attachment: YARN-8675.3.patch > Setting hostname of docker container breaks with "host"

[jira] [Commented] (YARN-8642) Add support for tmpfs mounts with the Docker runtime

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592196#comment-16592196 ] genericqa commented on YARN-8642: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592194#comment-16592194 ] genericqa commented on YARN-8710: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592173#comment-16592173 ] Billie Rinaldi commented on YARN-8675: -- Hey [~Jim_Brennan], thanks for taking a look. You're right,

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592142#comment-16592142 ] Jim Brennan commented on YARN-8675: --- [~suma.shivaprasad] Thanks for working on this.  I am still not

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Attachment: YARN-8710.1.patch > Service AM should set a finite limit on NM container max

[jira] [Commented] (YARN-8705) Refactor the UAM heartbeat thread in preparation for YARN-8696

2018-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592091#comment-16592091 ] Giovanni Matteo Fumarola commented on YARN-8705: Few comments: {\{threadpool}} and

[jira] [Updated] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8051: - Attachment: YARN-8051-branch-2.002.patch > TestRMEmbeddedElector#testCallbackSynchronization is flakey >

[jira] [Reopened] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe reopened YARN-8051: -- Reopening to get a Jenkins run on the branch-2 patch. > TestRMEmbeddedElector#testCallbackSynchronization

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592085#comment-16592085 ] Billie Rinaldi commented on YARN-8675: -- Ah, of course, I lost track of that condition. I don't see

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592086#comment-16592086 ] genericqa commented on YARN-8675: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8705) Refactor the UAM heartbeat thread in preparation for YARN-8696

2018-08-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8705: --- Summary: Refactor the UAM heartbeat thread in preparation for YARN-8696

[jira] [Created] (YARN-8711) YARN UI2 : Display component state in Component list and details page for a Service

2018-08-24 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8711: -- Summary: YARN UI2 : Display component state in Component list and details page for a Service Key: YARN-8711 URL: https://issues.apache.org/jira/browse/YARN-8711

[jira] [Commented] (YARN-8632) Threads in SLS quit without logging exception

2018-08-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592062#comment-16592062 ] Hudson commented on YARN-8632: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14825 (See

[jira] [Updated] (YARN-8051) TestRMEmbeddedElector#testCallbackSynchronization is flakey

2018-08-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-8051: - Affects Version/s: 2.10.0 2.9.1 2.8.4

[jira] [Commented] (YARN-8632) Threads in SLS quit without logging exception

2018-08-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592032#comment-16592032 ] Yufei Gu commented on YARN-8632: +1 for the patch v4. Committed to trunk. Thanks [~luxianghao] for the

[jira] [Created] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-08-24 Thread Suma Shivaprasad (JIRA)
Suma Shivaprasad created YARN-8710: -- Summary: Service AM should set a finite limit on NM container max retries Key: YARN-8710 URL: https://issues.apache.org/jira/browse/YARN-8710 Project: Hadoop

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Description: Container retries are currently set to a default of -1 in

[jira] [Updated] (YARN-8710) Service AM should set a finite limit on NM container max retries

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8710: --- Environment: (was: Container retries are currently set to a default of -1 in

[jira] [Updated] (YARN-8632) Threads in SLS quit without logging exception

2018-08-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-8632: --- Summary: Threads in SLS quit without logging exception (was: No data in file realtimetrack.json after

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592024#comment-16592024 ] genericqa commented on YARN-8488: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8706) DelayedProcessKiller is executed for Docker containers even though docker stop sends a KILL signal after the specified grace period

2018-08-24 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592013#comment-16592013 ] Chandni Singh commented on YARN-8706: - Seems that {{YarnConfiguration.NM_DOCKER_STOP_GRACE_PERIOD}} is

[jira] [Updated] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8675: --- Attachment: YARN-8675.2.patch > Setting hostname of docker container breaks with "host"

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592011#comment-16592011 ] Suma Shivaprasad commented on YARN-8675: Thanks for reviewing the patch [~billie.rinaldi] I think

[jira] [Commented] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591936#comment-16591936 ] Suma Shivaprasad commented on YARN-8488: Fixed some checkstyle/WS issues > YARN

[jira] [Updated] (YARN-8488) YARN service/components/instances should have SUCCEEDED/FAILED states

2018-08-24 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.7.patch > YARN service/components/instances should have

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591878#comment-16591878 ] Wangda Tan commented on YARN-8513: -- [~hustnn], what is the cause of "Failed to accept allocation

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591801#comment-16591801 ] Eric Badger commented on YARN-8638: --- Thanks for the patch updates, [~ccondit-target]. Patch 004 looks

[jira] [Assigned] (YARN-4211) Many InvalidStateTransitionException on NM recovering the containers

2018-08-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-4211: Assignee: Gergely Pollak > Many InvalidStateTransitionException on NM recovering the containers >

[jira] [Updated] (YARN-6286) TestCapacityScheduler.testAMLimitUsage throws UndeclaredThrowableException

2018-08-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6286: - Labels: capacityscheduler (was: ) > TestCapacityScheduler.testAMLimitUsage throws

[jira] [Commented] (YARN-8638) Allow linux container runtimes to be pluggable

2018-08-24 Thread Craig Condit (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591735#comment-16591735 ] Craig Condit commented on YARN-8638: [~ebadger] I think I've addressed all your concerns with the

[jira] [Commented] (YARN-8705) Refactor in preparation for YARN-8696

2018-08-24 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591730#comment-16591730 ] Botong Huang commented on YARN-8705: This Jira is purely refactoring, no functionality changes, so no

[jira] [Commented] (YARN-8675) Setting hostname of docker container breaks with "host" networking mode for Apps which do not run as a YARN service

2018-08-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591716#comment-16591716 ] Billie Rinaldi commented on YARN-8675: -- Thanks for the patch, [~suma.shivaprasad]! I think we should

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-24 Thread Elek, Marton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591692#comment-16591692 ] Elek, Marton commented on YARN-8623: I think it's more safe to handle two different images. But I have

[jira] [Resolved] (YARN-8708) TestDistributedShell test cases failing giving assertion error

2018-08-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt resolved YARN-8708. Resolution: Duplicate Closing it as duplicate of YARN-8535 > TestDistributedShell test

[jira] [Updated] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-7773: --- Fix Version/s: 3.0.4 > YARN Federation used Mysql as state store throw exception, Unknown

[jira] [Commented] (YARN-8709) intra-queue preemption checker always fail since one under-served queue was deleted

2018-08-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591543#comment-16591543 ] Tao Yang commented on YARN-8709: To solve this problem, how about to clear partitionToUnderServedQueues in

[jira] [Updated] (YARN-8709) intra-queue preemption checker always fail since one under-served queue was deleted

2018-08-24 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8709: --- Description: After some queues deleted, the preemption checker in SchedulingMonitor was always skipped

[jira] [Created] (YARN-8709) intra-queue preemption checker always fail since one under-served queue was deleted

2018-08-24 Thread Tao Yang (JIRA)
Tao Yang created YARN-8709: -- Summary: intra-queue preemption checker always fail since one under-served queue was deleted Key: YARN-8709 URL: https://issues.apache.org/jira/browse/YARN-8709 Project: Hadoop

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591501#comment-16591501 ] genericqa commented on YARN-8632: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591468#comment-16591468 ] Zac Zhou commented on YARN-8698: Sure, [~tangzhankun] I've checked, launch_container.sh invokes 

[jira] [Updated] (YARN-8708) TestDistributedShell test cases failing giving assertion error

2018-08-24 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Shah updated YARN-8708: -- Description: There is no directory created as "DS_APP_ATTEMPT" so

[jira] [Commented] (YARN-8708) TestDistributedShell test cases failing giving assertion error

2018-08-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591467#comment-16591467 ] Bibin A Chundatt commented on YARN-8708: cc:/[~rohithsharma] > TestDistributedShell test cases

[jira] [Created] (YARN-8708) TestDistributedShell test cases failing giving assertion error

2018-08-24 Thread Rakesh Shah (JIRA)
Rakesh Shah created YARN-8708: - Summary: TestDistributedShell test cases failing giving assertion error Key: YARN-8708 URL: https://issues.apache.org/jira/browse/YARN-8708 Project: Hadoop YARN

[jira] [Commented] (YARN-7964) Yarn Scheduler Load Simulator (SLS): MetricsLogRunnable stops working when there are too many jobs needed to load from sls

2018-08-24 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591456#comment-16591456 ] Xianghao Lu commented on YARN-7964: --- [~cxcw] Seems duplicate with YARN-8632. > Yarn Scheduler Load

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-24 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591435#comment-16591435 ] Xianghao Lu commented on YARN-8632: --- [~yufeigu] Thanks for your review! Patch for 2.7 is not necessary

[jira] [Updated] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-24 Thread Xianghao Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghao Lu updated YARN-8632: -- Attachment: YARN-8632.004.patch > No data in file realtimetrack.json after running

[jira] [Updated] (YARN-4289) TestDistributedShell failing with bind exception

2018-08-24 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Shah updated YARN-4289: -- Description: *Stacktrace* {noformat} org.apache.hadoop.service.ServiceStateException:

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591425#comment-16591425 ] Bibin A Chundatt commented on YARN-7773: I havnt analyzed other branches yet. Currently have

[jira] [Resolved] (YARN-8398) Findbugs warning IS2_INCONSISTENT_SYNC in AllocationFileLoaderService.reloadListener

2018-08-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen resolved YARN-8398. -- Resolution: Duplicate > Findbugs warning IS2_INCONSISTENT_SYNC in >

[jira] [Commented] (YARN-6474) CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301

2018-08-24 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591372#comment-16591372 ] Zoltan Siegl commented on YARN-6474: I could not find any way to improve this part while still keeping

[jira] [Assigned] (YARN-6474) CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301

2018-08-24 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Siegl reassigned YARN-6474: -- Assignee: (was: Zoltan Siegl) > CGroupsHandlerImpl.java has a few checkstyle issues left

[jira] [Assigned] (YARN-6474) CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed after YARN-5301

2018-08-24 Thread Zoltan Siegl (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zoltan Siegl reassigned YARN-6474: -- Assignee: Zoltan Siegl > CGroupsHandlerImpl.java has a few checkstyle issues left to be fixed

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

2018-08-24 Thread niu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591337#comment-16591337 ] niu commented on YARN-8513: --- I also check the logic for printing out of the error "Failed to accept allocation

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-24 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591265#comment-16591265 ] Zhankun Tang commented on YARN-8698: [~yuan_zac] Yeah. I guess so. I haven't reproduce your issue with

[jira] [Comment Edited] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591243#comment-16591243 ] Zac Zhou edited comment on YARN-8698 at 8/24/18 7:27 AM: - In my case, 

[jira] [Commented] (YARN-8707) It's not reasonable to decide whether app is starved by fairShare

2018-08-24 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591253#comment-16591253 ] genericqa commented on YARN-8707: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8698) [Submarine] Failed to add hadoop dependencies in docker container when submitting a submarine job

2018-08-24 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591243#comment-16591243 ] Zac Zhou commented on YARN-8698: In my case, launch_container.sh specified HADOOP_COMMON_HOME like this:

[jira] [Commented] (YARN-7773) YARN Federation used Mysql as state store throw exception, Unknown column 'homeSubCluster' in 'field list'

2018-08-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591233#comment-16591233 ] Rohith Sharma K S commented on YARN-7773: - Given branch-2 and branch-3.0 also affected, why not

[jira] [Commented] (YARN-8670) Support scheduling request for SLS input and attributes for Node in SLS

2018-08-24 Thread Sichen zhao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16591187#comment-16591187 ] Sichen zhao commented on YARN-8670: --- Hi, My idea of a large number of jobs/requests with PCs is the