[jira] [Commented] (YARN-10049) FIFOOrderingPolicy Improvements

2020-01-19 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17018890#comment-17018890 ] Manikandan R commented on YARN-10049: - Thanks [~sunilg] [~leftnoteasy] Attaching .00

[jira] [Updated] (YARN-10049) FIFOOrderingPolicy Improvements

2020-01-19 Thread Manikandan R (Jira)
[ https://issues.apache.org/jira/browse/YARN-10049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-10049: Attachment: YARN-10049.001.patch > FIFOOrderingPolicy Improvements > --

[jira] [Updated] (YARN-10080) Support show app id on localizer thread pool

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10080: Attachment: YARN-10080.002.patch > Support show app id on localizer thread pool > -

[jira] [Created] (YARN-10090) ApplicationNotFoundException will cause a UndeclaredThrowableException

2020-01-19 Thread qiwei huang (Jira)
qiwei huang created YARN-10090: -- Summary: ApplicationNotFoundException will cause a UndeclaredThrowableException Key: YARN-10090 URL: https://issues.apache.org/jira/browse/YARN-10090 Project: Hadoop YARN

[jira] [Commented] (YARN-10080) Support show app id on localizer thread pool

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019188#comment-17019188 ] zhoukang commented on YARN-10080: - [~abmodi]thanks for review, i submit a new patch to su

[jira] [Commented] (YARN-10060) Historyserver may recover too slow since JobHistory init too slow when there exist too many job

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019193#comment-17019193 ] zhoukang commented on YARN-10060: - I will submit a patch to skip load file older than max

[jira] [Updated] (YARN-10060) Historyserver may recover too slow since JobHistory init too slow when there exist too many job

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10060: Attachment: YARN-10060.001.patch > Historyserver may recover too slow since JobHistory init too slow when t

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.003.patch > Add diagnostics for outstanding resource requests on app attempts page > ---

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: (was: YARN-9567.003.patch) > Add diagnostics for outstanding resource requests on app attempts

[jira] [Updated] (YARN-10056) Logservice may encuonter nm fgc since filesystem will only close when app finished

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10056: Description: Currently, filesystem will only be closed when app finished, which may cause memory overhead

[jira] [Updated] (YARN-10056) Logservice may encuonter nm fgc since filesystem will only close when app finished

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10056: Attachment: YARN-10056.001.patch > Logservice may encuonter nm fgc since filesystem will only close when ap

[jira] [Commented] (YARN-9930) Support max running app logic for CapacityScheduler

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019204#comment-17019204 ] zhoukang commented on YARN-9930: Sorry for late reply, i will post a patch later. thanks [

[jira] [Updated] (YARN-10011) Catch all exception during init app in LogAggregationService

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10011: Attachment: YARN-10011.001.patch > Catch all exception during init app in LogAggregationService > ---

[jira] [Resolved] (YARN-10010) NM upload log cost too much time

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang resolved YARN-10010. - Resolution: Duplicate > NM upload log cost too much time > > >

[jira] [Commented] (YARN-10010) NM upload log cost too much time

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019205#comment-17019205 ] zhoukang commented on YARN-10010: - I post a patch in YARN-10056 [~wilfreds] I will close

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: YARN-9567.003.patch > Add diagnostics for outstanding resource requests on app attempts page > ---

[jira] [Updated] (YARN-9979) When a app expired with many containers , scheduler event size will be huge

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9979: --- Attachment: YARN-9979.001.patch > When a app expired with many containers , scheduler event size will be huge

[jira] [Commented] (YARN-10069) Showing jstack on UI for containers

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019207#comment-17019207 ] zhoukang commented on YARN-10069: - [~akhilpb]Showing jstack for running container > Show

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: app-activities-example.png > Add diagnostics for outstanding resource requests on app attempts pag

[jira] [Updated] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9567: --- Attachment: scheduler-activities-example.png > Add diagnostics for outstanding resource requests on app attemp

[jira] [Commented] (YARN-9567) Add diagnostics for outstanding resource requests on app attempts page

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019208#comment-17019208 ] Tao Yang commented on YARN-9567: Thanks [~cheersyang] for the review. I have attached V3 p

[jira] [Commented] (YARN-9605) Add ZkConfiguredFailoverProxyProvider for RM HA

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019209#comment-17019209 ] zhoukang commented on YARN-9605: ping~ [~prabhujoseph][~subru][~tangzhankun]Could you help

[jira] [Updated] (YARN-10062) Support deploy multiple historyserver in case of sp

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10062: Description: In this jira, i want to implement a patch to support history ha. We can deploy two historyserv

[jira] [Updated] (YARN-10062) Support deploy multiple historyserver in case of sp

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10062: Attachment: YARN-10062.001.patch > Support deploy multiple historyserver in case of sp > --

[jira] [Created] (YARN-10091) Support clean up orphan app's log in LogAggService

2020-01-19 Thread zhoukang (Jira)
zhoukang created YARN-10091: --- Summary: Support clean up orphan app's log in LogAggService Key: YARN-10091 URL: https://issues.apache.org/jira/browse/YARN-10091 Project: Hadoop YARN Issue Type: Impr

[jira] [Created] (YARN-10092) Support log retain time for give user

2020-01-19 Thread zhoukang (Jira)
zhoukang created YARN-10092: --- Summary: Support log retain time for give user Key: YARN-10092 URL: https://issues.apache.org/jira/browse/YARN-10092 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-10092) Support config special log retain time for given user

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10092: Summary: Support config special log retain time for given user (was: Support log retain time for give use

[jira] [Created] (YARN-10093) Support get applications by queue

2020-01-19 Thread zhoukang (Jira)
zhoukang created YARN-10093: --- Summary: Support get applications by queue Key: YARN-10093 URL: https://issues.apache.org/jira/browse/YARN-10093 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-10093) Support list applications by queue name

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10093: Summary: Support list applications by queue name (was: Support get applications by queue) > Support list

[jira] [Created] (YARN-10094) Add a configuration to support NM overuse in RM

2020-01-19 Thread zhoukang (Jira)
zhoukang created YARN-10094: --- Summary: Add a configuration to support NM overuse in RM Key: YARN-10094 URL: https://issues.apache.org/jira/browse/YARN-10094 Project: Hadoop YARN Issue Type: Improve

[jira] [Updated] (YARN-10094) Add a configuration to support NM overuse in RM

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10094: Description: In a large cluster , upgrade NM will cost too much time. Some times we want to support memory

[jira] [Updated] (YARN-10094) Add a configuration to support NM overuse in RM

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10094: Attachment: YARN-10094.001.patch > Add a configuration to support NM overuse in RM > --

[jira] [Updated] (YARN-10094) Add configuration to support NM overuse in RM

2020-01-19 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-10094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-10094: Summary: Add configuration to support NM overuse in RM (was: Add a configuration to support NM overuse in

[jira] [Updated] (YARN-7898) [FederationStateStore] Create a proxy chain for FederationStateStore API in the Router

2020-01-19 Thread Minni Mittal (Jira)
[ https://issues.apache.org/jira/browse/YARN-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minni Mittal updated YARN-7898: --- Attachment: YARN-7898.v7.patch > [FederationStateStore] Create a proxy chain for FederationStateStore

[jira] [Moved] (YARN-10095) Fix help message for yarn rmadmin

2020-01-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved HADOOP-16815 to YARN-10095: --- Key: YARN-10095 (was: HADOOP-16815) Project: Hadoop YARN (w

[jira] [Commented] (YARN-10095) Fix help message for yarn rmadmin

2020-01-19 Thread Akira Ajisaka (Jira)
[ https://issues.apache.org/jira/browse/YARN-10095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019272#comment-17019272 ] Akira Ajisaka commented on YARN-10095: -- Thank you for filing the jira. Moved the iss

[jira] [Updated] (YARN-9538) Document scheduler/app activities and REST APIs

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9538: --- Attachment: YARN-9538.004.patch > Document scheduler/app activities and REST APIs > --

[jira] [Commented] (YARN-9538) Document scheduler/app activities and REST APIs

2020-01-19 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17019278#comment-17019278 ] Tao Yang commented on YARN-9538: Thanks [~cheersyang] for the review. Attached v4 patch t