[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4140: --- Attachment: 0009-YARN-4140.patch Hi [~sunilg] Thnks for review and comments. Have updated

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903217#comment-14903217 ] Anubhav Dhoot commented on YARN-4180: - The test failure looks unrelated. > AMLauncher does not retry

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903246#comment-14903246 ] Vrushali C commented on YARN-4074: -- Chatted with Li offline and decided to file

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903284#comment-14903284 ] Li Lu commented on YARN-4074: - Sure, please go ahead with the current patch. Thanks for the work folks! >

[jira] [Commented] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903285#comment-14903285 ] Li Lu commented on YARN-4200: - Will flip the code quickly when there is no other interference. Right now our

[jira] [Assigned] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

[ https://issues.apache.org/jira/browse/YARN-4200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu reassigned YARN-4200: --- Assignee: Li Lu > Refactor reader classes in storage to nest under hbase specific package name >

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903305#comment-14903305 ] Varun Saxena commented on YARN-4075: [~gtCarrera9], thanks for the review. bq. Maybe we'd like to

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903329#comment-14903329 ] Varun Saxena commented on YARN-4075: I mean "I plan to combine two of the test webservices classes to

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903158#comment-14903158 ] Li Lu commented on YARN-4074: - Sorry I missed your message yesterday... I was thinking about putting those

[jira] [Commented] (YARN-4141) Runtime Application Priority change should not throw exception for applications at finishing states

[ https://issues.apache.org/jira/browse/YARN-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903168#comment-14903168 ] Jason Lowe commented on YARN-4141: -- Thanks for updating the patch. The new constants should be marked

[jira] [Updated] (YARN-4180) AMLauncher does not retry on failures when talking to NM

[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-4180: Attachment: YARN-4180.002.patch Addressed feedback > AMLauncher does not retry on failures when

[jira] [Updated] (YARN-4169) jenkins trunk+java build failed in TestNodeStatusUpdaterForLabels

[ https://issues.apache.org/jira/browse/YARN-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4169: Attachment: YARN-4169.v1.001.patch Hi [~ste...@apache.org], Was able to reproduce this

[jira] [Updated] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mit Desai updated YARN-3975: Attachment: YARN-3975.9.patch Somehow attached a wrong version of patch previously. Attached the patch with

[jira] [Created] (YARN-4200) Refactor reader classes in storage to nest under hbase specific package name

Vrushali C created YARN-4200: Summary: Refactor reader classes in storage to nest under hbase specific package name Key: YARN-4200 URL: https://issues.apache.org/jira/browse/YARN-4200 Project: Hadoop

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903162#comment-14903162 ] Li Lu commented on YARN-4075: - Sorry folks we're a little bit delayed on YARN-4074, but once that is in we can

[jira] [Updated] (YARN-4157) Merge YARN-1197 back to trunk

[ https://issues.apache.org/jira/browse/YARN-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4157: - Attachment: YARN-1197.diff.6.patch Rebased to latest trunk (diff.6) > Merge YARN-1197 back to trunk >

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903342#comment-14903342 ] Li Lu commented on YARN-4075: - Hi [~varun_saxena], thanks for the note! bq. Infact in initial patches in

[jira] [Updated] (YARN-4165) An outstanding container request makes all nodes to be reserved causing all jobs pending

[ https://issues.apache.org/jira/browse/YARN-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-4165: -- Component/s: capacity scheduler > An outstanding container request makes all nodes to be reserved

[jira] [Commented] (YARN-4189) Capacity Scheduler : Improve location preference waiting mechanism

[ https://issues.apache.org/jira/browse/YARN-4189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903125#comment-14903125 ] Wangda Tan commented on YARN-4189: -- [~xinxianyin], I mentioned this in design doc: bq. To avoid

[jira] [Commented] (YARN-4180) AMLauncher does not retry on failures when talking to NM

[ https://issues.apache.org/jira/browse/YARN-4180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903096#comment-14903096 ] Robert Kanter commented on YARN-4180: - +1 after doing those. > AMLauncher does not retry on failures

[jira] [Commented] (YARN-4176) Resync NM nodelabels with RM every x interval for distributed nodelabels

[ https://issues.apache.org/jira/browse/YARN-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903133#comment-14903133 ] Bibin A Chundatt commented on YARN-4176: Hi [~leftnoteasy] Could you please look into this issue

[jira] [Commented] (YARN-4113) RM should respect retry-interval when uses RetryPolicies.RETRY_FOREVER

[ https://issues.apache.org/jira/browse/YARN-4113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903139#comment-14903139 ] Sunil G commented on YARN-4113: --- Thank you [~leftnoteasy] for the review and commit and thank you Karthik for

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903387#comment-14903387 ] Varun Saxena commented on YARN-4000: [~jianhe] bq. actually, I think this will be a problem in regular

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903754#comment-14903754 ] Naganarasimha G R commented on YARN-3367: - Thanks [~gtCarrera9], For looking into this, There were

[jira] [Commented] (YARN-4199) Minimize lock time in LeveldbTimelineStore.discardOldEntities

[ https://issues.apache.org/jira/browse/YARN-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903729#comment-14903729 ] Shiwei Guo commented on YARN-4199: -- Sorry, I havn't noticed

[jira] [Resolved] (YARN-4199) Minimize lock time in LeveldbTimelineStore.discardOldEntities

[ https://issues.apache.org/jira/browse/YARN-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shiwei Guo resolved YARN-4199. -- Resolution: Duplicate > Minimize lock time in LeveldbTimelineStore.discardOldEntities >

[jira] [Commented] (YARN-4157) Merge YARN-1197 back to trunk

[ https://issues.apache.org/jira/browse/YARN-4157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903832#comment-14903832 ] Hadoop QA commented on YARN-4157: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903396#comment-14903396 ] Li Lu commented on YARN-4075: - bq. This can lead to code bloating with similar methods repeating again and

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903374#comment-14903374 ] Hadoop QA commented on YARN-4140: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903363#comment-14903363 ] Varun Saxena commented on YARN-4075: {quote} Or we can have 2 separate REST endpoints, with and without

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903461#comment-14903461 ] Li Lu commented on YARN-3367: - Hi [~Naganarasimha], I'm trying to go over all pending JIRAs for 2928 branch,

[jira] [Commented] (YARN-4169) jenkins trunk+java build failed in TestNodeStatusUpdaterForLabels

[ https://issues.apache.org/jira/browse/YARN-4169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903483#comment-14903483 ] Hadoop QA commented on YARN-4169: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903385#comment-14903385 ] Hadoop QA commented on YARN-3975: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4000) RM crashes with NPE if leaf queue becomes parent queue during restart

[ https://issues.apache.org/jira/browse/YARN-4000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903400#comment-14903400 ] Varun Saxena commented on YARN-4000: bq. Is this the case? I think in current code, RM is still

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903411#comment-14903411 ] Vrushali C commented on YARN-4074: -- Committed patch v8. Thanks [~sjlee0] for the contribution and everyone

[jira] [Commented] (YARN-3367) Replace starting a separate thread for post entity with event loop in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-3367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903527#comment-14903527 ] Li Lu commented on YARN-3367: - Also, I looked at the patch. One general comment is that, the logic of

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903979#comment-14903979 ] Varun Saxena commented on YARN-4075: bq. With proper overloading I don't see significant code

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903893#comment-14903893 ] Naganarasimha G R commented on YARN-1994: - Thanks for the explanation [~arpitagarwal], Even I had

[jira] [Commented] (YARN-3975) WebAppProxyServlet should not redirect to RM page if AHS is enabled

[ https://issues.apache.org/jira/browse/YARN-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903569#comment-14903569 ] Jason Lowe commented on YARN-3975: -- Latest patch looks good to me, however it does not apply cleanly to

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14903614#comment-14903614 ] Arpit Agarwal commented on YARN-1994: - bq. Is it assumed that NM_BIND_HOST is configured to specific IP

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902902#comment-14902902 ] Joep Rottinghuis commented on YARN-4075: Agreed with comments from [~gtCarrera] > [reader REST

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902662#comment-14902662 ] Sunil G commented on YARN-4140: --- Hi [~bibinchundatt] Thanks for updating patch. Some minor nits: 1.

[jira] [Commented] (YARN-4119) Expose the NM bind address as an env, so that AM can make use of it for exposing tracking URL

[ https://issues.apache.org/jira/browse/YARN-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902631#comment-14902631 ] Naganarasimha G R commented on YARN-4119: - Hi [~vvasudev] & [~rohithsharma], While trying to look

[jira] [Commented] (YARN-1994) Expose YARN/MR endpoints on multiple interfaces

[ https://issues.apache.org/jira/browse/YARN-1994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902369#comment-14902369 ] Naganarasimha G R commented on YARN-1994: - Hi [~cwelch] & [~arpitagarwal], I have few doubts for

[jira] [Commented] (YARN-4165) An outstanding container request makes all nodes to be reserved causing all jobs pending

[ https://issues.apache.org/jira/browse/YARN-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902771#comment-14902771 ] Jason Lowe commented on YARN-4165: -- Something must be amiss then, since the capacity scheduler should not

[jira] [Commented] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902756#comment-14902756 ] Hadoop QA commented on YARN-4140: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4141) Runtime Application Priority change should not throw exception for applications at finishing states

[ https://issues.apache.org/jira/browse/YARN-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902503#comment-14902503 ] Sunil G commented on YARN-4141: --- Hi [~jlowe] and [~rohithsharma] Could you please help to check the updated

[jira] [Updated] (YARN-4140) RM container allocation delayed incase of app submitted to Nodelabel partition

[ https://issues.apache.org/jira/browse/YARN-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4140: --- Attachment: 0008-YARN-4140.patch Hi [~leftnoteasy] Could you please review the patch

[jira] [Commented] (YARN-4119) Expose the NM bind address as an env, so that AM can make use of it for exposing tracking URL

[ https://issues.apache.org/jira/browse/YARN-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902709#comment-14902709 ] Naganarasimha G R commented on YARN-4119: - Only problem i can see with the above approach is that,

[jira] [Commented] (YARN-4011) Jobs fail since nm-local-dir not cleaned up when rogue job fills up disk

[ https://issues.apache.org/jira/browse/YARN-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902750#comment-14902750 ] Jason Lowe commented on YARN-4011: -- bq. The mapreduce task can check for BYTES_WRITTEN counter and fail

[jira] [Commented] (YARN-4199) Minimize lock time in LeveldbTimelineStore.discardOldEntities

[ https://issues.apache.org/jira/browse/YARN-4199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902757#comment-14902757 ] Jason Lowe commented on YARN-4199: -- Have you looked at the rolling leveldb implementation from YARN-3448?

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14902808#comment-14902808 ] Varun Saxena commented on YARN-2902: Ok. Then what I will do is NOT wait for completion of running