[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650894#comment-16650894 ] Zian Chen commented on YARN-8776: - Still work on refine the patch. Will update initial one later today or

[jira] [Assigned] (YARN-8778) Add Command Line interface to invoke interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8778: --- Assignee: Eric Yang (was: Zian Chen) > Add Command Line interface to invoke interactive docker

[jira] [Commented] (YARN-8778) Add Command Line interface to invoke interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650892#comment-16650892 ] Zian Chen commented on YARN-8778: - Hi [~eyang], sure, please take this one. I'll assign it to you. > Add

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642220#comment-16642220 ] Zian Chen commented on YARN-8777: - +1 for patch 7.  > Container Executor C binary change to execute

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16642219#comment-16642219 ] Zian Chen commented on YARN-8763: - [~eyang], thanks for +1. Could you help me commit this patch? Thanks  

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.005.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Comment Edited] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640482#comment-16640482 ] Zian Chen edited comment on YARN-8763 at 10/6/18 12:01 AM: --- [~eyang] sorry for

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640482#comment-16640482 ] Zian Chen commented on YARN-8763: - [~eyang] sorry for getting back late. I'm curious why

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638734#comment-16638734 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for patch 006. Seems we still have whitespace

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638730#comment-16638730 ] Zian Chen commented on YARN-8763: - [~eyang], just uploaded patch 004, please help review it. Thanks   >

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.004.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16638658#comment-16638658 ] Zian Chen commented on YARN-8763: - Thanks for the comments, Eric, I'll update the patch later today. >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16636543#comment-16636543 ] Zian Chen commented on YARN-8763: - Hi [~eyang], could you help review patch 003? It address comments as we

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.003.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16634486#comment-16634486 ] Zian Chen commented on YARN-8763: - Hi [~eyang] , make sense.  I'll work on patch 003 to address comments &

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16632636#comment-16632636 ] Zian Chen commented on YARN-8763: - Update patch-002 for review. really appreciate the help from [~eyang] 

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763.002.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626601#comment-16626601 ] Zian Chen commented on YARN-8758: - Hi [~sunilg] [~weiweiyagn666], could you help review the patch? Thanks

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8758: Attachment: YARN-8758.001.patch > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626513#comment-16626513 ] Zian Chen commented on YARN-8758: - I'll work on this Jira and provide an initial patch. >

[jira] [Assigned] (YARN-8758) PreemptionMessage when using AMRMClientAsync

[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8758: --- Assignee: Zian Chen > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624007#comment-16624007 ] Zian Chen commented on YARN-8785: - Hi [~simonprewo], thanks for the patch. The patch itself looks good to

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623999#comment-16623999 ] Zian Chen commented on YARN-8777: - Thanks [~eyang] for the work. I'm ok with patch 003. One quick

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622555#comment-16622555 ] Zian Chen commented on YARN-8805: - Thanks [~shaneku...@gmail.com], I'll work on the patch > Automatically

[jira] [Assigned] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8805: --- Assignee: Zian Chen > Automatically convert the launch command to the exec form when using >

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622499#comment-16622499 ] Zian Chen commented on YARN-8805: - Yes, just checked the latest released doc,

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622495#comment-16622495 ] Zian Chen commented on YARN-8785: - Hi [~simonprewo], would you like to work on this Jira and provide a

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622438#comment-16622438 ] Zian Chen commented on YARN-8801: - Thank you [~eyang] > java doc comments in docker-util.h is confusing >

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621350#comment-16621350 ] Zian Chen commented on YARN-8801: - Provide patch for the fix. Don't need to add UTs here. > java doc

[jira] [Updated] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8801: Labels: Docker (was: ) > java doc comments in docker-util.h is confusing >

[jira] [Created] (YARN-8801) java doc comments in docker-util.h is confusing

Zian Chen created YARN-8801: --- Summary: java doc comments in docker-util.h is confusing Key: YARN-8801 URL: https://issues.apache.org/jira/browse/YARN-8801 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-8790) Authentication Filter change to force security check

Zian Chen created YARN-8790: --- Summary: Authentication Filter change to force security check Key: YARN-8790 URL: https://issues.apache.org/jira/browse/YARN-8790 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619569#comment-16619569 ] Zian Chen commented on YARN-8777: - Hi [~eyang], thanks for the patch, some quick suggestions and

[jira] [Resolved] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen resolved YARN-8781. - Resolution: Invalid > back-port YARN-8091 to branch-2.6.4 > --- > >

[jira] [Commented] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616961#comment-16616961 ] Zian Chen commented on YARN-8781: - Close as invalid. > back-port YARN-8091 to branch-2.6.4 >

[jira] [Commented] (YARN-8781) back-port YARN-8091 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616416#comment-16616416 ] Zian Chen commented on YARN-8781: - Rework the YARN 8091 patch to fix conflicts with trunk since a lot of

[jira] [Created] (YARN-8781) back-port YARN-8091 to branch-2.6.4

Zian Chen created YARN-8781: --- Summary: back-port YARN-8091 to branch-2.6.4 Key: YARN-8781 URL: https://issues.apache.org/jira/browse/YARN-8781 Project: Hadoop YARN Issue Type: Bug Affects

[jira] [Updated] (YARN-8780) back-port YARN-8028 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8780: Attachment: YARN-8028-branch-2.6.4-001.patch > back-port YARN-8028 to branch-2.6.4 >

[jira] [Commented] (YARN-8780) back-port YARN-802 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16616409#comment-16616409 ] Zian Chen commented on YARN-8780: - Rework the YARN-8028 patch to fix conflicts with trunk since a lot of

[jira] [Updated] (YARN-8780) back-port YARN-8028 to branch-2.6.4

[ https://issues.apache.org/jira/browse/YARN-8780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8780: Summary: back-port YARN-8028 to branch-2.6.4 (was: back-port YARN-802 to branch-2.6.4) > back-port

[jira] [Created] (YARN-8780) back-port YARN-802 to branch-2.6.4

Zian Chen created YARN-8780: --- Summary: back-port YARN-802 to branch-2.6.4 Key: YARN-8780 URL: https://issues.apache.org/jira/browse/YARN-8780 Project: Hadoop YARN Issue Type: Bug

[jira] [Created] (YARN-8778) Add Command Line interface to invoke interactive docker shell

Zian Chen created YARN-8778: --- Summary: Add Command Line interface to invoke interactive docker shell Key: YARN-8778 URL: https://issues.apache.org/jira/browse/YARN-8778 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8777) Container Executor C binary change to execute interactive docker command

Zian Chen created YARN-8777: --- Summary: Container Executor C binary change to execute interactive docker command Key: YARN-8777 URL: https://issues.apache.org/jira/browse/YARN-8777 Project: Hadoop YARN

[jira] [Created] (YARN-8776) Container Executor change to create stdin/stdout pipeline

Zian Chen created YARN-8776: --- Summary: Container Executor change to create stdin/stdout pipeline Key: YARN-8776 URL: https://issues.apache.org/jira/browse/YARN-8776 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16610186#comment-16610186 ] Zian Chen commented on YARN-8763: - Hi [~eyang], thanks for the detailed suggestions. Make sense. Let me

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609919#comment-16609919 ] Zian Chen commented on YARN-8763: - Hi [~eyang], could you help review the patch? Thanks! > Add WebSocket

[jira] [Updated] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8763: Attachment: YARN-8763-001.patch > Add WebSocket logic to the Node Manager web server to establish servlet >

[jira] [Commented] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

[ https://issues.apache.org/jira/browse/YARN-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609917#comment-16609917 ] Zian Chen commented on YARN-8763: - Provide initial patch for this. > Add WebSocket logic to the Node

[jira] [Created] (YARN-8763) Add WebSocket logic to the Node Manager web server to establish servlet

Zian Chen created YARN-8763: --- Summary: Add WebSocket logic to the Node Manager web server to establish servlet Key: YARN-8763 URL: https://issues.apache.org/jira/browse/YARN-8763 Project: Hadoop YARN

[jira] [Updated] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

[ https://issues.apache.org/jira/browse/YARN-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8762: Attachment: Interactive Docker Shell design doc.pdf > [Umbrella] Support Interactive Docker Shell to

[jira] [Commented] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

[ https://issues.apache.org/jira/browse/YARN-8762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609916#comment-16609916 ] Zian Chen commented on YARN-8762: - Provide design doc for this.  > [Umbrella] Support Interactive Docker

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16609914#comment-16609914 ] Zian Chen commented on YARN-8523: - Offline discussed with Eric and Wangda, this feature involves creating

[jira] [Created] (YARN-8762) [Umbrella] Support Interactive Docker Shell to running Containers

Zian Chen created YARN-8762: --- Summary: [Umbrella] Support Interactive Docker Shell to running Containers Key: YARN-8762 URL: https://issues.apache.org/jira/browse/YARN-8762 Project: Hadoop YARN

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16592307#comment-16592307 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sorry for getting back late. I took some time to run SLS

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588010#comment-16588010 ] Zian Chen commented on YARN-8509: - Fix failed UTs and re-upload the patch > Total pending resource

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.005.patch > Total pending resource calculation in preemption should use user-limit

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.004.patch > Total pending resource calculation in preemption should use user-limit

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16581573#comment-16581573 ] Zian Chen commented on YARN-8509: - Offline discussed with Eric and Wangda, will upload a new patch to

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16578859#comment-16578859 ] Zian Chen commented on YARN-7417: - Hi [~eyang], thanks for the comments. I think we don't need to add

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.003.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Assigned] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8523: --- Assignee: Zian Chen > Interactive docker shell > > > Key:

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576945#comment-16576945 ] Zian Chen commented on YARN-8523: - Make sense. I'll work on provide an initial patch for this idea. Thanks

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576917#comment-16576917 ] Zian Chen commented on YARN-7417: - But looks like we can make AggregatedLogFormat.ContainerLogsReader to

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576900#comment-16576900 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sure, let address these two questions, 1) the summation

[jira] [Comment Edited] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573997#comment-16573997 ] Zian Chen edited comment on YARN-8509 at 8/10/18 9:21 PM: -- Hi Eric, thanks for

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576815#comment-16576815 ] Zian Chen commented on YARN-7417: - Thanks for the review [~eyang], that was my original plan to make it

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock and 

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock We have duplicate code

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: We have duplicate code in current implementation of  IndexedFileAggregatedLogsBlock and  >

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576697#comment-16576697 ] Zian Chen commented on YARN-8523: - Good point, I think we can make this Jira focus on building this

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573997#comment-16573997 ] Zian Chen commented on YARN-8509: - Hi Eric, thanks for the comments. Discussed with Wangda, the patch

[jira] [Commented] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573946#comment-16573946 ] Zian Chen commented on YARN-8523: - [~eyang], thanks for raising this feature. This is very useful for live

[jira] [Comment Edited] (YARN-8523) Interactive docker shell

[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573946#comment-16573946 ] Zian Chen edited comment on YARN-8523 at 8/8/18 10:07 PM: -- [~eyang], thanks for

[jira] [Updated] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Summary: Total pending resource calculation in preemption should use user-limit factor instead of

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570836#comment-16570836 ] Zian Chen commented on YARN-7417: - Update the patch 003 to address the findbugs issue. > re-factory

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570838#comment-16570838 ] Zian Chen commented on YARN-7417: - [~sunilg], could you help review the patch? Thanks > re-factory

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.002.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Commented] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570780#comment-16570780 ] Zian Chen commented on YARN-7089: - Hi [~leftnoteasy], could you help review this patch? Thanks > Mark the

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.001.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568795#comment-16568795 ] Zian Chen commented on YARN-7417: - Thanks [~xgong] for report this issue. I'll work on it and provide

[jira] [Assigned] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-7417: --- Assignee: Zian Chen > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to >

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566490#comment-16566490 ] Zian Chen commented on YARN-8509: - Thanks [~csingh] for the review. The failed UT are not related.  

[jira] [Assigned] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-7089: --- Assignee: Zian Chen (was: Xuan Gong) > Mark the log-aggregation-controller APIs as public >

[jira] [Commented] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565895#comment-16565895 ] Zian Chen commented on YARN-7089: - [~djp] [~xgong], [~rkanter] could you help review the patch? Thanks  

[jira] [Updated] (YARN-7089) Mark the log-aggregation-controller APIs as public

[ https://issues.apache.org/jira/browse/YARN-7089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7089: Attachment: YARN-7089.001.patch > Mark the log-aggregation-controller APIs as public >

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.003.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562513#comment-16562513 ] Zian Chen commented on YARN-8509: - Thanks [~csingh] for reviewing the patch. Fix the javadoc block and

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: (was: YARN-8509.003.patch) > Fix UserLimit calculation for preemption to balance scenario

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.003.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558965#comment-16558965 ] Zian Chen commented on YARN-8522: - [~sunilg], could you help review the latest patch? > Application fails

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558936#comment-16558936 ] Zian Chen commented on YARN-8509: - Update patch fixing failed UTs. > Fix UserLimit calculation for

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.002.patch > Fix UserLimit calculation for preemption to balance scenario after queue

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Description: In LeafQueue#getTotalPendingResourcesConsideringUserLimit, we calculate total pending

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558882#comment-16558882 ] Zian Chen commented on YARN-8509: - talked with [~sunilg], It can go beyond maxCap - usedCap. Because a

[jira] [Updated] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8522: Attachment: YARN-8522.002.patch > Application fails with InvalidResourceRequestException >

[jira] [Commented] (YARN-8522) Application fails with InvalidResourceRequestException

[ https://issues.apache.org/jira/browse/YARN-8522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558870#comment-16558870 ] Zian Chen commented on YARN-8522: - Thanks for the suggestions [~sunilg], Update patch 002. > Application

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554956#comment-16554956 ] Zian Chen commented on YARN-8509: - [~sunilg], I found something interesting while address the failed UT 

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551467#comment-16551467 ] Zian Chen commented on YARN-8509: - [~sunilg], Let me address the failed UTs first. > Fix UserLimit

[jira] [Commented] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551334#comment-16551334 ] Zian Chen commented on YARN-8509: - Upload first patch for review. [~sunilg],could you help review the

[jira] [Updated] (YARN-8509) Fix UserLimit calculation for preemption to balance scenario after queue satisfied

[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8509: Attachment: YARN-8509.001.patch > Fix UserLimit calculation for preemption to balance scenario after queue

  1   2   3   4   >