[jira] [Updated] (YARN-10144) Federation: Add missing FederationClientInterceptor APIs

2024-01-21 Thread Shilun Fan (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shilun Fan updated YARN-10144:
--
Affects Version/s: 3.4.0

> Federation: Add missing FederationClientInterceptor APIs
> 
>
> Key: YARN-10144
> URL: https://issues.apache.org/jira/browse/YARN-10144
> Project: Hadoop YARN
>  Issue Type: Improvement
>  Components: federation
>Affects Versions: 3.4.0
>Reporter: D M Murali Krishna Reddy
>Assignee: Shilun Fan
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.4.0
>
>
> In FederationClientInterceptor, many API's are not Implemented.
>  * getClusterNodes
>  * getQueueInfo
>  * getQueueUserAcls
>  * moveApplicationAcrossQueues
>  * getNewReservation
>  * submitReservation
>  * listReservations
>  * updateReservation
>  * deleteReservation
>  * getNodeToLabels
>  * getLabelsToNodes
>  * getClusterNodeLabels
>  * getApplicationAttemptReport
>  * getApplicationAttempts
>  * getContainerReport
>  * getContainers
>  * getDelegationToken
>  * renewDelegationToken
>  * cancelDelegationToken
>  * failApplicationAttempt
>  * updateApplicationPriority
>  * signalToContainer
>  * updateApplicationTimeouts
>  * getResourceProfiles
>  * getResourceProfile
>  * getResourceTypeInfo
>  * getAttributesToNodes
>  * getClusterNodeAttributes
>  * getNodesToAttributes



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-10144) Federation: Add missing FederationClientInterceptor APIs

2024-01-21 Thread Shilun Fan (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-10144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shilun Fan updated YARN-10144:
--
Target Version/s: 3.4.0

> Federation: Add missing FederationClientInterceptor APIs
> 
>
> Key: YARN-10144
> URL: https://issues.apache.org/jira/browse/YARN-10144
> Project: Hadoop YARN
>  Issue Type: Improvement
>  Components: federation
>Affects Versions: 3.4.0
>Reporter: D M Murali Krishna Reddy
>Assignee: Shilun Fan
>Priority: Major
>  Labels: pull-request-available
> Fix For: 3.4.0
>
>
> In FederationClientInterceptor, many API's are not Implemented.
>  * getClusterNodes
>  * getQueueInfo
>  * getQueueUserAcls
>  * moveApplicationAcrossQueues
>  * getNewReservation
>  * submitReservation
>  * listReservations
>  * updateReservation
>  * deleteReservation
>  * getNodeToLabels
>  * getLabelsToNodes
>  * getClusterNodeLabels
>  * getApplicationAttemptReport
>  * getApplicationAttempts
>  * getContainerReport
>  * getContainers
>  * getDelegationToken
>  * renewDelegationToken
>  * cancelDelegationToken
>  * failApplicationAttempt
>  * updateApplicationPriority
>  * signalToContainer
>  * updateApplicationTimeouts
>  * getResourceProfiles
>  * getResourceProfile
>  * getResourceTypeInfo
>  * getAttributesToNodes
>  * getClusterNodeAttributes
>  * getNodesToAttributes



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809272#comment-17809272
 ] 

ASF GitHub Bot commented on YARN-11649:
---

jchanggg opened a new pull request, #6481:
URL: https://github.com/apache/hadoop/pull/6481

   
   
   
   
   ### Description of PR
   When getNewApplication is called against YARN Router with Federation on, its 
possible we get different maxResourceCapabilities on different calls. This is 
because getNewApplication is called against a random cluster on each call, 
which may return different maxResourceCapability based on the cluster that the 
call is executed on.
   
   ### How was this patch tested?
   Added to interceptor test cases
   
   ### For code changes:
   
   - [ ] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   




> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>  Labels: pull-request-available
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities on different calls. This is 
> because getNewApplication is called against a random cluster on each call, 
> which may return different maxResourceCapability based on the cluster that 
> the call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809269#comment-17809269
 ] 

ASF GitHub Bot commented on YARN-11649:
---

jchanggg closed pull request #6480: YARN-11649. [Federation] Create Override 
for Maximum Resource Capability in getNewApplication
URL: https://github.com/apache/hadoop/pull/6480




> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>  Labels: pull-request-available
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities on different calls. This is 
> because getNewApplication is called against a random cluster on each call, 
> which may return different maxResourceCapability based on the cluster that 
> the call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Created] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread Jeffrey Chang (Jira)
Jeffrey Chang created YARN-11649:


 Summary: YARN Federation getNewApplication returns different 
maxresourcecapability
 Key: YARN-11649
 URL: https://issues.apache.org/jira/browse/YARN-11649
 Project: Hadoop YARN
  Issue Type: Bug
Reporter: Jeffrey Chang
Assignee: Jeffrey Chang


When getNewApplication is called against YARN Router with Federation on, its 
possible we get different maxResourceCapabilities on different calls. This is 
because getNewApplication is called against a random cluster on each call, 
which may return different maxResourceCapability based on the cluster that the 
call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread Jeffrey Chang (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeffrey Chang updated YARN-11649:
-
Description: When getNewApplication is called against YARN Router with 
Federation on, its possible we get different maxResourceCapabilities in its 
response on different calls. This is because getNewApplication is called 
against a random cluster on each call, which may return different 
maxResourceCapability based on the cluster that the call is executed on.  (was: 
When getNewApplication is called against YARN Router with Federation on, its 
possible we get different maxResourceCapabilities on different calls. This is 
because getNewApplication is called against a random cluster on each call, 
which may return different maxResourceCapability based on the cluster that the 
call is executed on.)

> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>  Labels: pull-request-available
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities in its response on 
> different calls. This is because getNewApplication is called against a random 
> cluster on each call, which may return different maxResourceCapability based 
> on the cluster that the call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Commented] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread ASF GitHub Bot (Jira)


[ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17809268#comment-17809268
 ] 

ASF GitHub Bot commented on YARN-11649:
---

jchanggg opened a new pull request, #6480:
URL: https://github.com/apache/hadoop/pull/6480

   
   
   
   
   ### Description of PR
   JIRA: [YARN-11649](https://issues.apache.org/jira/browse/YARN-11649). 
[Router] Create Override for Maximum Resource Capability in getNewApplication
   
   When getNewApplication is called against YARN Router with Federation on, its 
possible we get different maxResourceCapabilities on different calls. This is 
because getNewApplication is called against a random cluster on each call, 
which may return different maxResourceCapability based on the cluster that the 
call is executed on.
   
   
   ### How was this patch tested?
   Via adding test cases
   
   ### For code changes:
   
   - [ ] Does the title or this PR starts with the corresponding JIRA issue id 
(e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the 
endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies 
licensed in a way that is compatible for inclusion under [ASF 
2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, 
`NOTICE-binary` files?
   
   




> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities on different calls. This is 
> because getNewApplication is called against a random cluster on each call, 
> which may return different maxResourceCapability based on the cluster that 
> the call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread ASF GitHub Bot (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

ASF GitHub Bot updated YARN-11649:
--
Labels: pull-request-available  (was: )

> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>  Labels: pull-request-available
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities on different calls. This is 
> because getNewApplication is called against a random cluster on each call, 
> which may return different maxResourceCapability based on the cluster that 
> the call is executed on.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org



[jira] [Updated] (YARN-11649) YARN Federation getNewApplication returns different maxresourcecapability

2024-01-21 Thread Jeffrey Chang (Jira)


 [ 
https://issues.apache.org/jira/browse/YARN-11649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jeffrey Chang updated YARN-11649:
-
Description: When getNewApplication is called against YARN Router with 
Federation on, its possible we get different maxResourceCapabilities in its 
response on different calls. This is because getNewApplication is called 
against a random cluster on each call, which may return different 
maxResourceCapability based on the cluster that the call is executed on. ie in 
response in HTTP 
[https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_New_Application_API]
   (was: When getNewApplication is called against YARN Router with Federation 
on, its possible we get different maxResourceCapabilities in its response on 
different calls. This is because getNewApplication is called against a random 
cluster on each call, which may return different maxResourceCapability based on 
the cluster that the call is executed on.)

> YARN Federation getNewApplication returns different maxresourcecapability
> -
>
> Key: YARN-11649
> URL: https://issues.apache.org/jira/browse/YARN-11649
> Project: Hadoop YARN
>  Issue Type: Bug
>Reporter: Jeffrey Chang
>Assignee: Jeffrey Chang
>Priority: Minor
>  Labels: pull-request-available
>
> When getNewApplication is called against YARN Router with Federation on, its 
> possible we get different maxResourceCapabilities in its response on 
> different calls. This is because getNewApplication is called against a random 
> cluster on each call, which may return different maxResourceCapability based 
> on the cluster that the call is executed on. ie in response in HTTP 
> [https://hadoop.apache.org/docs/stable/hadoop-yarn/hadoop-yarn-site/ResourceManagerRest.html#Cluster_New_Application_API]
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org