[
https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15731369#comment-15731369
]
Junping Du commented on YARN-3866:
----------------------------------
Thanks for your additional input, Jian! I totally understand what you mean.
However, we should be clear on some following facts:
1. We released this API for years - it is marked as public and stable since
very early, you can found it even at hadoop 2.4:
https://hadoop.apache.org/docs/r2.4.1/api/index.html. So now we cannot claim
this is not a completed feature and remove it even it never work as expected -
calling some API with no result is one thing, but calling some API with throw
some unhandled exceptions is another thing. The later one could break the
application running.
2. We cannot assume app writer could be very easy to change their applications
to adapt our incompatible changes in 2.8. Some of these applications are
third-party software (no matter open or closed source), and they are already
released to their customers. I cannot imagine one software were using this API
(even by unintentionally) by following our official document and test against
any releases prior to 2.8 (like 2.6 or 2.7) works fine, but when end user
upgrade to 2.8, this software will get stuck. If this happens (although less
likely), Hadoop could get blamed as lacking of API compatibility, and user
could doubt our released APIs as well.
3. As I mentioned above, a public released API is a protocol, no matter we use
it or not, we should figure out a proper way/process to retire it. Yarn
shouldn't surprise its user in such way especially as a such success and mature
software. :)
More thoughts?
> AM-RM protocol changes to support container resizing
> ----------------------------------------------------
>
> Key: YARN-3866
> URL: https://issues.apache.org/jira/browse/YARN-3866
> Project: Hadoop YARN
> Issue Type: Sub-task
> Components: api
> Reporter: MENG DING
> Assignee: MENG DING
> Fix For: 2.8.0, 3.0.0-alpha1
>
> Attachments: YARN-3866-YARN-1197.4.patch, YARN-3866.1.patch,
> YARN-3866.2.patch, YARN-3866.3.patch
>
>
> YARN-1447 and YARN-1448 are outdated.
> This ticket deals with AM-RM Protocol changes to support container resize
> according to the latest design in YARN-1197.
> 1) Add increase/decrease requests in AllocateRequest
> 2) Get approved increase/decrease requests from RM in AllocateResponse
> 3) Add relevant test cases
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
