[
https://issues.apache.org/jira/browse/YARN-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16087093#comment-16087093
]
Bibin A Chundatt edited comment on YARN-6825 at 7/14/17 9:29 AM:
-----------------------------------------------------------------
Hi [~rohithsharma]
IIUC this could be handle by configuring the value 80% of (jute buffer size).
# Exception log could occupy space (YARN-6125 Bytes limit is added for
diagnostics message )
# Finish time , priority, queuename can be handle by configuring lesser value
So incombination we should be able handle.
was (Author: bibinchundatt):
Hi [~rohithsharma]
IIUC this could be handle by configuring the value about 80% for 1 MB(jute
buffer size).
# Exception log could occupy space (YARN-6125 Bytes limit is added for
diagnostics message )
# Finish time , priority, queuename can be handle by configuring lesser value
So incombination we should be able handle.
> RM quit due to ApplicationStateData exceed the limit size of znode in zk
> ------------------------------------------------------------------------
>
> Key: YARN-6825
> URL: https://issues.apache.org/jira/browse/YARN-6825
> Project: Hadoop YARN
> Issue Type: Bug
> Components: resourcemanager
> Reporter: Rohith Sharma K S
>
> YARN-5006 fixes this issue by strict validation for ApplicationStateData
> length against 1MB(default max jute buffer) during application submission
> only. There is possibility of thrashing as dead zone was not properly
> defined/taken care.
> But it do not consider scenarios where ApplicationStateData can be increased
> later point of time i.e
> # If app is submitted with less than 1MB during submission, later updated
> like queue name or life time value or priority is changed. The app update
> call will be sent to statestore which cause same issue because
> ApplicationStateData length has increased.
> # Consider there is no app update, but final state are stored in ZK. This
> adds up several fields such finishTime, finalState, finalApplicationState.
> This increases size of ApplicationStateData.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
