jerqi commented on PR #1889: URL: https://github.com/apache/incubator-uniffle/pull/1889#issuecomment-2230258279
> @jerqi Thanks for your documents, in fact I've read this documents before coding. In the beginning, I want to add a limit or behavior to `huge partition`, but I get some main idea from the design of `huge partition` through documents and code, i guess we try to let `huge partitions` take less affect and try to make the job success even encountered some huge partition. > > So I discussed with @rickyma, we need a new concept over `huge partition`, I say it `partition size limit`, it is a hard limit, any partition touch this limit size, the request can not succeed. The main idea of `partition size limit` is `quick-fail` and `protect rss server healthy` I think they are different strategies to address the issues of huge partition. Could we have a unified strategy framework to handle them? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
