WeichenXu123 commented on PR #40896: URL: https://github.com/apache/spark/pull/40896#issuecomment-1527643314
> But it is kind of DeveloperApi, our usage pattern is pretty limited. Moreover, it's likely to lead to weird behavior/failure to end users, due to the underlying RDDBarrier limitation. Our xgboost users are already aware of the limitations, it is not an issue. note that currently xgboost library( python package) already uses RDD barrier API, in future we need to adapt xgboost with spark connect mode, this means the SQL side barrier flag should also be an user-facing interface. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
