SteNicholas commented on PR #2482: URL: https://github.com/apache/celeborn/pull/2482#issuecomment-2102102034
@mridulm, my deployment experience is that the celeborn client jar is not placed in `jars` directory but placed in HDFS which path is set to `spark.jars` for using `SparkShuffleManager`. The reason why put the celeborn client jar to HDFS is that we need to decouple the celebrity client release from the spark release. Meanwhile, we could not control the user not to do this behavior. This is just internal deployment experience. Please let me know if anything wrong. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
