lgbo-ustc commented on issue #3351: URL: https://github.com/apache/incubator-gluten/issues/3351#issuecomment-2159955403
> > > How is this solved? @JkSelf @kelvin-qin 。 We also meet this problem > > > ```shell > > > NATIVE_WRITER_CONF="--conf spark.gluten.sql.native.writer.enabled=true > > > --conf spark.files=$SPARK_HOME/jars/gluten.jar > > > --conf spark.driver.extraClassPath=$SPARK_HOME/gluten.jar > > > --conf spark.executor.extraClassPath=./gluten.jar > > > --conf spark.driver.userClassPathFirst=true > > > --conf spark.executor.userClassPathFirst=true > > > " > > > ``` > > > > > > Found the problem. The path configuration spark.driver.extraClassPath is wrong > > @lgbo-ustc Hi, can you post the direct solution under this question? Thank you very much. As I recall it is indeed the relative or absolute path that is causing the problem. add following configure ``` --conf spark.gluten.sql.native.writer.enabled=true --conf spark.files=<your local gluten jar path> --conf spark.driver.extraClassPath=<your local gluten jar path> --conf spark.executor.extraClassPath=./gluten.jar --conf spark.driver.userClassPathFirst=true --conf spark.executor.userClassPathFirst=true ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
