zhouyuan commented on code in PR #9229: URL: https://github.com/apache/incubator-gluten/pull/9229#discussion_r2033695756
########## docs/get-started/VeloxGPU.md: ########## @@ -0,0 +1,48 @@ +--- +layout: page +title: Velox GPU +nav_order: 9 +parent: Getting-Started +--- + +# GPU Support in Velox Backend + +This is an experimental feature in velox, so as Gluten. Now it only supports OrderBy operator. + +Velox has several GPU support implementations, Gluten only enables cudf. + +## GPU environment + +It requires to install the cuda 12.8.0, driver and the nvidia-container-toolkit. + +Refers to [start_cudf.sh](https://github.com/apache/incubator-gluten/tree/main/dev/start_cudf.sh) +to set the ``host`` environment and start the container. + +> You may need to reboot after install the GPU driver. + +## GPU implementation + +Invokes [CUDF](https://docs.rapids.ai/api/cudf/stable/libcudf_docs/) API to support the Velox operators. + +Suppose we have a velox PlanNode, convert it to the GPU operator or CPU operator depending on the +config `spark.gluten.sql.columnar.cudf` which decides registering cudf driver adapter or not. + +Besides, config `spark.gluten.debug.enabled` true can print the operator replacement information. + +## Docker images +This docker image contains Spark at env $SPARK_HOME, Gluten at /opt/gluten, take a try if you are interested on it. +The Gluten has been built with Spark3.4. +``` +docker pull apache/gluten:centos-9-jdk8-cudf Review Comment: it looks like this docker image is not ready, I assume this is the image in this docker file: https://github.com/apache/incubator-gluten/pull/9229/files#diff-395a263b6f69bd7ef4991face3666e100acdd60e47f4b28e0737adbbf5fb945a shall we make a pull request with this docker image first, after merge it will be pushed to docker hub -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
