brentmjohnson commented on issue #19240: URL: https://github.com/apache/beam/issues/19240#issuecomment-1478495127
Can we expand this description to include appending all supported docker run options as defined here: https://docs.docker.com/engine/reference/commandline/run/#options Personally, I am looking to do something like this for providing gpu device access to the docker container for hardware accelerated workloads (pytorch): ``` docker run --device /dev/dxg --mount type=bind,src=/usr/lib/wsl,dst=/usr/lib/wsl -e LD_LIBRARY_PATH=/usr/lib/wsl/lib k8s-lb:5000/beam_gpu_test:0.0.1 ``` This example seems particularly relevant given the beam team's focus on enhancing the api for AI/ML workloads: https://beam.apache.org/documentation/ml/about-ml/ Unless I am missing something, this lack of support for docker run options basically rules out the incredible flexibility afforded by --environment_type="DOCKER" for any GPU accelerated workloads. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
