based on that i can answer some as well
4. Python would simply need to add a gpu flag on SystemDSContext, that then specify to use gpu, this should not be complicated to add. ________________________________ From: arnab phani <[email protected]> Sent: Thursday, May 6, 2021 11:53:46 AM To: [email protected] Subject: Re: [DISCUSS][SYSTEMDS-2970] Using SystemDS with GPU docs I can answer a few of the questions. Mark may answer the rest. 1. Yes -gpu flag is the way to go. I am not aware of any other option. 3. NVIDIA CUDA Development Toolkit needs to be installed and set up as well to be able to use gpu with SystemDS. 5. The default precision behavior is double. 6. The default memory allocator is regular cuda. SystemDS config provides an option to use unified memory manager, however, I doubt how robust it is, and even otherwise the default cuda allocator is guarded by our own gpu memory manager, which is a better choice. Regards, Arnab.. On Wed, May 5, 2021 at 2:00 AM Janardhan <[email protected]> wrote: > Hi all, > > I am planning to add GPU docs like [1]. Essentially the document should > answer > the following questions. Please, feel free to add new points or contribute > to > the discussion. thanks. > > 1. What are the ways in which to run SystemDS with gpu? > For example, > with -gpu flag > > spark-submit --jars ./systemds-2.1.0-SNAPSHOT-extra.jar ./SystemDS.jar -f > test.dml -gpu > > 2. What are the CUDNN and CUDA versions supported? > For example, which SDK[2] version to download > > 3. About JCUDA, do we need to download anything or pom.xml will take care > of it? > > 4. How do the python users invoke gpu? > > 5. What is the default precision behaviour (single or double)? > > 6. Default memory allocation - Unified memory[3]? > For example, we use `cuda`[4] > > -- > [1] http://systemds.apache.org/docs/1.2.0/gpu > [2] https://developer.nvidia.com/cuda-downloads > [3] > > https://developer.nvidia.com/blog/unified-memory-cuda-beginners/#:~:text=What%20is%20Unified%20Memory > ? > [4] > > https://github.com/apache/systemds/blob/5af203a001229a6f4608040ed7e558f59ffe937c/conf/SystemDS-config.xml.template#L95 > [SYSTEMDS-2970 > <https://github.com/apache/systemds/blob/5af203a001229a6f4608040ed7e558f59ffe937c/conf/SystemDS-config.xml.template#L95[SYSTEMDS-2970>] > https://issues.apache.org/jira/browse/SYSTEMDS-2970 > > Thank you, > Janardhan >
