Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-26 Thread Dominic Meiser
On 09/22/2014 01:47 PM, Ashwin Srinath wrote: Dominic, I second a request for such a branch. Thanks, Ashwin Hi Ashwin, I put together a branch with our GPU bug fixes: https://github.com/Tech-XCorp/petsc/ There is only one branch in this repo: gpu-master. Be aware that this branch is even

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-26 Thread Ashwin Srinath
Thanks Dominic! I'll give you some feedback soon! On Fri, Sep 26, 2014 at 11:16 AM, Dominic Meiser dmei...@txcorp.com wrote: On 09/22/2014 01:47 PM, Ashwin Srinath wrote: Dominic, I second a request for such a branch. Thanks, Ashwin Hi Ashwin, I put together a branch with our GPU bug

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-23 Thread Dominic Meiser
Hi Karli, PR #178 gets you most of the way. src/ksp/ksp/examples/tests/ex32.c uses DMDA's which require a few additional fixes. I haven't opened a pull request for these yet but I will do that before Thursday. Regarding the rebase, wouldn't it be preferable to just resolve the conflicts in

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-23 Thread Karl Rupp
Hi Dominic, PR #178 gets you most of the way. src/ksp/ksp/examples/tests/ex32.c uses DMDA's which require a few additional fixes. I haven't opened a pull request for these yet but I will do that before Thursday. Regarding the rebase, wouldn't it be preferable to just resolve the conflicts in

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-23 Thread Dominic Meiser
On 09/23/2014 01:45 PM, Karl Rupp wrote: Hi Dominic, PR #178 gets you most of the way. src/ksp/ksp/examples/tests/ex32.c uses DMDA's which require a few additional fixes. I haven't opened a pull request for these yet but I will do that before Thursday. Regarding the rebase, wouldn't it be

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-23 Thread Dominic Meiser
On 09/23/2014 01:45 PM, Karl Rupp wrote: Hi Dominic, PR #178 gets you most of the way. src/ksp/ksp/examples/tests/ex32.c uses DMDA's which require a few additional fixes. I haven't opened a pull request for these yet but I will do that before Thursday. Regarding the rebase, wouldn't it be

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-22 Thread Karl Rupp
Hi, I am new to PETSc and trying to determine if GPU speedup is possible with the 3D Poisson solvers. I configured 2 copies of 'petsc-master' on a standalone machine, one with CUDA toolkit 5.0 and one without (both without MPI): Machine: HP Z820 Workstation, Redhat Enterprise Linux 5.0 CPU:

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-22 Thread Dominic Meiser
On 09/22/2014 12:57 PM, Chung Shen wrote: Dear PETSc Users, I am new to PETSc and trying to determine if GPU speedup is possible with the 3D Poisson solvers. I configured 2 copies of 'petsc-master' on a standalone machine, one with CUDA toolkit 5.0 and one without (both without MPI): Machine:

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-22 Thread Ashwin Srinath
Dominic, I second a request for such a branch. Thanks, Ashwin On Mon, Sep 22, 2014 at 3:38 PM, Dominic Meiser dmei...@txcorp.com wrote: On 09/22/2014 12:57 PM, Chung Shen wrote: Dear PETSc Users, I am new to PETSc and trying to determine if GPU speedup is possible with the 3D Poisson

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-22 Thread Karl Rupp
Hi Dominic, I've got some time available at the end of this week for a merge to next. Is there anything other than PR #178 needed? It currently shows some conflicts, so is there any chance to rebase it on ~Thursday? Best regards, Karli On 09/22/2014 09:38 PM, Dominic Meiser wrote: On

Re: [petsc-users] GPU speedup in Poisson solvers

2014-09-22 Thread Jed Brown
Dominic Meiser dmei...@txcorp.com writes: - To get reliable timing you should configure PETSc without debugging (i.e. --with-debugging=no) - The ILU preconditioning in your GPU benchmark is done on the CPU. The host-device data transfers are killing performance. Can you try to run with the