Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread John Hubbard
On 2/5/21 7:53 AM, Daniel Vetter wrote: On Fri, Feb 05, 2021 at 11:43:19AM -0400, Jason Gunthorpe wrote: On Fri, Feb 05, 2021 at 04:39:47PM +0100, Daniel Vetter wrote: And again, for slightly older hardware, without pinning to VRAM there is no way to use this solution here for peer-to-peer.

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread Daniel Vetter
On Fri, Feb 05, 2021 at 12:00:03PM -0400, Jason Gunthorpe wrote: > On Fri, Feb 05, 2021 at 04:53:04PM +0100, Daniel Vetter wrote: > > On Fri, Feb 05, 2021 at 11:43:19AM -0400, Jason Gunthorpe wrote: > > > On Fri, Feb 05, 2021 at 04:39:47PM +0100, Daniel Vetter wrote: > > > > > > > > And again,

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread Jason Gunthorpe
On Fri, Feb 05, 2021 at 04:53:04PM +0100, Daniel Vetter wrote: > On Fri, Feb 05, 2021 at 11:43:19AM -0400, Jason Gunthorpe wrote: > > On Fri, Feb 05, 2021 at 04:39:47PM +0100, Daniel Vetter wrote: > > > > > > And again, for slightly older hardware, without pinning to VRAM there is > > > > no way

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread Daniel Vetter
On Fri, Feb 05, 2021 at 11:43:19AM -0400, Jason Gunthorpe wrote: > On Fri, Feb 05, 2021 at 04:39:47PM +0100, Daniel Vetter wrote: > > > > And again, for slightly older hardware, without pinning to VRAM there is > > > no way to use this solution here for peer-to-peer. So I'm glad to see that > > >

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread Jason Gunthorpe
On Fri, Feb 05, 2021 at 04:39:47PM +0100, Daniel Vetter wrote: > > And again, for slightly older hardware, without pinning to VRAM there is > > no way to use this solution here for peer-to-peer. So I'm glad to see that > > so far you're not ruling out the pinning option. > > Since HMM and

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-05 Thread Daniel Vetter
On Thu, Feb 04, 2021 at 11:00:32AM -0800, John Hubbard wrote: > On 2/4/21 10:44 AM, Alex Deucher wrote: > ... > > > > The argument is that vram is a scarce resource, but I don't know if > > > > that is really the case these days. At this point, we often have as > > > > much vram as system ram if

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-04 Thread Jason Gunthorpe
On Thu, Feb 04, 2021 at 08:50:38AM -0500, Alex Deucher wrote: > On Thu, Feb 4, 2021 at 2:48 AM John Hubbard wrote: > > > > On 12/15/20 1:27 PM, Jianxin Xiong wrote: > > > This patch series adds dma-buf importer role to the RDMA driver in > > > attempt to support RDMA using device memory such as

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-04 Thread John Hubbard
On 2/4/21 10:44 AM, Alex Deucher wrote: ... The argument is that vram is a scarce resource, but I don't know if that is really the case these days. At this point, we often have as much vram as system ram if not more. I thought the main argument was that GPU memory could move at any time

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-04 Thread Alex Deucher
On Thu, Feb 4, 2021 at 1:29 PM Jason Gunthorpe wrote: > > On Thu, Feb 04, 2021 at 08:50:38AM -0500, Alex Deucher wrote: > > On Thu, Feb 4, 2021 at 2:48 AM John Hubbard wrote: > > > > > > On 12/15/20 1:27 PM, Jianxin Xiong wrote: > > > > This patch series adds dma-buf importer role to the RDMA

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-04 Thread Alex Deucher
On Thu, Feb 4, 2021 at 2:48 AM John Hubbard wrote: > > On 12/15/20 1:27 PM, Jianxin Xiong wrote: > > This patch series adds dma-buf importer role to the RDMA driver in > > attempt to support RDMA using device memory such as GPU VRAM. Dma-buf is > > chosen for a few reasons: first, the API is

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-02-03 Thread John Hubbard
On 12/15/20 1:27 PM, Jianxin Xiong wrote: This patch series adds dma-buf importer role to the RDMA driver in attempt to support RDMA using device memory such as GPU VRAM. Dma-buf is chosen for a few reasons: first, the API is relatively simple and allows a lot of flexibility in implementing the

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-22 Thread Jason Gunthorpe
On Tue, Dec 15, 2020 at 01:27:12PM -0800, Jianxin Xiong wrote: > Jianxin Xiong (4): > RDMA/umem: Support importing dma-buf as user memory region > RDMA/core: Add device method for registering dma-buf based memory > region > RDMA/uverbs: Add uverbs command for dma-buf based MR

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-13 Thread Yishai Hadas
Koenig Subject: Re: [PATCH v16 0/4] RDMA: Add dma-buf support On Mon, Jan 11, 2021 at 12:44 PM Xiong, Jianxin wrote: -Original Message- From: Jason Gunthorpe Sent: Monday, January 11, 2021 7:43 AM To: Xiong, Jianxin Cc: linux-r...@vger.kernel.org; dri-devel@lists.freedesktop.org; Doug

RE: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-12 Thread Xiong, Jianxin
; > Christian Koenig ; Yishai > Hadas > Subject: Re: [PATCH v16 0/4] RDMA: Add dma-buf support > > On 1/11/2021 7:55 PM, Xiong, Jianxin wrote: > >> -Original Message- > >> From: Alex Deucher > >> Sent: Monday, January 11, 2021 9:47 AM > >> To:

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-11 Thread Jason Gunthorpe
On Mon, Jan 11, 2021 at 03:24:18PM +, Xiong, Jianxin wrote: > Jason, will this series be able to get into 5.12? I was going to ask you where things are after the break? Did everyone agree the userspace stuff is OK now? Is Edward OK with the pyverbs changes, etc Jason

RE: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-11 Thread Xiong, Jianxin
> > To: Xiong, Jianxin > > > Cc: linux-r...@vger.kernel.org; dri-devel@lists.freedesktop.org; > > > Doug Ledford ; Leon Romanovsky > > > ; Sumit Semwal ; Christian > > > Koenig ; Vetter, Daniel > > > > > > Subject: Re: [PATCH v16 0/4] RDMA: Add dma-bu

Re: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-11 Thread Alex Deucher
ug > > Ledford ; Leon Romanovsky > > ; Sumit Semwal ; Christian Koenig > > ; Vetter, Daniel > > > > Subject: Re: [PATCH v16 0/4] RDMA: Add dma-buf support > > > > On Mon, Jan 11, 2021 at 03:24:18PM +, Xiong, Jianxin wrote: > > > Jason, will this se

RE: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-11 Thread Xiong, Jianxin
> > Subject: Re: [PATCH v16 0/4] RDMA: Add dma-buf support > > On Mon, Jan 11, 2021 at 03:24:18PM +, Xiong, Jianxin wrote: > > Jason, will this series be able to get into 5.12? > > I was going to ask you where things are after the break? > > Did ever

RE: [PATCH v16 0/4] RDMA: Add dma-buf support

2021-01-11 Thread Xiong, Jianxin
Jason, will this series be able to get into 5.12? > -Original Message- > From: Xiong, Jianxin > Sent: Tuesday, December 15, 2020 1:27 PM > To: linux-r...@vger.kernel.org; dri-devel@lists.freedesktop.org > Cc: Xiong, Jianxin ; Doug Ledford > ; Jason Gunthorpe ; Leon Romanovsky > ; Sumit