[RFC PATCH 8/8 v2] IB/mlx5/hmm: enable ODP using HMM v2.

All pieces are in place for ODP (on demand paging) to work using HMM. Add kernel option and final code to enable it. Changed since v1: - Added kernel option in this last patch of the serie. Signed-off-by: Jérôme Glisse --- drivers/infiniband/Kconfig | 10 ++ drivers

[RFC PATCH 4/8 v2] IB/odp/hmm: prepare for HMM code path.

This is a preparatory patch for HMM implementation of ODP (on demand paging). It shuffle codes around that will be share between current ODP implementation and HMM code path. It also convert many #ifdef CONFIG to #if IS_ENABLED(). Signed-off-by: Jérôme Glisse --- drivers/infiniband/core

[RFC PATCH 7/8 v2] IB/mlx5/hmm: add page fault support for ODP on HMM v2.

This patch add HMM specific support for hardware page faulting of user memory region. Changed since v1: - Adapt to HMM page table changes. - Turn some sanity test to BUG_ON(). Signed-off-by: Jérôme Glisse --- drivers/infiniband/hw/mlx5/odp.c | 144 ++- 1

[RFC PATCH 1/8 v2] IB/mlx5: add a new parameter to __mlx_ib_populated_pas for ODP with HMM.

When using HMM for ODP it will be useful to pass the current mirror page table iterator for __mlx_ib_populated_pas() function benefit. Add void parameter for this. Signed-off-by: Jérôme Glisse --- drivers/infiniband/hw/mlx5/mem.c | 8 +--- drivers/infiniband/hw/mlx5/mlx5_ib.h | 2

[RFC PATCH 5/8 v2] IB/odp/hmm: add core infiniband structure and helper for ODP with HMM v3.

: - Adapt to new hmm_mirror lifetime rules. - Fix scan of existing mirror in ib_umem_odp_get(). Changed since v2: - Remove FIXME for empty umem as it is an invalid case. - Fix HMM version of ib_umem_odp_release() Signed-off-by: Jérôme Glisse Signed-off-by: John Hubbard Signed-off

[PATCH 02/15] mmu_notifier: keep track of active invalidation ranges v4

lain how helpers function are suppose to be use. - English syntax fixes. Signed-off-by: Jérôme Glisse Reviewed-by: Rik van Riel Reviewed-by: Haggai Eran --- drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c | 13 ++-- drivers/gpu/drm/i915/i915_gem_userptr.c | 10 +-- drivers/gpu/drm/radeon/radeon

[PATCH 04/15] mmu_notifier: allow range invalidation to exclude a specific mmu_notifier

This patch allow to invalidate a range while excluding call to a specific mmu_notifier which allow for a subsystem to invalidate a range for everyone but itself. Signed-off-by: Jérôme Glisse --- include/linux/mmu_notifier.h | 66 mm/mmu_notifier.c

[PATCH 06/15] HMM: add HMM page table v4.

ult() -> hmm_pt_iter_populate(). - Add hmm_pt_iter_walk() - Remove hmm_pt_iter_next() (useless now). - Code simplification and improved comments. - Fix hmm_pt_fini_directory(). Changed since v3: - Fix hmm_pt_iter_directory_unref_safe(). Signed-off-by: Jérôme Glisse Signed-off-by: Sherry

[PATCH 08/15] HMM: add device page fault support v4.

hmm in hmm_mirror_fault() Changed since v3: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin Kumar --- include/linux/hmm.h | 15 +++ mm/hm

[PATCH 10/15] HMM: use CPU page table during invalidation.

by the mmu_notifier layer. Signed-off-by: Jérôme Glisse --- mm/hmm.c | 53 +++-- 1 file changed, 35 insertions(+), 18 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index f0c3c81..d652233 100644 --- a/mm/hmm.c +++ b/mm/hmm.c @@ -47,9 +47,11

[PATCH 11/15] HMM: add discard range helper (to clear and free resources for a range).

THE HARDWARE WILL NO LONGER ACCESS THE RANGE BECAUSE CALLING THIS HELPER ! Signed-off-by: Jérôme Glisse --- include/linux/hmm.h | 3 +++ mm/hmm.c| 24 2 files changed, 27 insertions(+) diff --git a/include/linux/hmm.h b/include/linux/hmm.h index d819ec9..10e1558

[PATCH 13/15] HMM: DMA map memory on behalf of device driver v2.

table changes. Signed-off-by: Jérôme Glisse --- include/linux/hmm_pt.h | 11 +++ mm/hmm.c | 200 +++-- 2 files changed, 173 insertions(+), 38 deletions(-) diff --git a/include/linux/hmm_pt.h b/include/linux/hmm_pt.h index 4a8beb1..8a59a75

[PATCH 15/15] hmm/dummy: dummy driver for testing and showcasing the HMM API

file. Hence it should not be enabled by default and only people actively developing for hmm should use it. Signed-off-by: Jérôme Glisse --- drivers/char/Kconfig | 9 + drivers/char/Makefile | 1 + drivers/char/hmm_dummy.c | 923

[PATCH 12/15] HMM: add dirty range helper (toggle dirty bit inside mirror page table) v2.

Device driver must properly toggle the dirty inside the mirror page table so dirtyness is properly accounted when core mm code needs to know. Provide a simple helper to toggle that bit for a range of address. Changed since v1: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse

[PATCH 09/15] HMM: add mm page table iterator helpers.

map accross call which fit well with the HMM mirror page table update code. Signed-off-by: Jérôme Glisse --- mm/hmm.c | 95 1 file changed, 95 insertions(+) diff --git a/mm/hmm.c b/mm/hmm.c index 88f7801..f0c3c81 100644 --- a/mm

[PATCH 05/15] HMM: introduce heterogeneous memory management v5.

. - Export mirror ref/unref functions. - English syntax fixes. Changed since v4: - Properly reference existing hmm struct if any. Signed-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin

[PATCH 07/15] HMM: add per mirror page table v4.

-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin Kumar --- include/linux/hmm.h | 83 mm/hmm.c| 218

[PATCH 14/15] HMM: add documentation explaining HMM internals and how to use it.

This add documentation with a high level overview of how HMM works and a more in depth view of how it should be use by device driver writers. Signed-off-by: Jérôme Glisse --- Documentation/vm/hmm.txt | 219 +++ 1 file changed, 219 insertions

[PATCH 03/15] mmu_notifier: pass page pointer to mmu_notifier_invalidate_page() v2

page table. To avoid complex reverse dma mapping lookup just pass along a pointer to the page being invalidated. Changed since v1: - English syntax fixes. Signed-off-by: Jérôme Glisse --- drivers/infiniband/core/umem_odp.c | 1 + drivers/iommu/amd_iommu_v2.c | 1 + drivers/misc/sgi-gru

HMM (Heterogeneous Memory Management) v10

Minor fixes since last post (1), apply on top of 4.2-rc6 done that because conflict in infiniband are harder to solve then conflict with mm tree. Tree with the patchset: git://people.freedesktop.org/~glisse/linux hmm-v10 branch Previous cover letter : HMM (Heterogeneous Memory Management) is

[PATCH 01/15] mmu_notifier: add event information to address invalidation v8

. - Differentiate fork from other case. Changed since v7: - Renamed MMU_HUGE_PAGE_SPLIT to MMU_HUGE_PAGE_SPLIT. - Renamed MMU_ISDIRTY to MMU_CLEAR_SOFT_DIRTY. - Renamed MMU_WRITE_PROTECT to MMU_KSM_WRITE_PROTECT. - English syntax fixes. Signed-off-by: Jérôme Glisse Reviewed-by: Rik van Riel

HMM (Heterogeneous Memory Management) v10

Minor fixes since last post (1), apply on top of 4.2-rc6 done that because conflict in infiniband are harder to solve then conflict with mm tree. Tree with the patchset: git://people.freedesktop.org/~glisse/linux hmm-v10 branch Previous cover letter : HMM (Heterogeneous Memory Management) is

[RFC PATCH 6/8 v2] IB/mlx5/hmm: add mlx5 HMM device initialization and callback v3.

This add the core HMM callback for mlx5 device driver and initialize the HMM device for the mlx5 infiniband device driver. Changed since v1: - Adapt to new hmm_mirror lifetime rules. - HMM_ISDIRTY no longer exist. Changed since v2: - Adapt to HMM page table changes. Signed-off-by: Jérôme

[PATCH 04/15] HMM: add new HMM page table flag (select flag).

When migrating memory the same array for HMM page table entry might be use with several different devices. Add a new select flag so current device driver callback can know which entry are selected for the device. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm_pt.h | 6

[PATCH 05/15] HMM: handle HMM device page table entry on mirror page table fault and update.

When faulting or updating the device page table properly handle the case of device memory entry. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 13 + 1 file changed, 13 insertions(+) diff --git a/mm/hmm.c b/mm/hmm.c index 08c0160..8b1003a 100644 --- a/mm/hmm.c +++ b

[PATCH 07/15] HMM: mm add helper to update page table when migrating memory v2.

migrating. - Fix reverse logic on mm_forbids_zeropage() - Add comment on why we add to lru list new page. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/mm.h | 14 ++ mm/memory.c| 471 + 2 files changed, 485 insertions

[PATCH 07/15] HMM: add per mirror page table v4.

-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb...@nvidia.com Signed-off-by: Jatin Kumar jaku...@nvidia.com --- include/linux

[PATCH 14/15] HMM: add documentation explaining HMM internals and how to use it.

This add documentation with a high level overview of how HMM works and a more in depth view of how it should be use by device driver writers. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- Documentation/vm/hmm.txt | 219 +++ 1 file changed, 219

[PATCH 15/15] hmm/dummy: dummy driver for testing and showcasing the HMM API

file. Hence it should not be enabled by default and only people actively developing for hmm should use it. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/char/Kconfig | 9 + drivers/char/Makefile | 1 + drivers/char/hmm_dummy.c | 923

[PATCH 12/15] HMM: add dirty range helper (toggle dirty bit inside mirror page table) v2.

Device driver must properly toggle the dirty inside the mirror page table so dirtyness is properly accounted when core mm code needs to know. Provide a simple helper to toggle that bit for a range of address. Changed since v1: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse

[PATCH 09/15] HMM: add mm page table iterator helpers.

map accross call which fit well with the HMM mirror page table update code. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 95 1 file changed, 95 insertions(+) diff --git a/mm/hmm.c b/mm/hmm.c index 88f7801..f0c3c81

[PATCH 13/15] HMM: DMA map memory on behalf of device driver v2.

table changes. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm_pt.h | 11 +++ mm/hmm.c | 200 +++-- 2 files changed, 173 insertions(+), 38 deletions(-) diff --git a/include/linux/hmm_pt.h b/include/linux/hmm_pt.h index

[PATCH 11/15] HMM: add discard range helper (to clear and free resources for a range).

THE HARDWARE WILL NO LONGER ACCESS THE RANGE BECAUSE CALLING THIS HELPER ! Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm.h | 3 +++ mm/hmm.c| 24 2 files changed, 27 insertions(+) diff --git a/include/linux/hmm.h b/include/linux/hmm.h index

[PATCH 03/15] mmu_notifier: pass page pointer to mmu_notifier_invalidate_page() v2

page table. To avoid complex reverse dma mapping lookup just pass along a pointer to the page being invalidated. Changed since v1: - English syntax fixes. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/core/umem_odp.c | 1 + drivers/iommu/amd_iommu_v2.c | 1

[PATCH 05/15] HMM: introduce heterogeneous memory management v5.

. - Export mirror ref/unref functions. - English syntax fixes. Changed since v4: - Properly reference existing hmm struct if any. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove

[PATCH 09/15] HMM: allow to get pointer to spinlock protecting a directory.

Several use case for getting pointer to spinlock protecting a directory. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm_pt.h | 25 + 1 file changed, 25 insertions(+) diff --git a/include/linux/hmm_pt.h b/include/linux/hmm_pt.h index f745d6c

[PATCH 13/15] HMM: CPU page fault on migrated memory.

When CPU try to access memory that have been migrated to device memory we have to copy it back to system memory. This patch implement the CPU page fault handler for special HMM pte swap entry. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 54

[PATCH 06/15] HMM: mm add helper to update page table when migrating memory back v2.

change along the way. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/mm.h | 12 +++ mm/memory.c| 257 + 2 files changed, 269 insertions(+) diff --git a/include/linux/mm.h b/include/linux/mm.h index 580fe65

[PATCH 15/15] HMM/dummy: add fake device memory to dummy HMM device driver.

This patch add fake device memory by simply using regular system memory page and pretending they are not accessible by the CPU directly. This serve to showcase how migration to device memory can be impemented inside a real device driver. Signed-off-by: Jérôme Glisse jgli...@redhat.com

[PATCH 11/15] HMM: add helpers for migration back to system memory v3.

page table changes. - Fix bug in migration failure code path. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb

[PATCH 12/15] HMM: fork copy migrated memory into system memory for child process.

When forking if process being fork had any memory migrated to some device memory, we need to make a system copy for the child process. Latter patches can revisit this and use the same COW semantic for device memory. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 38

[PATCH 08/15] HMM: add device page fault support v4.

in hmm_mirror_fault() Changed since v3: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb

[PATCH 06/15] HMM: add HMM page table v4.

() - hmm_pt_iter_populate(). - Add hmm_pt_iter_walk() - Remove hmm_pt_iter_next() (useless now). - Code simplification and improved comments. - Fix hmm_pt_fini_directory(). Changed since v3: - Fix hmm_pt_iter_directory_unref_safe(). Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off

[PATCH 00/15] HMM anonymous memory migration.

Minor fixes since last post (1), apply on top of rc6 done that because conflict in infiniband are harder to solve then conflict with mm tree. Tree with the patchset: git://people.freedesktop.org/~glisse/linux hmm-v10 branch This part of the patchset implement anonymous memory migration. It

[PATCH 02/15] HMM: add special swap filetype for memory migrated to device v2.

and hooks HMM helpers functions inside the page fault and fork code path. Changed since v1: - Fix name when of HMM CPU page fault function. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off

[PATCH 01/15] fork: pass the dst vma to copy_page_range() and its sub-functions.

with HMM will have to copy migrated page on fork. We do not expect this to be a common or advised thing to do so we resort to the simpler solution of allocating new page. If this kind of usage turns out to be important we will revisit way to achieve COW even for remote memory. Signed-off-by: Jérôme

[PATCH 03/15] HMM: add new HMM page table flag (valid device memory).

For memory migrated to device we need a new type of memory entry. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb

[RFC PATCH 1/8 v2] IB/mlx5: add a new parameter to __mlx_ib_populated_pas for ODP with HMM.

When using HMM for ODP it will be useful to pass the current mirror page table iterator for __mlx_ib_populated_pas() function benefit. Add void parameter for this. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/hw/mlx5/mem.c | 8 +--- drivers/infiniband/hw/mlx5

[RFC PATCH 5/8 v2] IB/odp/hmm: add core infiniband structure and helper for ODP with HMM v3.

: - Adapt to new hmm_mirror lifetime rules. - Fix scan of existing mirror in ib_umem_odp_get(). Changed since v2: - Remove FIXME for empty umem as it is an invalid case. - Fix HMM version of ib_umem_odp_release() Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: John Hubbard

[PATCH 02/15] mmu_notifier: keep track of active invalidation ranges v4

are suppose to be use. - English syntax fixes. Signed-off-by: Jérôme Glisse jgli...@redhat.com Reviewed-by: Rik van Riel r...@redhat.com Reviewed-by: Haggai Eran hagg...@mellanox.com --- drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c | 13 ++-- drivers/gpu/drm/i915/i915_gem_userptr.c | 10 +-- drivers

[PATCH 10/15] HMM: split DMA mapping function in two.

To be able to reuse the DMA mapping logic, split it in two functions. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 120 ++- 1 file changed, 65 insertions(+), 55 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index

[PATCH 14/15] HMM: add mirror fault support for system to device memory migration v3.

for migration, calling mm_hmm_migrate_cleanup() is wrong. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb...@nvidia.com

[PATCH 08/15] HMM: new callback for copying memory from and to device memory v2.

From: Jerome Glisse jgli...@redhat.com This patch only adds the new callback device driver must implement to copy memory from and to device memory. Changed since v1: - Pass down the vma to the copy function. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche

[PATCH 04/15] mmu_notifier: allow range invalidation to exclude a specific mmu_notifier

This patch allow to invalidate a range while excluding call to a specific mmu_notifier which allow for a subsystem to invalidate a range for everyone but itself. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/mmu_notifier.h | 66 mm

[PATCH 01/15] mmu_notifier: add event information to address invalidation v8

. - Differentiate fork from other case. Changed since v7: - Renamed MMU_HUGE_PAGE_SPLIT to MMU_HUGE_PAGE_SPLIT. - Renamed MMU_ISDIRTY to MMU_CLEAR_SOFT_DIRTY. - Renamed MMU_WRITE_PROTECT to MMU_KSM_WRITE_PROTECT. - English syntax fixes. Signed-off-by: Jérôme Glisse jgli...@redhat.com Reviewed

[RFC PATCH 8/8 v2] IB/mlx5/hmm: enable ODP using HMM v2.

All pieces are in place for ODP (on demand paging) to work using HMM. Add kernel option and final code to enable it. Changed since v1: - Added kernel option in this last patch of the serie. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/Kconfig | 10

[RFC PATCH 4/8 v2] IB/odp/hmm: prepare for HMM code path.

This is a preparatory patch for HMM implementation of ODP (on demand paging). It shuffle codes around that will be share between current ODP implementation and HMM code path. It also convert many #ifdef CONFIG to #if IS_ENABLED(). Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers

[RFC PATCH 7/8 v2] IB/mlx5/hmm: add page fault support for ODP on HMM v2.

This patch add HMM specific support for hardware page faulting of user memory region. Changed since v1: - Adapt to HMM page table changes. - Turn some sanity test to BUG_ON(). Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/hw/mlx5/odp.c | 144

[PATCH 10/15] HMM: use CPU page table during invalidation.

by using the page passed by the mmu_notifier layer. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 53 +++-- 1 file changed, 35 insertions(+), 18 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index f0c3c81..d652233 100644 --- a/mm/hmm.c

[RFC PATCH 2/8 v2] IB/mlx5: add a new parameter to mlx5_ib_update_mtt() for ODP with HMM.

When using HMM for ODP it will be useful to pass the current mirror page table iterator for mlx5_ib_update_mtt() function benefit. Add void parameter for this. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/hw/mlx5/mlx5_ib.h | 2 +- drivers/infiniband/hw/mlx5/mr.c

[RFC PATCH 0/8 v2] Implement ODP using HMM v2

Posting just for comment, still waiting on HMM to be accepted before this patchset can be considered for inclusion. This patchset implement the on demand paging feature using HMM. It depends on the HMM patchset v10 (previous post (1)). Long term plan is to replace ODP with HMM allowing to share

[RFC PATCH 3/8 v2] IB/odp: export rbt_ib_umem_for_each_in_range()

The mlx5 driver will need this function for its driver specific bit of ODP (on demand paging) on HMM (Heterogeneous Memory Management). Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/infiniband/core/umem_rbtree.c | 1 + 1 file changed, 1 insertion(+) diff --git a/drivers/infiniband

[PATCH 2/8] IB/mlx5: add a new parameter to mlx5_ib_update_mtt() for ODP with HMM.

When using HMM for ODP it will be useful to pass the current mirror page table iterator for mlx5_ib_update_mtt() function benefit. Add void parameter for this. Signed-off-by: Jérôme Glisse --- drivers/infiniband/hw/mlx5/mlx5_ib.h | 2 +- drivers/infiniband/hw/mlx5/mr.c | 4 ++-- drivers

[PATCH 4/8] IB/odp/hmm: add new kernel option to use HMM for ODP.

This is a preparatory patch for HMM implementation of ODP (on demand paging). It introduce a new configure option and add proper build time conditional code section. Enabling INFINIBAND_ON_DEMAND_PAGING_HMM will result in build error with this patch. Signed-off-by: Jérôme Glisse --- drivers

[PATCH 7/8] IB/mlx5/hmm: add page fault support for ODP on HMM v2.

This patch add HMM specific support for hardware page faulting of user memory region. Changed since v1: - Adapt to HMM page table changes. - Turn some sanity test to BUG_ON(). Signed-off-by: Jérôme Glisse --- drivers/infiniband/hw/mlx5/odp.c | 144 ++- 1

[PATCH 6/8] IB/mlx5/hmm: add mlx5 HMM device initialization and callback v3.

This add the core HMM callback for mlx5 device driver and initialize the HMM device for the mlx5 infiniband device driver. Changed since v1: - Adapt to new hmm_mirror lifetime rules. - HMM_ISDIRTY no longer exist. Changed since v2: - Adapt to HMM page table changes. Signed-off-by: Jérôme

[PATCH 5/8] IB/odp/hmm: add core infiniband structure and helper for ODP with HMM v2.

: - Adapt to new hmm_mirror lifetime rules. - Fix scan of existing mirror in ib_umem_odp_get(). Signed-off-by: Jérôme Glisse Signed-off-by: John Hubbard Signed-off-by: Haggai Eran --- drivers/infiniband/core/umem_odp.c| 150 +- drivers/infiniband/core

[PATCH 3/8] IB/odp: export rbt_ib_umem_for_each_in_range()

The mlx5 driver will need this function for its driver specific bit of ODP (on demand paging) on HMM (Heterogeneous Memory Management). Signed-off-by: Jérôme Glisse --- drivers/infiniband/core/umem_rbtree.c | 1 + 1 file changed, 1 insertion(+) diff --git a/drivers/infiniband/core

[PATCH 8/8] IB/mlx5/hmm: enable ODP using HMM.

All pieces are in place for ODP (on demand paging) to work using HMM. Signed-off-by: Jérôme Glisse --- drivers/infiniband/core/uverbs_cmd.c | 4 drivers/infiniband/hw/mlx5/main.c| 5 - 2 files changed, 4 insertions(+), 5 deletions(-) diff --git a/drivers/infiniband/core

[PATCH 1/8] IB/mlx5: add a new parameter to __mlx_ib_populated_pas for ODP with HMM.

When using HMM for ODP it will be useful to pass the current mirror page table iterator for __mlx_ib_populated_pas() function benefit. Add void parameter for this. Signed-off-by: Jérôme Glisse --- drivers/infiniband/hw/mlx5/mem.c | 8 +--- drivers/infiniband/hw/mlx5/mlx5_ib.h | 2

[PATCH 0/8] Add ODP support using HMM

This patchset implement the on demand paging feature using HMM. It depends on the HMM patchset v9 (previous post (1)). Long term plan is to replace ODP with HMM allowing to share same code infrastructure accross different class of devices. HMM (Heterogeneous Memory Management) is an helper layer

[PATCH 02/15] mmu_notifier: keep track of active invalidation ranges v4

lain how helpers function are suppose to be use. - English syntax fixes. Signed-off-by: Jérôme Glisse Reviewed-by: Rik van Riel Reviewed-by: Haggai Eran --- drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c | 13 ++-- drivers/gpu/drm/i915/i915_gem_userptr.c | 10 +-- drivers/gpu/drm/radeon/radeon

[PATCH 01/15] mmu_notifier: add event information to address invalidation v8

. - Differentiate fork from other case. Changed since v7: - Renamed MMU_HUGE_PAGE_SPLIT to MMU_HUGE_PAGE_SPLIT. - Renamed MMU_ISDIRTY to MMU_CLEAR_SOFT_DIRTY. - Renamed MMU_WRITE_PROTECT to MMU_KSM_WRITE_PROTECT. - English syntax fixes. Signed-off-by: Jérôme Glisse Reviewed-by: Rik van Riel

[PATCH 04/15] mmu_notifier: allow range invalidation to exclude a specific mmu_notifier

This patch allow to invalidate a range while excluding call to a specific mmu_notifier which allow for a subsystem to invalidate a range for everyone but itself. Signed-off-by: Jérôme Glisse --- include/linux/mmu_notifier.h | 66 mm/mmu_notifier.c

[PATCH 03/15] mmu_notifier: pass page pointer to mmu_notifier_invalidate_page() v2

page table. To avoid complex reverse dma mapping lookup just pass along a pointer to the page being invalidated. Changed since v1: - English syntax fixes. Signed-off-by: Jérôme Glisse --- drivers/infiniband/core/umem_odp.c | 1 + drivers/iommu/amd_iommu_v2.c | 1 + drivers/misc/sgi-gru

[PATCH 07/15] HMM: add per mirror page table v4.

-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin Kumar --- include/linux/hmm.h | 83 mm/hmm.c| 218

[PATCH 10/15] HMM: use CPU page table during invalidation.

by the mmu_notifier layer. Signed-off-by: Jérôme Glisse --- mm/hmm.c | 53 +++-- 1 file changed, 35 insertions(+), 18 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index 826080b..0ecc3b0 100644 --- a/mm/hmm.c +++ b/mm/hmm.c @@ -47,9 +47,11

[PATCH 15/15] hmm/dummy: dummy driver for testing and showcasing the HMM API

file. Hence it should not be enabled by default and only people actively developing for hmm should use it. Signed-off-by: Jérôme Glisse --- drivers/char/Kconfig | 9 + drivers/char/Makefile | 1 + drivers/char/hmm_dummy.c | 925

[PATCH 08/15] HMM: add device page fault support v4.

hmm in hmm_mirror_fault() Changed since v3: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin Kumar --- include/linux/hmm.h | 15 +++ mm/hm

[PATCH 14/15] HMM: add documentation explaining HMM internals and how to use it.

This add documentation with a high level overview of how HMM works and a more in depth view of how it should be use by device driver writers. Signed-off-by: Jérôme Glisse --- Documentation/vm/hmm.txt | 219 +++ 1 file changed, 219 insertions

[PATCH 12/15] HMM: add dirty range helper (toggle dirty bit inside mirror page table) v2.

Device driver must properly toggle the dirty inside the mirror page table so dirtyness is properly accounted when core mm code needs to know. Provide a simple helper to toggle that bit for a range of address. Changed since v1: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse

[PATCH 09/15] HMM: add mm page table iterator helpers.

map accross call which fit well with the HMM mirror page table update code. Signed-off-by: Jérôme Glisse --- mm/hmm.c | 95 1 file changed, 95 insertions(+) diff --git a/mm/hmm.c b/mm/hmm.c index a9e3dc5..826080b 100644 --- a/mm

[PATCH 13/15] HMM: DMA map memory on behalf of device driver v2.

table changes. Signed-off-by: Jérôme Glisse --- include/linux/hmm_pt.h | 11 +++ mm/hmm.c | 200 +++-- 2 files changed, 173 insertions(+), 38 deletions(-) diff --git a/include/linux/hmm_pt.h b/include/linux/hmm_pt.h index 4a8beb1..8a59a75

[PATCH 05/15] HMM: introduce heterogeneous memory management v4.

. - Export mirror ref/unref functions. - English syntax fixes. Signed-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hairgrove Signed-off-by: John Hubbard Signed-off-by: Jatin Kumar --- MAINTAINERS | 7 + include/linux/hmm.h

[PATCH 11/15] HMM: add discard range helper (to clear and free resources for a range).

THE HARDWARE WILL NO LONGER ACCESS THE RANGE BECAUSE CALLING THIS HELPER ! Signed-off-by: Jérôme Glisse --- include/linux/hmm.h | 3 +++ mm/hmm.c| 24 2 files changed, 27 insertions(+) diff --git a/include/linux/hmm.h b/include/linux/hmm.h index d819ec9..10e1558

[PATCH 06/15] HMM: add HMM page table v3.

ult() -> hmm_pt_iter_populate(). - Add hmm_pt_iter_walk() - Remove hmm_pt_iter_next() (useless now). - Code simplification and improved comments. - Fix hmm_pt_fini_directory(). Signed-off-by: Jérôme Glisse Signed-off-by: Sherry Cheung Signed-off-by: Subhash Gutti Signed-off-by: Mark Hai

[PATCH 00/15] HMM (Heterogeneous Memory Management) v9

Not much changed since last post (1), i did incorporate comments i got so far, fixed couple bugs here and there and simplified the HMM page table code. I am splitting the patchset into 3 parts. The first part has the core of HMM and is enough for device that do not care about memory migration. The

[PATCH 11/15] HMM: add discard range helper (to clear and free resources for a range).

THE HARDWARE WILL NO LONGER ACCESS THE RANGE BECAUSE CALLING THIS HELPER ! Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm.h | 3 +++ mm/hmm.c| 24 2 files changed, 27 insertions(+) diff --git a/include/linux/hmm.h b/include/linux/hmm.h index

[PATCH 06/15] HMM: add HMM page table v3.

() - hmm_pt_iter_populate(). - Add hmm_pt_iter_walk() - Remove hmm_pt_iter_next() (useless now). - Code simplification and improved comments. - Fix hmm_pt_fini_directory(). Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti

[PATCH 05/15] HMM: introduce heterogeneous memory management v4.

. - Export mirror ref/unref functions. - English syntax fixes. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb...@nvidia.com

[PATCH 08/15] HMM: add device page fault support v4.

in hmm_mirror_fault() Changed since v3: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb

[PATCH 14/15] HMM: add documentation explaining HMM internals and how to use it.

This add documentation with a high level overview of how HMM works and a more in depth view of how it should be use by device driver writers. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- Documentation/vm/hmm.txt | 219 +++ 1 file changed, 219

[PATCH 12/15] HMM: add dirty range helper (toggle dirty bit inside mirror page table) v2.

Device driver must properly toggle the dirty inside the mirror page table so dirtyness is properly accounted when core mm code needs to know. Provide a simple helper to toggle that bit for a range of address. Changed since v1: - Adapt to HMM page table changes. Signed-off-by: Jérôme Glisse

[PATCH 00/15] HMM (Heterogeneous Memory Management) v9

Not much changed since last post (1), i did incorporate comments i got so far, fixed couple bugs here and there and simplified the HMM page table code. I am splitting the patchset into 3 parts. The first part has the core of HMM and is enough for device that do not care about memory migration. The

[PATCH 09/15] HMM: add mm page table iterator helpers.

map accross call which fit well with the HMM mirror page table update code. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 95 1 file changed, 95 insertions(+) diff --git a/mm/hmm.c b/mm/hmm.c index a9e3dc5..826080b

[PATCH 13/15] HMM: DMA map memory on behalf of device driver v2.

table changes. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/hmm_pt.h | 11 +++ mm/hmm.c | 200 +++-- 2 files changed, 173 insertions(+), 38 deletions(-) diff --git a/include/linux/hmm_pt.h b/include/linux/hmm_pt.h index

[PATCH 15/15] hmm/dummy: dummy driver for testing and showcasing the HMM API

file. Hence it should not be enabled by default and only people actively developing for hmm should use it. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- drivers/char/Kconfig | 9 + drivers/char/Makefile | 1 + drivers/char/hmm_dummy.c | 925

[PATCH 07/15] HMM: add per mirror page table v4.

-off-by: Jérôme Glisse jgli...@redhat.com Signed-off-by: Sherry Cheung sche...@nvidia.com Signed-off-by: Subhash Gutti sgu...@nvidia.com Signed-off-by: Mark Hairgrove mhairgr...@nvidia.com Signed-off-by: John Hubbard jhubb...@nvidia.com Signed-off-by: Jatin Kumar jaku...@nvidia.com --- include/linux

[PATCH 10/15] HMM: use CPU page table during invalidation.

by using the page passed by the mmu_notifier layer. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- mm/hmm.c | 53 +++-- 1 file changed, 35 insertions(+), 18 deletions(-) diff --git a/mm/hmm.c b/mm/hmm.c index 826080b..0ecc3b0 100644 --- a/mm/hmm.c

[PATCH 04/15] mmu_notifier: allow range invalidation to exclude a specific mmu_notifier

This patch allow to invalidate a range while excluding call to a specific mmu_notifier which allow for a subsystem to invalidate a range for everyone but itself. Signed-off-by: Jérôme Glisse jgli...@redhat.com --- include/linux/mmu_notifier.h | 66 mm

<    3   4   5   6   7   8   9   >