Re: dm: enable opt-out of device-mapper dax support

2017-08-01 Thread Dan Williams
On Tue, Aug 1, 2017 at 2:04 PM, Bart Van Assche <bart.vanass...@wdc.com> wrote: > On Tue, 2017-08-01 at 13:59 -0700, Dan Williams wrote: >> On Tue, Aug 1, 2017 at 12:45 PM, Dan Williams <dan.j.willi...@intel.com> >> wrote: >> > On Tue, Aug 1, 2017 at 12:02

Re: dm: enable opt-out of device-mapper dax support

2017-08-01 Thread Dan Williams
On Tue, Aug 1, 2017 at 12:45 PM, Dan Williams <dan.j.willi...@intel.com> wrote: > On Tue, Aug 1, 2017 at 12:02 PM, Mike Snitzer <snit...@redhat.com> wrote: >> On Tue, Aug 01 2017 at 2:12pm -0400, >> Dan Williams <dan.j.willi...@intel.com> wrote: >> >>&

[PATCH v2] dm: allow device-mapper to operate without dax support

2017-08-01 Thread Dan Williams
: Alasdair Kergon <a...@redhat.com> Cc: Mike Snitzer <snit...@redhat.com> Reported-by: Bart Van Assche <bart.vanass...@wdc.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/md/Kconfig |1 - drivers/md/dm-linear.c |6 ++ drivers/md/dm-stripe.c |

Re: dm: enable opt-out of device-mapper dax support

2017-08-01 Thread Dan Williams
On Tue, Aug 1, 2017 at 12:02 PM, Mike Snitzer <snit...@redhat.com> wrote: > On Tue, Aug 01 2017 at 2:12pm -0400, > Dan Williams <dan.j.willi...@intel.com> wrote: > >> Now that dax is no longer a default property of a block-device, i.e. >> ->direct_access()

[PATCH v2 3/5] fs, xfs: introduce FALLOC_FL_UNSEAL_BLOCK_MAP

2017-08-03 Thread Dan Williams
<h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Signed-off-by: Dan Williams <dan.j.will

[PATCH v2 5/5] xfs: toggle XFS_DIFLAG2_IOMAP_IMMUTABLE in response to fallocate

2017-08-03 Thread Dan Williams
Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.

[PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-03 Thread Dan Williams
31 [5]: https://lkml.org/lkml/2017/6/20/49 [6]: https://www.spinics.net/lists/linux-xfs/msg07871.html --- Dan Williams (5): fs, xfs: introduce S_IOMAP_IMMUTABLE fs, xfs: introduce FALLOC_FL_SEAL_BLOCK_MAP fs, xfs: introduce FALLOC_FL_UNSEAL_BLOCK_MAP xfs: introduce XFS_DIFLAG2_IO

[PATCH v2 2/5] fs, xfs: introduce FALLOC_FL_SEAL_BLOCK_MAP

2017-08-03 Thread Dan Williams
gested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- fs/open.c | 11 + fs/xfs/xfs_bmap_util.c | 101 +++ fs/xfs/xfs_bmap_util.h |2 + fs/x

[PATCH v2 1/5] fs, xfs: introduce S_IOMAP_IMMUTABLE

2017-08-03 Thread Dan Williams
h Hellwig <h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.j

[PATCH v2 4/5] xfs: introduce XFS_DIFLAG2_IOMAP_IMMUTABLE

2017-08-03 Thread Dan Williams
h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- fs/xfs/libxfs/xfs_format.h |5

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-03 Thread Dan Williams
[ adding linux-api to the cover letter for notification, will send the full set to linux-api for v3 ] On Thu, Aug 3, 2017 at 7:28 PM, Dan Williams <dan.j.willi...@intel.com> wrote: > Changes since v1 [1]: > * Add IS_IOMAP_IMMUTABLE() checks to xfs ioctl paths that perform block >

[4.9-stable PATCH] device-dax: fix sysfs duplicate warnings

2017-08-03 Thread Dan Williams
com> Cc: <sta...@vger.kernel.org> Reported-by: Dariusz Dokupil <dariusz.doku...@intel.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/dax/dax.c | 24 drivers/dax/dax.h |2 +- drivers/dax/pmem.c | 12 +++- 3 files chang

Re: [PATCH] ndctl, util: in util_namespace_to_json, initialize bb_count to 0

2017-08-03 Thread Dan Williams
ount":22 > } > > $ ndctl list --namespace=namespace7.0 > { > "dev":"namespace7.0", > "mode":"sector", > "size":65966080, > "uuid":"ca26fe8e-3f9a-4e3f-bfb0-1e34714996a4", > "sect

Re: [PATCH v4 2/3] mm: introduce MAP_VALIDATE a mechanism for adding new mmap flags

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 5:27 AM, Jan Kara <j...@suse.cz> wrote: > On Mon 14-08-17 23:12:16, Dan Williams wrote: >> The mmap syscall suffers from the ABI anti-pattern of not validating >> unknown flags. However, proposals like MAP_SYNC and MAP_DIRECT need a >> mecha

Re: [PATCH 2/3] libnvdimm, pfn, dax: show supported dax/pfn region alignments in sysfs

2017-08-15 Thread Dan Williams
On Mon, Aug 14, 2017 at 11:46 PM, Oliver wrote: > On Tue, Aug 15, 2017 at 4:02 PM, kbuild test robot wrote: [..] >>114 static const unsigned long *nd_pfn_supported_alignments(void) >>115 { >>116 /* >>117 * This needs to be a

Re: [PATCH v4 3/3] fs, xfs: introduce MAP_DIRECT for creating block-map-sealed file ranges

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 2:18 AM, Kirill A. Shutemov <kir...@shutemov.name> wrote: > On Mon, Aug 14, 2017 at 11:12:22PM -0700, Dan Williams wrote: >> MAP_DIRECT is an mmap(2) flag with the following semantics: >> >> MAP_DIRECT >> In addition to this ma

Re: get_user_pages_unlocked() fails for mmap()-ed nvdimm-backed file

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 2:56 PM, Honda Michio wrote: > Dear Linux NVDIMM developers, > > We are implementing a kernel module that get_user_pages()s an address > provided by a user-space application. This address is a mmap()-ed region of > a file backed by pmem (XFS with

Re: [PATCH v4 2/3] mm: introduce MAP_VALIDATE a mechanism for adding new mmap flags

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 9:28 AM, Andy Lutomirski <l...@kernel.org> wrote: > On Mon, Aug 14, 2017 at 11:12 PM, Dan Williams <dan.j.willi...@intel.com> > wrote: >> The mmap syscall suffers from the ABI anti-pattern of not validating >> unknown flags. However, proposal

[PATCH v5 0/5] MAP_DIRECT and block-map-atomic files

2017-08-16 Thread Dan Williams
mptions about the mapping to physical page to dax-file-offset relationship. The "explicitly breakable seals" aspect is not addressed in these patches, but I wonder if it might be a voluntary mechanism that can implemented via userfaultfd. --- Dan Williams (5): vfs: add fla

[PATCH v5 4/5] fs, xfs: introduce MAP_DIRECT for creating block-map-atomic file ranges

2017-08-16 Thread Dan Williams
Wong" <darrick.w...@oracle.com> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- fs/xfs/xfs_file.c | 115 ++- fs/xfs/xfs_inode.h |1 fs/

[PATCH v5 2/5] fs, xfs: introduce S_IOMAP_SEALED

2017-08-16 Thread Dan Williams
gt; Cc: Jeff Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Dave Chinner <da...@fromorbit.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> S

[PATCH v5 5/5] fs, fcntl: add F_MAP_DIRECT

2017-08-16 Thread Dan Williams
.cz> Cc: Jeff Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Dave Chinner <da...@fromorbit.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Cc: Ross Zwisler <ross.zwis...@linux.in

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 1:37 AM, Jan Kara <j...@suse.cz> wrote: > On Mon 14-08-17 09:14:42, Dan Williams wrote: >> On Mon, Aug 14, 2017 at 5:40 AM, Jan Kara <j...@suse.cz> wrote: >> > On Sun 13-08-17 13:31:45, Dan Williams wrote: >> >> On Sun, Aug

Re: [PATCH v4 3/3] fs, xfs: introduce MAP_DIRECT for creating block-map-sealed file ranges

2017-08-15 Thread Dan Williams
On Tue, Aug 15, 2017 at 9:29 AM, Dan Williams <dan.j.willi...@intel.com> wrote: > On Tue, Aug 15, 2017 at 5:42 AM, Jan Kara <j...@suse.cz> wrote: >> On Mon 14-08-17 23:12:22, Dan Williams wrote: >>> diff --git a/include/linux/mm_types.h b/include/linux/mm_

Re: ndctl oddity

2017-08-16 Thread Dan Williams
On Wed, Aug 16, 2017 at 8:20 AM, Jeff Moyer wrote: > Hi, Dan, > > If I create multiple namespaces in the same region, ndctl sometimes > outputs the wrong chardev for the newly created namespace. I can > reproduce this fairly regularly. > > Note how the chardev for the last two

Re: ndctl oddity

2017-08-16 Thread Dan Williams
On Wed, Aug 16, 2017 at 9:10 AM, Jeff Moyer <jmo...@redhat.com> wrote: > Dan Williams <dan.j.willi...@intel.com> writes: > >> On Wed, Aug 16, 2017 at 8:20 AM, Jeff Moyer <jmo...@redhat.com> wrote: >>> Hi, Dan, >>> >>> If I create multiple n

Re: [PATCH v5 4/5] fs, xfs: introduce MAP_DIRECT for creating block-map-atomic file ranges

2017-08-16 Thread Dan Williams
On Wed, Aug 16, 2017 at 4:12 AM, Kirill A. Shutemov <kir...@shutemov.name> wrote: > On Wed, Aug 16, 2017 at 12:44:28AM -0700, Dan Williams wrote: >> @@ -1411,6 +1422,9 @@ unsigned long do_mmap(struct file *file, unsigned long >> addr, >> >>

Re: [PATCH v5 3/5] mm: introduce mmap3 for safely defining new mmap flags

2017-08-16 Thread Dan Williams
On Wed, Aug 16, 2017 at 4:15 AM, Kirill A. Shutemov <kir...@shutemov.name> wrote: > On Wed, Aug 16, 2017 at 12:44:22AM -0700, Dan Williams wrote: >> diff --git a/include/linux/mman.h b/include/linux/mman.h >> index c8367041fafd..0e1de42c836f 100644 >> --- a/include/li

Re: [RFC PATCH 0/7] dax, ext4: Synchronous page faults

2017-08-13 Thread Dan Williams
On Sun, Aug 13, 2017 at 2:25 AM, Christoph Hellwig <h...@infradead.org> wrote: > On Sat, Aug 12, 2017 at 07:44:14PM -0700, Dan Williams wrote: >> How about MAP_SYNC == (MAP_SHARED|MAP_PRIVATE)? On older kernels that >> should get -EINVAL, and on new kernels it means SYNC+S

Re: [PATCH] ndctl: New structure definitions.

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 10:58 AM, Linda Knippers <linda.knipp...@hpe.com> wrote: > > On 8/11/2017 12:48 PM, Dan Williams wrote: >> >> On Fri, Aug 11, 2017 at 6:36 AM, Linda Knippers <linda.knipp...@hpe.com> >> wrote: >>> >>> >>> >&

Re: [PATCH v4 7/8] libnvdimm: Adding blk-mq support to the pmem driver

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 3:57 AM, Christoph Hellwig wrote: > On Mon, Aug 07, 2017 at 09:39:53AM -0700, Dave Jiang wrote: >> Adding blk-mq support to the pmem driver in addition to the direct bio >> support. > > Can you explain why this is only done for pmem and not btt and

Re: [PATCH] ndctl: New structure definitions.

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 6:36 AM, Linda Knippers <linda.knipp...@hpe.com> wrote: > > > On 8/10/2017 10:27 PM, Dan Williams wrote: >> >> On Thu, Aug 10, 2017 at 7:12 PM, Jerry Hoemann <jerry.hoem...@hpe.com> >> wrote: >>> >>> On

Re: [PATCH] bash completion: updates for the improved filtering

2017-08-14 Thread Dan Williams
On Mon, Aug 14, 2017 at 1:34 PM, Vishal Verma wrote: > ndctl added improved filtering means, allowing one to filter listings > with any combination of bus, dimm, region, or namespace. Make bash > completion use that to only show the filtered set for any object. For >

[PATCH v4 1/3] fs, xfs: introduce S_IOMAP_SEALED

2017-08-15 Thread Dan Williams
gt; Cc: Jeff Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Dave Chinner <da...@fromorbit.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> S

[PATCH v4 3/3] fs, xfs: introduce MAP_DIRECT for creating block-map-sealed file ranges

2017-08-15 Thread Dan Williams
: Jeff Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Dave Chinner <da...@fromorbit.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Signed-off

[PATCH v4 0/3] MAP_DIRECT and block-map sealed files

2017-08-15 Thread Dan Williams
.net/Articles/600502/ [3]: https://www.mail-archive.com/linux-kernel@vger.kernel.org/msg1467677.html --- Dan Williams (3): fs, xfs: introduce S_IOMAP_SEALED mm: introduce MAP_VALIDATE a mechanism for adding new mmap flags fs, xfs: introduce MAP_DIRECT for creating block-map-seal

[PATCH v3 5/6] xfs: toggle XFS_DIFLAG2_IOMAP_IMMUTABLE in response to fallocate

2017-08-11 Thread Dan Williams
Moyer <jmo...@redhat.com> Cc: Christoph Hellwig <h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.

[PATCH v3 3/6] fs, xfs: introduce FALLOC_FL_UNSEAL_BLOCK_MAP

2017-08-11 Thread Dan Williams
<h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Cc: "Darrick J. Wong" <darrick.w...@oracle.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Signed-off-by: Dan Williams <dan.j.will

[PATCH v3 6/6] mm, xfs: protect swapfile contents with immutable + unwritten extents

2017-08-11 Thread Dan Williams
me. Cc: linux...@kvack.org Cc: Andrew Morton <a...@linux-foundation.org> Cc: Anna Schumaker <anna.schuma...@netapp.com> Cc: Trond Myklebust <trond.mykleb...@primarydata.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darr

[PATCH v3 1/6] fs, xfs: introduce S_IOMAP_IMMUTABLE

2017-08-11 Thread Dan Williams
h Hellwig <h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Cc: Alexander Viro <v...@zeniv.linux.org.uk> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Da

[PATCH v3 4/6] xfs: introduce XFS_DIFLAG2_IOMAP_IMMUTABLE

2017-08-11 Thread Dan Williams
h...@lst.de> Cc: Ross Zwisler <ross.zwis...@linux.intel.com> Suggested-by: Dave Chinner <da...@fromorbit.com> Suggested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- fs/xfs/libxfs/xfs_format.h |5

[PATCH v3 2/6] fs, xfs: introduce FALLOC_FL_SEAL_BLOCK_MAP

2017-08-11 Thread Dan Williams
gested-by: "Darrick J. Wong" <darrick.w...@oracle.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- fs/open.c | 16 -- fs/xfs/xfs_bmap_util.c | 72 +++ fs/xfs/xfs_bmap_util.h |2 + fs/xfs

[PATCH v3 0/6] fs, xfs: block map immutable files

2017-08-11 Thread Dan Williams
ess the storage underlying the filesystem" [3] to enable a better / safer alternative to using a raw device for userpace block servers, dax hypervisors, and peer-to-peer transfers to name a few use cases. [2]: https://lkml.org/lkml/2017/8/5/56 [3]: https://lkml.org/lkml/2017/8/6/299 --- Dan Wi

Re: Daemon of NVDIMM event notification/monitoring(Re: Standardization of ACPI NVDIMM DSMs)

2017-08-09 Thread Dan Williams
On Wed, Aug 9, 2017 at 7:19 AM, Jeff Moyer wrote: > Yasunori Goto writes: > >> Hi, >> >>> > Another approach could be to integrate NVDIMM event >>> > monitoring into some other utility, like the rasdaemon. I'm interested in >>> > your thoughts. >>>

Re: [PATCH v4 2/8] dmaengine: change transaction type DMA_SG to DMA_SG_SG

2017-08-10 Thread Dan Williams
On Thu, Aug 10, 2017 at 12:44 PM, Dave Jiang <dave.ji...@intel.com> wrote: > > > On 08/10/2017 12:05 PM, Dan Williams wrote: >> On Thu, Aug 10, 2017 at 9:22 AM, Dave Jiang <dave.ji...@intel.com> wrote: >>> >>> >>> On 08/09/2017 07:20 PM, Dan Wi

Re: [PATCH v5 6/7] libnvdimm, btt: refactor initial_offset calculations

2017-08-11 Thread Dan Williams
On Tue, Aug 8, 2017 at 5:07 PM, Vishal Verma wrote: > In preparation for BTT error clearing, refactor the initial offset > calculations. Until now, all callers of arena_{read,write}_bytes assumed > a relative offset to the arena, and it was later adjusted for the >

Re: [PATCH v3 2/6] fs, xfs: introduce FALLOC_FL_SEAL_BLOCK_MAP

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 4:27 PM, Dave Chinner <da...@fromorbit.com> wrote: > On Thu, Aug 10, 2017 at 11:39:28PM -0700, Dan Williams wrote: >> >From falloc.h: >> >> FALLOC_FL_SEAL_BLOCK_MAP is used to seal (make immutable) all of the >> file logica

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 3:44 AM, Christoph Hellwig <h...@lst.de> wrote: > On Sun, Aug 06, 2017 at 11:51:50AM -0700, Dan Williams wrote: >> Of course it's a useful API. An application already needs to worry >> about the block map, that's why we have fallocate, msync, fiemap &g

[PATCH 3/3] libnvdimm, pfn, dax: limit namespace alignments to the supported set

2017-08-11 Thread Dan Williams
to 4K, 2M, or 1G. Cc: Oliver O'Halloran <ooh...@gmail.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/nvdimm/pfn_devs.c | 23 ++- 1 file changed, 2 insertions(+), 21 deletions(-) diff --git a/drivers/nvdimm/pfn_devs.c b/drivers/nvdimm/pfn_

[PATCH 2/3] libnvdimm, pfn, dax: show supported dax/pfn region alignments in sysfs

2017-08-11 Thread Dan Williams
_select_show() rename and other fixups] Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/nvdimm/pfn_devs.c | 28 1 file changed, 28 insertions(+) diff --git a/drivers/nvdimm/pfn_devs.c b/drivers/nvdimm/pfn_devs.c index 2ae9a000b090..6

[PATCH 0/3] libnvdimm: export supported page size alignments

2017-08-11 Thread Dan Williams
This series is a minor rework of Oliver's original patch: https://patchwork.kernel.org/patch/9811257/ It allows userspace to discover the system huge and gigantic page sizes for aligning devices to support larger than PAGE_SIZE mappings for dax. --- Dan Williams (2): libnvdimm: rename

[PATCH 1/3] libnvdimm: rename nd_sector_size_{show, store} to nd_size_select_{show, store}

2017-08-11 Thread Dan Williams
Prepare for other another consumer of this size selection scheme that is not a 'sector size'. Cc: Oliver O'Halloran <ooh...@gmail.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/nvdimm/btt_devs.c |4 ++-- drivers/nvdimm/core.c

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-11 Thread Dan Williams
On Fri, Aug 11, 2017 at 8:57 PM, Andy Lutomirski <l...@kernel.org> wrote: > On Fri, Aug 11, 2017 at 3:26 PM, Dan Williams <dan.j.willi...@intel.com> > wrote: >> On Fri, Aug 11, 2017 at 3:44 AM, Christoph Hellwig <h...@lst.de> wrote: >>> Please explain

Re: [RFC PATCH 0/7] dax, ext4: Synchronous page faults

2017-08-12 Thread Dan Williams
On Fri, Aug 11, 2017 at 3:03 AM, Christoph Hellwig <h...@infradead.org> wrote: > On Mon, Aug 07, 2017 at 05:24:08PM -0700, Dan Williams wrote: >> Does sys_mmap() reject unknown flag values today? I'm either not >> looking in the right place or it's missing and we'll n

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-12 Thread Dan Williams
On Sat, Aug 12, 2017 at 12:33 AM, Christoph Hellwig <h...@lst.de> wrote: > On Fri, Aug 11, 2017 at 03:26:05PM -0700, Dan Williams wrote: >> Right, but they let userspace make inferences about the state of >> metadata relative to I/O to a given storage address. In this regard

[ndctl PATCH 2/2] ndctl, list: add the remaining set of 'filter_by' helpers

2017-08-12 Thread Dan Williams
e0-fffe", "handle":256, "phys_id":2 }, { "dev":"nmem2", "id":"cdab-0a-07e0-feff", "handle":1, "phys_id":1 }, { "dev":"nmem4",

[ndctl PATCH 1/2] ndctl, util: cleanup filter-by-dimm helpers

2017-08-12 Thread Dan Williams
Use util_dimm_filter() as a helper for these 'filter_by' routines. Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- util/filter.c | 37 - 1 file changed, 4 insertions(+), 33 deletions(-) diff --git a/util/filter.c b/util/filter.c

Re: [RFC PATCH 0/7] dax, ext4: Synchronous page faults

2017-08-14 Thread Dan Williams
gt; (note the new Netapp email) > > On 13/08/17 12:25, Christoph Hellwig wrote: >> On Sat, Aug 12, 2017 at 07:44:14PM -0700, Dan Williams wrote: >>> How about MAP_SYNC == (MAP_SHARED|MAP_PRIVATE)? On older kernels that >>> should get -EINVAL, and on new kernels it means

Re: [PATCH v2 0/5] fs, xfs: block map immutable files for dax, dma-to-storage, and swap

2017-08-14 Thread Dan Williams
On Mon, Aug 14, 2017 at 5:40 AM, Jan Kara <j...@suse.cz> wrote: > On Sun 13-08-17 13:31:45, Dan Williams wrote: >> On Sun, Aug 13, 2017 at 2:24 AM, Christoph Hellwig <h...@lst.de> wrote: >> > Thay being said I think we absolutely should support RDMA memory >> &g

Re: [PATCH v5 0/5] MAP_DIRECT and block-map-atomic files

2017-08-16 Thread Dan Williams
On Wed, Aug 16, 2017 at 12:44 AM, Dan Williams <dan.j.willi...@intel.com> wrote: > Changes since v4 [1]: > * Drop the new vma ->fs_flags field, it can be replaced by just checking > ->vm_ops locally in the filesystem. This approach also allows > non-MAP_DIRECT vmas t

Re: [PATCH] ndctl: New structure definitions.

2017-08-10 Thread Dan Williams
On Thu, Aug 10, 2017 at 7:12 PM, Jerry Hoemann <jerry.hoem...@hpe.com> wrote: > On Thu, Aug 10, 2017 at 05:47:10PM -0700, Dan Williams wrote: >> On Thu, Aug 10, 2017 at 5:00 PM, Jerry Hoemann <jerry.hoem...@hpe.com> wrote: >> > Add structure definitions new

Re: [PATCH] ndctl: New structure definitions.

2017-08-10 Thread Dan Williams
On Thu, Aug 10, 2017 at 5:00 PM, Jerry Hoemann wrote: > Add structure definitions newly published/modified in v0.85: > > https://github.com/HewlettPackard/hpe-nvm/blob/master/Documentation/NFIT_DSM_DDR4_NVDIMM-N_v85.pdf Are there going to be follow-on patches that make use

[ndctl PATCH 0/2] Be kind to humans

2017-07-07 Thread Dan Williams
s 'machine' friendly output. This of course opens the door to things like colorized output to reflect the health state of a dimm. --- Dan Williams (2): ndctl, list: convert json control flags to bit-flags ndctl, daxctl, list: make terminal output human readable by default Documentat

[ndctl PATCH 1/2] ndctl, list: convert json control flags to bit-flags

2017-07-07 Thread Dan Williams
Before we go to add new flags to pass through the json helpers, convert the existing control flags to bit flags. Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- daxctl/list.c | 17 ++--- ndctl/list.c | 25 ++--- ndctl/namespace.c

[ndctl PATCH 2/2] ndctl, daxctl, list: make terminal output human readable by default

2017-07-07 Thread Dan Williams
s a pipe and the output can be forced into that mode with the --format=machine option. Reported-by: Linda Knippers <linda.knipp...@hpe.com> Reported-by: Yasunori Goto <y-g...@jp.fujitsu.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- Documentation/daxctl/daxct

[ndctl PATCH v2] ndctl, daxctl, list: add --human option for number formatting

2017-07-10 Thread Dan Williams
0 MiB / 67.11 MB", "type":"pmem", "iset_id":"0xa76c6907811fae57", "badblock_count":8 } Cc: Dave Jiang <dave.ji...@intel.com> Reported-by: Linda Knippers <linda.knipp...@hpe.com> Reported-by: Yasunori Goto <y

Re: [ndctl PATCH v2] ndctl, daxctl, list: add --human option for number formatting

2017-07-10 Thread Dan Williams
On Mon, Jul 10, 2017 at 11:42 AM, Linda Knippers <linda.knipp...@hpe.com> wrote: > On 07/10/2017 02:26 PM, Dan Williams wrote: >> The json output format of the 'list' commands is meant to make it easy >> to ingest the data into other tools. However, for direct administrator

Re: [ndctl PATCH v2] ndctl, daxctl, list: add --human option for number formatting

2017-07-10 Thread Dan Williams
On Mon, Jul 10, 2017 at 12:47 PM, Dan Williams <dan.j.willi...@intel.com> wrote: > On Mon, Jul 10, 2017 at 11:42 AM, Linda Knippers <linda.knipp...@hpe.com> > wrote: >> On 07/10/2017 02:26 PM, Dan Williams wrote: >>> The json output format of the 'list'

Re: [PATCH] libnvdimm: Stop using HPAGE_SIZE

2017-07-10 Thread Dan Williams
On Tue, Jun 27, 2017 at 2:56 AM, Oliver O'Halloran wrote: > Currently libnvdimm uses HPAGE_SIZE as the default alignment for DAX and > PFN devices. HPAGE_SIZE is the default hugetlbfs page size and when > hugetlbfs is disabled it defaults to PAGE_SIZE. Given DAX has more > in

Re: [PATCH] libnvdimm: show supported dax/pfn region alignments in sysfs

2017-07-10 Thread Dan Williams
On Tue, Jun 27, 2017 at 2:56 AM, Oliver O'Halloran wrote: > The alignment of a DAX and PFN regions dictates the page sizes that can > be used to map the region. Even if the hardware page sizes are known the > actual range of supported page sizes that can be used with DAX depends

Re: [RFC 1/4] libnvdimm: add to_{nvdimm,nd_region}_dev()

2017-07-10 Thread Dan Williams
On Tue, Jun 27, 2017 at 3:28 AM, Oliver O'Halloran wrote: > struct device contains the ->of_node pointer so that devices can be > assoicated with the device-tree node that created them on DT platforms. > libnvdimm hides the struct device for regions and nvdimm devices inside >

Re: [RFC 3/4] powerpc: Add pmem API support

2017-07-10 Thread Dan Williams
On Tue, Jun 27, 2017 at 3:28 AM, Oliver O'Halloran wrote: > Adds powerpc64 implementations of: > > memcpy_flushcache() > arch_wb_cache_pmem() > arch_invalidate_pmem() > > Which form the architecture-specific portition of the persistent memory > API. These

Re: [PATCH] nvdimm: Remove minimum size requirement

2017-07-10 Thread Dan Williams
On Mon, Jul 10, 2017 at 11:32 AM, Matthew Wilcox wrote: > From: Matthew Wilcox > > There was no need to have a minimum size of 4MB for NV-DIMMs; it was > just a sanity check. Keep a check that it's at least one page in size > because we really can't

[ndctl PATCH] ndctl, test: fix check_btt_autodetect() exit condition

2017-07-10 Thread Dan Williams
Static analysis reports that we fail to act on a pwrite() error initializing the info block to zero. Cc: Vishal Verma <vishal.l.ve...@intel.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- test/libndctl.c |1 + 1 file changed, 1 insertion(+) diff --git a/test/

Re: [PATCH] nvdimm: Remove minimum size requirement

2017-07-10 Thread Dan Williams
On Mon, Jul 10, 2017 at 1:30 PM, Matthew Wilcox <wi...@infradead.org> wrote: > On Mon, Jul 10, 2017 at 11:41:08AM -0700, Dan Williams wrote: >> > size = nvdimm_namespace_capacity(ndns); >> > - if (size < ND_MIN_NAMESPACE_SIZE) { >> > -

[ndctl PATCH v3] ndctl, daxctl, list: add --human option for number formatting

2017-07-10 Thread Dan Williams
0 MiB (67.11 MB)", "type":"pmem", "iset_id":"0xa76c6907811fae57", "badblock_count":8 } Cc: Dave Jiang <dave.ji...@intel.com> Reported-by: Linda Knippers <linda.knipp...@hpe.com> Reported-by: Yasunori Goto <

Re: [RFC 1/4] libnvdimm: add to_{nvdimm,nd_region}_dev()

2017-07-11 Thread Dan Williams
On Mon, Jul 10, 2017 at 9:38 PM, Oliver <ooh...@gmail.com> wrote: > On Tue, Jul 11, 2017 at 9:53 AM, Dan Williams <dan.j.willi...@intel.com> > wrote: >> On Tue, Jun 27, 2017 at 3:28 AM, Oliver O'Halloran <ooh...@gmail.com> wrote: >>> struct device contain

Re: Standardization of ACPI NVDIMM DSMs

2017-07-07 Thread Dan Williams
On Sun, Jul 2, 2017 at 9:53 PM, Yasunori Goto wrote: [..] > 2) I suppose a notification daemon may be necessary to inform the over > threshold event (to syslog, to other servers, or logging management OSS, > etc) > > Please correct me, if ndctl has this

Re: Some thoughts of ndctl list command output

2017-07-12 Thread Dan Williams
On Wed, Jul 12, 2017 at 9:35 PM, Yasunori Goto wrote: >> On Wed, Jul 12, 2017 at 3:25 AM, Yasunori Goto wrote: >> > Hello, >> > >> > I wrote current impression about ndctl. >> > If my understanding/thoughts is wrong, please correct me. >> > >> > >> >

Re: [PATCH v3] ndctl list should show more hardware information

2017-07-12 Thread Dan Williams
On Tue, Jul 11, 2017 at 11:44 PM, Yasunori Goto wrote: > Hi, > > I made the v3 of output hardware id . > If this patch is ok, please apply. > > -- > Change log > > v3 : - rebased on human readable option patch. > > > v2 : - use json_object_new_int() for each data. >

Re: [PATCH] nvdimm: Remove minimum size requirement

2017-07-12 Thread Dan Williams
On Wed, Jul 12, 2017 at 8:04 AM, Matthew Wilcox wrote: >> You're right. It should return -ENODEV regardless, but the warning >> should be for non-zero too small namespaces. > > OK, try this: > > 8< > > From: Matthew Wilcox > Date: Mon, 10

Re: [PATCH v2 5/6] libnvdimm, btt: rework error clearing

2017-07-17 Thread Dan Williams
On Mon, Jul 17, 2017 at 3:20 PM, Verma, Vishal L <vishal.l.ve...@intel.com> wrote: > On Mon, 2017-07-17 at 15:00 -0700, Dan Williams wrote: >> On Mon, Jul 17, 2017 at 2:27 PM, Vishal Verma <vishal.l.ve...@intel.co >> m> wrote: >> > Clearing errors or badblocks

Re: Persistent Memory type vs Reserved Memory type

2017-07-20 Thread Dan Williams
On Wed, Jul 19, 2017 at 5:04 PM, Soccer Liu wrote: > Hi: >I am trying to debug an issue related to my private built kernel's (4.11 > from upstream with ACPI/NFIT/NVDIMM enabled) interaction with a persistent > memory device's type. > We have a way to emulate a

[PATCH] device-dax: fix sysfs duplicate warnings

2017-07-19 Thread Dan Williams
Dokupil <dariusz.doku...@intel.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- drivers/dax/device-dax.h |2 +- drivers/dax/device.c | 24 drivers/dax/pmem.c | 12 +++- 3 files changed, 24 insertions(+), 14 deletions(-) diff

Re: [PATCH v3 6/6] libnvdimm: fix potential deadlock while clearing errors

2017-07-20 Thread Dan Williams
> flag for the current scope when issuing commands/IOs that are expected > to clear errors. > > Cc: <linux-a...@vger.kernel.org> > Cc: <linux-nvdimm@lists.01.org> > Cc: Dan Williams <dan.j.willi...@intel.com> > Cc: Robert Moore <robert.mo...@intel.com>

Re: [PATCH v3 5/6] libnvdimm, btt: rework error clearing

2017-07-20 Thread Dan Williams
r LBA is read. If we write to a new > location that may not have the map error flag set, but still might be in > the region's badblock list, we can trigger an EIO on the write, which is > undesirable and completely avoidable. > > Cc: Jeff Moyer <jmo...@redhat.com> > Cc: Toshi

[ndctl PATCH] ndctl, list: always show 'name' if it is available

2017-07-21 Thread Dan Williams
The user-friendly name of a namespace should always be emitted. Reported-by: Linda Knippers <linda.knipp...@hpe.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- util/json.c | 21 + 1 file changed, 9 insertions(+), 12 deletions(-) diff --git a/u

Moving ndctl development into the kernel tree?

2017-07-21 Thread Dan Williams
Hi Linus, Would you be open to the ndctl [1] project moving its development into the kernel tree? The main reasons why I ask are: * Unit test development can touch both the kernel-side emulated nvdimm infrastructure in tools/testing/nvdimm/ and the corresponding tests in tools/ndctl/test/ in the

Re: KVM "fake DAX" flushing interface - discussion

2017-07-22 Thread Dan Williams
On Fri, Jul 21, 2017 at 8:58 AM, Stefan Hajnoczi wrote: > On Fri, Jul 21, 2017 at 09:29:15AM -0400, Pankaj Gupta wrote: >> >> > > A] Problems to solve: >> > > -- >> > > >> > > 1] We are considering two approaches for 'fake DAX flushing interface'. >> > > >> >

Re: KVM "fake DAX" flushing interface - discussion

2017-07-25 Thread Dan Williams
On Tue, Jul 25, 2017 at 7:27 AM, Pankaj Gupta <pagu...@redhat.com> wrote: > >> Subject: Re: KVM "fake DAX" flushing interface - discussion >> >> On Mon 24-07-17 08:06:07, Pankaj Gupta wrote: >> > >> > > On Sun 23-07-17 13:10:34, Dan Will

Re: [PATCH] dm,dax: Make sure dm_dax_flush() is called if device supports it

2017-07-25 Thread Dan Williams
; EXPORT_SYMBOL_GPL(dax_write_cache); > > +bool dax_write_cache_enabled(struct dax_device *dax_dev) > +{ > + return test_bit(DAXDEV_WRITE_CACHE, _dev->flags); > +} We need : EXPORT_SYMBOL_GPL(dax_write_cache_enabled) ...but other than that, looks good to me. Acked-by: Dan

[PATCH 4/4] ndctl: switch to tools/lib/subcmd/

2017-07-25 Thread Dan Williams
of autotools and switch to the perf build system. Cc: Arnaldo Carvalho de Melo <a...@redhat.com> Cc: Namhyung Kim <namhy...@kernel.org> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- tools/lib/subcmd/parse-options.h |1 tools/ndctl/Makefile.am |

[PATCH 2/4] MAINTAINERS: add ndctl files to libnvdimm

2017-07-25 Thread Dan Williams
The ndctl project under tools/ndctl/ provides a helper utility and library interface to the libnvdimm sub-system. Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- MAINTAINERS |1 + 1 file changed, 1 insertion(+) diff --git a/MAINTAINERS b/MAINTAINERS index 527d13

[PATCH 1/4] ndctl: switch to kernel versioning scheme

2017-07-25 Thread Dan Williams
, but now the default version will no longer be hard coded. Instead, it is derived from the kernel's 'kernelversion' Makefile target. The policy appending '.git${abbrev_commit}', and optionally '.dirty', for off-label releases is still the default when a git tree is available. Signed-off-by: Dan Williams

[PATCH 3/4] ndctl: switch to tools/include/linux/{kernel, list, bitmap}.h

2017-07-25 Thread Dan Williams
> Cc: Alexander Shishkin <alexander.shish...@linux.intel.com> Signed-off-by: Dan Williams <dan.j.willi...@intel.com> --- tools/include/linux/hashtable.h |4 tools/include/linux/kernel.h | 10 tools/ndctl/Makefile.am |

Re: KVM "fake DAX" flushing interface - discussion

2017-07-23 Thread Dan Williams
[ adding Ross and Jan ] On Sun, Jul 23, 2017 at 7:04 AM, Rik van Riel <r...@redhat.com> wrote: > On Sat, 2017-07-22 at 12:34 -0700, Dan Williams wrote: >> On Fri, Jul 21, 2017 at 8:58 AM, Stefan Hajnoczi <stefa...@redhat.com >> > wrote: >> > >> > Ma

Re: KVM "fake DAX" flushing interface - discussion

2017-07-24 Thread Dan Williams
On Mon, Jul 24, 2017 at 5:37 AM, Jan Kara <j...@suse.cz> wrote: > On Mon 24-07-17 08:06:07, Pankaj Gupta wrote: >> >> > On Sun 23-07-17 13:10:34, Dan Williams wrote: >> > > On Sun, Jul 23, 2017 at 11:10 AM, Rik van Riel <r...@redhat.com> wrote: >&

Re: Daemon of NVDIMM event notification/monitoring(Re: Standardization of ACPI NVDIMM DSMs)

2017-07-24 Thread Dan Williams
On Sun, Jul 23, 2017 at 10:50 PM, Yasunori Goto wrote: > > Hi, > >> > Another approach could be to integrate NVDIMM event >> > monitoring into some other utility, like the rasdaemon. I'm interested in >> > your thoughts. >> >> Though I'm not sure which (existing or new)

Re: KVM "fake DAX" flushing interface - discussion

2017-07-24 Thread Dan Williams
On Mon, Jul 24, 2017 at 8:48 AM, Jan Kara <j...@suse.cz> wrote: > On Mon 24-07-17 08:10:05, Dan Williams wrote: >> On Mon, Jul 24, 2017 at 5:37 AM, Jan Kara <j...@suse.cz> wrote: [..] >> This approach would turn into a full fsync on the host. The question >> i

Re: KVM "fake DAX" flushing interface - discussion

2017-07-23 Thread Dan Williams
On Sun, Jul 23, 2017 at 11:10 AM, Rik van Riel <r...@redhat.com> wrote: > On Sun, 2017-07-23 at 09:01 -0700, Dan Williams wrote: >> [ adding Ross and Jan ] >> >> On Sun, Jul 23, 2017 at 7:04 AM, Rik van Riel <r...@redhat.com> >> wrote: >> > >>

<    2   3   4   5   6   7   8   9   10   11   >