Re: [f2fs-dev] [PATCH 7/8 v4] tests/xfs: add f2fs testcase and convert them being generic

2015-02-04 Thread Dave Chinner
need to be in the golden output file - it can just be dumped in the $seqres.full file. Similar changes can be made to 087 as well. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel

Re: [f2fs-dev] [PATCH 1/8 v4] common/rc: add _require_scratch_shtudown

2015-02-04 Thread Dave Chinner
to /dev/null? + _scratch_unmount +} Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership

Re: [f2fs-dev] [PATCH 2/8 v4] common/rc: add _require_bmap

2015-02-04 Thread Dave Chinner
. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming. The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media, is your hub for all things parallel

Re: [f2fs-dev] [PATCH 3/8 v4] common/rc: add _require_norecovery

2015-02-04 Thread Dave Chinner
$FSTYP does not support norecovery + _scratch_unmount +} What's the point of making tests that use an XFS specific mount option generic? If it requires this it is still an XFS specific test, right? Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [PATCH 4/8 v4] tests/xfs: convert 10 xfs's tests to be generic ones

2015-02-04 Thread Dave Chinner
recovery) All these tests need _require_scratch_shutdown, and some of them need _require_bmap utils. Suggested-by: Dave Chinner da...@fromorbit.com Signed-off-by: Jaegeuk Kim jaeg...@kernel.org --- tests/xfs/053 | 3 ++- tests/xfs/137 | 10 ++ tests/xfs/138 | 10

Re: [f2fs-dev] [PATCH 5/8 v4] tests/generic: relocate xfs's tests into tests/generic/

2015-02-04 Thread Dave Chinner
/xfs/libxfs/xfs_fs.h $ $ $ git diff --stat -M 97bf6af..2155355 fs/xfs/{ = libxfs}/xfs_fs.h | 0 1 file changed, 0 insertions(+), 0 deletions(-) $ It's much easier to review rename patches in this format. :) Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [PATCH 1/2 v3] xfs/087: test f2fs selectively

2015-01-20 Thread Dave Chinner
rules we can just place those tests in generic/ and filesystems that don't support foo will avoid it. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- New Year. New Location. New Benefits. New Data Center in Ashburn, VA

Re: [f2fs-dev] [PATCH 2/6 v2] f2fs: support goingdown for fs shutdown

2015-01-08 Thread Dave Chinner
user API. There's no need to change the XFS implementation at all. The second patch then adds the f2fs implementation. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming

Re: [f2fs-dev] [PATCH 2/6] f2fs: support goingdown for fs shutdown

2015-01-08 Thread Dave Chinner
On Thu, Jan 08, 2015 at 01:21:29PM -0800, Jaegeuk Kim wrote: On Fri, Jan 09, 2015 at 07:54:16AM +1100, Dave Chinner wrote: On Thu, Jan 08, 2015 at 02:33:17PM -0600, Eric Sandeen wrote: On 1/8/15 2:18 PM, Jaegeuk Kim wrote: On Thu, Jan 08, 2015 at 01:54:20PM -0600, Eric Sandeen wrote

Re: [f2fs-dev] [PATCH 8/9 v5] common/quota: give quota mount option per filesystem

2015-02-09 Thread Dave Chinner
in +xfs) +_require_xfs_quota +echo -o uquota +;; +*) +;; +esac +} Looking at this, it's pretty specific to the test, so it's probably best just to leave it as a helper function in the test itself. Otherwise look s good. Cheers, Dave. -- Dave

Re: [f2fs-dev] [PATCH 2/6] f2fs: support goingdown for fs shutdown

2015-01-08 Thread Dave Chinner
no need for new ioctls here. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming! The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media

Re: [f2fs-dev] [PATCH 2/2] generic/066: add _require_metadata_replay

2015-03-17 Thread Dave Chinner
. metadata and fsync. Consistency is data integrity behaviour across different filesystems is a good thing. :) Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming The Go

Re: [f2fs-dev] [PATCH 1/2] generic/067: add a testcase to check some inline truncation behaviors

2015-03-17 Thread Dave Chinner
you need the close command? Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Dive into the World of Parallel Programming The Go Parallel Website, sponsored by Intel and developed in partnership with Slashdot Media

Re: [f2fs-dev] [PATCH 03/18] f2fs crypto: declare some definitions for f2fs encryption feature

2015-05-12 Thread Dave Chinner
that are all slightly different... Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- One dashboard for servers and applications across Physical-Virtual-Cloud Widest out-of-the-box monitoring support with 50+ applications

Re: [f2fs-dev] [PATCH 03/18] f2fs crypto: declare some definitions for f2fs encryption feature

2015-05-13 Thread Dave Chinner
On Tue, May 12, 2015 at 11:48:02PM -0700, Jaegeuk Kim wrote: On Wed, May 13, 2015 at 12:02:08PM +1000, Dave Chinner wrote: On Fri, May 08, 2015 at 09:20:38PM -0700, Jaegeuk Kim wrote: This definitions will be used by inode and superblock for encyption. How much of this crypto stuff

Re: [f2fs-dev] [PATCH 2/2][v2] blk-plug: don't flush nested plug lists

2015-04-08 Thread Dave Chinner
-nr_reclaimed += nr_reclaimed; /* -- 1.8.3.1 -- Dave Chinner da...@fromorbit.com -- BPM Camp - Free Virtual Workshop May 6th at 10am PDT/1PM EDT Develop your own process in accordance with the BPMN 2 standard

Re: [f2fs-dev] [PATCH 13/35] xfs: set bi_op to REQ_OP

2016-01-08 Thread Dave Chinner
iles changed, 17 insertions(+), 13 deletions(-) Not sure which patches your note is refering to here. The XFS change here looks fine. Acked-by: Dave Chinner <dchin...@redhat.com> -Dave. -- Dave Chinner da...@fromorbit.com -

Re: [f2fs-dev] [PATCH 00/35 v2] separate operations from flags in the bio/request structs

2016-01-08 Thread Dave Chinner
rward? Set a "speak now or forever hold your peace" > review deadline? I say just ask Linus to pull it immediately after the next merge window closes Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- S

Re: [f2fs-dev] Consolidated file encryption interface/semantics?

2016-01-11 Thread Dave Chinner
forced at the VFS is how this should be done. Users will absolutely hate us if per-file encryption devolves into APIs and policies that differ between filesystems. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Site24x7 A

[f2fs-dev] xfstests/091 failures

2016-02-07 Thread Dave Chinner
devices correctly. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Site24x7 APM Insight: Get Deep Visibility into Application Performance APM + Mobile APM + RUM: Monitor 3 App instances at just $35/Month Monitor end

Re: [f2fs-dev] [PATCH 1/2] mm: add PF_MEMALLOC_NOFS

2016-04-26 Thread Dave Chinner
s that we don't actually care about in XFS at all. That way I can carry all the XFS changes in the XFS tree and not have to worry about when this stuff gets merged or conflicts with the rest of the work that is being done to the mm/ code and whatever tree that eventuall

Re: [f2fs-dev] [PATCH 2/2] mm, debug: report when GFP_NO{FS, IO} is used explicitly from memalloc_no{fs, io}_{save, restore} context

2016-04-26 Thread Dave Chinner
is simply going to restart the flood of false positive lockdep warnings we've silenced over the years, so perhaps lockdep needs to be made smarter as well... Cheers, Dave. -- Dave Chinner da...@fromorbit.com --

Re: [f2fs-dev] [PATCH 0/2] scop GFP_NOFS api

2016-05-01 Thread Dave Chinner
ntel CPU with local memory will be seen as a single node and so will have a single kswapd thread to do reclaim. There's a massive imbalance between maximum reclaim rate and maximum allocation rate in situations like this. If we want memory reclaim to run faster, we to be able to do more work *now*, no

Re: [f2fs-dev] [PATCH 0/2] scop GFP_NOFS api

2016-05-01 Thread Dave Chinner
ake the changes to the generic superblock shrinker code to enable finer grained reclaim and optimise the XFS shrinkers to make use of it... Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Find and fix application per

Re: [f2fs-dev] [PATCH 2/2] mm, debug: report when GFP_NO{FS, IO} is used explicitly from memalloc_no{fs, io}_{save, restore} context

2016-05-01 Thread Dave Chinner
On Wed, Apr 27, 2016 at 10:03:11AM +0200, Michal Hocko wrote: > On Wed 27-04-16 08:58:45, Dave Chinner wrote: > > On Tue, Apr 26, 2016 at 01:56:12PM +0200, Michal Hocko wrote: > > > From: Michal Hocko <mho...@suse.com> > > > > > > THIS PATCH IS FOR TE

Re: [f2fs-dev] [PATCH 4/6] xfs: use memalloc_nofs_{save, restore} instead of memalloc_noio*

2017-02-07 Thread Dave Chinner
caller paths is done and we're 100% certain that there are no lurking deadlocks. For example, I'm pretty sure we can call into _xfs_buf_map_pages() outside of a transaction context but with an inode ILOCK held exclusively. If we th

Re: [f2fs-dev] [PATCH] fscrypto: make XTS tweak initialization endian-independent

2016-10-06 Thread Dave Chinner
weakness in a fsck tool will be just as serious as a weakness in the kernel code, and there's a much larger amount of widely dispersed code that would need to be encryption enabled by going down this path. Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [PATCH v4] generic/391: check inode metadata on f{data}sync after power-cut

2016-11-20 Thread Dave Chinner
$testfile >/dev/null > + sleep 1 > + touch $testfile > + check_inode_metadata $1 > +} > + > +# punch XX KB with f{data}sync, followed by power-cut > +test_punch() > +{ > + ec

Re: [f2fs-dev] [PATCH] fscrypto: make XTS tweak initialization endian-independent

2016-10-13 Thread Dave Chinner
On Wed, Oct 05, 2016 at 10:16:25PM -0400, Theodore Ts'o wrote: > On Thu, Oct 06, 2016 at 12:17:15PM +1100, Dave Chinner wrote: > > This is the sanest approach, because encrypting filesystem internal > > metadata may have some unintended consequences. e.g being unable to >

Re: [f2fs-dev] [RFC PATCH] mm: introduce kv[mz]alloc helpers

2016-12-08 Thread Dave Chinner
_large(), which is XFS's version of kvmalloc() that is GFP_NOFS/GFP_NOIO safe. Any generic API for this functionality will have to play these memalloc_noio_save/ memalloc_noio_restore games to ensure they are GFP_NOF

Re: [f2fs-dev] [PATCH 2/9] xfs: introduce and use KM_NOLOCKDEP to silence reclaim lockdep false positives

2016-12-20 Thread Dave Chinner
On Mon, Dec 19, 2016 at 02:06:19PM -0800, Darrick J. Wong wrote: > On Tue, Dec 20, 2016 at 08:24:13AM +1100, Dave Chinner wrote: > > On Thu, Dec 15, 2016 at 03:07:08PM +0100, Michal Hocko wrote: > > > From: Michal Hocko <mho...@suse.com> > > > > &g

Re: [f2fs-dev] [PATCH 2/9] xfs: introduce and use KM_NOLOCKDEP to silence reclaim lockdep false positives

2016-12-20 Thread Dave Chinner
es which audits and changes all the unnecessary KM_NOFS allocations in one go. I've never liked whack-a-mole style changes like this - do it once, do it properly Cheers, Dave. -- Dave Chinner da...@fromorbit.com --

Re: [f2fs-dev] [PATCH 00/25] fscrypt: add some higher-level helper functions

2017-09-21 Thread Dave Chinner
On Thu, Sep 21, 2017 at 10:47:05AM -0700, Eric Biggers wrote: > Hi Dave, > > On Thu, Sep 21, 2017 at 04:45:02PM +1000, Dave Chinner wrote: > > fscrypto: clean up include file mess > > > > From: Dave Chinner <dchin...@redhat.com> > > > > Filesystems

Re: [f2fs-dev] [PATCH 00/25] fscrypt: add some higher-level helper functions

2017-09-21 Thread Dave Chinner
up by the individual filesystems > to switch to the new helpers. This all looks much nicer. Having just been looking at this stuff, it makes the code much simpler to understand. So: Acked-by: Dave Chinner <dchin...@redhat.com> While I'm here, the fscrypt header file includes are clunky a

Re: [f2fs-dev] Lockdep is less useful than it was

2017-12-07 Thread Dave Chinner
problem, you'd be happier, right? I'd be much happier if it wasn't turned on by default in the first place. We gave plenty of warnings that there were still unsolved false positive problems with the new checks in the storage stack. Cheers, Dave. -- Dave Chinner da...@fromorbit.com --

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-07 Thread Dave Chinner
hich means it has zero coverage of the entire XFS metadata buffer subsystem and the complex locking orders we have for metadata updates. Put simply: lockdep doesn't provide me with any benefit, so I don't use it... Cheers, Dave. -- Dave Chinner da...@fromorbit.com ---

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-07 Thread Dave Chinner
On Fri, Dec 08, 2017 at 01:45:52PM +0900, Byungchul Park wrote: > On Fri, Dec 08, 2017 at 09:22:16AM +1100, Dave Chinner wrote: > > On Thu, Dec 07, 2017 at 11:06:34AM -0500, Theodore Ts'o wrote: > > > On Wed, Dec 06, 2017 at 06:06:48AM -0800, Matthew Wilcox wrote: > > >

Re: [f2fs-dev] [PATCH v4 00/73] XArray version 4

2017-12-05 Thread Dave Chinner
On Wed, Dec 06, 2017 at 12:45:49PM +1100, Dave Chinner wrote: > On Tue, Dec 05, 2017 at 04:40:46PM -0800, Matthew Wilcox wrote: > > From: Matthew Wilcox <mawil...@microsoft.com> > > > > I looked through some notes and decided this was version 4 of the XArray. &g

Re: [f2fs-dev] [PATCH v4 00/73] XArray version 4

2017-12-05 Thread Dave Chinner
On Tue, Dec 05, 2017 at 06:05:15PM -0800, Matthew Wilcox wrote: > On Wed, Dec 06, 2017 at 12:45:49PM +1100, Dave Chinner wrote: > > On Tue, Dec 05, 2017 at 04:40:46PM -0800, Matthew Wilcox wrote: > > > From: Matthew Wilcox <mawil...@microsoft.com> > > >

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-05 Thread Dave Chinner
On Tue, Dec 05, 2017 at 06:02:08PM -0800, Matthew Wilcox wrote: > On Wed, Dec 06, 2017 at 12:36:48PM +1100, Dave Chinner wrote: > > > - if (radix_tree_preload(GFP_NOFS)) > > > - return -ENOMEM; > > > - > > > INIT_LIST_HEAD(>list_node); > >

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-05 Thread Dave Chinner
tions. Turning that around so that a larger XFS structure and algorithm is now protected by an opaque internal lock from generic storage structure the forms part of the larger structure seems like a bad design pattern to me... Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [PATCH v4 00/73] XArray version 4

2017-12-05 Thread Dave Chinner
his time. -Dave. > > > -Original Message----- > > From: Dave Chinner [mailto:da...@fromorbit.com] > > Sent: Tuesday, December 5, 2017 8:51 PM > > To: Matthew Wilcox <wi...@infradead.org> > > Cc: Matthew Wilcox <mawil...@microsoft.com>; Ross Zwisler > >

Re: [f2fs-dev] [PATCH v4 00/73] XArray version 4

2017-12-05 Thread Dave Chinner
On Tue, Dec 05, 2017 at 04:40:46PM -0800, Matthew Wilcox wrote: > From: Matthew Wilcox <mawil...@microsoft.com> > > I looked through some notes and decided this was version 4 of the XArray. > Last posted two weeks ago, this version includes a *lot* of changes. > I'd like

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-11 Thread Dave Chinner
On Sat, Dec 09, 2017 at 09:00:18AM -0800, Joe Perches wrote: > On Sat, 2017-12-09 at 09:36 +1100, Dave Chinner wrote: > > 1. Using lockdep_set_novalidate_class() for anything other > > than device->mutex will throw checkpatch warnings. Nice. (*) > [] > > (*)

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-11 Thread Dave Chinner
On Sun, Dec 10, 2017 at 08:23:15PM -0800, Matthew Wilcox wrote: > On Mon, Dec 11, 2017 at 10:57:45AM +1100, Dave Chinner wrote: > > i.e. the fact the cmpxchg failed may not have anything to do with a > > race condtion - it failed because the slot wasn't empty like

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-06 Thread Dave Chinner
On Tue, Dec 05, 2017 at 08:45:49PM -0800, Matthew Wilcox wrote: > On Wed, Dec 06, 2017 at 02:14:56PM +1100, Dave Chinner wrote: > > > The other conversions use the normal API instead of the advanced API, so > > > all of this gets hidden away. For example, the inode cache d

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-06 Thread Dave Chinner
On Wed, Dec 06, 2017 at 06:06:48AM -0800, Matthew Wilcox wrote: > On Wed, Dec 06, 2017 at 07:44:04PM +1100, Dave Chinner wrote: > > On Tue, Dec 05, 2017 at 08:45:49PM -0800, Matthew Wilcox wrote: > > > That said, using xa_cmpxchg() in the dquot code looked like the right > &g

Re: [f2fs-dev] Lockdep is less useful than it was

2017-12-08 Thread Dave Chinner
ructure just to add lockdep validation to a tree that doesn't actually need any extra locking validation... Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Check out the vibrant tech community on one of the world

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-10 Thread Dave Chinner
On Fri, Dec 08, 2017 at 03:01:31PM -0800, Matthew Wilcox wrote: > On Thu, Dec 07, 2017 at 11:38:43AM +1100, Dave Chinner wrote: > > > > cmpxchg is for replacing a known object in a store - it's not really > > > > intended for doing initial inserts after a lookup tells

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-11 Thread Dave Chinner
On Mon, Dec 11, 2017 at 02:12:28PM -0800, Joe Perches wrote: > On Tue, 2017-12-12 at 08:43 +1100, Dave Chinner wrote: > > On Sat, Dec 09, 2017 at 09:00:18AM -0800, Joe Perches wrote: > > > On Sat, 2017-12-09 at 09:36 +1100, Dave Chinner wrote: > > > > 1. Usin

Re: [f2fs-dev] [PATCH v4 72/73] xfs: Convert mru cache to XArray

2017-12-08 Thread Dave Chinner
Who-ever adds semaphore checking to lockdep can add those annotations. The externalisation of the development cost of new lockdep functionality is one of the problems here. -Dave. (*) checkpatch.pl is considered mostly harmful round here, too, but that's another rant (**) the frequent occurren

Re: [f2fs-dev] xfstests: generic/342 run failed in f2fs

2017-12-28 Thread Dave Chinner
new file that has the old name of the other file and is a child of the same parent directory, fsync the new inode, power fail and mount the filesystem, we do not lose the first file and that file has the name it was renamed to. This test is motivated by an issue found

Re: [f2fs-dev] xfstests: generic/342 run failed in f2fs

2017-12-28 Thread Dave Chinner
On Thu, Dec 28, 2017 at 08:59:18AM -0800, Eric Sandeen wrote: > On 12/28/17 1:09 AM, Dave Chinner wrote: > ... > > > There's a whole lot more detail in the kernel commit 2be63d5ce929 > > ("Btrfs: fix file loss on log replay after renaming a file and > > fsync"

Re: [f2fs-dev] Symlink not persisted even after fsync

2018-04-13 Thread Dave Chinner
at. So when we look at symlinks, the parent directory has a ordering dependency with the symlink inode, not whatever is found by resolving the path in the symlink data. IOWs, there is no ordering relationship between the symlink's p

Re: [f2fs-dev] Symlink not persisted even after fsync

2018-04-13 Thread Dave Chinner
g strictly ordered metadata recovery semantics, so it should behave the same way as ext4 and XFS in tests like these. If it doesn't, then there's filesystem bugs that need fixing... Cheers, Dave. -- Dave Chinner da...@fromorbit.com -

Re: [f2fs-dev] Symlink not persisted even after fsync

2018-04-14 Thread Dave Chinner
ilesystem or subsystem. There is no way this could possible trigger a directory fsync of the symlink parent, because the object being fsync()d may not even know what a filesystem is... If you want a symlink to have ordering behaviour like a dirent pointing to a regular file, then use h

Re: [f2fs-dev] Symlink not persisted even after fsync

2018-04-16 Thread Dave Chinner
asn't actually guaranteed inode changes made prior to the fsync to be persistent on disk. i.e. that's a violation of ordered metadata semantics and probably a bug. Cheers, Dave. -- Dave Chinner da...@fromorbit.com -- Che

Re: [f2fs-dev] [PATCH] f2fs: reserve bits for fs-verity

2018-04-02 Thread Dave Chinner
ine FADVISE_ENCRYPT_BIT 0x04 > > > > It's very wired that f2fs didn't use well defined FS_ENCRYPT_FL bit > > position, > > result in that we leave a hole in on-disk i_flags, and if we want to show > > the > > same 'encrypted'

Re: [f2fs-dev] Proposal: A new fs-verity interface

2019-01-14 Thread Dave Chinner
valent of a hole punch, then why wouldn't you just use FALLOC_FL_PUNCH_HOLE? Can you please write the man page for the interface so that the description of what it does and how it should be used is crystal clear and doesn't assume the reader knows "what darrick proposed".

Re: [f2fs-dev] [PATCH v2 01/12] fs-verity: add a documentation file

2018-12-19 Thread Dave Chinner
On Wed, Dec 19, 2018 at 02:30:05PM -0500, Theodore Y. Ts'o wrote: > On Wed, Dec 19, 2018 at 01:19:53PM +1100, Dave Chinner wrote: > > Putting metadata in user files beyond EOF doesn't work with XFS's > > post-EOF speculative allocation algorithms. > > > > i.e. Filesys

Re: [f2fs-dev] [RFC PATCH 0/6] Allow setting file birth time with utimensat()

2019-02-18 Thread Dave Chinner
xpose it through statx() (as authored time, not birth time), but store it a system xattr rather than an internal filesystem metadata field that requires was never intended to be user modifiable. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs

Re: [f2fs-dev] [RFC PATCH 0/6] Allow setting file birth time with utimensat()

2019-02-18 Thread Dave Chinner
VFS defined system xattrs so that it is common across all filesystems. It also means that backup applications can preserve them during file copies without really even being aware of their meaning, simply by copying all the xattrs on the file... Cheer

Re: [f2fs-dev] [PATCH 2/2] statx.2: add project support update

2019-03-04 Thread Dave Chinner
On Mon, Mar 04, 2019 at 10:16:29PM +0100, Michael Kerrisk (man-pages) wrote: > Hi Dave, > On Mon, 4 Mar 2019 at 21:50, Dave Chinner wrote: > > > > On Mon, Mar 04, 2019 at 02:52:59PM +0100, Michael Kerrisk (man-pages) wrote: > > > Hello Wang Shilong, > > > >

Re: [f2fs-dev] [PATCH v2] generic: test i_mode recovery after power failure

2019-03-06 Thread Dave Chinner
quot; > --- > > Adding a new test cases (beyond changing fsync_tester.c) > requires: > - Creating symlink tests/generic/311:21..24 -> 311 > - Writing golden output tests/generic/311:21..24.out Why create complex new infrastructure for something we already have mecha

Re: [f2fs-dev] [PATCH v2] generic: test i_mode recovery after power failure

2019-03-05 Thread Dave Chinner
ot; tests from the harness. Oh, wait, we *already have that infrastructure*: src/fsync-tester.c and generic/311. Can we please consider rolling all of these "do something, fsync, drop-writes, remount check" into fsync-tester.c and do the same for all future one-off "did fsync persist X"

Re: [f2fs-dev] [PATCH 2/2] statx.2: add project support update

2019-03-04 Thread Dave Chinner
account for files/directories in arbitrary admin defined groups. i.e. quotas that aren't bound by user/group identities. $ man 8 xfs_quota $ man 5 projects $ man 5 projid Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing

Re: [f2fs-dev] [PATCH 0/8] add generic interface to set/get project

2019-03-03 Thread Dave Chinner
stuff here: - Series needs to be cc'd to linux-...@vger.kernel.org - commit messages should be formatted similar to email. i.e. line wrap at 68-72 columns, not 50 - all of the patches have duplicate "From:" lines in the commit message. - most of the patches are missing comm

Re: [f2fs-dev] [PATCH 1/8] fs: add support to change project ID

2019-03-03 Thread Dave Chinner
#define AT_STATX_FORCE_SYNC 0x2000 /* - Force the attributes to be sync'd > with the server */ > #define AT_STATX_DONT_SYNC 0x4000 /* - Don't sync attributes with the > server */ > > +#define AT_FCHOWN_PROJID 0x4000 /* Change project ID instead of > group id */ > > #endif /* _UAPI_LINUX_FCNTL_H */ > diff --git a/tools/include/uapi/linux/fcntl.h > b/tools/include/uapi/linux/fcntl.h > index 6448cdd9a350..712c60d7f727 100644 > --- a/tools/include/uapi/linux/fcntl.h > +++ b/tools/include/uapi/linux/fcntl.h > @@ -90,5 +90,6 @@ > #define AT_STATX_FORCE_SYNC 0x2000 /* - Force the attributes to be sync'd > with the server */ > #define AT_STATX_DONT_SYNC 0x4000 /* - Don't sync attributes with the > server */ > > +#define AT_FCHOWN_PROJID 0x4000 /* Change project ID instead of > group id */ What is the significance of this number? Why not just the next highest flag bit in the sequence (i.e. 0x8000)? Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH 4/8] xfs: support project ID in xfs_setattr()

2019-03-03 Thread Dave Chinner
s: >* > @@ -741,6 +761,15 @@ xfs_setattr_nonsize( > ip->i_d.di_gid = xfs_kgid_to_gid(gid); > inode->i_gid = gid; > } > + if (!projid_eq(iprojid, projid)) { > + if (XFS_

Re: [f2fs-dev] [PATCH 5/8] fs: add project support to statx

2019-03-03 Thread Dave Chinner
ion */ > > /* > @@ -170,5 +173,6 @@ struct statx { > > #define STATX_ATTR_AUTOMOUNT 0x1000 /* Dir: Automount trigger */ > > +#define STATX_ATTR_PROJINHERIT 0x2000 /* [I] File project > inherit is set */

Re: [f2fs-dev] [PATCH 8/8] xfs: support project in xfs_getattr()

2019-03-03 Thread Dave Chinner
Should only be set if the caller is in the init_user_ns. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH 1/2] fchownat.2: add project support updates

2019-03-03 Thread Dave Chinner
when changing project ID in wrong userns, and EINVAL if an invalid project ID is supplied. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v2] generic: test i_mode recovery after power failure

2019-03-05 Thread Dave Chinner
On Wed, Mar 06, 2019 at 10:29:10AM +0800, Chao Yu wrote: > On 2019/3/6 4:53, Dave Chinner wrote: > > On Tue, Mar 05, 2019 at 07:47:44PM +0800, Chao Yu wrote: > >> After fsync, filesystem should guarantee inode metadata including > >> permission info being persisted, so

Re: [f2fs-dev] [PATCH v2] generic: test i_mode recovery after power failure

2019-03-07 Thread Dave Chinner
On Thu, Mar 07, 2019 at 09:12:06AM +0200, Amir Goldstein wrote: > On Thu, Mar 7, 2019 at 12:12 AM Dave Chinner wrote: > > > > On Wed, Mar 06, 2019 at 09:44:54AM +0200, Amir Goldstein wrote: > > > > > > > > > > > > Oh, wait, we *al

Re: [f2fs-dev] [RFC PATCH 0/6] Allow setting file birth time with utimensat()

2019-02-14 Thread Dave Chinner
doesn't really help, because once you've broken into a system, this makes it really easy to cover tracks (e.g. we can't find files that were created and unlinked during the break in window anymore) and lay false trails Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [RFC PATCH v2 11/20] fscrypt: add FS_IOC_REMOVE_ENCRYPTION_KEY ioctl

2019-02-11 Thread Dave Chinner
. If the inode is not in use then there will be only one, and so it will fall into iput_final() and the ->drop_inode() function determines if the inode should be evicted from the cache and destroyed immediately. IOWs, implement fscrypt_drop_inode() to do the right thing when the key has been destroyed, and you can get rid of all this crazy inode cache walk-and-invalidate hackery. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [RFC PATCH v2 11/20] fscrypt: add FS_IOC_REMOVE_ENCRYPTION_KEY ioctl

2019-02-11 Thread Dave Chinner
On Mon, Feb 11, 2019 at 03:31:29PM -0800, Eric Biggers wrote: > Hi Dave, > > On Tue, Feb 12, 2019 at 09:12:49AM +1100, Dave Chinner wrote: > > On Mon, Feb 11, 2019 at 09:27:29AM -0800, Eric Biggers wrote: > > > > Indeed, this is exactly what ->drop_inode() is fo

Re: [f2fs-dev] [RFC PATCH 0/6] Allow setting file birth time with utimensat()

2019-02-14 Thread Dave Chinner
On Thu, Feb 14, 2019 at 03:14:29PM -0800, Omar Sandoval wrote: > On Fri, Feb 15, 2019 at 09:06:26AM +1100, Dave Chinner wrote: > > On Thu, Feb 14, 2019 at 02:00:07AM -0800, Omar Sandoval wrote: > > > From: Omar Sandoval > > > > > > Hi, > > > >

Re: [f2fs-dev] [RFC] errno.h: Provide EFSCORRUPTED for everybody

2019-11-01 Thread Dave Chinner
ifferent values? That horse bolted to userspace years ago - this is just formalising the practice that has spread across multiple linux filesystems from XFS over the past ~10 years.. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH 1/1] errno.h: Provide EFSBADCRC for everybody

2019-11-05 Thread Dave Chinner
TDOT 73 /* RFS specific error */ > #define EBADMSG 74 /* Not a data message */ > +#define EFSBADCRCEBADMSG /* Bad CRC detected */ Inconsistent whitespace here. When you get tab vs space after #define wrong it only shows up in patches. :/ Cheers,

Re: [f2fs-dev] [RFC] errno.h: Provide EFSCORRUPTED for everybody

2019-11-05 Thread Dave Chinner
On Tue, Nov 05, 2019 at 04:15:50PM +0100, David Sterba wrote: > On Sat, Nov 02, 2019 at 08:38:23AM +1100, Dave Chinner wrote: > > On Fri, Nov 01, 2019 at 09:57:31PM +0100, Geert Uytterhoeven wrote: > > > Hi Valdis, > > > > > > On Thu, Oct 31, 2019 at 2

Re: [f2fs-dev] [PATCH v3] common/rc: generalize _get_filesize()

2019-10-15 Thread Dave Chinner
-c "%s"' tests/generic/286: test $(stat -c "%s" $src) = $(stat -c "%s" $dest) || tests/generic/286: test $(stat -c "%s" $src) = $(stat -c "%s" $dest) || tests/generic/286: test $(stat -c "%s" $src) = $(stat -c

Re: [f2fs-dev] [PATCH 1/3] fscrypt: add support for inline-encryption-optimized policies

2019-10-21 Thread Dave Chinner
filesystems. Why not just hash the 64 bit inode, file offset and block numbers into a single 64 bit value? It is still unique enough for the stated use (i.e. unique IV for each file block) but it doesn't limit what filesystem configurations can actually make use

Re: [f2fs-dev] [RFC PATCH 3/3] xfs: show prjquota info on statfs for a file

2019-11-19 Thread Dave Chinner
s code should probably end up looking like this: - if ((ip->i_d.di_flags & XFS_DIFLAG_PROJINHERIT) && + if ((mp->m_flags & XFS_MOUNT_DIRQUOTA) && ((mp->m_qflags & (XFS_PQUOTA_ACCT|XFS_PQUOTA_ENFD))) == (XFS_PQUOT

Re: [f2fs-dev] [PATCH v5 04/13] mm: Add readahead address space operation

2020-02-10 Thread Dave Chinner
r_pages(page); > + rac->start += rac->batch_count; There's no mention of large page support in the patch description and I don't recall this sort of large page batching in previous iterations. This seems like new functionality to me, not directly related to the initial ->readahead A

Re: [f2fs-dev] [PATCH 04/12] mm: Add readahead address space operation

2020-01-28 Thread Dave Chinner
s = 2, left = 1, this looks up the page at index 2, which is the one we issued IO on, not the one we "left behind" which is at index 3. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v6 03/19] mm: Use readahead_control to pass arguments

2020-02-17 Thread Dave Chinner
the next >* batch. >*/ > - if (nr_pages) > - read_pages(mapping, filp, _pool, nr_pages, > - gfp_mask); > - nr_pages = 0; &g

Re: [f2fs-dev] [PATCH v6 11/19] btrfs: Convert from readpages to readahead

2020-02-17 Thread Dave Chinner
; + break; > + } > + > + return batch; > +} Seems a bit big for an inline function. > + > +#define readahead_for_each_batch(rac, array, size, nr) > \ > + for (; (nr = readahead_page_batch(rac, array, size)); \ > + readahead_next(rac)) I had to go look at the caller to work out what "size" refered to here. This is complex enough that it needs proper API documentation. Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v6 06/19] mm: rename readahead loop variable to 'i'

2020-02-17 Thread Dave Chinner
-off-by: Matthew Wilcox (Oracle) > --- > mm/readahead.c | 6 +++--- > 1 file changed, 3 insertions(+), 3 deletions(-) Looks fine. Reviewed-by: Dave Chinner -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linu

Re: [f2fs-dev] [PATCH v6 07/19] mm: Put readahead pages in cache earlier

2020-02-17 Thread Dave Chinner
_list) { > + page->index = offset; > + list_add(>lru, _pool); > + } else if (add_to_page_cache_lru(page, mapping, offset, > + gfp_mask) < 0) { > +

Re: [f2fs-dev] [PATCH v6 00/19] Change readahead API

2020-02-17 Thread Dave Chinner
e2/0xfa [2.479776] ret_from_fork+0x1f/0x30 [2.480737] ---[ end trace e77079de9b22dc6a ]--- I just dropped the ext4 conversion from my local tree so I can boot the machine and test XFS. Might have some more info when that crashes and burns... Cheers, Dave. -- Dave Chinner da...@fromorbit.com

Re: [f2fs-dev] [PATCH v6 08/19] mm: Add readahead address space operation

2020-02-17 Thread Dave Chinner
ahead.c > index 9e430daae42f..975ff5e387be 100644 > --- a/mm/readahead.c > +++ b/mm/readahead.c > @@ -121,7 +121,13 @@ static void read_pages(struct readahead_control *rac, > struct list_head *pages) > > blk_start_plug(); > > -

Re: [f2fs-dev] [PATCH v6 01/19] mm: Return void from various readahead functions

2020-02-17 Thread Dave Chinner
nd we don't need to worry that a present page in the readahead > window causes us to return a smaller nr_pages than we ought to have. > > Signed-off-by: Matthew Wilcox (Oracle) Looks good. Reviewed-by: Dave Chinner -- Dave Chinner da...@fromorbit.com __

Re: [f2fs-dev] [PATCH v6 02/19] mm: Ignore return value of ->readpages

2020-02-17 Thread Dave Chinner
Reviewed-by: Christoph Hellwig > --- > mm/readahead.c | 8 ++-- > 1 file changed, 2 insertions(+), 6 deletions(-) Simple enough. Reviewed-by: Dave Chinner -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linu

Re: [f2fs-dev] [PATCH v6 04/19] mm: Rearrange readahead loop

2020-02-17 Thread Dave Chinner
Also, why? This adds a goto from branched code that continues, then adds a continue so the unbranched code doesn't execute the code the goto jumps to. In absence of any explanation, this isn't an improvement and doesn't make any sense... -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v6 09/19] mm: Add page_cache_readahead_limit

2020-02-17 Thread Dave Chinner
st certainly not the function you want to call. Use page_cache_async_readahead or page_cache_sync_readahead() instead." Cheers, Dave. -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v6 05/19] mm: Remove 'page_offset' from readahead loop

2020-02-17 Thread Dave Chinner
t; > Signed-off-by: Matthew Wilcox (Oracle) > --- > mm/readahead.c | 10 ++ > 1 file changed, 6 insertions(+), 4 deletions(-) Looks ok, but having the readahead dispatch out of line from the case that triggers it makes it hard to follow. Cheers, Dav

Re: [f2fs-dev] [PATCH v6 10/19] fs: Convert mpage_readpages to mpage_readahead

2020-02-17 Thread Dave Chinner
ed, 73 insertions(+), 126 deletions(-) That's actually pretty simple changeover. Nothing really scary there. :) Reviewed-by: Dave Chinner -- Dave Chinner da...@fromorbit.com ___ Linux-f2fs-devel mailing list Linux-f2fs-devel@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/linux-f2fs-devel

Re: [f2fs-dev] [PATCH v6 00/19] Change readahead API

2020-02-18 Thread Dave Chinner
On Tue, Feb 18, 2020 at 05:42:30AM -0800, Matthew Wilcox wrote: > On Tue, Feb 18, 2020 at 03:56:33PM +1100, Dave Chinner wrote: > > Latest version in your git tree: > > > > $ ▶ glo -n 5 willy/readahead > > 4be497096c04 mm: Use memalloc_nofs_save in readahead path >

Re: [f2fs-dev] [PATCH v6 08/19] mm: Add readahead address space operation

2020-02-18 Thread Dave Chinner
On Tue, Feb 18, 2020 at 08:10:04AM -0800, Matthew Wilcox wrote: > On Tue, Feb 18, 2020 at 05:21:47PM +1100, Dave Chinner wrote: > > On Mon, Feb 17, 2020 at 10:45:54AM -0800, Matthew Wilcox wrote: > > > From: "Matthew Wilcox (Oracle)" > > > > > > Th

  1   2   >