Re: [Cluster-devel] [PATCH v9 23/25] f2fs: Pass the inode to f2fs_mpage_readpages

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 07:22:29AM -0700, Matthew Wilcox wrote: > From: "Matthew Wilcox (Oracle)" > > This function now only uses the mapping argument to look up the inode, > and both callers already have the inode, so just pass the inode instead > of the mapping. > > Signed-off-by: Matthew

Re: [Cluster-devel] [PATCH v9 22/25] f2fs: Convert from readpages to readahead

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 07:22:28AM -0700, Matthew Wilcox wrote: > From: "Matthew Wilcox (Oracle)" > > Use the new readahead operation in f2fs > > Signed-off-by: Matthew Wilcox (Oracle) > Reviewed-by: William Kucharski > --- > fs/f2fs/data.c | 47

Re: [Cluster-devel] [PATCH v9 21/25] ext4: Pass the inode to ext4_mpage_readpages

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 07:22:27AM -0700, Matthew Wilcox wrote: > From: "Matthew Wilcox (Oracle)" > > This function now only uses the mapping argument to look up the inode, > and both callers already have the inode, so just pass the inode instead > of the mapping. > > Signed-off-by: Matthew

Re: [Cluster-devel] [PATCH v9 20/25] ext4: Convert from readpages to readahead

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 10:48:48AM -0700, Matthew Wilcox wrote: > On Fri, Mar 20, 2020 at 10:37:34AM -0700, Eric Biggers wrote: > > On Fri, Mar 20, 2020 at 07:22:26AM -0700, Matthew Wilcox wrote: > > > From: "Matthew Wilcox (Oracle)" > > > > > > Use the new readahead operation in ext4 > > > > >

Re: [Cluster-devel] [PATCH v9 12/25] mm: Move end_index check out of readahead loop

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 11:11:32AM -0700, Matthew Wilcox wrote: > On Fri, Mar 20, 2020 at 11:00:17AM -0700, Eric Biggers wrote: > > On Fri, Mar 20, 2020 at 10:30:40AM -0700, Matthew Wilcox wrote: > > > On Fri, Mar 20, 2020 at 09:58:28AM -0700, Eric Biggers wrote: > > > > On Fri, Mar 20, 2020 at

Re: [Cluster-devel] [PATCH v9 12/25] mm: Move end_index check out of readahead loop

2020-03-20 Thread Matthew Wilcox
On Fri, Mar 20, 2020 at 11:00:17AM -0700, Eric Biggers wrote: > On Fri, Mar 20, 2020 at 10:30:40AM -0700, Matthew Wilcox wrote: > > On Fri, Mar 20, 2020 at 09:58:28AM -0700, Eric Biggers wrote: > > > On Fri, Mar 20, 2020 at 07:22:18AM -0700, Matthew Wilcox wrote: > > > > + /* Avoid wrapping

Re: [Cluster-devel] [PATCH v9 12/25] mm: Move end_index check out of readahead loop

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 10:30:40AM -0700, Matthew Wilcox wrote: > On Fri, Mar 20, 2020 at 09:58:28AM -0700, Eric Biggers wrote: > > On Fri, Mar 20, 2020 at 07:22:18AM -0700, Matthew Wilcox wrote: > > > + /* Avoid wrapping to the beginning of the file */ > > > + if (index + nr_to_read < index) > >

Re: [Cluster-devel] [PATCH v9 20/25] ext4: Convert from readpages to readahead

2020-03-20 Thread Matthew Wilcox
On Fri, Mar 20, 2020 at 10:37:34AM -0700, Eric Biggers wrote: > On Fri, Mar 20, 2020 at 07:22:26AM -0700, Matthew Wilcox wrote: > > From: "Matthew Wilcox (Oracle)" > > > > Use the new readahead operation in ext4 > > > > Signed-off-by: Matthew Wilcox (Oracle) > > Reviewed-by: William Kucharski

Re: [Cluster-devel] [PATCH v9 13/25] mm: Add page_cache_readahead_unbounded

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 07:22:19AM -0700, Matthew Wilcox wrote: > From: "Matthew Wilcox (Oracle)" > > ext4 and f2fs have duplicated the guts of the readahead code so > they can read past i_size. Instead, separate out the guts of the > readahead code so they can call it directly. > >

Re: [Cluster-devel] [PATCH v9 12/25] mm: Move end_index check out of readahead loop

2020-03-20 Thread Eric Biggers
On Fri, Mar 20, 2020 at 07:22:18AM -0700, Matthew Wilcox wrote: > From: "Matthew Wilcox (Oracle)" > > By reducing nr_to_read, we can eliminate this check from inside the loop. > > Signed-off-by: Matthew Wilcox (Oracle) > Reviewed-by: John Hubbard > Reviewed-by: William Kucharski > --- >

[Cluster-devel] [PATCH v9 00/25] Change readahead API

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" This series adds a readahead address_space operation to replace the readpages operation. The key difference is that pages are added to the page cache as they are allocated (and then looked up by the filesystem) instead of passing them on a list to the readpages

[Cluster-devel] [PATCH v9 25/25] iomap: Convert from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Use the new readahead operation in iomap. Convert XFS and ZoneFS to use it. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Christoph Hellwig Reviewed-by: Darrick J. Wong Reviewed-by: William Kucharski --- fs/iomap/buffered-io.c | 90

[Cluster-devel] [PATCH v9 09/25] mm: Remove 'page_offset' from readahead loop

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Replace the page_offset variable with 'index + i'. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: John Hubbard Reviewed-by: Christoph Hellwig Reviewed-by: William Kucharski --- mm/readahead.c | 8 +++- 1 file changed, 3 insertions(+), 5 deletions(-)

[Cluster-devel] [PATCH v9 06/25] mm: Use readahead_control to pass arguments

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" In this patch, only between __do_page_cache_readahead() and read_pages(), but it will be extended in upcoming patches. The read_pages() function becomes aops centric, as this makes the most sense by the end of the patchset. Signed-off-by: Matthew Wilcox (Oracle)

[Cluster-devel] [PATCH v9 11/25] mm: Add readahead address space operation

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" This replaces ->readpages with a saner interface: - Return void instead of an ignored error code. - Page cache is already populated with locked pages when ->readahead is called. - New arguments can be passed to the implementation without changing all the

[Cluster-devel] [PATCH v9 04/25] mm: Move readahead nr_pages check into read_pages

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Simplify the callers by moving the check for nr_pages and the BUG_ON into read_pages(). Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Zi Yan Reviewed-by: John Hubbard Reviewed-by: Christoph Hellwig Reviewed-by: William Kucharski --- mm/readahead.c |

[Cluster-devel] [PATCH v9 16/25] fs: Convert mpage_readpages to mpage_readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Implement the new readahead aop and convert all callers (block_dev, exfat, ext2, fat, gfs2, hpfs, isofs, jfs, nilfs2, ocfs2, omfs, qnx6, reiserfs & udf). The callers are all trivial except for GFS2 & OCFS2. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by:

[Cluster-devel] [PATCH v9 10/25] mm: Put readahead pages in cache earlier

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" When populating the page cache for readahead, mappings that use ->readpages must populate the page cache themselves as the pages are passed on a linked list which would normally be used for the page cache's LRU. For mappings that use ->readpage or the upcoming

[Cluster-devel] [PATCH v9 01/25] mm: Move readahead prototypes from mm.h

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" The readahead code is part of the page cache so should be found in the pagemap.h file. force_page_cache_readahead is only used within mm, so move it to mm/internal.h instead. Remove the parameter names where they add no value, and rename the ones which were

[Cluster-devel] [PATCH v9 21/25] ext4: Pass the inode to ext4_mpage_readpages

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" This function now only uses the mapping argument to look up the inode, and both callers already have the inode, so just pass the inode instead of the mapping. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: William Kucharski --- fs/ext4/ext4.h | 2 +-

[Cluster-devel] [PATCH v9 20/25] ext4: Convert from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Use the new readahead operation in ext4 Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: William Kucharski --- fs/ext4/ext4.h | 3 +-- fs/ext4/inode.c| 21 + fs/ext4/readpage.c | 22 -- 3 files changed, 18

[Cluster-devel] [PATCH v9 02/25] mm: Return void from various readahead functions

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" ondemand_readahead has two callers, neither of which use the return value. That means that both ra_submit and __do_page_cache_readahead() can return void, and we don't need to worry that a present page in the readahead window causes us to return a smaller nr_pages

[Cluster-devel] [PATCH v9 03/25] mm: Ignore return value of ->readpages

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" We used to assign the return value to a variable, which we then ignored. Remove the pretence of caring. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Christoph Hellwig Reviewed-by: Dave Chinner Reviewed-by: John Hubbard Reviewed-by: William Kucharski

[Cluster-devel] [PATCH v9 13/25] mm: Add page_cache_readahead_unbounded

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" ext4 and f2fs have duplicated the guts of the readahead code so they can read past i_size. Instead, separate out the guts of the readahead code so they can call it directly. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Christoph Hellwig Reviewed-by:

[Cluster-devel] [PATCH v9 14/25] mm: Document why we don't set PageReadahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" If the page is already in cache, we don't set PageReadahead on it. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Christoph Hellwig Reviewed-by: William Kucharski --- mm/readahead.c | 9 ++--- 1 file changed, 6 insertions(+), 3 deletions(-) diff

[Cluster-devel] [PATCH v9 22/25] f2fs: Convert from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Use the new readahead operation in f2fs Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: William Kucharski --- fs/f2fs/data.c | 47 +++-- include/trace/events/f2fs.h | 6 ++--- 2 files changed, 22 insertions(+),

[Cluster-devel] [PATCH v9 08/25] mm: rename readahead loop variable to 'i'

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Change the type of page_idx to unsigned long, and rename it -- it's just a loop counter, not a page index. Suggested-by: John Hubbard Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: Dave Chinner Reviewed-by: William Kucharski --- mm/readahead.c | 8

[Cluster-devel] [PATCH v9 18/25] erofs: Convert uncompressed files from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Use the new readahead operation in erofs Signed-off-by: Matthew Wilcox (Oracle) Acked-by: Gao Xiang Reviewed-by: William Kucharski --- fs/erofs/data.c | 39 +--- fs/erofs/zdata.c | 2 +-

[Cluster-devel] [PATCH v9 07/25] mm: Rename various 'offset' parameters to 'index'

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" The word 'offset' is used ambiguously to mean 'byte offset within a page', 'byte offset from the start of the file' and 'page offset from the start of the file'. Use 'index' to mean 'page offset from the start of the file' throughout the readahead code.

[Cluster-devel] [PATCH v9 23/25] f2fs: Pass the inode to f2fs_mpage_readpages

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" This function now only uses the mapping argument to look up the inode, and both callers already have the inode, so just pass the inode instead of the mapping. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: William Kucharski --- fs/f2fs/data.c | 7 +++

[Cluster-devel] [PATCH v9 05/25] mm: Add new readahead_control API

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Filesystems which implement the upcoming ->readahead method will get their pages by calling readahead_page() or readahead_page_batch(). These functions support large pages, even though none of the filesystems to be converted do yet. Signed-off-by: Matthew Wilcox

[Cluster-devel] [PATCH v9 17/25] btrfs: Convert from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Implement the new readahead method in btrfs using the new readahead_page_batch() function. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: William Kucharski --- fs/btrfs/extent_io.c | 46 ++-- fs/btrfs/extent_io.h |

[Cluster-devel] [PATCH v9 12/25] mm: Move end_index check out of readahead loop

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" By reducing nr_to_read, we can eliminate this check from inside the loop. Signed-off-by: Matthew Wilcox (Oracle) Reviewed-by: John Hubbard Reviewed-by: William Kucharski --- mm/readahead.c | 17 +++-- 1 file changed, 11 insertions(+), 6

[Cluster-devel] [PATCH v9 15/25] mm: Use memalloc_nofs_save in readahead path

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Ensure that memory allocations in the readahead path do not attempt to reclaim file-backed pages, which could lead to a deadlock. It is possible, though unlikely this is the root cause of a problem observed by Cong Wang. Signed-off-by: Matthew Wilcox (Oracle)

[Cluster-devel] [PATCH v9 19/25] erofs: Convert compressed files from readpages to readahead

2020-03-20 Thread Matthew Wilcox
From: "Matthew Wilcox (Oracle)" Use the new readahead operation in erofs. Signed-off-by: Matthew Wilcox (Oracle) Acked-by: Gao Xiang Reviewed-by: Dave Chinner Reviewed-by: William Kucharski --- fs/erofs/zdata.c | 29 + 1 file changed, 9 insertions(+), 20