Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-15 Thread Miklos Szeredi
On Wed, Jul 15, 2020 at 11:02 AM Pavel Begunkov wrote: > I think, if you're going to push this idea, we should start a new thread > CC'ing strace devs. Makes sense. I've pruned the Cc list, so here's the link for reference:

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-15 Thread Pavel Begunkov
On 15/07/2020 11:49, Pavel Begunkov wrote: > On 15/07/2020 11:41, Miklos Szeredi wrote: >> On Wed, Jul 15, 2020 at 10:33 AM Pavel Begunkov >> wrote: >>> >>> On 14/07/2020 14:55, Miklos Szeredi wrote: On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov wrote: > > On 14/07/2020

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-15 Thread Pavel Begunkov
On 15/07/2020 11:41, Miklos Szeredi wrote: > On Wed, Jul 15, 2020 at 10:33 AM Pavel Begunkov > wrote: >> >> On 14/07/2020 14:55, Miklos Szeredi wrote: >>> On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov >>> wrote: On 14/07/2020 11:07, Miklos Szeredi wrote: > On Tue, Jul 14, 2020

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-15 Thread Miklos Szeredi
On Wed, Jul 15, 2020 at 10:33 AM Pavel Begunkov wrote: > > On 14/07/2020 14:55, Miklos Szeredi wrote: > > On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov > > wrote: > >> > >> On 14/07/2020 11:07, Miklos Szeredi wrote: > >>> On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: > > Hi! >

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-15 Thread Pavel Begunkov
On 14/07/2020 14:55, Miklos Szeredi wrote: > On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov wrote: >> >> On 14/07/2020 11:07, Miklos Szeredi wrote: >>> On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: Hi! >> At first, I thought that the proposed system call is capable of

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-14 Thread Miklos Szeredi
On Tue, Jul 14, 2020 at 1:36 PM Pavel Begunkov wrote: > > On 14/07/2020 11:07, Miklos Szeredi wrote: > > On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: > >> > >> Hi! > >> > At first, I thought that the proposed system call is capable of > reading *multiple* small files using a

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-14 Thread Pavel Begunkov
On 14/07/2020 11:07, Miklos Szeredi wrote: > On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: >> >> Hi! >> At first, I thought that the proposed system call is capable of reading *multiple* small files using a single system call - which would help increase HDD/SSD queue

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-14 Thread Miklos Szeredi
On Tue, Jul 14, 2020 at 8:51 AM Pavel Machek wrote: > > Hi! > > > > At first, I thought that the proposed system call is capable of > > > reading *multiple* small files using a single system call - which > > > would help increase HDD/SSD queue utilization and increase IOPS (I/O > > > operations

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-14 Thread Pavel Machek
Hi! > > At first, I thought that the proposed system call is capable of > > reading *multiple* small files using a single system call - which > > would help increase HDD/SSD queue utilization and increase IOPS (I/O > > operations per second) - but that isn't the case and the proposed > > system

Re: Vectored syscalls Was: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-08 Thread René Rebe
Hey, > On 8. Jul 2020, at 17:38, Greg Kroah-Hartman > wrote: > > On Wed, Jul 08, 2020 at 05:16:41PM +0200, René Rebe wrote: >> Hey there, >> >> maybe instead of this rather specific, niche readfile syscall, would it not >> be beneficial >> to allow issuing any group or bundle of several

Re: Vectored syscalls Was: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-08 Thread Greg Kroah-Hartman
On Wed, Jul 08, 2020 at 05:16:41PM +0200, René Rebe wrote: > Hey there, > > maybe instead of this rather specific, niche readfile syscall, would it not > be beneficial > to allow issuing any group or bundle of several arbitrary system calls so > this could also > be used to speed up other, more

Vectored syscalls Was: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-08 Thread René Rebe
Hey there, maybe instead of this rather specific, niche readfile syscall, would it not be beneficial to allow issuing any group or bundle of several arbitrary system calls so this could also be used to speed up other, more demanding high performance applications that need a bit more than just

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-06 Thread Dave Martin
On Sat, Jul 04, 2020 at 04:02:46PM +0200, Greg Kroah-Hartman wrote: > Here is a tiny new syscall, readfile, that makes it simpler to read > small/medium sized files all in one shot, no need to do open/read/close. > This is especially helpful for tools that poke around in procfs or > sysfs, making

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-06 Thread Greg KH
On Mon, Jul 06, 2020 at 08:07:46AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 1:58 PM Greg KH wrote: > > > > On Sun, Jul 05, 2020 at 06:09:03AM +0200, Jan Ziak wrote: > > > On Sun, Jul 5, 2020 at 5:27 AM Matthew Wilcox wrote: > > > > > > > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-06 Thread Matthew Wilcox
On Mon, Jul 06, 2020 at 08:07:46AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 1:58 PM Greg KH wrote: > > It also is a measurable increase over reading just a single file. > > Here's my really really fast AMD system doing just one call to readfile > > vs. one call sequence to open/read/close:

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-06 Thread Jan Ziak
On Sun, Jul 5, 2020 at 1:58 PM Greg KH wrote: > > On Sun, Jul 05, 2020 at 06:09:03AM +0200, Jan Ziak wrote: > > On Sun, Jul 5, 2020 at 5:27 AM Matthew Wilcox wrote: > > > > > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > > > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox > > >

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Vito Caputo
On Sun, Jul 05, 2020 at 01:44:54PM +0200, Greg KH wrote: > On Sun, Jul 05, 2020 at 01:07:14AM -0700, Vito Caputo wrote: > > On Sun, Jul 05, 2020 at 04:27:32AM +0100, Matthew Wilcox wrote: > > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > > > On Sun, Jul 5, 2020 at 5:12 AM Matthew

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Greg KH
On Sun, Jul 05, 2020 at 09:25:39AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 8:32 AM Andreas Dilger wrote: > > > > On Jul 4, 2020, at 8:46 PM, Jan Ziak <0xe2.0x9a.0...@gmail.com> wrote: > > > > > > On Sun, Jul 5, 2020 at 4:16 AM Matthew Wilcox wrote: > > >> > > >> On Sun, Jul 05, 2020 at

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Greg KH
On Sun, Jul 05, 2020 at 06:09:03AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 5:27 AM Matthew Wilcox wrote: > > > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > > > > > > > You should probably take a look at

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Greg KH
On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: > Hello > > At first, I thought that the proposed system call is capable of > reading *multiple* small files using a single system call - which > would help increase HDD/SSD queue utilization and increase IOPS (I/O > operations per second)

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Greg Kroah-Hartman
On Sat, Jul 04, 2020 at 08:30:40PM +0100, Al Viro wrote: > On Sat, Jul 04, 2020 at 04:02:46PM +0200, Greg Kroah-Hartman wrote: > > Here is a tiny new syscall, readfile, that makes it simpler to read > > small/medium sized files all in one shot, no need to do open/read/close. > > This is especially

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Greg KH
On Sun, Jul 05, 2020 at 01:07:14AM -0700, Vito Caputo wrote: > On Sun, Jul 05, 2020 at 04:27:32AM +0100, Matthew Wilcox wrote: > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > > > > > > > You should probably take a look

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Vito Caputo
On Sun, Jul 05, 2020 at 04:27:32AM +0100, Matthew Wilcox wrote: > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > > > > > You should probably take a look at io_uring. That has the level of > > > complexity of this proposal

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Jan Ziak
On Sun, Jul 5, 2020 at 8:32 AM Andreas Dilger wrote: > > On Jul 4, 2020, at 8:46 PM, Jan Ziak <0xe2.0x9a.0...@gmail.com> wrote: > > > > On Sun, Jul 5, 2020 at 4:16 AM Matthew Wilcox wrote: > >> > >> On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: > >>> Hello > >>> > >>> At first, I

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-05 Thread Andreas Dilger
On Jul 4, 2020, at 8:46 PM, Jan Ziak <0xe2.0x9a.0...@gmail.com> wrote: > > On Sun, Jul 5, 2020 at 4:16 AM Matthew Wilcox wrote: >> >> On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: >>> Hello >>> >>> At first, I thought that the proposed system call is capable of >>> reading

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Jan Ziak
On Sun, Jul 5, 2020 at 5:27 AM Matthew Wilcox wrote: > > On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > > > > > You should probably take a look at io_uring. That has the level of > > > complexity of this proposal and

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Matthew Wilcox
On Sun, Jul 05, 2020 at 05:18:58AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > > > You should probably take a look at io_uring. That has the level of > > complexity of this proposal and supports open/read/close along with many > > other opcodes. > > Then

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Jan Ziak
On Sun, Jul 5, 2020 at 5:12 AM Matthew Wilcox wrote: > > You should probably take a look at io_uring. That has the level of > complexity of this proposal and supports open/read/close along with many > other opcodes. Then glibc can implement readfile using io_uring and there is no need for a new

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Matthew Wilcox
On Sun, Jul 05, 2020 at 04:46:04AM +0200, Jan Ziak wrote: > On Sun, Jul 5, 2020 at 4:16 AM Matthew Wilcox wrote: > > > > On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: > > > Hello > > > > > > At first, I thought that the proposed system call is capable of > > > reading *multiple* small

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Jan Ziak
On Sun, Jul 5, 2020 at 4:16 AM Matthew Wilcox wrote: > > On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: > > Hello > > > > At first, I thought that the proposed system call is capable of > > reading *multiple* small files using a single system call - which > > would help increase

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Matthew Wilcox
On Sun, Jul 05, 2020 at 04:06:22AM +0200, Jan Ziak wrote: > Hello > > At first, I thought that the proposed system call is capable of > reading *multiple* small files using a single system call - which > would help increase HDD/SSD queue utilization and increase IOPS (I/O > operations per second)

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Jan Ziak
Hello At first, I thought that the proposed system call is capable of reading *multiple* small files using a single system call - which would help increase HDD/SSD queue utilization and increase IOPS (I/O operations per second) - but that isn't the case and the proposed system call can read just

Re: [PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Al Viro
On Sat, Jul 04, 2020 at 04:02:46PM +0200, Greg Kroah-Hartman wrote: > Here is a tiny new syscall, readfile, that makes it simpler to read > small/medium sized files all in one shot, no need to do open/read/close. > This is especially helpful for tools that poke around in procfs or > sysfs, making

[PATCH 0/3] readfile(2): a new syscall to make open/read/close faster

2020-07-04 Thread Greg Kroah-Hartman
Here is a tiny new syscall, readfile, that makes it simpler to read small/medium sized files all in one shot, no need to do open/read/close. This is especially helpful for tools that poke around in procfs or sysfs, making a little bit of a less system load than before, especially as syscall