Re: [PERFORM] further testing on IDE drives

2003-10-15 Thread Ang Chin Han
Bruce Momjian wrote: Yes. If you were doing multiple WAL writes before transaction fsync, you would be fsyncing every write, rather than doing two writes and fsync'ing them both. I wonder if larger transactions would find open_sync slower? No hard numbers, but I remember testing fsync vs open_sy

Re: [PERFORM] further testing on IDE drives

2003-10-14 Thread scott.marlowe
On Tue, 14 Oct 2003, Tom Lane wrote: > "scott.marlowe" <[EMAIL PROTECTED]> writes: > > open_sync was WAY faster at this than the other two methods. > > Do you not have open_datasync? That's the preferred method if > available. Nope, when I try to start postgresql with it set to that, I get this

Re: [PERFORM] further testing on IDE drives

2003-10-14 Thread Tom Lane
"scott.marlowe" <[EMAIL PROTECTED]> writes: > open_sync was WAY faster at this than the other two methods. Do you not have open_datasync? That's the preferred method if available. regards, tom lane ---(end of broadcast)---

Re: [PERFORM] further testing on IDE drives

2003-10-13 Thread Vivek Khera
> "BM" == Bruce Momjian <[EMAIL PROTECTED]> writes: BM> COPY only does fsync on COPY completion, so I am not sure there are BM> enough fsync's there to make a difference. Perhaps then it is part of the indexing that takes so much time with the WAL. When I applied Marc's WAL disabling patch,

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread scott.marlowe
On Fri, 10 Oct 2003, Josh Berkus wrote: > Bruce, > > > Yes. If you were doing multiple WAL writes before transaction fsync, > > you would be fsyncing every write, rather than doing two writes and > > fsync'ing them both. I wonder if larger transactions would find > > open_sync slower? > > Want

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Bruce Momjian
Vivek Khera wrote: > > "BM" == Bruce Momjian <[EMAIL PROTECTED]> writes: > > >> Sounds reasonable to me. Are there many / any scenarios where a plain > >> fsync would be faster than open_sync? > > BM> Yes. If you were doing multiple WAL writes before transaction fsync, > BM> you would be f

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Vivek Khera
> "BM" == Bruce Momjian <[EMAIL PROTECTED]> writes: >> Sounds reasonable to me. Are there many / any scenarios where a plain >> fsync would be faster than open_sync? BM> Yes. If you were doing multiple WAL writes before transaction fsync, BM> you would be fsyncing every write, rather than

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Josh Berkus
Bruce, > I would be interested to see if wal_sync_method = fsync is slower than > wal_sync_method = open_sync. How often are we doing more then one write > before a fsync anyway? OK. I'll see if I can get to it around my other stuff I have to do this weekend. -- Josh Berkus Aglio Database S

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Bruce Momjian
Josh Berkus wrote: > Bruce, > > > Yes. If you were doing multiple WAL writes before transaction fsync, > > you would be fsyncing every write, rather than doing two writes and > > fsync'ing them both. I wonder if larger transactions would find > > open_sync slower? > > Want me to test? I've go

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread scott.marlowe
On Fri, 10 Oct 2003, Josh Berkus wrote: > Bruce, > > > Yes. If you were doing multiple WAL writes before transaction fsync, > > you would be fsyncing every write, rather than doing two writes and > > fsync'ing them both. I wonder if larger transactions would find > > open_sync slower? > > Want

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Josh Berkus
Bruce, > Yes. If you were doing multiple WAL writes before transaction fsync, > you would be fsyncing every write, rather than doing two writes and > fsync'ing them both. I wonder if larger transactions would find > open_sync slower? Want me to test? I've got an ide-based test machine here, a

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread Bruce Momjian
scott.marlowe wrote: > On Thu, 9 Oct 2003, Bruce Momjian wrote: > > > scott.marlowe wrote: > > > I was testing to get some idea of how to speed up the speed of pgbench > > > with IDE drives and the write caching turned off in Linux (i.e. hdparm -W0 > > > /dev/hdx). > > > > > > The only paramete

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread scott.marlowe
On Thu, 9 Oct 2003, Bruce Momjian wrote: > scott.marlowe wrote: > > I was testing to get some idea of how to speed up the speed of pgbench > > with IDE drives and the write caching turned off in Linux (i.e. hdparm -W0 > > /dev/hdx). > > > > The only parameter that seems to make a noticeable dif

Re: [PERFORM] further testing on IDE drives

2003-10-10 Thread scott.marlowe
Nope, write-cache enabled by default. On Thu, 9 Oct 2003, Bruce Momjian wrote: > > How did this drive come by default? Write-cache disabled? > > --- > > scott.marlowe wrote: > > On Thu, 2 Oct 2003, scott.marlowe wrote: >

Re: [PERFORM] further testing on IDE drives

2003-10-09 Thread Bruce Momjian
How did this drive come by default? Write-cache disabled? --- scott.marlowe wrote: > On Thu, 2 Oct 2003, scott.marlowe wrote: > > > I was testing to get some idea of how to speed up the speed of pgbench > > with IDE drive

Re: [PERFORM] further testing on IDE drives

2003-10-09 Thread Bruce Momjian
scott.marlowe wrote: > I was testing to get some idea of how to speed up the speed of pgbench > with IDE drives and the write caching turned off in Linux (i.e. hdparm -W0 > /dev/hdx). > > The only parameter that seems to make a noticeable difference was setting > wal_sync_method = open_sync. W

Re: [PERFORM] further testing on IDE drives

2003-10-02 Thread scott.marlowe
On Thu, 2 Oct 2003, scott.marlowe wrote: > I was testing to get some idea of how to speed up the speed of pgbench > with IDE drives and the write caching turned off in Linux (i.e. hdparm -W0 > /dev/hdx). > > The only parameter that seems to make a noticeable difference was setting > wal_sync_m