please eat my data!

2010-04-12 Thread Servilio Afre Puentes
On 12 April 2010 13:47, Dirk Hohndel wrote: > On Mon, 12 Apr 2010 10:14:05 -0700, Stewart Smith flamingspork.com> wrote: >> On Mon, 12 Apr 2010 17:24:35 +0200, "Sebastian Spaeth" > SSpaeth.de> wrote: >> > What I find intersting is that we have a 2x speedup and a 10x speedup >> > for different

please eat my data!

2010-04-12 Thread Sebastian Spaeth
On 2010-04-12, Jameson Rollins wrote: > On Mon, 12 Apr 2010 15:33:35 +0200, "Sebastian Spaeth" > Wow, this is really > interesting, Sebastian. For those of us not in the > know, can you explain what libeatmydata is and how it's used? Hehe, I just got the pointer to it on IRC myself:

please eat my data!

2010-04-12 Thread ra...@free.fr
- "Jameson Rollins" a ?crit : > On Mon, 12 Apr 2010 15:33:35 +0200, "Sebastian Spaeth" > wrote: > > fsync is really killing xapian (and notmuch). What suffers, are the > > boolean prefixes (tag, id, and thread). Using libeatmydata (which > > disables fsync) shows a 10x speedup for tagging.

please eat my data!

2010-04-12 Thread Dirk Hohndel
On Mon, 12 Apr 2010 19:10:25 -0400, Servilio Afre Puentes wrote: > On 12 April 2010 13:47, Dirk Hohndel wrote: > > On Mon, 12 Apr 2010 10:14:05 -0700, Stewart Smith > flamingspork.com> wrote: > >> On Mon, 12 Apr 2010 17:24:35 +0200, "Sebastian Spaeth" >> SSpaeth.de> wrote: > >> > What I find

please eat my data!

2010-04-12 Thread Sebastian Spaeth
fsync is really killing xapian (and notmuch). What suffers, are the boolean prefixes (tag, id, and thread). Using libeatmydata (which disables fsync) shows a 10x speedup for tagging. The speedup is only factor 2 for e.g. from: searches. This is ext4 on recent stock Ubuntu. Given that search by tag

please eat my data!

2010-04-12 Thread Dirk Hohndel
On Mon, 12 Apr 2010 10:14:05 -0700, Stewart Smith wrote: > On Mon, 12 Apr 2010 17:24:35 +0200, "Sebastian Spaeth" SSpaeth.de> wrote: > > What I find intersting is that we have a 2x speedup and a 10x speedup > > for different queries. Olly was saying on IRC that both *should* really be > >

please eat my data!

2010-04-12 Thread Jameson Rollins
On Mon, 12 Apr 2010 15:33:35 +0200, "Sebastian Spaeth" wrote: > fsync is really killing xapian (and notmuch). What suffers, are the > boolean prefixes (tag, id, and thread). Using libeatmydata (which > disables fsync) shows a 10x speedup for tagging. The speedup is only > factor 2 for e.g. from:

please eat my data!

2010-04-12 Thread Stewart Smith
On Mon, 12 Apr 2010 17:24:35 +0200, "Sebastian Spaeth" wrote: > What I find intersting is that we have a 2x speedup and a 10x speedup > for different queries. Olly was saying on IRC that both *should* really be > behaving in much the same manner. Remember that on ext3 (and pretty sure ext4)

please eat my data!

2010-04-12 Thread Sebastian Spaeth
fsync is really killing xapian (and notmuch). What suffers, are the boolean prefixes (tag, id, and thread). Using libeatmydata (which disables fsync) shows a 10x speedup for tagging. The speedup is only factor 2 for e.g. from: searches. This is ext4 on recent stock Ubuntu. Given that search by tag

Re: please eat my data!

2010-04-12 Thread Jameson Rollins
On Mon, 12 Apr 2010 15:33:35 +0200, Sebastian Spaeth sebast...@sspaeth.de wrote: fsync is really killing xapian (and notmuch). What suffers, are the boolean prefixes (tag, id, and thread). Using libeatmydata (which disables fsync) shows a 10x speedup for tagging. The speedup is only factor 2

Re: please eat my data!

2010-04-12 Thread racin
- Jameson Rollins jroll...@finestructure.net a écrit : On Mon, 12 Apr 2010 15:33:35 +0200, Sebastian Spaeth sebast...@sspaeth.de wrote: fsync is really killing xapian (and notmuch). What suffers, are the boolean prefixes (tag, id, and thread). Using libeatmydata (which disables

Re: please eat my data!

2010-04-12 Thread Sebastian Spaeth
On 2010-04-12, Jameson Rollins wrote: On Mon, 12 Apr 2010 15:33:35 +0200, Sebastian Spaeth Wow, this is really interesting, Sebastian. For those of us not in the know, can you explain what libeatmydata is and how it's used? Hehe, I just got the pointer to it on IRC myself:

Re: please eat my data!

2010-04-12 Thread Stewart Smith
On Mon, 12 Apr 2010 17:24:35 +0200, Sebastian Spaeth sebast...@sspaeth.de wrote: What I find intersting is that we have a 2x speedup and a 10x speedup for different queries. Olly was saying on IRC that both *should* really be behaving in much the same manner. Remember that on ext3 (and pretty

Re: please eat my data!

2010-04-12 Thread Servilio Afre Puentes
On 12 April 2010 13:47, Dirk Hohndel hohn...@infradead.org wrote: On Mon, 12 Apr 2010 10:14:05 -0700, Stewart Smith stew...@flamingspork.com wrote: On Mon, 12 Apr 2010 17:24:35 +0200, Sebastian Spaeth sebast...@sspaeth.de wrote: What I find intersting is that we have a 2x speedup and a 10x

Re: please eat my data!

2010-04-12 Thread Dirk Hohndel
On Mon, 12 Apr 2010 19:10:25 -0400, Servilio Afre Puentes servi...@gmail.com wrote: On 12 April 2010 13:47, Dirk Hohndel hohn...@infradead.org wrote: On Mon, 12 Apr 2010 10:14:05 -0700, Stewart Smith stew...@flamingspork.com wrote: On Mon, 12 Apr 2010 17:24:35 +0200, Sebastian Spaeth