On Sun, 05 Dec 2010 11:27:01 +0000 Clive Eisen <cl...@serendipita.com> wrote:
> On 05/12/2010 10:52, Owen wrote: > > > > I have 445, 6 element csv files, about 350000 lines in all. I only > > have one machine, but a number of Linux OS. > > > > These csv files are parsed, the data checked for purity and then > > placed in an sqlite file. > > > > On one OS, this takes 30-35 minutes, on several other operating > > systems, it takes 7-8 hours. > > > > I am at a loss to understand why this is so. > > > > Are there any suggestions as to what may cause this anomaly? > > > > The version of SQLite is 3.6.13 > > > Um - we need more information > > Name the opsys (32 or 64 bit?) and their times > Name the file system types and their mount options where the sqlite > db resides and the respective times > > As a bare minimum Bingo! Thank you. It looks like relatime is the key The fast distro is a 32 bit system mounted ext3(rw, relatime) (30 mins) The slow distro is 64 bit system mounted ext4 (rw) (8 hrs) Another machine I tried was mounted type ext3(rw,quota) (5 hrs) Googling mount and relatime has throws many results and I will now do some experiments with different mount options. Owen