>>>>> Robin Bowes <[EMAIL PROTECTED]> writes: > So, 44 min 5 seconds to scan 22,161 files - mainly flac.
Hi Robin, I have a smaller collection of music, all MP3s, but I thought this was interesting so here's some statistics on scanning my collection. I just updated trunk/6.5 from svn. First, I have 8246 tracks: | % find /music/mp3 -name "*.mp3" | wc -l | 8246 Using shell utilities, I can dump all the tags in 20 seconds: | % time find /music/mp3 -name "*.mp3" -print0 | xargs -0 id3info > foo | find /music/mp3 -name "*.mp3" -print0 0.01s user 0.04s system 0% cpu 15.731 total | xargs -0 id3info > foo 6.99s user 12.10s system 99% cpu 19.183 total and the tags take up less than 4M: | % ll foo | -rw-r--r-- 1 greg greg 4008414 Aug 24 11:41 foo despite having been printed in an extremely verbose format: | *** Tag information for /music/mp3/cd/Buchanan, Roy/Second Album/01 - Filthy Teddy.mp3 | === TPE1 (Lead performer(s)/Soloist(s)): Roy Buchanan | === TALB (Album/Movie/Show title): Second Album | === TIT2 (Title/songname/content description): Filthy Teddy | === TCON (Content type): (0) | === TRCK (Track number/Position in set): 1/8 | === TSOP (Performer sort): Buchanan, Roy | === TYER (Year): 1973 | *** mp3 info | MPEG1/layer III | Bitrate: 192KBps | Frequency: 44KHz and not having achieved any savings from representing the duplicated artist and album names as pointers to shared objects. If I simply remove the "text" descriptions of the tags, that goes down to only 2.5K: | % sed 's/^\(=== ....\) (.*):/\1:/g' foo | wc -c | 2658968 By comparison, the slimserver scanner takes 5:30, more than 16 times longer: | % time /usr/bin/perl slim/svn/devel/trunk/server/scanner.pl \ | --prefsfile=/etc/slimserver.conf \ | --priority=0 \ | --wipe \ | --d_server >& slim.log | /usr/bin/perl slim/svn/devel/trunk/server/scanner.pl --priority=0 --wipe >& | 264.24s user 17.41s system 84% cpu 5:31.51 total What exactly is it doing all this time? The database created seems to be about 34M in size, so we're averaging more than 4K per track: | % ll slim/db/MySQL | -rw-rw---- 1 greg greg 5242880 Aug 24 09:39 ib_logfile0 | -rw-rw---- 1 greg greg 5242880 Aug 24 09:39 ib_logfile1 | -rw-rw---- 1 greg greg 35651584 Aug 24 09:39 ibdata1 This seems awfully high.. though I'm less concerned with wasting a few Mb of disk space than the time consumed. The machine is a dual Xeon 2.8 GHz, 4Gb RAM, running FC3. greg _______________________________________________ beta mailing list [email protected] http://lists.slimdevices.com/lists/listinfo/beta
