Re: [SlimDevices: Plugins] Custom Scan speed

2012-05-08 Thread MillmoorRon
Just an update to an old thread to add my experiences: I skipped 7.6 totally and reinstalled my entire operating system (Ubuntu 10.04LTS) on to a new small (but fast) SSD and installed LMS 7.7.2. All other hardware remained untouched with music being stored on a separate conventional HD. My

Re: [SlimDevices: Plugins] Custom Scan speed

2011-07-29 Thread PasTim
Daverz;644072 Wrote: Without the trick mentioned earlier in the thread, previous scan times with SBS 7.5 were at least 10 hours, which was ridiculous, especially if you only have a few things to add to the menus. 2.5 hours is back in the realm of reasonable for 60k tracks. Custom

Re: [SlimDevices: Plugins] Custom Scan speed

2011-07-29 Thread PasTim
PasTim;644678 Wrote: 7.6 crept up on me quite unexpectedly. I had been expecting it to come in a month or two (at the end of summer). Anyway, I made the move, using SQLite. On my Windows 7 64 bit system , SB 7.6 takes 3 to 4 times longer to scan my files from scratch. It used to take

Re: [SlimDevices: Plugins] Custom Scan speed

2011-07-27 Thread Daverz
Here's last night's scan with SBS 7.6 and CS v2.8.3378: [11-07-27 01:42:26.0290] Plugins::CustomScan::Scanner::initTrackScan (1413) Got 59491 tracks [...] [11-07-27 04:07:03.2186] Plugins::CustomScan::Scanner::exitScan (1048) Rescan finished Which is under 2.5 hours. Without the trick

Re: [SlimDevices: Plugins] Custom Scan speed

2011-04-01 Thread PasTim
MillmoorRon;621204 Wrote: I'm on 7.5.3 and last time I checked, following a full library rescan, Custom Scan took about 12 hours, but leaving my SB playing it took nearer 6 hours. I just tried this myself. It halved the custom scan time for me as well. I have noted in the past that when

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-27 Thread erland
Daverz;619562 Wrote: OK, now I've found something really bizarre. Maybe you know about this already: when music is streaming Custom Scan no longer waits several seconds at a time. (This is SBS 7.5.3 r31792, CS v2.10.3296, Ubuntu 10.10). Ok, this sounds really strange, scanning has

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-27 Thread MillmoorRon
I'm on 7.5.3 and last time I checked, following a full library rescan, Custom Scan took about 12 hours, but leaving my SB playing it took nearer 6 hours. -- MillmoorRon MillmoorRon's Profile:

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-21 Thread Daverz
OK, now I've found something really bizarre. Maybe you know about this already: when music is streaming Custom Scan no longer waits several seconds at a time. (This is SBS 7.5.3 r31792, CS v2.10.3296, Ubuntu 10.10). This is my procedure: 1. Set Custom Scan logging to DEBUG 2. Start all in

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-20 Thread erland
Daverz;619316 Wrote: That would be great, thanks. I'll also start looking at the Custom Scan code. The idea would be to replace the file scanning phase with just scanning the file (in XML or some Perl specific format?) produced by the external scanner. I've just sent you a PM about

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-20 Thread Daverz
erland;619362 Wrote: I've just sent you a PM about something else related to this. You should get a reply. As mentioned before, there is a risk the performance is more related to the the background scheduling in SBS than actually reading tags and write information to the database, if

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-19 Thread erland
Daverz;619120 Wrote: I wonder if an external scanner might be the way to go. I wrote a Python script that dumps all the tags to an easily parsed text file, and this only takes about 20 minutes to scan everything. Perhaps a plugin could then read and process the text file? Or does the data

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-19 Thread Daverz
erland;619146 Wrote: How long does Custom Scan take for the same library ? It takes about 10.5 hours for Custom Scan to scan 56k flacs. Here's a simple-minded Python script that uses 'mutagen' (http://code.google.com/p/mutagen/) to dump tags to an on-disk hashtable (just for a test

Re: [SlimDevices: Plugins] Custom Scan speed

2011-03-18 Thread Daverz
I wonder if an external scanner might be the way to go. I wrote a Python script that dumps all the tags to an easily parsed text file, and this only takes about 20 minutes to scan everything. Perhaps a plugin could then read and process the text file? Or does the data discovery have to be

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread PasTim
erland;608133 Wrote: I would consider that if 7.6 didn't already have a solution for it, but since 7.6 will improve this a lot I don't want to spend time making the current solution more advanced. I'm glad to see my nose for spotting potential sources of software problems hasn't entirely

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread MillmoorRon
PasTim;608057 Wrote: Your 12 hour custom scan sounds about the same as mine scaled up for the 2-3 hours it takes for (now) about 12,000 tracks. However, my straight SB full scan seems to be much quicker than yours. Maybe a difference in raw CPU/Disc power? (not that my PC is any great

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread PasTim
MillmoorRon;608230 Wrote: Mine's an AMD Athlon 64 X2 4800+ with 2 GB DDR2 RAM with music on internal SATAII Drive. Hardly a supercomputer but more than good enough for a dedicated Squeezecenter I would have thought! Mine's a lot older and slower than that, but more than adequate for most

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread volpone
PasTim;608233 Wrote: Mine's a lot older and slower than that, but more than adequate for most things. It sounds as if SB 7.6 is what we need. I don't know when this is due for official release, not whether a new version of the plugin will be needed. I'm using CustomScan with a quite large

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread erland
PasTim;608159 Wrote: Good news about 7.6. I'm very happy that an improvement is in the pipeline. Should I try the 7.6 beta or is that a bit risky? At the moment you won't see any improvement with 7.6, I need to implement support for the new scanner API first. I don't plan to do any

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-04 Thread PasTim
erland;608294 Wrote: A They will always continue to work on the current Squeezebox Server version, the question is when I no longer have the interest to spend my spare time for free to upgrade them to work with a new Squeezebox Server version. When this happens you might be forced to not

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread MillmoorRon
I've got more than 60k tracks and it takes about 12 hours to do a CustomScan (CustomTag only, 2 new tags) after the 2 hours it takes for a (full) Squeezecenter rescan. This is the only thing that is slower since I switched from Win to Ubuntu - no idea why though. Hard disc activity is fairly

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread erland
PasTim;607973 Wrote: When doing a custom scan my PC doesn't seem to be doing much. One task, SQUEEZ~3.exe, uses between 0 and 3%. Nothing much else seems to be using much CPU (user or kernel). The disks seem pretty quiet. What's going on? Sounds strange, SqueezeboxServer and MySQL

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread PasTim
erland;608008 Wrote: Sounds strange, SqueezeboxServer and MySQL processes should use more CPU during scanning. Exactly how have you configured the Custom Scan settings ? Are you using an internal harddisk or an USB or network drive ? I have an internal 1tb SATA 2 drive. Looking at the

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread PasTim
MillmoorRon;607997 Wrote: I've got more than 60k tracks and it takes about 12 hours to do a CustomScan (CustomTag only, 2 new tags) after the 2 hours it takes for a (full) Squeezecenter rescan. This is the only thing that is slower since I switched from Win to Ubuntu - no idea why though.

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread erland
PasTim;608057 Wrote: This makes me suspicious that something odd is happening in custom scans to make it use resources inefficiently (and periodically). Ah, that's probably it. I'm using the scheduling function in SBS since it's not possible to run third party scanners within the separate

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread SteveEast
Do you have to give control to SBS after every track? Or could you perhaps scan, say, 5 tracks at a time? Steve. -- SteveEast Home: 3*SB3 (1 dead), 1*Touch, 1*Boom, 4*Radio running 7.5.1 on Acer Aspire easyStore H340 WHS. Cabin: 1*Touch running 7.5.0 on itself.

Re: [SlimDevices: Plugins] Custom Scan speed

2011-02-03 Thread erland
SteveEast;608123 Wrote: Do you have to give control to SBS after every track? Or could you perhaps scan, say, 5 tracks at a time? Steve. I need to do it after every track, the reason is to at least make it theoretically possible to stream music simultaneously. Streaming is really

[SlimDevices: Plugins] Custom Scan speed

2011-01-29 Thread PasTim
I'm running 7.5.3 on a PC (XP). Doing the scans for Custom Scan with around 10,000 tracks on an internal SATA II drive is taking 2-3 hours. I have the Mixed Tag and Custom Tag scans (with 2 new tags being loaded) The main SB scan takes only 5-6 minutes. Is there any way I can speed up the