Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim wrote: Hi Erland - is there likely to be any progress with version 3? It'd be really nice to have fast scans for minor changes/additions if possible. I still hope to get some time to finish it, especially as I want it myself, it's just that I've had some trouble to find time for it during last months due to some other music related development activities which I at the moment have to give higher priority, due to this I don't expect much progress during next 2-3 months. However, if you still haven't seen any progress in a few months please feel free to push/remind me about it again. erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Hi Erland - is there likely to be any progress with version 3? It'd be really nice to have fast scans for minor changes/additions if possible. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Some problems with the Alpha Custom Scan, as attached. I'm not sure what caused them. I was doing a scan for changed music and it hung. SB wouldn't stop, and the scan never stopped. +---+ |Filename: log extract.txt | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=12591| +---+ -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
erland;659461 Wrote: Thanks, based on the log I think it's a bug somewhere, will take a look at it as soon as possible and post a new corrected version. I saw a new version of custom scan was out recently so had another go (I am also up to date on all the other plugins I use). I changed a custom tag on a track, rescanned for 'changed' only, and it all worked fine in a minute or 2. I tried again with a few more changes which didn't seem to 'take' for some reason, but at least custom scan ran, and ran quickly! Have you also done something to the custom browse menus that include custom tags? I may be wrong, but I think they have sped up back to where they were in 7.5.3-4. When I get time I'll do a few more tests, but this is definitely a major step forwards. Thanks! -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
A new alpha version of the new Custom Scan solution which support new/changed rescan under 7.6 is now available in the alpha repository specified in the first post in this thread. This new version will require you to install the latest version of License Manager plugin and obtain a license. The new version should at least solve: - Title formats under 7.6 and SQLite - Disc usage during rescan should now be a bit less (smaller WAL file) than before. - Should now work on Squeezebox Server on Windows If you try this, please let me know how the support for new/changed scanning works. If it still takes long time, please try to enable some logging in SBS Settings/Advanced/Logging on plugin.customscan and look in the log to see if you can see the log messages when it starts to take long time. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) Interested in music discovery ? See 'Social Music Discovery (SMD)' (http://forums.slimdevices.com/showthread.php?p=656713) project. erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Results below for 1st scan. So far so good. I don't see much change in speed, but no issues thus far. Discovering files/directories: D:\Music\flac (19704 of 19704) Complete 00:00:40 Scanning new files: D:\Music\flac (14846 of 14846) Complete 00:09:10 Discovering playlists: D:\Music\playlists (8 of 8) Complete 00:00:00 Scanning new playlists: D:\Music\playlists (7 of 7) Complete 00:00:00 Custom Scan refresh (10 of 10) Complete 00:02:05 Custom Scan tracks (14843 of 14843) Complete 00:45:04 Custom Scan post process tracks (1 of 1) Complete 00:02:55 Custom Scan optimize (3 of 3) Complete 00:00:04 Pre-caching Artwork (68 of 68) Complete 00:00:03 The server has finished scanning your music collection. Total Time: 01:00:01 (Saturday, September 24, 2011 / 15.04.14) -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim;659423 Wrote: Results below for 1st scan. So far so good. I don't see much change in speed, but no issues thus far. The main speed difference related to scanning speed will be if you perform a new/changed rescan, this should be a lot faster with this alpha version compared to the 2.8.x version in the official repository. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) Interested in music discovery ? See 'Social Music Discovery (SMD)' (http://forums.slimdevices.com/showthread.php?p=656713) project. erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
erland;659425 Wrote: The main speed difference related to scanning speed will be if you perform a new/changed rescan, this should be a lot faster with this alpha version compared to the 2.8.x version in the official repository. I tried changing just one Custom tag and doing a 'look for changed' rescan. CustomScan is set to do an automatic scan. The SB scan took seconds. Customscan is still running 45 minutes later. Is that because I didn't change a standard tag as well, or is there something else going on? I notice there's nothing about the customscan in the server log for this scan. I'll tweak the log setting if you need a log. I also noticed that the standard scan details on the basic page did not show the Customscan phase, unlike it did when I did a full 'clear library and rescan'. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim;659438 Wrote: I tried changing just one Custom tag and doing a 'look for changed' rescan. CustomScan is set to do an automatic scan. The SB scan took seconds. Customscan is still running 45 minutes later. Is that because I didn't change a standard tag as well, or is there something else going on? I notice there's nothing about the customscan in the server log for this scan. I'll tweak the log setting if you need a log. Try to enable some logging on plugin.customscan in Settings/Advanced/Logging and see if you can see what it's doing, you should be able to even set the log level to debug as long as you keep plugin.customscan.customtag at info level. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) Interested in music discovery ? See 'Social Music Discovery (SMD)' (http://forums.slimdevices.com/showthread.php?p=656713) project. erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
The previous customscan never appeared to finish according to the 'manage scanning' screen, but the server seemed to be idle. The change I made had not appeared in the customscan database. I stopped the server, made another trivial change to the same tag, started the server, changed the log settings, and rescanned as before. Results attached. The forum would not me post the text: Images include use of smilies, the BB code [img] tag and HTML img tags. The use of these is all subject to them being enabled by the administrator. I don't understand why. +---+ |Filename: customscan.txt | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=12526| +---+ -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim;659458 Wrote: The previous customscan never appeared to finish according to the 'manage scanning' screen, but the server seemed to be idle. The change I made had not appeared in the customscan database. I stopped the server, made another trivial change to the same tag, started the server, changed the log settings, and rescanned as before. Results attached. The forum would not me post the text: Images include use of smilies, the BB code [img] tag and HTML img tags. The use of these is all subject to them being enabled by the administrator. I don't understand why. Thanks, based on the log I think it's a bug somewhere, will take a look at it as soon as possible and post a new corrected version. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) Interested in music discovery ? See 'Social Music Discovery (SMD)' (http://forums.slimdevices.com/showthread.php?p=656713) project. erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
erland;654503 Wrote: Thanks for trying, it looks like it will require some bigger changes so you will have to wait until I have a new release ready. You're welcome. Post again here if you want me to try again sometime. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
I have just given it a try. The scanner log contains errors, as below, as if custom scan is not installed properly. The plugin is v3.0pre3426. If I want to revert to the earlier one, how do I do that? Just delete the line from the Alpha list at the bottom of the settings/plugins? [11-08-31 18:00:38.9098] main::main (196) Starting Squeezebox Server scanner (v7.6.1, r33110, Thu Aug 18 03:48:58 PDT 2011) perl 5.01 [11-08-31 18:00:42.4812] Slim::bootstrap::tryModuleLoad (289) Warning: Module [Plugins::CustomScan::Importer] failed to load: Base class package Slim::Web::Settings is empty. (Perhaps you need to 'use' the module which defines that package first, or make that module available in @INC (@INC contains: C:\ProgramData\Squeezebox\Cache\InstalledPlugins\Plugins\CustomScan\lib C:\ProgramData\Squeezebox\Cache\InstalledPlugins C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10.0\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10.0\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\lib C:\PROGRA~2\SQUEEZ~1\server\CPAN C:/PROGRA~2/SQUEEZ~1/server C:/PROGRA~2/SQUEEZ~1/server C:\Users\SQUEEZ~1\AppData\Local\Temp\pdk-Squeezebox-4796\ C:\PROGRA~2\SQUEEZ~1\server). at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/BaseSettings.pm line 20 BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/BaseSettings.pm line 20. Compilation failed in require at (eval 1170) line 3. ...propagated at /C:\PROGRA~2\SQUEEZ~1\server\scanner.exebase.pm line 93. BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/ModuleSettings.pm line 19. Compilation failed in require at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Importer.pm line 43. BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Importer.pm line 43. Compilation failed in require at (eval 1057) line 2. BEGIN failed--compilation aborted at (eval 1057) line 2. [11-08-31 18:00:42.5408] Slim::Utils::PluginManager::load (288) Error: Couldn't load Plugins::CustomScan::Importer [11-08-31 18:00:46.5007] Slim::Music::Import::runImporter (460) Starting Slim::Music::MusicFolderScan scan [11-08-31 18:00:46.5018] Slim::Utils::Scanner::Local::rescan (166) Discovering files in D:\Music\flac [11-08-31 18:01:22.6900] Slim::Utils::Scanner::Local::__ANON__ (246) Removing deleted files (0) [11-08-31 18:01:22.6907] Slim::Utils::Scanner::Local::__ANON__ (321) Scanning new files (14638) [11-08-31 18:02:37.7032] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/B/Beethoven/Symphonies/3/Marriner/Sir%20Neville%20Marriner%20Beethoven%20Symphony%20No.%203%20in%20Eb%20major,%20Op.%2055%20%27Eroica%27.cue [11-08-31 18:04:39.8339] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/M/Mahler/Symphonies/4/Tennstedt/Klaus%20Tennstedt%20-%20Lucia%20Popp%20-%20London%20Philarmonic%20Orchestra%20-%20EMI.cue [11-08-31 18:04:54.6969] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/M/Mozart,%20WA/Piano%20Concertos/19/Serkin/Mozart%20-%20Klavierkonzert%20Nr.19,%2025%20-%20Serkin.cue [11-08-31 18:07:48.2076] Slim::Utils::Scanner::Local::__ANON__ (396) Rescanning changed files (0) [11-08-31 18:07:48.2085] Slim::Music::Import::endImporter (592) Completed Slim::Music::MusicFolderScan Scan in 421 seconds. [11-08-31 18:07:48.2093] Slim::Music::Import::runImporter (460) Starting Slim::Music::PlaylistFolderScan scan [11-08-31 18:07:48.2103] Slim::Utils::Scanner::Local::rescan (166) Discovering files in D:\Music\playlists [11-08-31 18:07:48.7348] Slim::Utils::Scanner::Local::__ANON__ (246) Removing deleted files (0) [11-08-31 18:07:48.7353] Slim::Utils::Scanner::Local::__ANON__ (321) Scanning new files (5) [11-08-31 18:07:48.9168] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Chriss%20Desktop-00_0c_76_14_b4_66.m3u [11-08-31 18:07:48.9321] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Squeezebox%20Touch-00_04_20_22_70_65.m3u [11-08-31 18:07:48.9434] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Tims%20Desktop-00_16_17_6e_10_66.m3u [11-08-31 18:07:48.9544] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Touch-00_04_20_22_70_65.m3u [11-08-31 18:07:48.9744] Slim::Utils::Scanner::Local::new (783) Handling new playlist
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim;654417 Wrote: I have just given it a try. The scanner log contains errors, as below, as if custom scan is not installed properly. The plugin is v3.0pre3426. Thanks, if you are willing to patch it, you can try to open the CustomScan/Importer.pm file and remove the following lines in a text editor: Code: use Plugins::CustomScan::ModuleSettings; use Plugins::CustomScan::Settings; use Plugins::CustomScan::Manage; I'll try to fix it in a future release but there are some other stuff I like to focus on first, so it might take a while. PasTim;654417 Wrote: If I want to revert to the earlier one, how do I do that? Just delete the line from the Alpha list at the bottom of the settings/plugins? Yes, I think you might have to uninstall it and reinstall it after you have changed the repository list, to get the old version. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
I deleted those 3 lines and tried again (after a restart). I still get similar errors, as below: [11-08-31 20:07:45.8936] main::main (196) Starting Squeezebox Server scanner (v7.6.1, r33110, Thu Aug 18 03:48:58 PDT 2011) perl 5.01 [11-08-31 20:07:48.4098] Slim::bootstrap::tryModuleLoad (289) Warning: Module [Plugins::CustomScan::Importer] failed to load: Base class package Slim::Web::Settings is empty. (Perhaps you need to 'use' the module which defines that package first, or make that module available in @INC (@INC contains: C:\ProgramData\Squeezebox\Cache\InstalledPlugins\Plugins\CustomScan\lib C:\ProgramData\Squeezebox\Cache\InstalledPlugins C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10.0\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10.0\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\5.10\MSWin32-x86-multi-thread\auto C:\PROGRA~2\SQUEEZ~1\server\CPAN\arch\MSWin32-x86-multi-thread C:\PROGRA~2\SQUEEZ~1\server\lib C:\PROGRA~2\SQUEEZ~1\server\CPAN C:/PROGRA~2/SQUEEZ~1/server C:/PROGRA~2/SQUEEZ~1/server C:\Users\SQUEEZ~1\AppData\Local\Temp\pdk-Squeezebox-5016\ C:\PROGRA~2\SQUEEZ~1\server). at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/BaseSettings.pm line 20 BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/BaseSettings.pm line 20. Compilation failed in require at (eval 1200) line 3. ...propagated at /C:\PROGRA~2\SQUEEZ~1\server\scanner.exebase.pm line 93. BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/ModuleSettings.pm line 19. Compilation failed in require at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Plugin.pm line 43. BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Plugin.pm line 43. Compilation failed in require at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Importer.pm line 46. BEGIN failed--compilation aborted at C:\ProgramData\Squeezebox\Cache\InstalledPlugins/Plugins/CustomScan/Importer.pm line 46. Compilation failed in require at (eval 1060) line 2. BEGIN failed--compilation aborted at (eval 1060) line 2. [11-08-31 20:07:48.4812] Slim::Utils::PluginManager::load (288) Error: Couldn't load Plugins::CustomScan::Importer [11-08-31 20:07:55.8903] Slim::Music::Import::runImporter (460) Starting Slim::Music::MusicFolderScan scan [11-08-31 20:07:55.8912] Slim::Utils::Scanner::Local::rescan (166) Discovering files in D:\Music\flac [11-08-31 20:08:35.2935] Slim::Utils::Scanner::Local::__ANON__ (246) Removing deleted files (0) [11-08-31 20:08:35.2942] Slim::Utils::Scanner::Local::__ANON__ (321) Scanning new files (14638) [11-08-31 20:10:03.6468] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/B/Beethoven/Symphonies/3/Marriner/Sir%20Neville%20Marriner%20Beethoven%20Symphony%20No.%203%20in%20Eb%20major,%20Op.%2055%20%27Eroica%27.cue [11-08-31 20:12:22.8904] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/M/Mahler/Symphonies/4/Tennstedt/Klaus%20Tennstedt%20-%20Lucia%20Popp%20-%20London%20Philarmonic%20Orchestra%20-%20EMI.cue [11-08-31 20:12:43.7138] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/flac/Classical/M/Mozart,%20WA/Piano%20Concertos/19/Serkin/Mozart%20-%20Klavierkonzert%20Nr.19,%2025%20-%20Serkin.cue [11-08-31 20:16:25.4482] Slim::Utils::Scanner::Local::__ANON__ (396) Rescanning changed files (0) [11-08-31 20:16:25.4492] Slim::Music::Import::endImporter (592) Completed Slim::Music::MusicFolderScan Scan in 509 seconds. [11-08-31 20:16:25.4499] Slim::Music::Import::runImporter (460) Starting Slim::Music::PlaylistFolderScan scan [11-08-31 20:16:25.4507] Slim::Utils::Scanner::Local::rescan (166) Discovering files in D:\Music\playlists [11-08-31 20:16:26.2392] Slim::Utils::Scanner::Local::__ANON__ (246) Removing deleted files (0) [11-08-31 20:16:26.2398] Slim::Utils::Scanner::Local::__ANON__ (321) Scanning new files (5) [11-08-31 20:16:26.4232] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Chriss%20Desktop-00_0c_76_14_b4_66.m3u [11-08-31 20:16:26.4512] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Squeezebox%20Touch-00_04_20_22_70_65.m3u [11-08-31 20:16:26.4629] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Tims%20Desktop-00_16_17_6e_10_66.m3u [11-08-31 20:16:26.4743] Slim::Utils::Scanner::Local::new (783) Handling new playlist file:///D:/Music/playlists/SyncOptions-Touch-00_04_20_22_70_65.m3u [11-08-31 20:16:26.4933]
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
And I should have mentioned I use Custom and Mixed tags, with manual Ratings tag. All 'refresh/rescan' options are set to 'Yes'. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
PasTim;654464 Wrote: I deleted those 3 lines and tried again (after a restart). I still get similar errors, as below: Thanks for trying, it looks like it will require some bigger changes so you will have to wait until I have a new release ready. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Hi Erland, I just loaded this up to give it a try. I am a bit confused by some of your comments, hopefully you can explain. You say 'my hope is that this should make it possible to play music without interruption while doing a full rescan'. What do you mean about a full rescan? If you are talking 'Clear library and rescan everything' (which I am currently doing) then you have no music when scanning (as it has yet to be discovered), or are you talking about from mysqueezebox.com? I put on the radio whilst scanning and had rebuffering issues at the end of the scanning new files stage (300 files or so from the end) Another comment, I don't understand Haven't tested or implemented anything regarding export/import modules provided by TrackStat, so my guess is that these probably won't work yet when triggered from the main SBS scanner. Do you mean, only LastFM, custom Tag, Mixed Tag and Rating Tag work? If so, I use none of them, so I am not sure my test will prove anything. So onto your rescan performance question. As I don't use any of the implemented features I guess it will be similar. But with Custom Scan enabled I get: Discovering files/directories: \\TheMACServer\Music\Music (16935 of 16935) Complete 00:03:07 Scanning new files: \\TheMACServer\Music\Music (14696 of 14696) Complete 00:37:02 Discovering playlists: \\TheMACServer\Music\Squeezebox\Playlists (133 of 133) Complete 00:00:02 Scanning new playlists: \\TheMACServer\Music\Squeezebox\Playlists (125 of 125) Complete 00:00:39 Pre-caching Artwork (1511 of 1511) Complete 00:05:27 The server has finished scanning your music collection. Total Time: 00:46:17 (Monday, August 22, 2011 / 10:02 AM) I also get the following in the log: [11-08-22 09:08:52.0783] main::init (350) Starting Squeezebox Server (v7.6.1, r33110, Wed Aug 17 18:52:34 PDT 2011) perl 5.01 [11-08-22 09:23:23.7602] Slim::Control::Request::notify (2079) Error: Failed notify: Can't call method secs on an undefined value at C:\Documents and Settings\All Users\Application Data\Squeezebox\Cache\InstalledPlugins/Plugins/TrackStat/Plugin.pm line 3983. [11-08-22 09:23:24.0928] Plugins::TrackStat::Plugin::getCLIRating (4439) Track -155253332 not found [11-08-22 09:23:24.0933] Slim::Plugin::CLI::Plugin::cli_process (649) Request [trackstat] failed with error: Bad params! [11-08-22 09:23:25.4281] Plugins::TrackStat::Plugin::getCLIRating (4439) Track -166400292 not found [11-08-22 09:23:25.4669] Slim::Plugin::CLI::Plugin::cli_process (649) Request [trackstat] failed with error: Bad params! Without I get: Discovering files/directories: \\TheMACServer\Music\Music (16935 of 16935) Complete 00:04:01 Scanning new files: \\TheMACServer\Music\Music (14696 of 14696) Complete 00:38:51 Discovering playlists: \\TheMACServer\Music\Squeezebox\Playlists (133 of 133) Complete 00:00:02 Scanning new playlists: \\TheMACServer\Music\Squeezebox\Playlists (125 of 125) Complete 00:00:50 Pre-caching Artwork (1511 of 1511) Complete 00:08:16 The server has finished scanning your music collection. Total Time: 00:52:00 (Monday, August 22, 2011 / 11:04 AM) So it's faster by 6 minutes! I get this in the log [11-08-22 10:41:53.0279] Plugins::TrackStat::Plugin::getCLIRating (4439) Track -155253332 not found [11-08-22 10:41:53.0284] Slim::Plugin::CLI::Plugin::cli_process (649) Request [trackstat] failed with error: Bad params! [11-08-22 10:41:54.0767] Plugins::TrackStat::Plugin::getCLIRating (4439) Track -166400292 not found [11-08-22 10:41:54.0772] Slim::Plugin::CLI::Plugin::cli_process (649) Request [trackstat] failed with error: Bad params! I checked disc usage and nothing out of the ordinary. I tried adding some new music and just scanning for that. I get: Discovering files/directories: \\TheMACServer\Music\Music (17001 of 17001) Complete 00:03:26 Removing deleted files: \\TheMACServer\Music\Music (0 of 1) Running 00:00:00 Scanning new files: \\TheMACServer\Music\Music (0 of 56) Running 00:00:00 and my server has hung with CPU=100% If you want me to check anything else let me know HTH CW -- Chunkywizard *Squeezebox:* Boom x2 (Lounge and Office), Radio (with battery) *Server:* 7.6.1 for Windows Home Server (HP EX-490 MediaSmart Server) *Plugins:* Dynamic Playlists 2.8.4 | SQL Playlist 2.5.3359 | Music Information Screen 4.4.7 | Custom Scan 2.83378 | TrackStat 2.10.3366 | Album Review 2.9.5 | Biography 2.9.4 *Remote:* iPod Touch Gen. 1 running 'iPeng' (http://penguinlovesmusic.de/2008/11/25/ipeng-application-now-on-app-store/) *Music: *'Last.fm' (http://www.last.fm/user/chunkywizard) Chunkywizard's Profile: http://forums.slimdevices.com/member.php?userid=25868 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Chunkywizard;651767 Wrote: I just loaded this up to give it a try. I am a bit confused by some of your comments, hopefully you can explain. You say 'my hope is that this should make it possible to play music without interruption while doing a full rescan'. What do you mean about a full rescan? If you are talking 'Clear library and rescan everything' (which I am currently doing) then you have no music when scanning (as it has yet to be discovered), or are you talking about from mysqueezebox.com? I put on the radio whilst scanning and had rebuffering issues at the end of the scanning new files stage (300 files or so from the end) Isn't the library filled bit by bit so you can start playing the already scanned tracks before the complete scanning is finished. The new/changed files rescanning when you have changed many files will still have playback disturbances and I'm not sure that's possible to avoid, the advantage is that rescanning 10 added files will take 5 seconds instead of 4 hours as it can take to rescan the whole library as Custom Scan did before. Chunkywizard;651767 Wrote: Another comment, I don't understand Haven't tested or implemented anything regarding export/import modules provided by TrackStat, so my guess is that these probably won't work yet when triggered from the main SBS scanner. Do you mean, only LastFM, custom Tag, Mixed Tag and Rating Tag work? If so, I use none of them, so I am not sure my test will prove anything. At the moment I think only LastFM, Custom Tag, Mixed Tag and Rating Tag will work. I'll see if it's easy to add the TrackStat based import/export module sometime soon, hopefully later this week. Chunkywizard;651767 Wrote: I checked disc usage and nothing out of the ordinary. I tried adding some new music and just scanning for that. Disc usage is only relevant if you use one of the scanning modules provided by the Custom Scan module itself, I suspect it's mostly Custom Tag, Mixed Tag and LastFM module that might cause problems regarding disc usage. Chunkywizard;651767 Wrote: I get: Discovering files/directories: \\TheMACServer\Music\Music (17001 of 17001) Complete 00:03:26 Removing deleted files: \\TheMACServer\Music\Music (0 of 1) Running 00:00:00 Scanning new files: \\TheMACServer\Music\Music (0 of 56) Running 00:00:00 and my server has hung with CPU=100% Could you try to enable debug logging in both plugin.trackstat and plugin.customscan and see if you get any errors in the server.log or scanner.log when the server hangs with 100% CPU. I suspect it might be related to the TrackStat refresh operation which execute when SBS scanning is finished but I'm not completely sure, the server.log or scanner.log when activating debug logging for Custom Scan/TrackStat should indicate if this is the case. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Erland, I am eager to try, but events (and PCs) conspire against me. My internal Hard Disk has given up the ghost after only 8 months, so I am on my USB backup. I do have another slightly older USB backup as well (belt and braces) but am a little nervous if it's likely to break the main database (although I can live with broken trackstat). I'm also unusually busy (for me) from now until next week and am out about much of the time. If you still want help next week I'll give it a go (having first taken another backup - and hopefully my replacement HD will arrive by then). I normally only scan Custom and Mixed. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
[SlimDevices: Plugins] Need help to test Custom Scan with support for new/changed scanning
Hi I've implemented a very preliminary alpha version of Custom Scan plugin for 7.6 which following changes: 1. When doing a full rescan, Custom Scan now runs inside the main scanner process, my hope is that this should make it possible to play music without interruption while doing a full rescan. 2. When a new/changed files scanning is performed in SBS, Custom Scan will now only rescan the changed/new/deleted files instead of doing a full rescan. 3. The status of Custom Scan rescans triggered by a SBS rescan is now shown in the main status dialog in SBS Settings/Information. Known limitations in this alpha version: - Haven't tested or implemented anything regarding export/import modules provided by TrackStat, so my guess is that these probably won't work yet when triggered from the main SBS scanner. - A scanning triggered by SBS rescan can currently not be aborted in a nice way, I'll implement this but I wanted to make something available for testing already now. It's still possible to trigger a rescan the old way through the Custom Scan settings page, but this won't take advantage of the new features, it will basically work exactly as before. Now, there is a lot of work left before this is ready for general usage, but I'm posting it here because I really need help to test it. I'd strongly recommend anyone testing it to either use a separate environment or make sure that you take a backup of the Cache directory (or at least the database files or TrackStat data) before so you can easily restore it afterwards if something goes wrong. The reason a backup is important is in case it hangs or crashes as I've seen issues where this can in worst case corrupt the database (where TrackStat data is stored). The things I'd like help to test is: - Performance of full rescans, is it better or worse than before ? - Accuracy of new/changed rescan, does it seem to do the right thing ? - Is there any disturbance in music playing while scanning ? - How is the disc usage during scanning ? I'm asking as I saw the persist.db-wal file to get really large (over 500MB) in my own setup with only 3500 tracks so I want to be sure this doesn't get worse in larger libraries. To install it you need to add the following repository to SBS Settings/Plugins: Code: http://erlandplugins.googlecode.com/svn/repository/trunk/alpha.xml And then just upgrade/install the Custom Scan alpha version that appears in the list. I'm not sure any of this will be included in an official release yet, depends on how much inspiration and available spare time I get to finish it. If you want to encourage future work in this direction or make it more prioritized, you know where to find the donation link. If you try this alpha version and find some issues: - Describe the issues and post back to this thread - And if the error is a crash or something that's hard to reproduce, try to enable debug logging of plugin.customscan in SBS Settings/Advanced/Logging and post any error messages in server.log or scanner.log. Also, please post back in this thread also if you try it and it works without any problems as I'd like to know if someone has tested it. -- erland Erland Isaksson ('My homepage' (http://erland.isaksson.info)) (Developer of 'many plugins/applets' (http://wiki.slimdevices.com/index.php/User:Erland). If my answer helped you and you like to encourage future presence on this forum and/or third party plugin/applet development, 'donations are always appreciated' (http://erland.isaksson.info/donate)) erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=89768 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins