Re: [SlimDevices: Plugins] Custom Scan and 7.6
I do not start a new thread since the title of this one fits my question. Please don't see this as hijacking ;-) I like to see the ALBUMARTIST in the title format used by the web interface. Since Squeezebox Server does not do this by itself I use CustomScan MixedTags. The actual title format incl. the field CUSTOMSCAN_MIXEDTAG_ALBUMARTIST is set on the Interface page of the server settings. That worked very well until the update to 7.6.1 (I skipped 7.6). The field CUSTOMSCAN_MIXEDTAG_ALBUMARTIST is still available but always empty. Any idea why? Cheers Frank -- frank_from_hh frank_from_hh's Profile: http://forums.slimdevices.com/member.php?userid=25866 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;650439 Wrote: Just to better understand the real problem here, could you look in the server.log file and see how long time it is between the log message saying: CustomScan: Synchronizing Custom Scan data, please wait... And the one saying: CustomScan: Synchronization finished I'm interested in the time it takes between these two log messages both at Squeezebox Server startup and also after a Custom Scan operation has started due to browsing by Music Folder. On my system I don't get a message at startup from Custom Scan. I assume that's because it is not configured to rescan at startup (there is no way I'm waiting an hour every morning before I can play music). For a manually initiated rescan something odd is now happening at times. When I click once on scan all it waits, and then sometimes says it is already running (message in red on the GUI - Scanning already in progress, wait until its finished). It still runs though. An example of a Music Folder initiated scan (messages only - the actual scans take around an hour): [11-08-12 12:10:04.0352] Slim::Utils::Scanner::Local::rescan (166) Discovering files in D:\Music\flac\Classical\C\Chopin\Scherzi\Ashkenazy [11-08-12 12:10:05.0036] Slim::Utils::Scanner::Local::__ANON__ (246) Removing deleted files (0) [11-08-12 12:10:05.0040] Slim::Utils::Scanner::Local::__ANON__ (321) Scanning new files (1) [11-08-12 12:10:06.0799] Slim::Utils::Scanner::Local::__ANON__ (396) Rescanning changed files (0) [11-08-12 12:10:06.1067] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-12 12:14:22.8033] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished A Manual scan: [11-08-15 13:51:24.9851] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-15 13:54:41.1781] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished And a manual scan this morning: [11-08-17 07:26:16.3405] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-17 07:27:36.2450] Slim::Networking::SqueezeNetwork::Players::_players_error (317) Unable to get players from SN: Connect timed out: Bad file descriptor, retrying in 300 seconds [11-08-17 07:27:36.2565] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;650456 Wrote:
On my system I don't get a message at startup from Custom Scan. I
assume that's because it is not configured to rescan at startup (there
is no way I'm waiting an hour every morning before I can play music).
Does it do a rescan at startup ???
It's supposed to only do the synchronization/refresh operation and that
seems to take about 4 minutes in your system according to these logs.
I understand 4 minutes is still too much at startup but if it really
does a 2 hour rescan at startup if you enable the Startup refresh
option I like to know because then there might be more serious issues
in SBS which Logitech needs to solve.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
Hi erland, I see this also. The log reports [11-08-17 09:31:39.6077] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-17 09:31:39.7355] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished but if you go into Settings:Plug Ins:Custom Scan it still reports 'Scanning in Progress' even if you hit refresh. This takes about an hour to disappear Normally it makes playback very stuttery but today it seems to be behaving. I am on 7.6.1. r33094 (rc1 I believe) Let me know if there is any further information you need Regards CW -- Chunkywizard *Squeezebox:* Boom x2 (Lounge and Office), Radio (with battery) *Server:* 7.6.0 for Windows Home Server (HP EX-490 MediaSmart Server) *Plugins:* Dynamic Playlists 2.8.4 | SQL Playlist 2.5.3359 | Music Information Screen 4.4.7 | Custom Scan 2.83378 | TrackStat 2.10.3366 | Album Review 2.9.5 | Biography 2.9.4 *Remote:* iPod Touch Gen. 1 running 'iPeng' (http://penguinlovesmusic.de/2008/11/25/ipeng-application-now-on-app-store/) *Music: *'Last.fm' (http://www.last.fm/user/chunkywizard) Chunkywizard's Profile: http://forums.slimdevices.com/member.php?userid=25868 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;650471 Wrote: Does it do a rescan at startup ??? It's supposed to only do the synchronization/refresh operation and that seems to take about 4 minutes in your system according to these logs. I understand 4 minutes is still too much at startup but if it really does a 2 hour rescan at startup if you enable the Startup refresh option I like to know because then there might be more serious issues in SBS which Logitech needs to solve. I confess to being a little confused. I have always run with the 1st two Custom Scan 'refresh' options turned off. I had assumed these were for scanning. I had not appreciated that a refresh was something different. I have now turned them on. I stopped restarted SB - no Custom Scan message. I checked I had saved the options. I had. I rebooted the PC (which restarts SB as a service). Still no Custom Scan messages. I tried using one of the menus that I reported elsewhere as being slow first time. They were quick enough (10 seconds, not 60 or more). So maybe I now understand what a 'refresh' is - it reads the tags so that it can respond to requests quickly. Why there is no log message I don't know. Do you want me to turn on more logging? -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;650487 Wrote:
I confess to being a little confused. I have always run with the 1st
two Custom Scan 'refresh' options turned off. I had assumed these were
for scanning. I had not appreciated that a refresh was something
different.
REFRESH
Synchronize the contents in Custom Scan database tables with the
standard tables used by SBS. Primarily this is needed if you have
renamed or moved some track or performed a full rescan in SBS.
The goal is that the refresh should take maximum a few seconds, so
there shouldn't be any problems to do it at SBS startup and after a SBS
rescan. Refresh at startup is activated through the Startup refresh
option and refresh after rescan is activated through the Rescan
refresh option.
Nothing else can be done by the server while the refresh operation
executes, so this can disturb music but should only do so during a few
seconds and the hardware players usually have enough audio buffer to
handle that without disrupting the sound.
RESCAN
Performs a rescan where it:
- Deletes existing Custom Scan data from database
- Reads tags from all music files
- Write the tag data back to Custom Scan tables in the database
The rescan usually takes a long time since it currently needs to go
through the complete library.
With the Rescan refresh option, you will configure Custom Scan to
start by doing a Refresh and then continue to do a rescan when a
rescan is triggered, a rescan can be triggered:
- Manually through Custom Scan settings page by clicking the scan
links
or
- Automatically after a SBS rescan if the Automatic rescan option is
enabled in Custom Scan.
The rescan operation is performed in the background and the intention
is that it shouldn't disturb music, the exception is the Mixed Tag
scanning module which runs at the end and usually is fairly quick.
However, 7.6 seems to be more aggressive to execute background work so
due to this the scanning process itself might disturb music in 7.6. The
solution to this is to rewrite the scanning logic in Custom Scan to use
the new scanner API which is available in 7.6, but this is a bit of
work to do as I've mentioned earlier so I'm not sure exactly when it
will happen. If I get the time and inspiration I might take a look at
it fairly soon, at least to see how much work it is, with the new
scanning API it should be possible to also support incremental scanning
which means that the rescan part of the process will be very quick if
you just have added/updated/deleted a few tracks.
PasTim;650487 Wrote:
I have now turned them on.
I stopped restarted SB - no Custom Scan message. I checked I had
saved the options. I had. I rebooted the PC (which restarts SB as a
service). Still no Custom Scan messages.
Why there is no log message I don't know. Do you want me to turn on
more logging?
They should be logged if the plugin.customscan logging point has been
configured to log warning (or info or debug) in SBS
Settings/Advanced/Logging.
Is this the case ?
PasTim;650487 Wrote:
I tried using one of the menus that I reported elsewhere as being slow
first time. They were quick enough (10 seconds, not 60 or more).
So maybe I now understand what a 'refresh' is - it reads the tags so
that it can respond to requests quickly.
I don't think the refresh operation currently will affect performance,
it's more about making sure the Custom Scan and standard SBS data is in
sync.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
Hi erland, thanks for the explanation, it helps clarify things a bit for me. So my log was for a refresh then (hence why it was so quick - I renamed the artist for one album). What I don't understand is why Settings:Plug Ins:Custom Scan is still reporting 'Scanning in Progress' even if you hit refresh. I have all scanning module set to Manual, yet the iTunes input one still shows scanning. Do you have to restart SBS after changing options (I only set the scan to be manual today) CW -- Chunkywizard *Squeezebox:* Boom x2 (Lounge and Office), Radio (with battery) *Server:* 7.6.0 for Windows Home Server (HP EX-490 MediaSmart Server) *Plugins:* Dynamic Playlists 2.8.4 | SQL Playlist 2.5.3359 | Music Information Screen 4.4.7 | Custom Scan 2.83378 | TrackStat 2.10.3366 | Album Review 2.9.5 | Biography 2.9.4 *Remote:* iPod Touch Gen. 1 running 'iPeng' (http://penguinlovesmusic.de/2008/11/25/ipeng-application-now-on-app-store/) *Music: *'Last.fm' (http://www.last.fm/user/chunkywizard) Chunkywizard's Profile: http://forums.slimdevices.com/member.php?userid=25868 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;650492 Wrote: They should be logged if the plugin.customscan logging point has been configured to log warning (or info or debug) in SBS Settings/Advanced/Logging. Is this the case ? Thanks for the information. I understand a bit better now. I have 'Warn' on the customscan log. There's no log at startup (see below - 3 starts), although it does appear to do something - startup is slower, and once I am into SB the CB menus are quicker the first time I use them. The previous logs I posted were produced with the same log settings (ie they are unchanged). [11-08-17 09:13:52.7485] main::init (349) Starting Squeezebox Server (v7.6.1, r33082, Mon Aug 15 02:06:39 PDT 2011) perl 5.01 [11-08-17 09:38:59.3518] main::init (349) Starting Squeezebox Server (v7.6.1, r33082, Mon Aug 15 02:06:39 PDT 2011) perl 5.01 [11-08-17 10:34:28.6105] main::init (349) Starting Squeezebox Server (v7.6.1, r33082, Mon Aug 15 02:06:39 PDT 2011) perl 5.01 -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;650498 Wrote: I have 'Warn' on the customscan log. I tried setting it to 'Info'. I saved it, moved to another page, went back to the logging page and checked it was at Info. So far so good. I stopped and restarted SBS. No Custom Scan messages, and the logging level had been reset to warn. I tried this twice. Does SBS always reset these? If so, there is no way I can change it for a restart. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;650502 Wrote: If so, there is no way I can change it for a restart. In 'Advanced Log Settings' just above all the drop-down lists there is a check box entitled 'Save logging settings for use at next application restart '. I think this saves your setting permanently. -- MillmoorRon MillmoorRon's Profile: http://forums.slimdevices.com/member.php?userid=6413 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
MillmoorRon;650576 Wrote: In 'Advanced Log Settings' just above all the drop-down lists there is a check box entitled 'Save logging settings for use at next application restart '. I think this saves your setting permanently. Indeed it does - thanks. I Learn something every day. I have now found the following using the 'info' setting. It puzzles be a bit since it appears to spend a lot of time on musicbrains, which I don't use as far as I know (indeed I am only dimly aware of what it is). [11-08-17 20:14:41.0293] main::init (349) Starting Squeezebox Server (v7.6.1, r33082, Mon Aug 15 02:06:39 PDT 2011) perl 5.01 [11-08-17 20:14:46.5517] Plugins::CustomScan::Scanner::initDatabase (448) Creating indexes [11-08-17 20:14:46.5535] Plugins::CustomScan::Scanner::executeSQLFile (515) Executing SQL file C:\ProgramData\Squeezebox\Cache\InstalledPlugins\Plugins\CustomScan\SQL\SQLite\dbindex.sql [11-08-17 20:14:46.5573] Plugins::CustomScan::Plugin::installHook (132) Installing Custom Scan hooks [11-08-17 20:15:31.9259] Plugins::CustomScan::Scanner::refreshData (1871) Refresh triggered by module: Rating Tag [11-08-17 20:15:31.9264] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-17 20:15:31.9267] Plugins::CustomScan::Scanner::refreshData (1884) Starting to update musicbrainz id's in custom scan artist data based on names [11-08-17 20:15:31.9275] Plugins::CustomScan::Scanner::refreshData (1908) Finished updating musicbrainz id's in custom scan artist data based on names, updated 0 items : It took 0.000721 seconds [11-08-17 20:15:31.9279] Plugins::CustomScan::Scanner::refreshData (1914) Starting to update custom scan artist data based on musicbrainz ids [11-08-17 20:15:31.9287] Plugins::CustomScan::Scanner::refreshData (1937) Finished updating custom scan artist data based on musicbrainz ids, updated 0 items : It took 0.0007 seconds [11-08-17 20:15:31.9291] Plugins::CustomScan::Scanner::refreshData (1944) Starting to update custom scan artist data based on names [11-08-17 20:15:31.9297] Plugins::CustomScan::Scanner::refreshData (1967) Finished updating custom scan artist data based on names, updated 0 items : It took 0.000635 seconds [11-08-17 20:15:31.9301] Plugins::CustomScan::Scanner::refreshData (1974) Starting to update musicbrainz id's in custom scan album data based on titles [11-08-17 20:15:31.9309] Plugins::CustomScan::Scanner::refreshData (1998) Finished updating musicbrainz id's in custom scan album data based on titles, updated 0 items : It took 0.000667 seconds [11-08-17 20:15:31.9314] Plugins::CustomScan::Scanner::refreshData (2004) Starting to update custom scan album data based on musicbrainz ids [11-08-17 20:15:31.9322] Plugins::CustomScan::Scanner::refreshData (2027) Finished updating custom scan album data based on musicbrainz ids, updated 0 items : It took 0.000756 seconds [11-08-17 20:15:31.9326] Plugins::CustomScan::Scanner::refreshData (2033) Starting to update custom scan album data based on titles [11-08-17 20:15:31.9333] Plugins::CustomScan::Scanner::refreshData (2056) Finished updating custom scan album data based on titles, updated 0 items : It took 0.000636 seconds [11-08-17 20:15:31.9337] Plugins::CustomScan::Scanner::refreshData (2062) Starting to update musicbrainz id's in custom scan track data based on urls [11-08-17 20:19:39.8494] Plugins::CustomScan::Scanner::refreshData (2086) Finished updating musicbrainz id's in custom scan track data based on urls, updated 0 items : It took 247.915691 seconds [11-08-17 20:19:39.8498] Plugins::CustomScan::Scanner::refreshData (2092) Starting to update custom scan track data based on musicbrainz ids [11-08-17 20:19:42.5639] Plugins::CustomScan::Scanner::refreshData (2188) Finished updating custom scan track data based on musicbrainz ids, updated 0 items : It took 2.713974 seconds [11-08-17 20:19:42.5644] Plugins::CustomScan::Scanner::refreshData (2194) Starting to update custom scan track data based on urls [11-08-17 20:19:45.2003] Plugins::CustomScan::Scanner::refreshData (2217) Finished updating custom scan track data based on urls, updated 0 items : It took 2.635724 seconds [11-08-17 20:19:45.2007] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
Seeking to resolve some small part of my ignorance, I looked up a bit on Musicbrainz. I still don't really understand it. However, I tripped over MusicIP on the same site. Hmm, I thought. I have that plugin disabled (since I tend to disable stuff I don't use). I wonder if Log follows with MusicIP plugin enabled. This is very much quicker, with no change made to my library whatsoever from well before the restart before the restart for which I reported the previous log. [11-08-17 21:12:38.5152] main::init (349) Starting Squeezebox Server (v7.6.1, r33082, Mon Aug 15 02:06:39 PDT 2011) perl 5.01 [11-08-17 21:12:49.7733] Plugins::CustomScan::Scanner::initDatabase (448) Creating indexes [11-08-17 21:12:49.7749] Plugins::CustomScan::Scanner::executeSQLFile (515) Executing SQL file C:\ProgramData\Squeezebox\Cache\InstalledPlugins\Plugins\CustomScan\SQL\SQLite\dbindex.sql [11-08-17 21:12:49.7783] Plugins::CustomScan::Plugin::installHook (132) Installing Custom Scan hooks [11-08-17 21:13:00.1283] Plugins::CustomScan::Scanner::refreshData (1871) Refresh triggered by module: Rating Tag [11-08-17 21:13:00.1287] Plugins::CustomScan::Scanner::refreshData (1882) CustomScan: Synchronizing Custom Scan data, please wait... [11-08-17 21:13:00.1291] Plugins::CustomScan::Scanner::refreshData (1884) Starting to update musicbrainz id's in custom scan artist data based on names [11-08-17 21:13:00.1299] Plugins::CustomScan::Scanner::refreshData (1908) Finished updating musicbrainz id's in custom scan artist data based on names, updated 0 items : It took 0.000715 seconds [11-08-17 21:13:00.1303] Plugins::CustomScan::Scanner::refreshData (1914) Starting to update custom scan artist data based on musicbrainz ids [11-08-17 21:13:00.1310] Plugins::CustomScan::Scanner::refreshData (1937) Finished updating custom scan artist data based on musicbrainz ids, updated 0 items : It took 0.000695 seconds [11-08-17 21:13:00.1314] Plugins::CustomScan::Scanner::refreshData (1944) Starting to update custom scan artist data based on names [11-08-17 21:13:00.1321] Plugins::CustomScan::Scanner::refreshData (1967) Finished updating custom scan artist data based on names, updated 0 items : It took 0.000623 seconds [11-08-17 21:13:00.1325] Plugins::CustomScan::Scanner::refreshData (1974) Starting to update musicbrainz id's in custom scan album data based on titles [11-08-17 21:13:00.1332] Plugins::CustomScan::Scanner::refreshData (1998) Finished updating musicbrainz id's in custom scan album data based on titles, updated 0 items : It took 0.000659 seconds [11-08-17 21:13:00.1337] Plugins::CustomScan::Scanner::refreshData (2004) Starting to update custom scan album data based on musicbrainz ids [11-08-17 21:13:00.1348] Plugins::CustomScan::Scanner::refreshData (2027) Finished updating custom scan album data based on musicbrainz ids, updated 0 items : It took 0.001085 seconds [11-08-17 21:13:00.1353] Plugins::CustomScan::Scanner::refreshData (2033) Starting to update custom scan album data based on titles [11-08-17 21:13:00.1361] Plugins::CustomScan::Scanner::refreshData (2056) Finished updating custom scan album data based on titles, updated 0 items : It took 0.000685 seconds [11-08-17 21:13:00.1365] Plugins::CustomScan::Scanner::refreshData (2062) Starting to update musicbrainz id's in custom scan track data based on urls [11-08-17 21:13:03.3503] Plugins::CustomScan::Scanner::refreshData (2086) Finished updating musicbrainz id's in custom scan track data based on urls, updated 0 items : It took 3.213709 seconds [11-08-17 21:13:03.3508] Plugins::CustomScan::Scanner::refreshData (2092) Starting to update custom scan track data based on musicbrainz ids [11-08-17 21:13:06.0754] Plugins::CustomScan::Scanner::refreshData (2188) Finished updating custom scan track data based on musicbrainz ids, updated 0 items : It took 2.72443 seconds [11-08-17 21:13:06.0759] Plugins::CustomScan::Scanner::refreshData (2194) Starting to update custom scan track data based on urls [11-08-17 21:13:08.7279] Plugins::CustomScan::Scanner::refreshData (2217) Finished updating custom scan track data based on urls, updated 0 items : It took 2.652111 seconds [11-08-17 21:13:08.7283] Plugins::CustomScan::Scanner::refreshData (2219) CustomScan: Synchronization finished -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
Sorry - a red herring. I thought I should double check by disabling MusicIP again and restarting. Scan times were quick, as they were with that plugin enabled. So I still have no idea why the earlier log took 4 minutes to do nothing (Finished updating musicbrainz id's in custom scan track data based on urls, updated 0 items : It took 247.915691 seconds). I had a look in the database, and I have no musicbrainz ids on tracks or contributors. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out over 'a bit of wire' to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
The musicbrainz step is because a query that isn't optimized good enough
yet, it has nothing to do if you have musicbrainz tags or not.
The performance varies, sometimes it's fast sometimes it's slow, it's
the same in my setup. I'm not sure if it's related to caching,
defragmentation of SQLite database or something else.
I have enough information for now, I'll get back if I need something
more.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;649812 Wrote:
I have turned off all automatic Custom Scans, and now run them manually
when I need to. I had to do this because I quite often add tracks and
play them straight away (via Music Folders) to make sure they are OK.
SBS does a short scan which runs OK, but then if Custom Scan is
configured to kick in after an SBS scan it stops SBS from responding or
being able to play music.
Just to better understand the real problem here, could you look in the
server.log file and see how long time it is between the log message
saying:
CustomScan: Synchronizing Custom Scan data, please wait...
And the one saying:
CustomScan: Synchronization finished
I'm interested in the time it takes between these two log messages both
at Squeezebox Server startup and also after a Custom Scan operation has
started due to browsing by Music Folder.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
I have turned off all automatic Custom Scans, and now run them manually when I need to. I had to do this because I quite often add tracks and play them straight away (via Music Folders) to make sure they are OK. SBS does a short scan which runs OK, but then if Custom Scan is configured to kick in after an SBS scan it stops SBS from responding or being able to play music. -- PasTim Server on Windows 7 Ultimate 64 bit, 2 CPU, 2GHz, 4GB, FLAC files. Touch on Ethernet (in another room). Analogue out to ageing Quad Hi-Fi. An old (wireless) laptop controls the server using Chrome. PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;649399 Wrote: I suspect the background scheduling is more aggressive in 7.6 compared to 7.5 making it prioritize Custom Scan background scanning before handling the music. This is great as long as you don't play music but as you say it causes problem if you like to simultaneously play music. Do I understand correctly that the issue is that you can play music but gets very choppy and isn't possible to listen to ? If so, I'll have to test it in my own environment and see if it would be possible to somehow lower the priority of the background scanning if music is playing. The result will probably be that the scanning when playing music will take more time time but the advantage is that you can enjoy music while it's playing and this is probably preferred by most users. When I try to play music during a custom scan it is difficult to get the server to respond to my request, and then the Toucb starts buffering and rebuffering, stops, stutters and so on. Since my custom scan is now quite quick, and I can run it only when I want, I don't mind this. However, others, as you say, may find this a problem. I don't know if the priorities in the performance settings affect this. What priority does the custom scan take? Scanner or server? I have the server on High (-16) and the scanner on -12. I'm on Windows 7 64 bit. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;644799 Wrote: I seem to recall a while back you saying that Custom Scan refreshes had to go back SB 7.5.n frequently to allow people to play tracks whilst scanning. My experience thus far is that it is quite impossible to play anything whilst scanning (base or custom) using SB 7.6. I get no sound, then rebuffering, restarting, and so on. It is very noticeable using 7.6 that the the squeezebox service is now running at a constant steady pace (about 9-10% CPU on my PC) whilst custom scanning. It used to scan in short bursts of a few seconds. If feasible (optionally?), I'd much rather all scans ran as fast as possible and I'll forgo listening to SB whilst it is scanning. SB sometimes decides to rescan without me telling it to, usually when I have added a track and played it via Music Folder. I wish it wouldn't, but the issue I have here is that I then get a custom scan which takes 2 hours. During this time I cannot play anything. This is very different from 7.5.n, when I could play tracks whilst custom scanning. I had been hoping for faster Custom Scans in 7.6. What we seem to have now is Custom Scans that are not much quicker than before when playing music in parallel, but which now don't let you play music at the same time. For now I will have to set custom scans to entirely manual and trigger them only when I want to. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
I am now on 7.6.1 - r33048, and ran a full scan (11 minutes - getting quicker) and then (manually) a custom scan. The custom scan is now much quicker - around 1 hour for my 14,500 tracks (with 4 new tags). I can live quite happily with not playing anything for this time, provided I can control when it happens, which I can. There don't seem to be any log entries for the Custom Scan, which surprised me (and I did stop/restart SB to make sure), but I can live without assuming that if something fails it will be logged. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;649254 Wrote: There don't seem to be any log entries for the Custom Scan, which surprised me (and I did stop/restart SB to make sure), but I can live without assuming that if something fails it will be logged. I think the default only logs errors. If you set plugin.customscan to 'info' under the advancedlogging setting you'll get the start and stop times and some other relevant stuff. -- MillmoorRon MillmoorRon's Profile: http://forums.slimdevices.com/member.php?userid=6413 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
MillmoorRon;649271 Wrote: I think the default only logs errors. If you set plugin.customscan to 'info' under the advancedlogging setting you'll get the start and stop times and some other relevant stuff. OK - Thanks. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;649191 Wrote:
SB sometimes decides to rescan without me telling it to, usually when I
have added a track and played it via Music Folder. I wish it wouldn't,
but the issue I have here is that I then get a custom scan which takes 2
hours. During this time I cannot play anything. This is very different
from 7.5.n, when I could play tracks whilst custom scanning.
I had been hoping for faster Custom Scans in 7.6. What we seem to have
now is Custom Scans that are not much quicker than before when playing
music in parallel, but which now don't let you play music at the same
time.
For now I will have to set custom scans to entirely manual and trigger
them only when I want to.
The only solution to this is that I add support for new/changed rescans
also in Custom Scan, this would be possible in 7.6 and it is something I
eventually like to do, the problem is just to get the time and
inspiration to do it since I never use Music Folder browsing myself and
due to this doesn't have the issues you have in my own setup. It's also
a pretty big change of the Custom Scan code so it will take a lot of
time to implement and test it.
So it might be solved sometime in the future but it's unlikely to be
solved in the near future.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;649312 Wrote: The only solution to this is that I add support for new/changed rescans also in Custom Scan, this would be possible in 7.6 and it is something I eventually like to do, the problem is just to get the time and inspiration to do it since I never use Music Folder browsing myself and due to this doesn't have the issues you have in my own setup. It's also a pretty big change of the Custom Scan code so it will take a lot of time to implement and test it. So it might be solved sometime in the future but it's unlikely to be solved in the near future. I do wonder why the latest version doesn't allow one to play tracks while custom scanning, but that's only relatively idle interest now since my custom scans are recently down to an 1 hour. I'm content that I can control when Custom Scans take place (unlike SB scans). People who have custom scans lasting many hours might feel differently. I'm quite sure you have more useful things to do with your spare time than tinker with this. I'm most grateful that you have done as much as you have. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
PasTim;649317 Wrote:
I do wonder why the latest version doesn't allow one to play tracks
while custom scanning, but that's only relatively idle interest now
since my custom scans are recently down to an 1 hour. I'm content that
I can control when Custom Scans take place (unlike SB scans). People
who have custom scans lasting many hours might feel differently.
I suspect the background scheduling is more aggressive in 7.6 compared
to 7.5 making it prioritize Custom Scan background scanning before
handling the music. This is great as long as you don't play music but
as you say it causes problem if you like to simultaneously play music.
Do I understand correctly that the issue is that you can play music but
gets very choppy and isn't possible to listen to ?
If so, I'll have to test it in my own environment and see if it would
be possible to somehow lower the priority of the background scanning if
music is playing. The result will probably be that the scanning when
playing music will take more time time but the advantage is that you
can enjoy music while it's playing and this is probably preferred by
most users.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
I was trying to restore my Trackstat data via Custom Scan earlier today, and the Squeezebox was unusable while it was running--even just playing Spotify. I finally had to abort and started it later when we were leaving the house. -- MeSue SUE 1 Duet | 2 Booms | 1 Radio | 1 Touch (beta) | 1 SB2 HP MediaSmart EX470 | Squeezebox Server 7.5 | iPod Touch w/ iPeng Find me on 'Last.FM' (http://www.last.fm/user/MeSue) | 'Twitter' (http://twitter.com/suechastain) MeSue's Profile: http://forums.slimdevices.com/member.php?userid=985 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
MeSue;649402 Wrote:
I was trying to restore my Trackstat data via Custom Scan earlier today,
and the Squeezebox was unusable while it was running--even just playing
Spotify. I finally had to abort and started it later when we were
leaving the house.
Are you using the third party Spotify plugin or Logitech's ?
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;649408 Wrote: Are you using the third party Spotify plugin or Logitech's ? Using Triode's Spotify. Also, I just went to verify my trackstat restore and I can't get the TS button to show up in the webUI now. I have the extra buttons setting enabled. -- MeSue SUE 1 Duet | 2 Booms | 1 Radio | 1 Touch (beta) | 1 SB2 HP MediaSmart EX470 | Squeezebox Server 7.5 | iPod Touch w/ iPeng Find me on 'Last.FM' (http://www.last.fm/user/MeSue) | 'Twitter' (http://twitter.com/suechastain) MeSue's Profile: http://forums.slimdevices.com/member.php?userid=985 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
Try to enable info level debugging on plugin.customscan in SBS
Settings/Advanced/Logging and see if it seems to hang on a certain
query in the refresh operation that happens as the first step of a
rescan. With info level logging you will be able to see how long time
each step in the refresh operation takes in the server.log.
I solved some issues in one of the latest Custom Scan versions related
to this but I've seen that it can take some time in my own fairly small
library, so I suspect it might take longer in a large library. I've also
seen that sometimes it can work very fast and sometimes it will work
very slow.
--
erland
Erland Isaksson ('My homepage' (http://erland.isaksson.info))
(Developer of 'many plugins/applets'
(http://wiki.slimdevices.com/index.php/User:Erland). If my answer
helped you and you like to encourage future presence on this forum
and/or third party plugin/applet development, 'donations are always
appreciated' (http://erland.isaksson.info/donate))
erland's Profile: http://forums.slimdevices.com/member.php?userid=3124
View this thread: http://forums.slimdevices.com/showthread.php?t=89135
___
plugins mailing list
plugins@lists.slimdevices.com
http://lists.slimdevices.com/mailman/listinfo/plugins
Re: [SlimDevices: Plugins] Custom Scan and 7.6
erland;644677 Wrote: Try to enable info level debugging on plugin.customscan in SBS Settings/Advanced/Logging and see if it seems to hang on a certain query in the refresh operation that happens as the first step of a rescan. With info level logging you will be able to see how long time each step in the refresh operation takes in the server.log. I solved some issues in one of the latest Custom Scan versions related to this but I've seen that it can take some time in my own fairly small library, so I suspect it might take longer in a large library. I've also seen that sometimes it can work very fast and sometimes it will work very slow. I seem to recall a while back you saying that Custom Scan refreshes had to go back SB 7.5.n frequently to allow people to play tracks whilst scanning. My experience thus far is that it is quite impossible to play anything whilst scanning (base or custom) using SB 7.6. I get no sound, then rebuffering, restarting, and so on. It is very noticeable using 7.6 that the the squeezebox service is now running at a constant steady pace (about 9-10% CPU on my PC) whilst custom scanning. It used to scan in short bursts of a few seconds. If feasible (optionally?), I'd much rather all scans ran as fast as possible and I'll forgo listening to SB whilst it is scanning. -- PasTim PasTim's Profile: http://forums.slimdevices.com/member.php?userid=41642 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
[SlimDevices: Plugins] Custom Scan and 7.6
Just installed 7.6 and it seems custom scan is causing the server to not playback. After install a scan was kicked off and then a custom scan started. It caused the music to actually freeze in playblack and only play a short burst of music every minute or so. I restarted the server which means custom scan wasn't running and it seem fine now. Or it might just be something with my setup. -- lrossouw Louis 'Last.fm' (http://www.last.fm/user/lrossouw) lrossouw's Profile: http://forums.slimdevices.com/member.php?userid=3416 View this thread: http://forums.slimdevices.com/showthread.php?t=89135 ___ plugins mailing list plugins@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/plugins
