Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
It seems that the playlist issue also applies to CUE files. Can you elaborate? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Michael, I'm wondering if something changed in 7.9.3 as well? After all the issues I went through with Catalina on Mac MINI, I reverted back to High Sierra from a TimeMachine backup, but installed 7.9.3 and did a complete rescan. NO iTUNES, just my audio drives. There's a little over 40,000 songs and it took almost 2.5 hours to complete the scan. When I've done it before, a new rescan would take 5-10 minutes at the most. I most likely had a 'nightly' in the TimeMachine restore but wouldn't know which one. TimeMachine date was Sept 9, and I'm usually pretty good about keeping up with the nightlies if that gives you an idea. Thanks again for all of the help. I'm stable again and will avoid upgrading the OS for a while. Eric Eric Seaberg - San Diego -A.E.S., I.E.E.E., S.M.P.T.E., S.P.A.R.S.- e...@seaberg.com _ Transporter, Multiple Duets and SB3s Eric Seaberg's Profile: http://forums.slimdevices.com/member.php?userid=7896 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
It seems that the playlist issue also applies to CUE files. Logitech Media Server Version: 8.0.0 - 1600144351 @ Tue Sep 15 06:55:13 CEST 2020 Carsten carp's Profile: http://forums.slimdevices.com/member.php?userid=3584 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > I thought I had that fixed... would you mind sharing your library.db > with me? > yes, will send over. Looking at the error, anything to do with possibly saving youtube in a playlist? Code: youtube:// I notice there's a LEFT JOIN that is truncating/replacing file:// and %20 stuff. kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
[20-09-30 15:43:10.7835] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db do failed: SQL logic error or missing database unable to use function MATCH in the requested context [for Statement " I thought I had that fixed... would you mind sharing your library.db with me? https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Just post your scanner.log and we'll know... > Code: Logitech Media Server Version: 8.0.0 - 1601380107 @ Tue Sep 29 14:20:56 CEST 2020 Hostname: odroid Server IP Address: xx Server HTTP Port Number: 9000 Operating system: Debian - EN - utf8 Platform Architecture: armv7l-linux Perl Version: 5.26.1 - arm-linux-gnueabihf-thread-multi-64int Audio::Scan: 0.95 IO::Socket::SSL: 2.060 Database Version: DBD::SQLite 1.34_01 (sqlite 3.7.7.1) Total Players Recognized: 1 Code: [20-09-30 15:33:27.8827] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1601380107, Tue Sep 29 14:20:56 CEST 2020) perl 5.026001 [20-09-30 15:33:28.1342] Slim::Schema::forceCommit (2157) Warning: Trying to commit transactions before DB is initialized! [20-09-30 15:33:28.3237] Slim::Music::Import::runImporter (577) Starting Slim::Media::MediaFolderScan scan [20-09-30 15:33:28.3243] Slim::Utils::Scanner::Local::rescan (179) Discovering audio files in /mnt/mother/mp3 [20-09-30 15:41:07.6788] Slim::Utils::Scanner::Local::__ANON__ (191) Start processing found tracks [20-09-30 15:41:07.6796] Slim::Utils::Scanner::Local::__ANON__ (199) Connect do DB [20-09-30 15:41:07.6799] Slim::Utils::Scanner::Local::__ANON__ (202) Get latest ID [20-09-30 15:41:07.6804] Slim::Utils::Scanner::Local::__ANON__ (224) Delete temporary table if exists [20-09-30 15:41:07.6808] Slim::Utils::Scanner::Local::__ANON__ (227) Re-build temporary table [20-09-30 15:41:11.9542] Slim::Utils::Scanner::Local::__ANON__ (276) Get deleted tracks count [20-09-30 15:41:16.5410] Slim::Utils::Scanner::Local::__ANON__ (283) Get new tracks count [20-09-30 15:41:16.5418] Slim::Utils::Scanner::Local::__ANON__ (288) Get changed tracks count [20-09-30 15:41:22.5568] Slim::Utils::Scanner::Local::deleteTracks (519) Removing deleted audio files (0) [20-09-30 15:41:22.5573] Slim::Utils::Scanner::Local::__ANON__ (301) Scanning new audio files (1) [20-09-30 15:41:22.5954] Slim::Utils::Scanner::Local::__ANON__ (381) Rescanning changed audio files (0) [20-09-30 15:41:22.5964] Slim::Music::Import::endImporter (710) Completed Slim::Media::MediaFolderScan Scan in 474 seconds. [20-09-30 15:41:22.5972] Slim::Music::Import::runImporter (577) Starting Slim::Music::PlaylistFolderScan scan [20-09-30 15:41:22.6002] Slim::Utils::Scanner::Local::rescan (179) Discovering audio files in /mnt/mother/! Playlists [20-09-30 15:41:23.6902] Slim::Utils::Scanner::Local::__ANON__ (191) Start processing found tracks [20-09-30 15:41:23.6909] Slim::Utils::Scanner::Local::__ANON__ (199) Connect do DB [20-09-30 15:41:23.6913] Slim::Utils::Scanner::Local::__ANON__ (202) Get latest ID [20-09-30 15:41:23.6919] Slim::Utils::Scanner::Local::__ANON__ (224) Delete temporary table if exists [20-09-30 15:41:23.6924] Slim::Utils::Scanner::Local::__ANON__ (227) Re-build temporary table [20-09-30 15:41:27.8180] Slim::Utils::Scanner::Local::__ANON__ (276) Get deleted tracks count [20-09-30 15:41:30.3941] Slim::Utils::Scanner::Local::__ANON__ (283) Get new tracks count [20-09-30 15:41:30.3947] Slim::Utils::Scanner::Local::__ANON__ (288) Get changed tracks count [20-09-30 15:41:30.3970] Slim::Utils::Scanner::Local::deleteTracks (519) Removing deleted audio files (0) [20-09-30 15:41:30.3973] Slim::Utils::Scanner::Local::__ANON__ (301) Scanning new audio files (0) [20-09-30 15:41:30.3976] Slim::Utils::Scanner::Local::__ANON__ (381) Rescanning changed audio files (0) [20-09-30 15:41:30.3981] Slim::Music::Import::endImporter (710) Completed Slim::Music::PlaylistFolderScan Scan in 7 seconds. [20-09-30 15:41:30.4025] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::ExtendedBrowseModes::Libraries scan [20-09-30 15:41:30.4029] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan [20-09-30 15:41:30.4040] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (445) Starting fulltext index build [20-09-30 15:41:30.4043] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (449) Initialize fulltext table [20-09-30 15:41:36.3298] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (462) Create fulltext index for tracks [20-09-30 15:42:47.6769] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (472) Create fulltext index for albums [20-09-30 15:43:08.6206] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (481) Create fulltext index for contributors [20-09-30 15:43:10.5347] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (491) Create fulltext index for playlists [20-09-30 15:43:10.7835] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db do failed: SQL logic error or missing database unable to use function MATCH in the requested context [for Statement " INSERT INTO fulltext (id, type, w10, w5, w3, w1)
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I'm pretty sure I'm up to date, there's nothing screaming at me that it needs to be. and the scans are still stopping unexpectedly. Just post your scanner.log and we'll know... -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > Did you see these failures with the latest build? Other reporters of > this issue have confirmed it was fixed (for them...). I'm pretty sure I'm up to date, there's nothing screaming at me that it needs to be. and the scans are still stopping unexpectedly. kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kbeast wrote: > I know this quote wasn't for me directly (and its also taken out of > context a little), but I still owe you a db file -- I'm still getting an > error when scanning. I finally had time to copy the library.db file > over, but I'm a little hesitant to upload it to dropbox-- > > > Code: > > > Building full text index (3 of 7) Complete 00:01:47 > Media scan terminated unexpectedly (Scanning Progress) > > > > > Seems like you were making headway, but I'm assuming you still need > mine? Did you see these failures with the latest build? Other reporters of this issue have confirmed it was fixed (for them...). Michael "It doesn't work - what shall I do?" - "Please check your server.log and/or scanner.log file!" (LMS: Settings/Information) mherger's Profile: http://forums.slimdevices.com/member.php?userid=50 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > > It's hard to give advice when I lack any information... > I know this quote wasn't for me directly (and its also taken out of context a little), but I still owe you a db file -- I'm still getting an error when scanning. I finally had time to copy the library.db file over, but I'm a little hesitant to upload it to dropbox-- Code: Building full text index (3 of 7) Complete 00:01:47 Media scan terminated unexpectedly (Scanning Progress) Seems like you were making headway, but I'm assuming you still need mine? kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Still taking a long time for me: > > Thanks for your file! So... you have 10 playlists with 10k+ tracks? One > > with close to 30k tracks. Do you really use those? They seem to be > imported from iTunes. Unless you're serious about using them I suggest > you add them to the ignore list in the iTunes plugin settings. This > should speed up the import considerably. > > -- > > Michael Thanks, looks like I need a tidy up! Ade_AV's Profile: http://forums.slimdevices.com/member.php?userid=69532 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Still taking a long time for me: Thanks for your file! So... you have 10 playlists with 10k+ tracks? One with close to 30k tracks. Do you really use those? They seem to be imported from iTunes. Unless you're serious about using them I suggest you add them to the ignore list in the iTunes plugin settings. This should speed up the import considerably. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Still taking a long time for me: The please answer my questions about library size, number of playlists, number of tracks in those playlists, and share library.db and full scanner.log.zip with me. https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a It's hard to give advice when I lack any information... -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Still taking a long time for me: Code: [20-09-26 08:09:47.0649] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1601033329, Fri Sep 25 13:53:32 CEST 2020) perl 5.018004 [20-09-26 08:27:31.4928] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan [20-09-26 08:27:31.4933] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (445) Starting fulltext index build [20-09-26 08:27:31.4934] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (449) Initialize fulltext table [20-09-26 08:27:31.5326] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (462) Create fulltext index for tracks [20-09-26 08:27:36.0543] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (472) Create fulltext index for albums [20-09-26 08:27:37.9209] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (481) Create fulltext index for contributors [20-09-26 08:27:38.0669] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (491) Create fulltext index for playlists [20-09-26 10:41:00.4914] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (506) Optimize fulltext index [20-09-26 10:41:00.9810] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (521) Fulltext index build done! [20-09-26 10:41:00.9812] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 8009 seconds. Ade_AV's Profile: http://forums.slimdevices.com/member.php?userid=69532 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Success! :cool: > > Ok, 15s for the playlist FTS index look much more reasonable :-). Does > it work? Can you search for tracks in a playlist?l Searching from the top search box doesn't bring up anything in playlists. (top pic below) Searching by clicking on the spyglass brings up playlists that contain the search criteria, I'm not sure I see the value in that. But then it wasn't me who asked for "search within playlists". :D 31688 31689 +---+ |Filename: Bringer2.jpg | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31689| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Success! :cool: Ok, 15s for the playlist FTS index look much more reasonable :-). Does it work? Can you search for tracks in a playlist? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > I think I finally nailed the issue with the help of kidstypike's > library.db. Please give the next build another try... Success! :cool: 31686 +---+ |Filename: scanner.log.zip | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31687| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I think I finally nailed the issue with the help of kidstypike's library.db. Please give the next build another try... -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
[20-09-25 17:56:17.1967] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1600976618, Thu Sep 24 22:15:54 CEST 2020) perl 5.018004 [20-09-25 17:56:17.3779] Slim::Schema::forceCommit (2157) Warning: Trying to commit transactions before DB is initialized! Thanks. Would you mind sharing your library.db with me? https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > [20-09-25 18:29:07.5107] > Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (479) Create > fulltext index for playlists > >[20-09-25 18:29:10.5696] Slim::Schema::Storage::throw_exception > (121) Error: DBI Exception: DBD::SQLite::db do failed: malformed MATCH > expression: [file:///Volumes/Ade_iTunes/iTunes/iTunes > Media/Music/Metz/Metz/11 --))--.m4a] [for Statement " > > What LMS build is this? > > -- > > Michael Code: [20-09-25 17:56:17.1967] main::main (206) Starting Logitech Media Server scanner (v8.0.0, 1600976618, Thu Sep 24 22:15:54 CEST 2020) perl 5.018004 [20-09-25 17:56:17.3779] Slim::Schema::forceCommit (2157) Warning: Trying to commit transactions before DB is initialized! Ade_AV's Profile: http://forums.slimdevices.com/member.php?userid=69532 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
[20-09-25 18:29:07.5107] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (479) Create fulltext index for playlists [20-09-25 18:29:10.5696] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db do failed: malformed MATCH expression: [file:///Volumes/Ade_iTunes/iTunes/iTunes Media/Music/Metz/Metz/11 --))--.m4a] [for Statement " What LMS build is this? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Code: [20-09-25 18:29:07.5107] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (479) Create fulltext index for playlists [20-09-25 18:29:10.5696] Slim::Schema::Storage::throw_exception (121) Error: DBI Exception: DBD::SQLite::db do failed: malformed MATCH expression: [file:///Volumes/Ade_iTunes/iTunes/iTunes Media/Music/Metz/Metz/11 --))--.m4a] [for Statement " INSERT INTO fulltext (id, type, w10, w5, w3, w1) SELECT playlist_track.playlist, 'playlist', ?, '', ?, GROUP_CONCAT(w10 || ' ' || w5 || ' ' || w3 || ' ' || w1) FROM playlist_track LEFT JOIN tracks ON tracks.url = playlist_track.track LEFT JOIN fulltext ON fulltext MATCH REPLACE(playlist_track.track, '%20', ' ') AND type = 'track' WHERE playlist_track.playlist = ? "] [20-09-25 18:29:10.5700] Slim::Schema::Storage::throw_exception (121) Backtrace: frame 0: Slim::Utils::Log::logBacktrace (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Schema/Storage.pm line 121) frame 1: Slim::Schema::Storage::throw_exception (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/CPAN/DBIx/Class/Storage/DBI.pm line 1006) frame 2: DBIx::Class::Storage::DBI::__ANON__ (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Plugin/FullTextSearch/Plugin.pm line 520) frame 3: Slim::Plugin::FullTextSearch::Plugin::_createPlaylistItem (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Plugin/FullTextSearch/Plugin.pm line 488) frame 4: Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Plugin/FullTextSearch/Plugin.pm line 157) frame 5: Slim::Plugin::FullTextSearch::Plugin::startScan (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Music/Import.pm line 579) frame 6: Slim::Music::Import::runImporter (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Music/Import.pm line 455) frame 7: Slim::Music::Import::runScanPostProcessing (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/scanner.pl line 344) frame 8: (eval) (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/scanner.pl line 344) frame 9: main::main (/Library/PreferencePanes/Squeezebox.prefPane/Contents/server/scanner.pl line 499) [20-09-25 18:29:10.5724] main::main (348) Error: Failed when running scan post-process: [Carp::Clan::__ANON__(): DBI Exception: DBD::SQLite::db do failed: malformed MATCH expression: [file:///Volumes/Ade_iTunes/iTunes/iTunes Media/Music/Metz/Metz/11 --))--.m4a] [for Statement " INSERT INTO fulltext (id, type, w10, w5, w3, w1) SELECT playlist_track.playlist, 'playlist', ?, '', ?, GROUP_CONCAT(w10 || ' ' || w5 || ' ' || w3 || ' ' || w1) FROM playlist_track LEFT JOIN tracks ON tracks.url = playlist_track.track LEFT JOIN fulltext ON fulltext MATCH REPLACE(playlist_track.track, '%20', ' ') AND type = 'track' WHERE playlist_track.playlist = ? "] at /Library/PreferencePanes/Squeezebox.prefPane/Contents/server/Slim/Schema/Storage.pm line 125 ] [20-09-25 18:29:10.5726] main::main (349) Error: Not updating lastRescanTime! Ade_AV's Profile: http://forums.slimdevices.com/member.php?userid=69532 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Media scan terminated unexpectedly (Scanning Progress) Please share your scanner.log. Thanks! -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Code: Discovering files/directories: /mnt/mother/mp3 (173263 of 173263) Complete 00:07:59 Scanning new music files: /mnt/mother/mp3 (1 of 1) Complete 00:00:00 Discovering playlists: /mnt/mother/! Playlists (130 of 130) Complete 00:00:01 Building full text index (3 of 7) Complete 00:01:42 Media scan terminated unexpectedly (Scanning Progress) Total Time: 00:09:42 (Thursday, September 24, 2020 / 7:53 PM) kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
No better I'm afraid. This sucks. I'm using the same SQLite version as you, and I can run those queries on your library just fine. I'll give it another try in a build later today. I'm wondering whether I'm missing something here. The log file seems to indicate there's a problem with a string in the query. But as I said: I don't see this issue with your library :-(. Thanks for testing! -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Not so good, logs attached :( > > Thanks. Stupid mistake of mine (hopefully). There should be new builds > out in a bit. Thanks for testing! No better I'm afraid. 31678 +---+ |Filename: server.log (2).zip | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31680| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Not so good, logs attached :( Thanks. Stupid mistake of mine (hopefully). There should be new builds out in a bit. Thanks for testing! -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > There's nothing unusual in either the scanner or sever logs > (attached). > > Ok, figured something out: I was looking up stuff in the FTS index by > the track ID. But in some library versions this value would NOT be > indexed. Which means, that in those case the database had to do a slow > scan instead of a quick lookup. > > I've committed a change to 8.0 which should mitigate this issue. Please > give it a try and let me know about your experience. Not so good, logs attached :( 31677 +---+ |Filename: Screenshot 2020-09-24 154830.jpg | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31677| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
There's nothing unusual in either the scanner or sever logs (attached). Ok, figured something out: I was looking up stuff in the FTS index by the track ID. But in some library versions this value would NOT be indexed. Which means, that in those case the database had to do a slow scan instead of a quick lookup. I've committed a change to 8.0 which should mitigate this issue. Please give it a try and let me know about your experience. One minor problem - practically all of my artists have had face transplants. :( Isn't this a browser side caching issue? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Mine's a bit over 700MB so not so sure about that. Feel free to upload it to https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a Largest playlist file is 583K -- i'm sure some of the lists are pointing I assume that's 583KB, not 583'000 tracks?... to files that may no longer exist. As far as length, some playlists over 8 hours or so if you are talking about length. I have 130 playlsts right now, but nothing changed since maybe 3 months ago as far as new playlists. FTS did change. I broke it at some point in the past: it wouldn't index tracks in a playlist any more. Now that I've fixed this, users with large playlists are suffering the issues you're seeing, as something about the indexing is super busy. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Building full text index (7 of 7) Complete 08:20:15 > > See? It's not broken :-) > lol! mherger wrote: > > Would you mind sharing your library.db with me? > Mine's a bit over 700MB so not so sure about that. mherger wrote: > > Are you using iTunes integration? How many playlists? How large are the > > longer among them? > No iTunes, running on an odroid ubuntu where playlists and music are on NAS storage. Largest playlist file is 583K -- i'm sure some of the lists are pointing to files that may no longer exist. As far as length, some playlists over 8 hours or so if you are talking about length. I have 130 playlsts right now, but nothing changed since maybe 3 months ago as far as new playlists. I did notice a had a video file in my playlist folder, not sure if that has anything to do with it, I removed it from there and rerunning a scan now..seems to be stuck there still anyway. kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
One minor problem - practically all of my artists have had face transplants. :( The Corrs never looked that funky before! I'll look into the data later tonight/tomorrow. Thanks! -- -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > It's actually finished a complete scan. A normal clear & rescan > usually > > takes about 44 minutes, this scan took 85 minutes. > > But only 27 minutes for the FTS index. > > > I need to go out now, let me know if you want me to supply any logs or > > other and I'll upload them when I get back. > > Sure, scanner.log in particular, and the library.db, if you don't mind: > > https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a > > -- > > Michael There's nothing unusual in either the scanner or sever logs (attached). Library.db uploading. One minor problem - practically all of my artists have had face transplants. :( 31654 31655 +---+ |Filename: server.log.zip | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31657| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
It's actually finished a complete scan. A normal clear & rescan usually takes about 44 minutes, this scan took 85 minutes. But only 27 minutes for the FTS index. I need to go out now, let me know if you want me to supply any logs or other and I'll upload them when I get back. Sure, scanner.log in particular, and the library.db, if you don't mind: https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Would you believe it! It's actually finished a complete scan. A normal clear & rescan usually takes about 44 minutes, this scan took 85 minutes. I need to go out now, let me know if you want me to supply any logs or other and I'll upload them when I get back. 31652 +---+ |Filename: finished scan.jpg| |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31652| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Building full text index (7 of 7) Complete 08:20:15 See? It's not broken :-) Would you mind sharing your library.db with me? Are you using iTunes integration? How many playlists? How large are the longer among them? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kbeast wrote: > I'm up to 3 hours and 38 minutes, something tells me this isn't going to > finish :) Scanner Information Code: Building full text index (7 of 7) Complete 08:20:15 Scanner Log File Code: [20-09-22 10:55:51.5580] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-22 10:55:51.5583] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-22 10:56:00.1459] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-22 10:57:12.6994] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-22 10:57:34.6155] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-22 10:57:36.5095] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists [20-09-22 19:16:00.7693] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (503) Optimize fulltext index [20-09-22 19:16:06.4218] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (518) Fulltext index build done! kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kidstypike wrote: > As nothing has advanced after 20 minutes, I'm not prepared to wait hours > to see if the FTS scan finishes, I'm going to stop LMS and remove the > library.db. OK, restarted LMS a new scan is running with FST enabled and scan logging enabled. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kidstypike wrote: > Try again :) > > > Code: > > [20-09-23 12:37:54.1236] main::init (388) Starting Logitech Media Server (v8.0.0, 1600604030, Sun Sep 20 14:55:17 CEST 2020) perl 5.028000 - arm-linux-gnueabihf-thread-multi-64int[20-09-23 12:37:56.7072] Plugins::LazySearch2::Plugin::initPlugin (852) Initialising v3.6.6 (trunk-7.x) > [20-09-23 12:37:57.0181] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (560) Fulltext index missing or outdated - re-building > [20-09-23 12:37:57.0185] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build > [20-09-23 12:37:57.0187] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table > [20-09-23 12:37:59.7831] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks > [20-09-23 12:38:30.5912] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums > [20-09-23 12:38:40.0181] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors > [20-09-23 12:38:40.4496] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists > > As nothing has advanced after 20 minutes, I'm not prepared to wait hours to see if the FTS scan finishes, I'm going to stop LMS and remove the library.db. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
[20-09-23 12:38:40.4496] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists] So yeah, it's stuck at the same place again. Hmm... and I wouldn't know of a simple way to change the logging on pCP. In order to disable FTS again find plugin/state.prefs inside your prefs folder. Find the FullTextSearch line and replace "enabled" with "disabled", restart LMS. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Try again :) Code: [20-09-23 12:37:54.1236] main::init (388) Starting Logitech Media Server (v8.0.0, 1600604030, Sun Sep 20 14:55:17 CEST 2020) perl 5.028000 - arm-linux-gnueabihf-thread-multi-64int[20-09-23 12:37:56.7072] Plugins::LazySearch2::Plugin::initPlugin (852) Initialising v3.6.6 (trunk-7.x) [20-09-23 12:37:57.0181] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (560) Fulltext index missing or outdated - re-building [20-09-23 12:37:57.0185] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-23 12:37:57.0187] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-23 12:37:59.7831] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-23 12:38:30.5912] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-23 12:38:40.0181] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-23 12:38:40.4496] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
OK, found it I think using SCP. This is all I see. Code: [20-09-23 12:37:54.1236 main::init (388) Starting Logitech Media Server (v8.0.0, 1600604030, Sun Sep 20 14:55:17 CEST 2020) perl 5.028000 - arm-linux-gnueabihf-thread-multi-64int[20-09-23 12:37:56.7072] Plugins::LazySearch2::Plugin::initPlugin (852) Initialising v3.6.6 (trunk-7.x) [20-09-23 12:37:57.0181] Slim::Plugin::FullTextSearch::Plugin::_initPopularTerms (560) Fulltext index missing or outdated - re-building [20-09-23 12:37:57.0185] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-23 12:37:57.0187] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-23 12:37:59.7831] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-23 12:38:30.5912] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-23 12:38:40.0181] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-23 12:38:40.4496] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists] *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Restarted LMS a couple of times from the pCP ui, rebooted the Pi, > still > > can't get into LMS or it's settings. > > As always: check the server.log. It might give you a hint. Eg. LMS might > > be trying to re-build the FTS as it didn't get created in the previous > scan. > > -- > > Michael How do I get to the server log? *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Restarted LMS a couple of times from the pCP ui, rebooted the Pi, still can't get into LMS or it's settings. As always: check the server.log. It might give you a hint. Eg. LMS might be trying to re-build the FTS as it didn't get created in the previous scan. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Please note, I've not had this issue up to the last week or so. > > Would there be anything in server.log? Could you please run a FTS > enabled scan with logging for scan enabled? > > And please share a library.db with the FTS enabled with me. > > From what I can see your playlists don't look crazy large. LMS should > be able to handle these with FTS. When it crashed, was the scanner still > > busy (taking a very long time to finish) using the CPU? Or did it exit > prematurely? I enabled logging for -(scan) - All scan logging-, was prompted to restart LMS. Enabled FST (which I'd disabled last night), prompted to restart LMS, I now can't get into LMS settings to start a scan, or to view progress if already started. According to pCP webgui LMS is running but I just get "This site can't be reached" for LMS or it's settings. Restarted LMS a couple of times from the pCP ui, rebooted the Pi, still can't get into LMS or it's settings. I've pulled the plug on the Pi. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Please note, I've not had this issue up to the last week or so. > > Would there be anything in server.log? Could you please run a FTS > enabled scan with logging for scan enabled? > > And please share a library.db with the FTS enabled with me. > > From what I can see your playlists don't look crazy large. LMS should > be able to handle these with FTS. When it crashed, was the scanner still > > busy (taking a very long time to finish) using the CPU? Or did it exit > prematurely?l Scanner was busy, or at least the time was still incrementing as in the pic below (taken from a previous non-terminating scan). Which of these scan items should I enable? 31650 31651 +---+ |Filename: scan01.jpg | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=31651| +---+ *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Please note, I've not had this issue up to the last week or so. Would there be anything in server.log? Could you please run a FTS enabled scan with logging for scan enabled? And please share a library.db with the FTS enabled with me. From what I can see your playlists don't look crazy large. LMS should be able to handle these with FTS. When it crashed, was the scanner still busy (taking a very long time to finish) using the CPU? Or did it exit prematurely? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Please note, I've not had this issue up to the last week or so. That's because the playlist indexing was broken before that. Broken as in not working at all. Now it's broken as in "too slow under certain circumstances"... Thanks for the file. I'll look into it. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > Who's willing to share his library.db with me? > > https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6al Done. Please note, I've not had this issue up to the last week or so. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Who's willing to share his library.db with me? https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kbeast wrote: > I'm up to 3 hours and 38 minutes, something tells me this isn't going to > finish :)So how many and what size are the playlists? Sent from my Pixel 3a using Tapatalk slartibartfast's Profile: http://forums.slimdevices.com/member.php?userid=35609 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kidstypike wrote: > Same here with the playlists, it got so bad I uninstalled the > FullTextSearch plugin. I'm up to 3 hours and 38 minutes, something tells me this isn't going to finish :) kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Logitech Media Server Version: 8.0.0 - 1600604030 @ Sun Sep 20 14:55:17 CEST 2020 Hostname: musicbox5 Server IP Address: 192.168.1.4 Server HTTP Port Number: 9000 Operating system: piCore - EN - utf8 Platform Architecture: armv7l-linux Perl Version: 5.28.0 - arm-linux-gnueabihf-thread-multi-64int Audio::Scan: 1.02 IO::Socket::SSL: 2.060 Database Version: DBD::SQLite 1.58 (sqlite 3.22.0) Total Players Recognized: 4 Re-installed FTS, ran a clear and rescan, scan got stuck on FST playlists, after about 15 minutes it crashed the Pi, (Pi4/4GB) knocked it off the network. This has always worked fine up until the last couple of nightlies. 25 playlists, 2 about 500/600 tracks, the rest all less than 100 tracks. Nothing in the server logs from before my reboot of the Pi. Uninstalled FTS, running full scan ATM. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I'm getting stuck at the playlists one. at times over an hour and a half What exact LMS version are you using? How many playlists? How large? How many tracks overall in playlists? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
kbeast wrote: > > Code: > > > [20-09-22 10:55:51.5580] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build > [20-09-22 10:55:51.5583] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table > [20-09-22 10:56:00.1459] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks > [20-09-22 10:57:12.6994] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums > [20-09-22 10:57:34.6155] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors > [20-09-22 10:57:36.5095] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists > > > > > I'm getting stuck at the playlists one. at times over an hour and a > half Same here with the playlists, it got so bad I uninstalled the FullTextSearch plugin. *Server - LMS 8.0.0 *Pi4B 4GB/Flirc case/pCP 6.1.0 - 74K library, playlists & LMS cache on SSD (ntfs) *Study -* Pi3B/pCP 6.1.0/pi screen/Allo Boss DAC Ruark MR1 Mk2 *Lounge* - Pi2/pCP 6.0.0 > HiFiBerry DIGI+ > AudioEngine DAC1 > AVI DM5 *Garage* - Squeezebox Boom + Fostex sub *Dining Room* - Squeezebox Radio *Spares* - 2xTouch, 1xSB3, 1xRadio, 7xRPi kidstypike's Profile: http://forums.slimdevices.com/member.php?userid=10436 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Code: [20-09-22 10:55:51.5580] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-22 10:55:51.5583] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-22 10:56:00.1459] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-22 10:57:12.6994] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-22 10:57:34.6155] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-22 10:57:36.5095] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists I'm getting stuck at the playlists one. at times over an hour and a half kbeast's Profile: http://forums.slimdevices.com/member.php?userid=4761 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > > Yes, FTS is all I'm interested in at this point. Thanks! > > OK. There's nothing about FTS in the server.log, but the scanner.log has: Code: [20-09-15 09:56:32.0525] Slim::Music::Import::runImporter (577) Starting Slim::Media::MediaFolderScan scan [20-09-15 09:56:32.0530] Slim::Music::Import::endImporter (709) Completed Slim::Media::MediaFolderScan Scan in 0 seconds. [20-09-15 09:56:32.0536] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::iTunes::Importer scan [20-09-15 09:59:25.9270] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::iTunes::Importer Scan in 173 seconds. [20-09-15 09:59:25.9320] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan [20-09-15 09:59:25.9327] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-15 09:59:25.9329] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-15 09:59:26.0628] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-15 09:59:34.9338] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-15 09:59:37.4522] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-15 09:59:37.7953] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists [20-09-15 10:50:16.4258] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (503) Optimize fulltext index [20-09-15 10:50:16.7703] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (518) Fulltext index build done! [20-09-15 10:50:16.7706] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 3050 seconds. [20-09-15 10:50:16.7709] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::ExtendedBrowseModes::Libraries scan [20-09-15 10:50:16.7710] Slim::Music::Import::runImporter (577) Starting Slim::Music::VirtualLibraries scan [20-09-15 10:50:17.6517] Slim::Music::Import::endImporter (709) Completed Slim::Music::VirtualLibraries Scan in 0 seconds. [20-09-15 10:50:17.7767] Slim::Music::Artwork::updateStandaloneArtwork (234) Starting updateStandaloneArtwork for 1549 albums [20-09-15 10:50:18.2655] Slim::Music::Artwork::__ANON__ (349) updateStandaloneArtwork finished in 0.483903884887695 [20-09-15 10:50:18.2843] Slim::Music::Artwork::precacheAllArtwork (659) Starting precacheArtwork for 0 albums [20-09-15 10:50:18.2846] Slim::Music::Import::endImporter (709) Completed precacheArtwork Scan in 0 seconds. [20-09-15 10:50:18.2852] Slim::Music::Import::runScanPostProcessing (479) Starting Database optimization. [20-09-15 10:50:23.0222] Slim::Music::Import::endImporter (709) Completed dbOptimize Scan in 4 seconds. testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Sure Michael. What logging levels would you like? Just debug for plugin.fulltext? Or anything else? Yes, FTS is all I'm interested in at this point. Thanks! -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > That sounds like a decent improvement :-). Could you please post the > server.log content? > Sure Michael. What logging levels would you like? Just debug for plugin.fulltext? Or anything else? John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
That brings the scan time down to 50 minutes. That sounds like a decent improvement :-). Could you please post the server.log content? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > Ok, maybe the solution is quite simple: in the iTunes settings in LMS, > please add "Downloaded" to the list of "Ignored playlists". Then re-run > > a scan. This should skip the playlist with the 40k tracks, considerably > > speeding up the Fulltext Index creation. > Thanks Michael, That brings the scan time down to 50 minutes. John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Ok, maybe the solution is quite simple: in the iTunes settings in LMS, please add "Downloaded" to the list of "Ignored playlists". Then re-run a scan. This should skip the playlist with the 40k tracks, considerably speeding up the Fulltext Index creation. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > Would you mind sharing your iTunes > Library.xml file (or similar) with me? > > https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a > [color=blue] > Done. I've added the library.db file as well in case it's important they both match, as I added some more music yesterday. John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Actually, I've found the playlist with the entire library in it. It's the one titled 'Downloaded :iTunes' which isn't visible in iTunes and I've never noticed before as I mainly use the 'Not Played For Ages' and 'Never Played' ones. Should I delete it in LMS and see what happens? It'll be re-imported. We do have a condition in the importer to exclude an "all tracks" playlist that must have existed at some point. But that might have changed over time. Would you mind sharing your iTunes Library.xml file (or similar) with me? https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a I've also installed the most recent nightly but turned off the full text search plugin as that restores the scan duration to the normal few minutes and by reverting to the simple title search. That's always an option of course. But I'd like to understand the issue in order to prevent this surprise for other users. Thanks for helping me out so far! -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > Now I check, I see 23 in the playlists menu. LMS library stats say: > > Could you please send me a list of the playlists shown in the Playlists > > menu of My Music? > Here they are: Blue Note :iTunes Chill :iTunes Classical Music :iTunes Cooder :iTunes Davis Monk Coltrane :iTunes Downloaded :iTunes Dub :iTunes ECM :iTunes Fairport :iTunes Female Folk :iTunes Female Jazz :iTunes Jazz Piano Trios :iTunes Merchant Welch etc. :iTunes Mingus :iTunes My Top Rated :iTunes Never Played :iTunes Not Played For Ages :iTunes Pastorius :iTunes Recently Added :iTunes Recently Played :iTunes Skip :iTunes Top 100 Most Played :iTunes Waterson Carthy :iTunes Actually, I've found the playlist with the entire library in it. It's the one titled 'Downloaded :iTunes' which isn't visible in iTunes and I've never noticed before as I mainly use the 'Not Played For Ages' and 'Never Played' ones. Should I delete it in LMS and see what happens? I've also installed the most recent nightly but turned off the full text search plugin as that restores the scan duration to the normal few minutes and by reverting to the simple title search. John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Now I check, I see 23 in the playlists menu. LMS library stats say: Could you please send me a list of the playlists shown in the Playlists menu of My Music? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > >> There's a 40k tracks playlist imported from iTunes?/QUOTE] > >> > >> That's the entire library, held in iTunes. I use iTunes because I > always > >> have. The 31 playlists are 'smart' ones set up in iTunes. > > Would these lists show up in the Playlists menu, too? > Now I check, I see 23 in the playlists menu. LMS library stats say: Total Images: 0 Total Videos: 0 Total Tracks: 40,795 Total Albums: 3,374 Total Artists: 1,620 Total Genres: 56 Total Playlists: 23 Total Playing Time: 3155:59:28 but the scan details says: iTunes Playlist Import (31 of 31) So I don't know where the other eight are! John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
There's a 40k tracks playlist imported from iTunes?/QUOTE] That's the entire library, held in iTunes. I use iTunes because I always have. The 31 playlists are 'smart' ones set up in iTunes. Would these lists show up in the Playlists menu, too? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > > There's a 40k tracks playlist imported from iTunes?/QUOTE] > > That's the entire library, held in iTunes. I use iTunes because I always > have. The 31 playlists are 'smart' ones set up in iTunes. > > John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Done. There's a 40k tracks playlist imported from iTunes?... I'll keep investigating. -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
testmatch wrote: > Mildly technical from a software perspective - what would I need to do? I've found where the full text search plugin lives and am happy to edit the .pm file if there are changes you'd like me to make. I've done that with several of the third party plugins to update them, so if that's the level of tinkering needed, I'm sure I can handle that. John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > Could you please share your library.db with me? > > https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a > > Done. John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
Could you please share your library.db with me? https://www.dropbox.com/request/T3RctyzGgNg0oFDubq6a -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > How technical would you be? I don't have playlists that large to test > with. If I posted a change, would you be able to apply the code change > to re-test with your collection (probably won't happen over the > weekend)? > Mildly technical from a software perspective - what would I need to do? If you can point me to some general guidance I can see if I'm comfortable with it. I can follow instructions, and do spend time tinkering with Python and assorted Raspberry Pi hardware and software, but might not have the time to try too many new things. In the meantime, I'll revert to the version before you made the changes because it makes life simpler. Thanks, John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I've done that, Michael, but don't see much in the scanner log (below) I see this: [20-09-12 07:52:49.4831] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists [20-09-12 11:10:59.3181] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (503) Optimize fulltext index Which tells me that most of the time indeed is spent in the playlist processing, which I fixed a few days ago. Previously it wouldn't include track information in the playlist index. While I do understand that it's taking longer now, I need to investigate why it would take _that_ much longer... How technical would you be? I don't have playlists that large to test with. If I posted a change, would you be able to apply the code change to re-test with your collection (probably won't happen over the weekend)? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > > I've indeed applied a change to the FTS plugin a few days ago. Could you > > please enable logging for plugin.fulltext and re-run a scan? > > I've done that, Michael, but don't see much in the scanner log (below) or server log. Should I have enabled anything else in the logging? The only ones at debug level for this were plugin.fulltext and scan.auto (which was like that before). John [20-09-12 07:48:15.9962] Slim::Music::Import::runImporter (577) Starting Slim::Media::MediaFolderScan scan [20-09-12 07:48:15.9965] Slim::Music::Import::endImporter (709) Completed Slim::Media::MediaFolderScan Scan in 0 seconds. [20-09-12 07:48:15.9969] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::iTunes::Importer scan [20-09-12 07:52:35.9071] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::iTunes::Importer Scan in 259 seconds. [20-09-12 07:52:35.9110] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::ExtendedBrowseModes::Libraries scan [20-09-12 07:52:35.9113] Slim::Music::Import::runImporter (577) Starting Slim::Plugin::FullTextSearch::Plugin scan [20-09-12 07:52:35.9118] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (442) Starting fulltext index build [20-09-12 07:52:35.9119] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (446) Initialize fulltext table [20-09-12 07:52:36.0251] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (459) Create fulltext index for tracks [20-09-12 07:52:45.0663] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (469) Create fulltext index for albums [20-09-12 07:52:49.0455] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (478) Create fulltext index for contributors [20-09-12 07:52:49.4831] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (488) Create fulltext index for playlists [20-09-12 11:10:59.3181] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (503) Optimize fulltext index [20-09-12 11:10:59.7622] Slim::Plugin::FullTextSearch::Plugin::_rebuildIndex (518) Fulltext index build done! [20-09-12 11:10:59.7625] Slim::Music::Import::endImporter (709) Completed Slim::Plugin::FullTextSearch::Plugin Scan in 11903 seconds. [20-09-12 11:10:59.7634] Slim::Music::Import::runImporter (577) Starting Slim::Music::VirtualLibraries scan [20-09-12 11:11:00.7056] Slim::Music::Import::endImporter (709) Completed Slim::Music::VirtualLibraries Scan in 0 seconds. [20-09-12 11:11:00.8217] Slim::Music::Artwork::updateStandaloneArtwork (234) Starting updateStandaloneArtwork for 1549 albums [20-09-12 11:11:01.2910] Slim::Music::Artwork::__ANON__ (349) updateStandaloneArtwork finished in 0.464868068695068 [20-09-12 11:11:01.3116] Slim::Music::Artwork::precacheAllArtwork (659) Starting precacheArtwork for 0 albums [20-09-12 11:11:01.3125] Slim::Music::Import::endImporter (709) Completed precacheArtwork Scan in 0 seconds. [20-09-12 11:11:01.3141] Slim::Music::Import::runScanPostProcessing (479) Starting Database optimization. [20-09-12 11:11:07.1345] Slim::Music::Import::endImporter (709) Completed dbOptimize Scan in 5 seconds. testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I'd normally see the full text index taking less than a minute to complete, and the whole scan just over four minutes. I've indeed applied a change to the FTS plugin a few days ago. Could you please enable logging for plugin.fulltext and re-run a scan? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
mherger wrote: > > > But does it finish successfully? Would you have many playlists, or large > > playlists? > Thanks Michael, Yes - it finishes successfully. I ran the scan a second time in case it was one of those things that takes ages the first time and then is faster subsequently, but it makes no difference to the scan time. The scan information for that second scan says: iTunes Import (40885 of 40885) Complete 00:01:42 iTunes Playlist Import (31 of 31) Complete 00:02:24 Building full text index (7 of 7) Complete 02:40:39 Create library views (5 of 5) Complete 00:00:01 Find updated coverart files (1549 of 1549) Complete 00:00:01 Database Optimize (2 of 2) Complete 00:00:05 The server has finished scanning your media library. Total Time: 02:44:52 (Friday, September 11, 2020 / 6:54 PM) I'd normally see the full text index taking less than a minute to complete, and the whole scan just over four minutes. Those 31 playlists vary in size, but the biggest of them is 3,800 items. The next biggest is 1500. Does that give you any clues as to what's changed? John testmatch's Profile: http://forums.slimdevices.com/member.php?userid=30954 View this thread: http://forums.slimdevices.com/showthread.php?t=112920 ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
Re: [SlimDevices: SqueezeCenter] Scan taking hours instead of minutes on recent nightlies
I'm seeing a consistent change in scanning in the most recent nightlies. LogitechMediaServer-8.0.0-1599321733 (from September 6th) completes scans within minutes as normal, but all the nightlies after that take several hours to scan. The logjam is in the Albums section (2 of 7) of the 'Building full text index' stage of the scan. That used to take 40 seconds or so, but now takes just short of three hours. I can't see anything odd in the logs - it just runs really slowly through that stage, with the rest of the scan happening at the same speed as normal. But does it finish successfully? Would you have many playlists, or large playlists? -- Michael ___ Squeezecenter mailing list Squeezecenter@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/squeezecenter
