Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Is it just me or has the option to enable 1GB+ memory tuning for MySQL disappeared from the final 7.5.2 release (using the debian version from repository). I have checket my.tt and there seems to be no tuning there either indicating some kind of auto-tuning. -- marsboer marsboer's Profile: http://forums.slimdevices.com/member.php?userid=18417 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
marsboer;596270 Wrote: Is it just me or has the option to enable 1GB+ memory tuning for MySQL disappeared from the final 7.5.2 release (using the debian version from repository)? The tuning is also not present in my.tt as it was in the betas. No, it's not you. It's a pretty screwed up situation. They released 7.5.2 only with new firmware. If you were running 7.5.2 beta for any of the updates or bug fixes then you _don't_ want to install the 7.5.2 release version. Go back to the beta builds, which are now versioned 7.5.3. -- JJZolx JJZolx's Profile: http://forums.slimdevices.com/member.php?userid=10 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
marsboer;596270 Wrote: Is it just me or has the option to enable 1GB+ memory tuning for MySQL disappeared from the final 7.5.2 release (using the debian version from repository)? The tuning is also not present in my.tt as it was in the betas. ANDYG, is this true? has anyone checked the 7.5.3 beta to see if its in that? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parents' home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 45k+ mp3 ::VOTE FOR 'BUG 15604' (http://bugs.slimdevices.com/show_bug.cgi?id=15604)!!!:: MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
ANDYG, is this true? has anyone checked the 7.5.3 beta to see if its in that? Yes, that's true. If you read the announcement then you'll see that the released 7.5.2 was basically a firmware release only. Don't panic: if you've been using 7.5.2 before, you should upgrade to the 7.5.3 nightlies, which include all of the previous 7.5.2 changes. -- Michael ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Scans had grown to 9 hours and it was now taking more than 50 seconds for new items added to a playlist to appear in my own server system! Thanks to new parameters, scanning is back to 2 hours (42000 tracks) and basic operations are now typically back to 1s. Using HP MediaSmart (old gen) that I have upgraded to 2Gb. -- efalarde efalarde's Profile: http://forums.slimdevices.com/member.php?userid=42154 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
After doing some reading on MySQL performance tuning, it looks like innodb_buffer_pool_size, if memory permits, should be set to 110% of the database size. If you have a MySQL user setup you can use a SQL query to get the size of the DB. Otherwise, just look at the size of the ibdata file. In windows, that's in -...\Cache\MySQL\-. So, for instance, my ibdata file shows as 247,808K (242M), so I set innodb_buffer_pool to 267M. -- bobkoure bobkoure's Profile: http://forums.slimdevices.com/member.php?userid=14646 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Hello, I have been reading this thread and this evening I did the following on my Debian server. This completely killed the Squeezebox Server: Stopped SqueezeboxServer + MySQL Deleted both: /etc/mysql/my.cnf /var/lib/squeezeboxserver/cache/my.cnf Edited: /usr/share/squeezeboxserver/MySQL/my.tt with the new moonbase settings (my.tt.txt). Rebooted. Nothing. I thought that my.cnf was somehow regenerated from my.tt?? So, I created a new /etc/mysql/my.cnf and used the values from this thread here: Yeah I think it would be the my.ini file. Found in your MYSQL installation folder. EDIT: I guess that's covered already. Anyway here's a straight paste of my my.ini file: # MySQL Server Instance Configuration File # -- # Generated by the MySQL Server Instance Configuration Wizard # # # Installation Instructions # -- # # On Linux you can copy this file to /etc/my.cnf to set global options, # mysql-data-dir/my.cnf to set server-specific options # (@localstatedir@ for this installation) or to # ~/.my.cnf to set user-specific options. # # On Windows you should keep this file in the installation directory # of your server (e.g. C:\Program Files\MySQL\MySQL Server X.Y). To # make sure the server reads the config file use the startup option # --defaults-file. # # To run run the server from the command line, execute this in a # command line shell, e.g. # mysqld --defaults-file=C:\Program Files\MySQL\MySQL Server X.Y\my.ini # # To install the server as a Windows service manually, execute this in a # command line shell, e.g. # mysqld --install MySQLXY --defaults-file=C:\Program Files\MySQL\MySQL Server X.Y\my.ini # # And then execute this in a command line shell to start the server, e.g. # net start MySQLXY # # # Guildlines for editing this file # -- # # In this file, you can use all long options that the program supports. # If you want to know the options a program supports, start the program # with the --help option. # # More detailed information about the individual options can also be # found in the manual. # # # CLIENT SECTION # -- # # The following options will be read by MySQL client applications. # Note that only client applications shipped by MySQL are guaranteed # to read this section. If you want your own MySQL client program to # honor these values, you need to specify it as an option during the # MySQL client library initialization. # [client] port=3307 [mysql] default-character-set=latin1 # SERVER SECTION # -- # # The following options will be read by the MySQL Server. Make sure that # you have installed the server correctly (see above) so it reads this # file. # [mysqld] # The TCP/IP Port the MySQL Server will listen on port=3307 #Path to installation directory. All paths are usually resolved relative to this. basedir=R:/Program Files/MySQL/MySQL Server 5.1/ #Path to the database root datadir=R:/Program Files/MySQL/MySQL Server 5.1/Data/ # The default character set that will be used when a new schema or table is # created and no character set is defined default-character-set=latin1 # The default storage engine that will be used when create new tables when default-storage-engine=INNODB # Set the SQL mode to strict sql-mode=STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_E NGINE_SUBSTITUTION # The maximum amount of concurrent sessions the MySQL server will # allow. One of these connections will be reserved for a user with # SUPER privileges to allow the administrator to login even if the # connection limit has been reached. max_connections=100 # Query cache is used to cache SELECT results and later return them # without actual executing the same query once again. Having the query # cache enabled may result in significant speed improvements, if your # have a lot of identical queries and rarely changing tables. See the # Qcache_lowmem_prunes status variable to check if the current value # is high enough for your load. # Note: In case your tables change very often or if your queries are # textually different every time, the query cache may result in a # slowdown instead of a performance improvement. query_cache_size=128M # The number of open tables for all threads. Increasing this value # increases the number of file descriptors that mysqld requires. # Therefore you have to make sure to set the amount of open files # allowed to at least 4096 in the variable open-files-limit in # section [mysqld_safe] table_cache=256 # Maximum size for internal (in-memory) temporary tables. If a table # grows larger than this value, it is automatically converted to disk # based table This limitation is for a single table. There can be many # of them. tmp_table_size=17M
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Hello, I have been reading this thread and this evening I did the following on my Debian server. This completely killed the Squeezebox Server: Stopped SqueezeboxServer + MySQL Deleted both: /etc/mysql/my.cnf /var/lib/squeezeboxserver/cache/my.cnf Edited: /usr/share/squeezeboxserver/MySQL/my.tt with the new moonbase settings (my.tt.txt). Rebooted. Nothing. I thought that my.cnf was somehow regenerated from my.tt?? So, I created a new /etc/mysql/my.cnf and used the values from this thread here: Yeah I think it would be the my.ini file. Found in your MYSQL installation folder. EDIT: I guess that's covered already. Anyway here's a straight paste of my my.ini file: # MySQL Server Instance Configuration File # -- # Generated by the MySQL Server Instance Configuration Wizard # # # Installation Instructions # -- # # On Linux you can copy this file to /etc/my.cnf to set global options, # mysql-data-dir/my.cnf to set server-specific options # (@localstatedir@ for this installation) or to # ~/.my.cnf to set user-specific options. # # On Windows you should keep this file in the installation directory # of your server (e.g. C:\Program Files\MySQL\MySQL Server X.Y). To # make sure the server reads the config file use the startup option # --defaults-file. # # To run run the server from the command line, execute this in a # command line shell, e.g. # mysqld --defaults-file=C:\Program Files\MySQL\MySQL Server X.Y\my.ini # # To install the server as a Windows service manually, execute this in a # command line shell, e.g. # mysqld --install MySQLXY --defaults-file=C:\Program Files\MySQL\MySQL Server X.Y\my.ini # # And then execute this in a command line shell to start the server, e.g. # net start MySQLXY # # # Guildlines for editing this file # -- # # In this file, you can use all long options that the program supports. # If you want to know the options a program supports, start the program # with the --help option. # # More detailed information about the individual options can also be # found in the manual. # # # CLIENT SECTION # -- # # The following options will be read by MySQL client applications. # Note that only client applications shipped by MySQL are guaranteed # to read this section. If you want your own MySQL client program to # honor these values, you need to specify it as an option during the # MySQL client library initialization. # [client] port=3307 [mysql] default-character-set=latin1 # SERVER SECTION # -- # # The following options will be read by the MySQL Server. Make sure that # you have installed the server correctly (see above) so it reads this # file. # [mysqld] # The TCP/IP Port the MySQL Server will listen on port=3307 #Path to installation directory. All paths are usually resolved relative to this. basedir=R:/Program Files/MySQL/MySQL Server 5.1/ #Path to the database root datadir=R:/Program Files/MySQL/MySQL Server 5.1/Data/ # The default character set that will be used when a new schema or table is # created and no character set is defined default-character-set=latin1 # The default storage engine that will be used when create new tables when default-storage-engine=INNODB # Set the SQL mode to strict sql-mode=STRICT_TRANS_TABLES,NO_AUTO_CREATE_USER,NO_E NGINE_SUBSTITUTION # The maximum amount of concurrent sessions the MySQL server will # allow. One of these connections will be reserved for a user with # SUPER privileges to allow the administrator to login even if the # connection limit has been reached. max_connections=100 # Query cache is used to cache SELECT results and later return them # without actual executing the same query once again. Having the query # cache enabled may result in significant speed improvements, if your # have a lot of identical queries and rarely changing tables. See the # Qcache_lowmem_prunes status variable to check if the current value # is high enough for your load. # Note: In case your tables change very often or if your queries are # textually different every time, the query cache may result in a # slowdown instead of a performance improvement. query_cache_size=128M # The number of open tables for all threads. Increasing this value # increases the number of file descriptors that mysqld requires. # Therefore you have to make sure to set the amount of open files # allowed to at least 4096 in the variable open-files-limit in # section [mysqld_safe] table_cache=256 # Maximum size for internal (in-memory) temporary tables. If a table # grows larger than this value, it is automatically converted to disk # based table This limitation is for a single table. There can be many # of them. tmp_table_size=17M
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
lloyd, the option is now a built in setting in 7.5.2beta settings. very stable, i recommend using that. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parents' home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 45k+ mp3 ::VOTE FOR 'BUG 15604' (http://bugs.slimdevices.com/show_bug.cgi?id=15604)!!!:: MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Right now my system is completely trashed. I have had to remove/purge squeezeboxserver. -- DLloyd DLloyd's Profile: http://forums.slimdevices.com/member.php?userid=9063 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Apologies for the delayed reply I have a 1GB RAM ReadyNAS NV+ with the following library stats :- Total Tracks: 22,261 Total Albums: 2,116 Total Artists: 3,373 Total Genres: 29 Total Playing Time: 1751:33:33 Music Scan Details Directory Scan (22268 of 22268) Complete 02:38:01 Playlist ScanComplete 00:00:00 iTunes Import (21651 of 21651) Complete 00:47:45 iTunes Playlist Import (6 of 6) Complete 00:02:23 Merge Various Artists (504 of 504) Complete 00:01:19 Artwork Scan (2116 of 2116) Complete 00:08:00 The server has finished scanning your music collection. Total Time: 03:37:28 (Thursday, 28 October 2010 / 06.44)Now, with the new option - which I understand is directed towards reserving more RAM for scans etc, the database memory config can be set to high, but I also assume further tweaking of Server Priority and Scanner Priority, in conjunction with the memory setting, may reap additional rewards. My previous question, perhaps not well worded, should have been more along the lines of asking whether anyone's found a good / ideal / bad / non-workable (etc) balance of all 3 settings? -- rolski rolski's Profile: http://forums.slimdevices.com/member.php?userid=23776 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Any experiences with using these newly added options ? Recommended settings ? -- rolski rolski's Profile: http://forums.slimdevices.com/member.php?userid=23776 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
what do you mean? i just enable it via the webui settingsadvanced page. i think it works great as is, but it prob could use more than just on/off, (to be even better). its in 7.5.2b and 7.6b -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 45k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Done, it's in 7.5 in r31367. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
sorry to bug you Andy, but whats the word? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Sorry haven't got around to it yet, will do it tomorrow. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
andyg;577959 Wrote: Sorry haven't got around to it yet, will do it tomorrow. thx, u rock! so tomorrow's nightly then... looking forward to it. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
andyg;573093 Wrote: OK it's pretty self-contained so I can backport it to 7.5. Andy, just installed 7.5.2 to my Dad's system, but i don't see it... is it there yet? if yes, where? can it be in tonights nightly if not? thx. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
andyg;570884 Wrote: KISS is right. I've just added an option to the Performance settings page called Database Memory Config. Currently this only works for MySQL and uses Moonbase's config which is listed below. I expect in the future we can also include some SQLite settings when this option is enabled, once we determine what the best settings are. Code: # $Id$ # # Squeezebox Server specific MySQL Server config. # High-memory configuration by Moonbase # http://forums.slimdevices.com/showthread.php?t=60682 [mysqld] innodb skip-locking long_query_time = 2 log_slow_queries # If you want to have user permissions - you need to setup a valid user, and # remove this line below. skip-grant-tables basedir = [% basedir %] datadir = [% datadir %] tmpdir= [% datadir %] language = [% language %] port = [% port %] socket= [% socket %] pid-file = [% pidFile %] log-error = [% errorLog %] innodb_fast_shutdown = 1 max_connections = 4 thread_concurrency= 4 log-warnings = 0 bind-address = [% bindAddress %] default-character-set = utf8 default-collation = utf8_general_ci key_buffer= 16M max_allowed_packet= 1M table_cache = 64 sort_buffer_size = 512K net_buffer_length = 8K read_buffer_size = 256K read_rnd_buffer_size = 512K # InnoDB settings # You can set .._buffer_pool_size up to 50 - 80 % # of RAM but beware of setting memory usage too high innodb_buffer_pool_size = 32M innodb_additional_mem_pool_size = 2M # Set .._log_file_size to 25 % of buffer pool size innodb_log_file_size = 5M innodb_log_buffer_size = 8M innodb_flush_log_at_trx_commit = 1 innodb_lock_wait_timeout = 50 [client] socket= [% socket %] This is slightly different from Moonbase's final my.tt recommendations, where he used key_buffer_size instead of key_buffer etc Code: # Some tweaks by Moonbase, recommended for systems with 1GB+ RAM # key_buffer: cache index blocks for MyISAM, temp disc tables for InnoDB key_buffer_size = 16M # sort_buffer_size: improve ORDER BY and GROUP BY sort_buffer_size = 2M # join_buffer_size: improve full JOINs (non-indexed) join_buffer_size = 2M # read_buffer_size: don't adjust too high, just for full scans read_buffer_size = 512K # read_rnd_buffer_size: really improve ORDER BY read_rnd_buffer_size = 2M Is there any reason for this? -- agonynine agonynine's Profile: http://forums.slimdevices.com/member.php?userid=39887 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I've updated my-highmem.tt with these newer values. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Before: Directory Scan (78706 of 78706) Complete 02:02:54 Playlist Scan (5882 of 5882) Complete 00:08:48 Merge Various Artists (9901 of 9901) Complete 00:05:37 Artwork Scan (10249 of 10249) Complete 01:18:49 Total Time: 03:36:08 (Saturday, August 28, 2010 / 6:06 PM) After: Directory Scan (78706 of 78706) Complete 01:46:53 Playlist Scan (5882 of 5882) Complete 00:09:09 Merge Various Artists (9901 of 9901) Complete 00:05:48 Artwork Scan (10249 of 10249) Complete 01:18:38 Total Time: 03:20:28 (Sunday, August 29, 2010 / 7:00 AM) Not a huge gain but a gain, I suppose. I'm using a Windows XP nettop with 2 GB RAM and version 7.5.1 of SBS. -- jimzak http://zzzone.net http://have-a-nice-day.org http://www.last.fm/user/zzzoneDOTnet http://somethingsomethingsomething.net Ripper: dBpoweramp Router: Lynksys WRT54GL Server: SBS 7.5.1 - dedicated Atom-based nettop - Windows XP SP3 Music: 2 Booms, 1 Radio, 1 Duet, 1 Touch, Control: 1 extra controller, 1 iPod Touch w/iPeng, 1 iPad w/iPeng SqueezePad Files: 77,000+ FLAC/MP3 files - 2TB external HD x 2 Logitech: Harmony One x 2, Wilife Home Security jimzak's Profile: http://forums.slimdevices.com/member.php?userid=17592 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
but what about webui? does the interface seem snappier? ANDYG, can/will you backport this to 7.5.2? i think it makes a lot of sense to get this mod into what looks to be the last mysql only SBS. thx! -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
thx andy! i'll look for it this week. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Thanks Moonbase for this thread. For folks with a relatively powerful Squeezebox Server system and **RAM to burn** :-), I've attached my settings for my.tt. For those running into trouble, rebooting and doing a Clear library and rescan everything will avoid database issues. On my system (4G RAM, Opteron 165 Dual Core @2GHz, SB Server 7.5.1, 53K songs on 1.5TB WD Caviar Green SATA, 600x600+ artwork, 70% FLAC, ~200 24/96+ albums/LP rips), a full rescan was 30% faster and day-to-day use appears speedier. Web interface quite snappy and CLI apps like iPeng SqueezePad at times instantaneous. Details below... As usual, YMMV :-) Archimago - Tests (these are all Clear library and rescan everything times after a reboot): Squeezebox Server Information: Version: 7.5.1 - r30836 @ Tue Jun 1 06:02:45 PDT 2010 Operating system: Windows 2008 Server R2 - EN - Platform Architecture: 586 Perl Version: 5.10.0 - MSWin32-x86-multi-thread MySQL Version: 5.0.22-community-nt-log Default my.tt: (sorry, didn't copy and paste detailed timings) Total Time: 1:55:05 Moonbase's my.tt: Total Time: 1:40:20 Moonbase's my.tt + 300M innodb_buffer_pool_size: Directory Scan (53293 of 53293) Complete 00:53:49 Playlist Scan (3 of 3) Complete 00:00:00 Merge Various Artists (3785 of 3785) Complete 00:01:27 Artwork Scan (3928 of 3928) Complete 00:40:46 Total Time:01:36:02 ArchMega500 my.tt (500M innodb_buffer_pool_size + key_buffer, etc. tweaks): Directory Scan (53293 of 53293) Complete 00:31:25 Playlist Scan (3 of 3) Complete 00:00:00 Merge Various Artists (3786 of 3786) Complete 00:01:29 Artwork Scan (3929 of 3929) Complete 00:40:30 Total Time:01:13:24 Observation: 1. With just my FTP Server and Apache running in the background unused, Windows reports physical memory usage not to exceed 2.2GB through the scan. Memory usage drops thereafter in day-to-day use. 2. I don't see much multithreading going on at all, Directory Scan uses about 30-40% CPU, Artwork Scan only uses up to 50% of the dual cores. Therefore, HD speed, MHz/GHz speed more important than # cores for the scanning process. 3. IMO key_buffer and table_cache just as significant as innodb_buffer_pool_size. I actually did not notice any difference between 300M to 500M for the pool_size but decided to leave it as 500M to give the database room to grow. 4. An interesting related article: http://www.debianhelp.co.uk/mysqlperformance.htm +---+ |Filename: ArchMega500v2-my.tt.txt | |Download: http://forums.slimdevices.com/attachment.php?attachmentid=10550| +---+ -- Archimago Archimago's Profile: http://forums.slimdevices.com/member.php?userid=2207 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
KISS is right. I've just added an option to the Performance settings page called Database Memory Config. Currently this only works for MySQL and uses Moonbase's config which is listed below. I expect in the future we can also include some SQLite settings when this option is enabled, once we determine what the best settings are. Code: # $Id$ # # Squeezebox Server specific MySQL Server config. # High-memory configuration by Moonbase # http://forums.slimdevices.com/showthread.php?t=60682 [mysqld] innodb skip-locking long_query_time = 2 log_slow_queries # If you want to have user permissions - you need to setup a valid user, and # remove this line below. skip-grant-tables basedir = [% basedir %] datadir = [% datadir %] tmpdir= [% datadir %] language = [% language %] port = [% port %] socket= [% socket %] pid-file = [% pidFile %] log-error = [% errorLog %] innodb_fast_shutdown = 1 max_connections = 4 thread_concurrency= 4 log-warnings = 0 bind-address = [% bindAddress %] default-character-set = utf8 default-collation = utf8_general_ci key_buffer= 16M max_allowed_packet= 1M table_cache = 64 sort_buffer_size = 512K net_buffer_length = 8K read_buffer_size = 256K read_rnd_buffer_size = 512K # InnoDB settings # You can set .._buffer_pool_size up to 50 - 80 % # of RAM but beware of setting memory usage too high innodb_buffer_pool_size = 32M innodb_additional_mem_pool_size = 2M # Set .._log_file_size to 25 % of buffer pool size innodb_log_file_size = 5M innodb_log_buffer_size = 8M innodb_flush_log_at_trx_commit = 1 innodb_lock_wait_timeout = 50 [client] socket= [% socket %] -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I also added the following pragmas for SQLite when highmem mode is enabled: Code: PRAGMA cache_size = 2; PRAGMA temp_store = MEMORY; This should let the database use up to 20MB for page cache and store temporary files in memory (used by sorts, joins, etc) -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
wow, this is awesome... what would be killer, would be for someone (not necessarily AndyG) to explain in remarks in the code, what each line is for and some advice on what ranges to use given what hardware one has. i agree with the KISS thing too, but eventually it would be good to have differing levels of settings so one could pick the level that most closely matches their hardware, and i don't see much danger in it if one can simply switch back to the default or whatnot. is this in 7.6 and 7.5.2? thx AndyG! -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
This is awesome ! thankyou :) Btw the differing level would not only match hardware but ones needs . Me, I want to flat out use my whole little server for sbs ! an easy case. But it can easily be so that people with powerful machines but not that much focus on sbs want's to run other applications too, then it's great that one can choose wich size sbs you want to run :) Btw is MySQL in7.6 working now ? last time i tried, scan crashed and it reused the old dB since the last successful MySQL scan made with 7.5 beta. I've not yet figured a way the clear the cache without loosing my SQlite dB and trackstats in the process. -- Mnyb Main hifi: Touch + CIA PS +MeridianG68J MeridianHD621 and assorted amps SiriuS, Classe' Primare and Dynadio speakers, Contour 4 Contour Center, and Contour 1.3SE for the rear ch. Rel Stadium 3 sub. Bedroom/Office: Boom Kitchen: SB3 + powered Fostex PM0.4 Miscellaneous use: Radio (with battery) I use a Controller various ir-remotes and a Eee-PC with squeezeplay to control this Mnyb's Profile: http://forums.slimdevices.com/member.php?userid=4143 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
EVERYONE, AndyG is willing to make a pref for this, see here: http://bugs.slimdevices.com/show_bug.cgi?id=14921 however, i don't know how to answer his question... i wish moonbase was still around. we need a DB settings expert to submit to AndyG in that bug exactly what would be best, and exactly what should be changed. i know i could just copy in moonbases my.tt text, but i can't explain it. can someone help??? what i'd like to see on the sbs mysql prefs page (short of a self tuning mechanism): A. default (meaning todays's current shipping sbs settings, ie. the lowest common denominator / sparc nas type numbers) B. typical 1gig machine C. typical 2gig machine D. 3gig E. 4gig and beyond --- i don't know if CPU matters to the settings or not, but i know ram size does. an expert really should answer AndyG's question though. thx! ps. is it possible to have different defaults based on different SBS distrobutions? one default for sparcnas, another for windows sbs? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbrec ipeng (parent's home) - sbs 7.5.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz, 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 43k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I am not the database expert you're looking for, but I suggest applying the KISS principle. There's one set of values (from Moonbase) that has been tested by members of this forum for almost a year now, and we've had overwhelmingly positive reports. I don't suggest making new sets of values, that have yet to be tested and may have unintended consequences. I know you were looking for a more sophisticated answer than that, but I feel that we're in danger of letting the best be the enemy of the good here. Whatever values are chosen, it is worth using tuning-primer.sh to do a sanity check on them (if you are on a Linux type system) https://launchpad.net/mysql-tuning-primer -- dsdreamer -- Dreamer, easy in the chair that really fits you... dsdreamer's Profile: http://forums.slimdevices.com/member.php?userid=12588 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I applied the settings on my NAS but I didn't notice any obvious WebUI or scanner speedups. OTOH Controller operation has sped up dramatically, instead of 5-10 sec delays the Controller now displays lists nearly instantly (1 sec) when searching for music. Quite a significant improvement in usability... -- yerma SC 7.5.0 on QNAP TS-219P, one Duet, one Boom yerma's Profile: http://forums.slimdevices.com/member.php?userid=31470 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
turls;552454 Wrote: Are the tweaks in here still valid? Yes. These are tweaks to improve the performance of MySQL in the special case of having a database small enough to fit into memory (MySQL is normally used with databases that do -not- fit). Further, the default settings that SqueezeServer uses for MySQL are for a machine with very little memory. Starting with SqueezeServer 7.6, if all goes to plan, there will be a choice between SQLite and MySQL as database systems. These tweaks will continue to work - but only if you've chosen / installed MySQL. Parenthetically, SQLite used to be really slow, which is why SqueezeServer has been using MySQL. But SQLite performance has improved over the last few years. Still not the appropriate choice for a big-ish database, but even with 200K tracks, Squeeze doesn't get into that range. Personally, I use a low-spec (for low power consumption) music server so I'm looking forward to trying SQLite. Another angle with 7.6 is that, given that the current MySQL settings are for a minimal server, and that there will then be SQLite for that minimal server, I'd expect something like these tweaks to become the norm (no longer a need to accommodate those minimal boxes as SQLite's there for that). Hoping that makes it clear... PS: Just to put the Squeezeserver's database is small into perspective, a few years ago I setup a MySQL database that had hundreds of millions of rows. SqueezeServer's db is more in the tens or hundreds of thousands of rows (depending on the number of tracks) -- bobkoure bobkoure's Profile: http://forums.slimdevices.com/member.php?userid=14646 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
It seems surprising that this thread has not been posted to since January. Are the tweaks in here still valid? I voided my HP WHS warranty to beef it up with a faster proc and more memory and SB is still slow. I guess I won't hurt anything trying these tweaks, but there are only a couple of posts here from WHS users it seems, and none of them showed much improvement. -- turls turls's Profile: http://forums.slimdevices.com/member.php?userid=36599 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
the tweaks are for MySQL users. SBS seems to be going to a SQLite by default setup, and so you can't do the tweaks with that. If you do use MySQL for your install, i have not seen the tweaks hurt anyone, while they do seem to help a lot of people. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.5b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 40k+ mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Sorry, I lost my before log, but it was a total of 8 minutes and 20 seconds. The following is my new timing: Code: Library Statistics Total Tracks: 7,084 Total Albums: 500 Total Artists: 491 Total Genres: 55 Total Playing Time: 552:49:02 Music Scan Details Directory Scan (7084 of 7084) Complete 00:02:30 Playlist Scan (2 of 2) Complete 00:00:00 Merge Various Artists (455 of 455) Complete 00:00:08 Artwork Scan (500 of 500) Complete 00:02:08 The server has finished scanning your music collection. Total Time: 00:04:46 (Friday, January 1, 2010 / 10:17 AM) The web UI is noticeably faster, and even manipulation of long play lists has become practical for the first time. Running Windows Vista 64-bit on a Core-2 Duo 2.8GHz CPU with 4 GB RAM installed. -- dsdreamer -- Dreamer, easy in the chair that really fits you... dsdreamer's Profile: http://forums.slimdevices.com/member.php?userid=12588 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
So I ran some timings and I was quite surprised: Standard my.tt Directory Scan (19021 of 19021) Complete 00:51:48 Playlist Scan (10 of 10) Complete 00:00:05 Merge Various Artists (1870 of 1870) Complete 00:01:31 Artwork Scan (1966 of 1966) Complete 00:37:08 Total Time: 01:30:32 (Thu, 10. Dec 2009 / 10:39:08) Using moonbase's my.tt but with innodb_buffer_pool_size = 128M Directory Scan (19021 of 19021) Complete 00:52:53 Playlist Scan (10 of 10) Complete 00:00:06 Merge Various Artists (1870 of 1870) Complete 00:01:35 Artwork Scan (1966 of 1966) Complete 00:36:04 Total Time: 01:30:38 (Thu, 10. Dec 2009 / 1:08:14) So no significant difference (to the accuracy of the benchmark) I also made some measurements of response times in the web ui and, to the accuracy of my second counting, I couldn't spot any differences. It still felt faster but maybe that's placebo. I also tried moonbase's my.tt unchanged but not for a scan. Again no measurable improvements to the webui. So, I think it helps, but the numbers don't back me up. Double blind testing anyone :-) -- bstrulo bstrulo's Profile: http://forums.slimdevices.com/member.php?userid=15997 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
if i might be so bold, perhaps you didn't delete the cached my.tt each time with a stopped SBS? somehow i doubt it made no difference. almost everyone has reported faster scanning or faster UI, or normally both. i also doubt the dramatic difference you noted in the UI in your first post was just placebo effect. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I changed the mytt. Sorry, I didn't bother to log scan times: they don't usually bother me since I do them at night or when I'm not using the SB. I'll try to note them at some stage but not just now. But the change in the Web UI was really noticeable. I was so pleased I pushed the innodb_buffer_pool_size up to 128M and still got some noticeable improvements to responsiveness. It changes the Web UI from adequate, to pleasant to use. Particular improvements to search and random mix. I've voted for the bug. -- bstrulo bstrulo's Profile: http://forums.slimdevices.com/member.php?userid=15997 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
My results (SheevaPlug, ARM, 1.2 GHz, 512 MB RAM, Ge network) - Squeezebox Server Status Version: 7.4.1 - r28947 @ Tue Oct 20 08:02:44 PDT 2009 Hostname: debian Server IP Address: 127.0.0.1 Server HTTP Port Number: 9000 Operating system: Debian - EN - iso-8859-1 Platform Architecture: armv5tel-linux Perl Version: 5.10.1 - arm-linux-gnueabi-thread-multi MySQL Version: 5.1.37-2 Total Players Recognized: 1 Library Statistics Total Tracks: 4,346 Total Albums: 368 Total Artists: 391 Total Genres: 31 Total Playing Time: 297:06:17 Before: Music Scan Details Directory Scan Complete 00:23:20 Playlist Scan Complete 00:02:01 Merge Various Artists Complete 00:01:02 Artwork Scan Complete 00:05:33 The server has finished scanning your music collection. Total Time: 00:31:56 (Saturday, December 5, 2009 / 5:28 AM) After: Music Scan Details Directory Scan Complete 00:22:57 Playlist Scan Complete 00:02:00 Merge Various Artists Complete 00:01:01 Artwork Scan Complete 00:05:33 The server has finished scanning your music collection. Total Time: 00:31:31 (Saturday, December 5, 2009 / 6:37 AM) The scan was not much faster (20 seconds out of 31 minutes is pretty small. HOWEVER, the Web UI is much more responsive. The server page used to take almost a second to show the green screen and 3 seconds to show the left side. Those are almost immediate now (less than a second). -- mark f mark f's Profile: http://forums.slimdevices.com/member.php?userid=5057 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
mherger;484651 Wrote: I haven't seen many Linux systems so far. Is this more important on Windows I wonder? I think, to see the difference of a larger innodb_buffer_pool_size in Linux, you also need to set innodb_flush_method=O_DIRECT otherwise you're still double-buffering in the OS and MySQL. See 'mysqlperformanceblog' (http://www.mysqlperformanceblog.com/2007/11/03/choosing-innodb_buffer_pool_size/) -- bobkoure bobkoure's Profile: http://forums.slimdevices.com/member.php?userid=14646 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
My results System - WHS (Windows Server 2003), 1GB RAM, Dual Core Pentium (E2180) @2Ghz Version: 7.4.1 - r28947 @ Tue Oct 20 08:13:15 PDT 2009 Hostname: home-server Server IP Address: 192.168.0.100 Server HTTP Port Number: 9000 Operating system: Windows Home Server - EN - cp1252 Platform Architecture: 586 Perl Version: 5.10.0 - MSWin32-x86-multi-thread MySQL Version: 5.0.22-community-nt-log Total Tracks: 8,627 Total Albums: 719 Total Artists: 322 Total Genres: 78 Total Playing Time: 590:12:39 Before (previous night's scan): Music Scan Details Directory Scan (8627 of 8627) Complete 00:08:13 Playlist Scan ( of ) Complete 00:01:11 Merge Various Artists (670 of 670) Complete 00:00:05 Artwork Scan (719 of 719) Complete 00:03:25 The server has finished scanning your music collection. Total Time: 00:12:54 (Saturday, December 5, 2009 / 04.13) After (manual scan): Directory Scan(8627 of 8627) Complete 00:11:23 Playlist Scan ( of ) Complete 00:01:19 Merge Various Artists (670 of 670) Complete 00:00:05 Artwork Scan(719 of 719) Complete 00:03:23 The server has finished scanning your music collection. Total Time: 00:16:10 (Saturday, December 5, 2009 / 21.23) So, I'm afraid it made my scan somewhat slower Maybe I did something wrong? I followed the instructions without any problems and rebooted the server though The UI doesn't seem noticeable different, but it wasn't too slow anyway. -- SadGamerGeek SadGamerGeek's Profile: http://forums.slimdevices.com/member.php?userid=6145 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
MrSinatra;486218 Wrote: it was dramatic for me. how many files do you guys have? i think the effect is linear based on the more you have, the more potent the effect. That would be straightforward to test. Divide your library up into increasingly large subsets, whether through temporarily re-arranging the folder structure or other means. Then simply compare the responsiveness with different MySQL settings on each subset, being sure to clear the broswer cache in between. To be conclusive it would really help to have some way to quantify what it is you're trying to measure, rather than subjective assessments. -- aubuti aubuti's Profile: http://forums.slimdevices.com/member.php?userid=2074 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
aubuti;485837 Wrote: After trying it out some more I'd say the mysql tweak may speed up the web ui a little bit on my system, but it's hard to say for sure. Certainly nothing that I would describe as obvious or dramatic. Same here. It's maybe a bit quicker but I didn't consider it slow in the first place. -- radish 'HELP ME RAISE MONEY FOR CHILDREN'S CANCER RESEARCH!' (HTTP://WWW.ADAMREEVE.COM/24IN24/) http://www.last.fm/user/polymeric radish's Profile: http://forums.slimdevices.com/member.php?userid=77 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
it was dramatic for me. how many files do you guys have? i think the effect is linear based on the more you have, the more potent the effect. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
MrSinatra;486218 Wrote: it was dramatic for me. how many files do you guys have? i think the effect is linear based on the more you have, the more potent the effect. Around 22k. -- radish 'HELP ME RAISE MONEY FOR CHILDREN'S CANCER RESEARCH!' (HTTP://WWW.ADAMREEVE.COM/24IN24/) http://www.last.fm/user/polymeric radish's Profile: http://forums.slimdevices.com/member.php?userid=77 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
MrSinatra;485009 Wrote: some people have talked about doing searches or drilling down to artists or songs via different nav paths. but if you mean a true benchmark, no. most people mentioning this hav simply said they have seen an obvious, for the better, improvement. i know in my usage, album art in the webui loads MUCH faster, as a for instance, but i'm not sure i could benchmark it. After trying it out some more I'd say the mysql tweak may speed up the web ui a little bit on my system, but it's hard to say for sure. Certainly nothing that I would describe as obvious or dramatic. -- aubuti aubuti's Profile: http://forums.slimdevices.com/member.php?userid=2074 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
guys, remember, scan times is just HALF the tweak. the other half is a dramatic increase in UI responsiveness. also, we need prob 30 votes for this to get implemented officially, so everyone PLEASE VOTE! https://bugs.slimdevices.com/show_bug.cgi?id=14921 -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
some people have talked about doing searches or drilling down to artists or songs via different nav paths. but if you mean a true benchmark, no. most people mentioning this hav simply said they have seen an obvious, for the better, improvement. i know in my usage, album art in the webui loads MUCH faster, as a for instance, but i'm not sure i could benchmark it. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
mherger;484897 Wrote: Ok, here go my numbers (this is a Via C3/1GHz, 1GB RAM box): Before (SBS MySQL): After (using system's MySQL): Michael, i don't do linux, but i'm confused... you have two mysql's? and did you apply the moonbase file to the second one only? i think your tests should use the same mysql for both, or am i way off here? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
MrSinatra;484935 Wrote: guys, remember, scan times is just HALF the tweak. the other half is a dramatic increase in UI responsiveness. I admit I haven't done much systematic comparison of ui responsiveness, but the little I have done certainly didn't show dramatic differences. Maybe I'll do some more over the weekend. Any good recommendations for how best to *measure* ui responsiveness? -- aubuti aubuti's Profile: http://forums.slimdevices.com/member.php?userid=2074 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
i don't do linux, but i'm confused... you have two mysql's? and did Yes. Only the packages use the system's mysqld by default. As I'm running from trunk (svn checkout) I was too lazy configuring this before. I didn't care about the additional memory load. you apply the moonbase file to the second one only? I ran the test against both. The difference for the modified version was below a minute for the grand total, thus I only posted one of them. Michael ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Here are results on my massive library: PC Spec: Windows XP SP3 Pentium 4 - 3.0 Ghz 2.5 GB Ram Most music on 2 external 1TB USB Western Digital Drives, some on internal 750 GB IDE drive. Library size: 2.2 Terabytes, about 75% FLAC, the rest in MP3 Squeezebox Server Status Version: 7.4.2 - r29203 @ Mon Nov 9 04:03:04 PST 2009 Operating system: Windows XP - EN - cp1252 Platform Architecture: 586 Perl Version: 5.10.0 - MSWin32-x86-multi-thread MySQL Version: 5.0.22-community-nt Total Players Recognized: 1 Music Scan Details Directory Scan (147326 of 147326) Complete 03:18:19 Playlist Scan ( of ) Complete 00:00:00 Merge Various Artists (8235 of 8235) Complete 00:06:29 Artwork Scan (8244 of 8244) Complete 01:13:50 The server has finished scanning your music collection. Total Time: 04:38:38 (Tuesday, November 10, 2009 / 2:09 AM) --- After adding moonbase's my.tt.txt (And cleaning up some ALBUMARTISTSORT issues): Music Scan Details Directory Scan (147326 of 147326) Complete 02:29:05 Playlist Scan ( of ) Complete 00:00:00 Merge Various Artists (8236 of 8236) Complete 00:05:47 Artwork Scan (8245 of 8245) Complete 01:10:42 The server has finished scanning your music collection. Total Time: 03:45:34 (Wednesday, November 11, 2009 / 2:09 AM) The total time dropped from 04:38:38 to 03:45:34 - a nice improvement. And more importantly, the responsiveness does have the promised gains. While the search function used to be worthless on my library due to how slow it was, it can now actually return results. Thanks for taking the time to dig into this. -- Random Lurker Random Lurker's Profile: http://forums.slimdevices.com/member.php?userid=21320 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
this is great, but we need MORE results and MORE votes!!! vote for the bug!!! https://bugs.slimdevices.com/show_bug.cgi?id=14921 i'm surprised some of the old guard here hasn't posted their results yet. (even just an idea of how much improved, if you don't have pre tweak stats) -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
this is great, but we need MORE results and MORE votes!!! I eventually gave this a try, tweaking both the mysqld instance shipped with SBS as well as my system's configuration. None made a notable difference (1-2% at max). I haven't seen many Linux systems so far. Is this more important on Windows I wonder? ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
this is great, but we need MORE results and MORE votes!!! I eventually gave this a try, tweaking both the mysqld instance shipped with SBS as well as my system's configuration. None made a notable difference (1-2% at max). I haven't seen many Linux systems so far. Is this more important on Windows I wonder? I use the system instance of mysql with my linux install. The changes are irrelevant since the system file already matches the suggested value. -kdf ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
sheevaplug is linux right? made a big difference on that. in moonbases orig thread another linux user had a HUGE benefit, 4hr to 2.5 r u sure you implemented the tweak in the right place? linux seems to be more variable as to where the file should go. and how many files, etc? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I have lived with a modded my.tt (see my posts earlier in this thread) with set innodb_buffer_pool_size set to 500m for two weeks, monitoring the memory usage via Windows Task Manager. Unless I have performed a Clear Rescan, mysqld.exe does not use more than about 125M. Lazy searches are extra fast, with the number of matches almost instant as I enter each character. The GUI is fast and as I said earlier a pleasure to use (this is with a library of 97,759 tracks, 8,473 albums, most with cover.jpg - mostly FLAC, but some mp3 and m4a). Browsing by albums - Home Albums - takes a few seconds going from one letter to another, but is still acceptable. Clicking on the artwork instantly brings up the album details. Browsing by artists - Home Artists - also takes a a couple of seconds between letters, but again clicking on an artist brings up an instant display of the albums. Search Music - Home Search -is nearly instant in displaying search results. This mod is certainly worthwhile in Windows and Squeezecenter 7.3.4 -- Wirrunna A camel is a racehorse designed by a committee. Wirrunna's Profile: http://forums.slimdevices.com/member.php?userid=3225 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
As promised, here are my results. Not a huge improvement in actual time, but it works out to around 10% which isn't terrible. This is on my production server which is an AthlonXP/2G RAM. Version: 7.4.2 - r29220 @ Tue Nov 10 04:01:26 PST 2009 Hostname: gary Server IP Address: 192.168.2.163 Server HTTP Port Number: 9000 Operating system: Debian - EN - utf8 Platform Architecture: i686-linux Perl Version: 5.10.0 - i486-linux-gnu-thread-multi MySQL Version: 5.0.75-0ubuntu10.2 Total Players Recognized: 9 == Before == Directory Scan (21833 of 21833) Complete 00:21:45 Playlist Scan (8 of 8) Complete 00:00:06 Merge Various Artists (963 of 963) Complete 00:00:06 Artwork Scan (1580 of 1580) Complete 00:05:27 The server has finished scanning your music collection. Total Time: 00:27:24 == After == Directory Scan (21833 of 21833) Complete 00:19:23 Playlist Scan (8 of 8) Complete 00:00:04 Merge Various Artists (963 of 963) Complete 00:00:06 Artwork Scan (1580 of 1580) Complete 00:04:56 The server has finished scanning your music collection. Total Time: 00:24:29 -- radish 'HELP ME RAISE MONEY FOR CHILDREN'S CANCER RESEARCH!' (HTTP://WWW.ADAMREEVE.COM/24IN24/) http://www.last.fm/user/polymeric radish's Profile: http://forums.slimdevices.com/member.php?userid=77 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Ok, here go my numbers (this is a Via C3/1GHz, 1GB RAM box): Version: 7.5.0 - rTRUNK @ UNKNOWN BS: Red Hat - DE - utf8 Plattform: i686-linux Perl-Version: 5.10.0 - i386-linux-thread-multi MySQL-Version: 4.1.22 Before (SBS MySQL): Durchsuche Musik-Verzeichnis (15435 von 15435) Beendet 00:32:34 Suche Wiedergabelisten (6 von 6) Beendet 00:00:01 MusicIP-Import (15481 von 15481) Beendet 00:18:07 Gruppiere Diverse Artisten (1156 von 1156) Beendet 00:02:25 Suche Plattenhüllen (1157 von 1157) Beendet 00:19:35 Der Server hat das Durchsuchen Ihrer Musiksammlung abgeschlossen. Laufzeit: 01:12:42 (Freitag, 28. Oktober 2009 / 09:09) After (using system's MySQL): Durchsuche Musik-Verzeichnis (15503 von 15503) Beendet 00:27:59 Suche Wiedergabelisten (6 von 6) Beendet 00:00:00 MusicIP-Import (15481 von 15481) Beendet 00:16:35 Gruppiere Diverse Artisten (1156 von 1156) Beendet 00:02:14 Suche Plattenhüllen (1157 von 1157) Beendet 00:18:43 Der Server hat das Durchsuchen Ihrer Musiksammlung abgeschlossen. Laufzeit: 01:05:31 (Freitag, 13. November 2009 / 00:29) Hmm... that's actually more of an improvement than I thought I had seen the first time I tested this... ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
My system is an Atom single-core 1.6MHz (Intel 945GC) with 2GB RAM, although only 1.6GB is available because 0.4GB is allocated to a virtual machine, which was suspended while running these tests. The OS is Ubuntu 8.10 Desktop, and running SBS is about all the machine does. The directory scan time is about 22% faster, although on my small library of 5132 tracks that's less than one minute. Other aspects of rescan are basically unchanged before and after the tweak. Total scan time is 11% faster, or almost exactly 1 minute out of 10:39. Version: 7.4.1 - r28947 @ Tue Oct 20 07:58:02 PDT 2009 Hostname: pinot Server IP Address: 192.168.0.21 Server HTTP Port Number: 9000 Operating system: Debian - EN - utf8 Platform Architecture: i686-linux Perl Version: 5.10.0 - i486-linux-gnu-thread-multi MySQL Version: 5.0.67-0ubuntu6 Total Players Recognized: 10 BEFORE TWEAK Music Scan Details Directory Scan (5132 of 5132) Complete 00:05:07 Playlist Scan (28 of 28) Complete 00:00:40 MusicIP Import (5131 of 5131) Complete 00:03:23 Merge Various Artists (397 of 397) Complete 00:00:25 Artwork Scan (403 of 403) Complete 00:01:04 The server has finished scanning your music collection. Total Time: 00:10:39 (Sunday, November 1, 2009 / 10:40) AFTER THE TWEAK Music Scan Details Directory Scan (5132 of 5132) Complete 00:04:11 Playlist Scan (28 of 28) Complete 00:00:40 MusicIP Import (5131 of 5131) Complete 00:03:22 Merge Various Artists (397 of 397) Complete 00:00:24 Artwork Scan (403 of 403) Complete 00:01:01 The server has finished scanning your music collection. Total Time: 00:09:38 (Sunday, November 1, 2009 / 10:55) -- aubuti aubuti's Profile: http://forums.slimdevices.com/member.php?userid=2074 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Summary: Overall scan time decreased by around 11% (from 46 mins to 41 mins) Note: Playlist scan time increased by a couple of seconds due to addition of new playlist between scans PC Spec: 7.4.1 on XP Pro 2.5ghz. AMD Athlon Dual Core 4850e 3gb Ram 1tb Internal SataII music disk Total Tracks: 25,258 Total Albums: 1,860 Total Artists: 858 Total Genres: 57 Total Playing Time: 2282:38:38 Pre-fix stats: Directory Scan (25258 of 25258) Complete 00:23:22 Playlist Scan (20 of 20) Complete 00:00:09 MusicIP Import (24596 of 24596) Complete 00:11:58 Merge Various Artists (1721 of 1721) Complete 00:00:48 Artwork Scan (1860 of 1860) Complete 00:09:45 The server has finished scanning your music collection. Total Time: 00:46:02 (Saturday 31 October 2009 / 12:07:57) Post fix stats: Directory Scan (25258 of 25258) Complete 00:21:06 Playlist Scan (21 of 21) Complete 00:00:11 MusicIP Import (24596 of 24596) Complete 00:09:08 Merge Various Artists (1721 of 1721) Complete 00:00:46 Artwork Scan (1860 of 1860) Complete 00:09:37 The server has finished scanning your music collection. Total Time: 00:40:48 (Saturday 31 October 2009 / 16:11:01) MC -- ModelCitizen Think the third party Squeeze plugins and applets are important? Then 'vote for bug 14194' (http://bugs.slimdevices.com/show_bug.cgi?id=14194) so more can be made. Last.fm/user/ModelCitizen ModelCitizen's Profile: http://forums.slimdevices.com/member.php?userid=446 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
More experimantation, different server Q9450, music on 5400rpm WD Green Power 1Tb and Samsung 1.5Tb EcoGreen HD154UI, 4GbRAM. XP Pro SP3 Version: 7.3.4 - 28402 @ Sun Sep 13 03:01:44 PDT 2009 Standard my.tt Directory Scan (97147 of 97147) Complete 01:12:22 MusicIP Import (97146 of 97146) Complete 00:46:40 Playlist Scan (21 of 21) Complete 00:00:14 Merge Various Artists (7730 of 7730) Complete 00:01:31 Artwork Scan (8431 of 8431) Complete 00:29:25 Database Optimize (0 of ) Complete 00:02:39 SqueezeCenter has finished scanning your music collection. Total Time: 02:32:51 (Saturday, October 31, 2009 / 9:04 PM) Installed Moonbase's my.tt and set innodb_buffer_pool_size = 500M. Music Scan Details Directory Scan (97147 of 97147) Complete 01:03:50 MusicIP Import (97146 of 97146) Complete 00:21:12 Playlist Scan (21 of 21) Complete 00:00:06 Merge Various Artists (7730 of 7730) Complete 00:01:27 Artwork Scan (8431 of 8431) Complete 00:28:43 Database Optimize (0 of ) Complete 00:00:31 SqueezeCenter has finished scanning your music collection. Total Time: 01:55:49 (Sunday, November 1, 2009 / 12:17 AM) During both scans I monitored memory usage of mysqld.exe with Windows Task Manager, standard my.tt used 18,242K, modified my.tt built up to a peak of about 580,000K after scanning about 60,000 tracks. I also monitored disk i/o using Windows Process Monitor; with the standard my.tt mysqld.exe dominated the disk i/o, with the modified my.tt scanner.exe was the major disk i/o until 60,000 tracks then mysqld.exe occasionally did some disk i/o but only 3 or 4 Mb in a burst. The web UI is now a pleasure to use. I had stopped using it since I bought iPeng as the ui was so slow and even caused re-buffering in the music, but it is now very fast for searches and to display album art. After the scan, mysqld.exe was still using 580M of RAM, so I re-booted the server to see if it would release some RAM, which it does. It has now been running for an hour, I have done some music searches, browse albums and artists an the mysqld.exe is using only 146,808K, less than the 170,304K that SQUEEZ~1.EXE is using. Conclusion - if you have plenty of RAM in your server, give the innodb_buffer_pool_size as much ram as you can, up to the size of C:\Documents and Settings\All Users\Application Data\SqueezeCenter\Cache\MySQL. mysqld.exe will use all it can on a clear and rescan but after a scan will only use what it needs. -- Wirrunna A camel is a racehorse designed by a committee. Wirrunna's Profile: http://forums.slimdevices.com/member.php?userid=3225 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Standard my.tt , system is XP SP3, Q9300, 4Gb RAM, music on 1Tb WD Green Power and 1.5Tb Samsung EcoGreen 154UI, both low performance 5400rpm disks. Version: 7.3.4 - 28402 @ Sun Sep 13 03:01:44 PDT 2009 Operating system: Windows XP - EN - cp1252 Platform Architecture: 586 Perl Version: 5.8.8 - MSWin32-x86-multi-thread MySQL Version: 5.0.22-community-nt Total Players Recognized: 0 Music Scan Details Directory Scan (97147 of 97147) Complete 01:29:11 MusicIP Import (97146 of 97146) Complete 01:01:52 Playlist Scan (21 of 21) Complete 00:00:19 Merge Various Artists (7417 of 7417) Complete 00:01:30 Artwork Scan (8107 of 8107) Complete 00:29:07 Database Optimize (0 of ) Complete 00:04:05 SqueezeCenter has finished scanning your music collection. Total Time: 03:06:04 (Friday, October 30, 2009 / 1:50 PM) Moonbase's modified my.tt Music Scan Details Directory Scan (97147 of 97147) Complete 01:14:23 MusicIP Import (97146 of 97146) Complete 00:30:50 Playlist Scan (21 of 21) Complete 00:00:13 Merge Various Artists (7417 of 7417) Complete 00:01:33 Artwork Scan (8108 of 8108) Complete 00:28:59 Database Optimize (0 of ) Complete 00:01:33 SqueezeCenter has finished scanning your music collection. Total Time: 02:17:31 (Saturday, October 31, 2009 / 9:21 AM) Significant speed up. I don't know why it found one more artwork, nothing was changed. A bit of Googling on optimizing Mysql led me to this http://optimmysql.blogspot.com/2008/04/variable-day-out-4-innodbbufferpoolsize.html which has some good links for those who want to experiment further. -- Wirrunna A camel is a racehorse designed by a committee. Wirrunna's Profile: http://forums.slimdevices.com/member.php?userid=3225 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
erland, other guys, did you do the tweak? post the results! everyone so far has gotten some kind of boost from it... -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I'll do it tonight if I get a chance. -- radish 'HELP ME RAISE MONEY FOR CHILDREN'S CANCER RESEARCH!' (HTTP://WWW.ADAMREEVE.COM/24IN24/) http://www.last.fm/user/polymeric radish's Profile: http://forums.slimdevices.com/member.php?userid=77 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I ran this on my 2Ghz (celeron) Win XP box, 512MB RAM, music collection on an external USB2 drive. (Yes, I know I'm a little light on RAM, but hopefully this helps you plumb the lower end.) Before optimization: Total Tracks: 23,880 Total Albums: 4,322 Total Artists: 2,164 Total Genres: 174 Total Playing Time: 1854:48:41 Music Scan Details Directory Scan (23889 of 23889) Complete 01:05:39 Playlist Scan ( of ) Complete 00:03:31 MusicIP Import (23929 of 23929) Complete 00:26:29 Merge Various Artists (4228 of 4228) Complete 00:04:59 Artwork Scan (4321 of 4321) Complete 00:30:56 The server has finished scanning your music collection. Total Time: 02:11:34 With optimized my.tt file: Directory Scan (23889 of 23889) Complete 00:49:51 Playlist Scan (0 of ) Complete 00:03:30 MusicIP Import (23929 of 23929) Complete 00:21:42 Merge Various Artists (4227 of 4227) Complete 00:05:02 Artwork Scan (4321 of 4321) Complete 00:32:39 The server has finished scanning your music collection. Total Time: 01:52:44 -- jonstahl jonstahl's Profile: http://forums.slimdevices.com/member.php?userid=8348 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
mherger;478121 Wrote: On Linux systems the pre-installed database server is being used. The changes discussed would need to be applied to the main mysql instance. Configuration will influence other apps using it too. Not always. I'm running a SVN checkout of 7.3.x, and it's using a my.cnf file in the SqueezeCenter Cache directory. SqueezeCenter spawns separate mysqld processes for SqueezeCenter using mysqld binaries compiled by Logitech and pulled from Subversion. SVN checkouts of SBS 7.4 and SBS 7.5 behave the same. Be sure what you're doing. Yes, indeed. I suspect Michael's right about those using the RPM and .deb packages, but SVN behaves differently, and I expect the fat tarball releases may, too. -- peterw http://www.tux.org/~peterw/ free plugins: http://www.tux.org/~peterw/#slim AllQuiet AutoDisplay'*' (http://www.tux.org/~peterw/slim/AutoDisplay.html#credit) BlankSaver ContextMenu FuzzyTime KidsPlay KitchenTimer PlayLog PowerCenter/BottleRocket SaverSwitcher SettingsManager SleepFade StatusFirst SyncOptions VolumeLock peterw's Profile: http://forums.slimdevices.com/member.php?userid=2107 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
peterw;478995 Wrote: Not always. I'm running a SVN checkout of 7.3.x, and it's using a my.cnf file in the SqueezeCenter Cache directory. SqueezeCenter spawns separate mysqld processes for SqueezeCenter using mysqld binaries compiled by Logitech and pulled from Subversion. SVN checkouts of SBS 7.4 and SBS 7.5 behave the same. On the debian/ubuntu installation it uses the system installed mysqld but it still launches a separate instance of it with the Squeezebox Server specific my.cnf, it's started by Squeezebox Server like this: /usr/sbin/mysqld --defaults-file=/var/lib/squeezeboxserver/cache/my.cnf -- erland Erland Isaksson 'My homepage' (http://erland.isaksson.info) (Install my plugins through Extension Downloader) (Developer of 'TrackStat, SQLPlayList, DynamicPlayList, Custom Browse, Custom Scan, Custom Skip, Multi Library, Title Switcher and Database Query plugins' (http://wiki.erland.isaksson.info/index.php/Category:SlimServer)) erland's Profile: http://forums.slimdevices.com/member.php?userid=3124 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
MrSinatra;477909 Wrote: webui response better? Yes, the WebUI looks more responsive. -- verypsb 2x Duet, 1x Boom, 1x Classic verypsb's Profile: http://forums.slimdevices.com/member.php?userid=17295 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
where can i find the my.tt file in a debian install? -- raven22 Setup: 1 SB3, 3 Booms. Server: SheevaPlug running Debian 6.0 Squeeze on SD-card with SqueezeBoxServer 7.4.1 raven22's Profile: http://forums.slimdevices.com/member.php?userid=16511 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
raven22;478079 Wrote: where can i find the my.tt file in a debian install? i don't know, isn't it roughly in the same spot? did u try reading the whole thread at the first link i posted? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
where can i find the my.tt file in a debian install? On Linux systems the pre-installed database server is being used. The changes discussed would need to be applied to the main mysql instance. Configuration will influence other apps using it too. Be sure what you're doing. Configuration files most likely are in /etc/my.cnf or similar. ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
raven22;478079 Wrote: where can i find the my.tt file in a debian install? edit: found it! it is in /usr/share/squeezeboxserver/MySQL just in case you missed his edit. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
mherger;478121 Wrote: where can i find the my.tt file in a debian install? On Linux systems the pre-installed database server is being used. The changes discussed would need to be applied to the main mysql instance. Configuration will influence other apps using it too. Be sure what you're doing. Configuration files most likely are in /etc/my.cnf or similar. Well, I changed the files according instructions on my Sheevaplug running Debian. It has 'only' 512mb memory and not the suggested at least 1GB. Speed increase is incredible on 16000 files with artwork files in each album folder. First it took around 1 hour 30 minutes, now only 1 hour and 2 minutes. -- raven22 Setup: 1 SB3, 3 Booms. Server: SheevaPlug running Debian 6.0 Squeeze on SD-card with SqueezeBoxServer 7.4.1 raven22's Profile: http://forums.slimdevices.com/member.php?userid=16511 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
thats what we're trying to figure out... the default my.tt is set to work with even the most low power hardware, (think NAS, etc) so moonbase setup a tweaked file to unchoke the DB, but his values for it are really just guesses. the danger is the tweaks could outpower someones hardware, but we don't yet have a handle on what thresholds are where. ultimately, the best solution is for hardware tests to be run during SBS install so the values are dynamically set (as well as library size and artwork calculations), but unless there is a pgm out there that already knows how to do that well (to optimize sql for differing hardware), we have to give AndyG datapoints to set different my.tt's based on what installer finds. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
I saw some mention of SQLite so I wanted to clear up some confusion. SQLite has no tunable parameters like this. It is faster during scanning (no IPC traffic to MySQL) but not as fast during complex browse queries where MySQL is more advanced. The current plan is to include full support for both MySQL and SQLite, with MySQL the default on non-embedded platforms. There will be a pref to switch database backends if you want. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
That's good news. I am still figuring out how to migrate my iTunes smart playlists to MySQL playlists, and was a bit worried that these might not be compatible with the next major release. -- usch usch's Profile: http://forums.slimdevices.com/member.php?userid=33389 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
[slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
if you feel that scans take too long, the UI's are too slow, read this thread: http://forums.slimdevices.com/showthread.php?t=60682 and vote for this bug: https://bugs.slimdevices.com/show_bug.cgi?id=14921 hopefully, eventually the optimization will be automated at install. in the meantime, there are the instructions, but BEWARE, this is AT YOUR OWN RISK!!! make copies FIRST of everything you change!!! don't do this unless you feel comfortable trying it, but if you do you should notice substantial improvements. a win-xp-dummies guide to installing moonbases tweaks, but easily translated to most windows/slimware. MAKE SURE YOU KNOW YOUR LAST SCANS STATS PRIOR TO ANY OF THIS! 1. download moonbase's my.tt.txt from post 18 http://forums.slimdevices.com/showpost.php?p=401530postcount=18 2. stop SBS and exit all SBS functions. (check task manager to be sure all squeeze stuff, slim stuff, mysql/mysqld, etc... is gone/closed) 3. find the SBServer cache folder, which is normally located at: C:\Documents and Settings\All Users\Application Data\Squeezebox\Cache and delete a file called my.cnf which might appear as a shortcut w/an icon of a monitor simply named: my 4. backup your current copy of my.tt which is normally located at: C:\Program Files\Squeezebox\server\MySQL to a safe place. then delete it from its original location. 5. copy moonbases downloaded file to the my.tt original location. 6. rename moonbase's file to remove the .txt at the end. 7. if desired, reboot the computer (safer). if not, simply restart SBS. 8. run a full clear and rescan and see how much better it is, *then report both results back here to this thread.* moonbase's file assumes you have at least a gig of ram and other reasonably new hardware. part of what we want to know is what hardware it works well with, and what hardware it doesn't. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Is this not too much work, when there soon will be a switch to SQLite from MySQL? -- verypsb 2x Duet, 1x Boom, 1x Classic verypsb's Profile: http://forums.slimdevices.com/member.php?userid=17295 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
verypsb;477801 Wrote: Is this not too much work, when there soon will be a switch to SQLite from MySQL? What is soon? :) The release of the Touch? -- signor_rossi signor_rossi's Profile: http://forums.slimdevices.com/member.php?userid=11941 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
i'm not 100% positive, but i believe there will be a variation of this applicable to the forthcoming SQLite ver of SBS. AndyG needs our data in order to implement the feature. -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
Total Tracks: 35,792 Total Albums: 3,445 Total Artists: 1,033 Total Genres: 151 Total Playing Time: 2767:39:29 Music Scan Details (Before) Directory Scan (35792 of 35792) Complete 00:35:37 Playlist Scan ( of ) Complete 00:00:00 MusicIP Import (35321 of 35321) Complete 00:24:03 Merge Various Artists (3309 of 3309) Complete 00:01:27 Artwork Scan (3445 of 3445) Complete 00:24:36 The server has finished scanning your music collection. Total Time: 01:25:43 (Monday, 26 October 2009 / 19:24) Music Scan Details (After) Directory Scan (35792 of 35792) Complete 00:33:56 Playlist Scan ( of ) Complete 00:00:00 MusicIP Import (35321 of 35321) Complete 00:13:57 Merge Various Artists (3309 of 3309) Complete 00:01:26 Artwork Scan (3445 of 3445) Complete 00:24:34 The server has finished scanning your music collection. Total Time: 01:13:53 (Monday, 26 October 2009 / 20:56) -- verypsb 2x Duet, 1x Boom, 1x Classic verypsb's Profile: http://forums.slimdevices.com/member.php?userid=17295 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
Re: [slim] Scans seem slow? web, SBC ui slow? how to make them faster! vote for this bug!
interesting... your directory scan part only improved a min or two, but your musicip part improved by around 10min. in my case, i don't use musicip, but my directory scan improved by about 9min. i think other people will get better results since my music is on an ext usb2 drive. hard drive cranking, any issues like that? webui response better? -- MrSinatra www.lion-radio.org using: sb2 sbc (my home) / sbr (parent's home) - sbs 7.4.2b - win xp pro sp3 ie8 - p4(ht) 3.2ghz / 2gig ram - 1tb wd usb2 raid1 - d-link dir-655 - 35k mp3 MrSinatra's Profile: http://forums.slimdevices.com/member.php?userid=2336 View this thread: http://forums.slimdevices.com/showthread.php?t=70371 ___ discuss mailing list discuss@lists.slimdevices.com http://lists.slimdevices.com/mailman/listinfo/discuss
