[slim] Re: V6.5 huge FileCache

2006-10-30 Thread Grahame
Looks good - Managed a continuous listening session of 4 albums, from a playlist of 18 on a system with 1796 albums with 22373 songs by 2320 artists without interruption, which wasn't achievable recently. No 5 minute pauses every hour, as previously. Thanks. -- Grahame

[slim] Re: V6.5 huge FileCache

2006-10-29 Thread Triode
Please try tomorrow's nightlies to see if this improves the situation for you. Changes are: 1) scanning code no longer stores stuff in the file cache 2) file cache split up and artwork is only purged at startup 3) only purge when all players are off [so you should not notice it] -- Triode

[slim] Re: V6.5 huge FileCache

2006-10-27 Thread Grahame
andyg;147724 Wrote: Any version of 6.5.1 after 10/6. On my system(s), Windows XP enough space on C:\ but with a large collection (300GB \ 500GB +) of tagged flacs with album art Typically 300x300 - ish, on 6.5.1 nightlies after this fix, I've noticed the following. At hourly intervals

[slim] Re: V6.5 huge FileCache

2006-10-27 Thread Triode
How do people feel about a solution which requires a server restart to completely purge the cache? It would purge common files while the server is running, but only do a full purge at startup. -- Triode Triode's Profile:

[slim] Re: V6.5 huge FileCache

2006-10-27 Thread Grahame
Triode;150322 Wrote: How do people feel about a solution which requires a server restart to completely purge the cache? It would purge common files while the server is running, but only do a full purge at startup. Works for me. Would it work for people running on resource constrained

[slim] Re: V6.5 huge FileCache

2006-10-19 Thread rbdavis
I've sadly had to revert to SlimServer 6.3 with this problem still happening. Can you advise me if you have managed to fix it, or offer alternative options (e.g. store cache on different drive / switch off cache / dont cache artwork)? Or do I have to stay on 6.3 for ever ;( -- rbdavis

Re: [slim] Re: V6.5 huge FileCache

2006-10-19 Thread Michael Herger
I've sadly had to revert to SlimServer 6.3 with this problem still happening. What version have you been using? IMHO this is fixed. My Slimserver has been running for two weeks now and the FileCache weighs 16MB. -- Michael -

[slim] Re: V6.5 huge FileCache

2006-10-19 Thread andyg
Yes this problem is fixed. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-19 Thread Jeff52
Which version of slimserver contains the fix (I assume it is one of the nightly versions)? -- Jeff52 Jeff52's Profile: http://forums.slimdevices.com/member.php?userid=103 View this thread:

[slim] Re: V6.5 huge FileCache

2006-10-19 Thread andyg
Any version of 6.5.1 after 10/6. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-12 Thread rbdavis
andyg;145550 Wrote: It's probably album art. Run the cachedump script to see. Hi andyg, I did already run cachedump and reported the results here. Here they are again: -- rbdavis rbdavis's Profile:

[slim] Re: V6.5 huge FileCache

2006-10-12 Thread andyg
So when you ran it again did it reduce the size by a huge amount? The same thing should now happen while running SlimServer. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this

[slim] Re: V6.5 huge FileCache

2006-10-12 Thread andyg
So can you post a cachedump output showing 400MB of usage? -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-12 Thread rbdavis
Hi andy That log was with 400+ MB of usage. Though as i said, the script took about 10 mins to run and at the end the usage had decresed. Cheers, Rob -- rbdavis rbdavis's Profile:

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread rbdavis
This thread is about the /Cache/FileCache folder only - thats the cache we are all referring to. With SlimServer 6.3 I had a fully working SlimServer / SoftSqueeze set up and was looking to invest in a 5-room SqueezeBox configuration (though i have also raised a query about whether there will be

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread rbdavis
I totally deleted my install directory and installed SlimServer_6.5_v2006-10-11.exe just now. It ran OK (though oddly its attempt to run after install failed - i had to manually start it). 10 mins later the cache is 92MB and growing rapidly... -- rbdavis

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread rbdavis
Back up to 400+MB now... -- rbdavis rbdavis's Profile: http://forums.slimdevices.com/member.php?userid=7751 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread rbdavis
And back to SlimServer 6.3 and i have an immediately working system again... Seems mysql might be spoiling things for the rest of the class... -- rbdavis rbdavis's Profile:

Re: [slim] Re: V6.5 huge FileCache

2006-10-11 Thread Michael Herger
Seems mysql might be spoiling things for the rest of the class... MySQL has nothing to do with the FileCache. -- Michael - http://www.herger.net/SlimCD - your SlimServer on a CD http://www.herger.net/slim - AlbumReview,

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread andyg
If you really do have 100s of GB's in your FileCache directory, the first time you run a build of 6.5 with the cache cleanup code, it will take a long time for it to clean out the cache. Just let it run. For more detailed info you can run slim.exe --d_server from the command line. -- andyg

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread ModelCitizen
andyg;145320 Wrote: If you really do have 100s of GB's in your FileCache directory, the first time you run a build of 6.5 with the cache cleanup code, it will take a long time for it to clean out the cache. Just let it run. For more detailed info you can run slim.exe --d_server from the

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread andyg
And have you run a 6.5.1 nightly build to have it clean out the cache? -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread rbdavis
I was running the nightly build that i mentioned. I started with a cache of 0 (i had deleted the entire directory) and it increased over about 30 mins to 500MB, leaving no space on the C drive. Are you saying it would gradually decrease again? Why can't i put this huge cache on my music drive,

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread andyg
It's probably album art. Run the cachedump script to see. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-11 Thread Ron F .
My first post on this forum... I noticed my regular computer running SlimServer began having a problem immediately after I installed 6.5 a few days ago. SlimServer runs for a while, and then dies. This did not occur with releases in the past. I came to this thread during my search of an answer

[slim] Re: V6.5 huge FileCache

2006-10-10 Thread rbdavis
Oh dear. I installed SlimServer_6.5_v2006-10-06.exe and left it running over the weekend. I was away so SlimServer was not being used. However according to the task tray SlimServer was not actually started. When I came back, the cache was 430MB. I did notice mysqld.exe running in my process

Re: [slim] Re: V6.5 huge FileCache

2006-10-10 Thread Michael Herger
When I came back, the cache was 430MB. What cache? We're only talking about the Cache/FileCache folder here. There are other subfolders for the html template or for the MySQL database files or for some plugins. I'm also running 10-06, using it daily. The file cache is 18M, while the DB

[slim] Re: V6.5 huge FileCache

2006-10-06 Thread rbdavis
The OS has a 6GB partition, there is a separate 1GB partition for the pagefile and then there plenty of GB of extra storage. Actually this config was not my choice, but was set up by Dell at the time i got the machine. I know this set up is not ideal, but it seemed clear something else was going

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread rbdavis
andyg;141719 Wrote: So assuming we're only concerned with what's in the FileCache directory, I've attached a quick script that lists all the keys in the cache along with their size. I've installed ActivePerl and the 4 Oct release of SlimServer. I left SlimServer running overnight and the

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread rbdavis
Over the subsequent hour the cache size rose again to around 207 MB. -- rbdavis rbdavis's Profile: http://forums.slimdevices.com/member.php?userid=7751 View this thread:

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread Mark Lanctot
I wrote this early on, but you chose to ignore it: Mark Lanctot;141436 Wrote: So there's obviously something wrong with your installation, but still, if you have less than 0.5 GB of space left on your HDD (512 MB) it's amazing your computer is running at all. You indicate you have a

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread shabbs
rbdavis;143234 Wrote: Over the subsequent hour the cache size rose again to around 207 MB. I can't answer for what's in your FileCache - but it sounds like you should focus on freeing up some space on your primary drive. Running with 500MB free is not recommended. Cheers. -- shabbs

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread andyg
OK I think what is happening here is that expired items are not being removed on a regular basis, because removal only happens the next time get() is called, and if you're just playing music from your local drive or not using SlimServer at all, it won't get called and cleaned up. I'll take a

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread shabbs
andyg;143258 Wrote: or not using SlimServer at all, it won't get called and cleaned up. That's consistent with my observations. After using SS during the day regularly, the FileCache size is relatively small. I've only noticed it being large after SS has been idle for quite some time. Cheers.

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread andyg
OK I've added a periodic cleanup of the FileCache (at startup and once an hour). This should keep the size at a normal level. The first time you run SlimServer it may take a bit of time to clean out the old cache items, but should be fast after that. -- andyg

[slim] Re: V6.5 huge FileCache

2006-10-05 Thread andyg
Tonight's build, either 6.5.1 or 7.0. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread rbdavis
Hi - i've been away but have just caught up on this thread. I have album artwork for 90% of the tracks in my iTunes library, so I wonder if that could be the cause? Actually I did used to have an odd bug with the last version of SlimServer - it would display album artwork for some tracks but

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread andyg
It should not be that big. Please run my cachedump script if you'd like to know what's using up the space. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread:

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread shabbs
Out of curiosity, I checked my FileCache and it was pretty large. I ran the cachedump script and it produced an output that contained nearly 500 lines that referenced fitstretch-100-100-0 on each line. Is this for the resizing of the Album Art? Here are my details: Library: 722 albums with 9653

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread andyg
Yes that's resized cover art. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread Scallywagfr78
I may add a few stats: I've just upgraded to 6.5 and my stats are as follows: Database: some 130 Go in some 13.000 files and the Cache is about 1.75 Go size with 4237 folders and 12.889 files. I have no ready comparison with 6.3.0, but I may add that some 124 files are not read/scanned comme il

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread ModelCitizen
andyg;141719 Wrote: To run this script: Install ActivePerl if on Windows. Place cachedump.pl in your SlimServer's 'server' directory. Run at a command prompt: perl -Ilib -ICPAN cachedump.pl C:/Program Files/SlimServer/server/Cache After it's done, open up the cachedump.txt file. Replace

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread andyg
Change to the server directory first: cd \Program Files\SlimServer\server -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread:

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread shabbs
I had to run the command like this on my system (from the Server directory): perl -Ilib -ICPAN cachedump.pl C:/Program Files/SlimServer/server/Cache I needed to wrap the path in quotes due to the space in the Program Files folder name. Cheers. -- shabbs [shabbs] *MP3s:* 67.2 GB / 9,653

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread ModelCitizen
I had tried that but thought it's inclusion made my post too long... :-( here's the output (using your path as posted with the forward slashes): C:\Program Files\SlimServer\serverperl -Ilib -ICPAN cachedump.pl C:/Program Files/SlimServer/server/Cache Directory C:/Program does not seem to

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread shabbs
ModelCitizen;142544 Wrote: here's the output (using your path as posted with the forward slashes): C:\Program Files\SlimServer\serverperl -Ilib -ICPAN cachedump.pl C:/Program Files/SlimServer/server/Cache Directory C:/Program does not seem to contain a FileCache directory. See my post

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread Ramage
A .bat script run from the server directory solved the space in Program Files for me, and I used this command: perl -Ilib -ICPAN cachedump.pl Cache in a .bat Just change the .txt extension on the attached to .bat and put in server directory with cachedump.pl. Using a batch file allows you to

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread ModelCitizen
Well, the script worked, but the output flummoxes me. The output contains 153 lines of fitstretches and 9 lines of squash. I have 1,060 folder.jpg files, each resting in the individual album folders. Virtually all (barring mistakes) are 300 pixels by 300 pixels. Anyway, that aside, quick

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread shabbs
It seems the file cache size is always changing. I just checked mine now and it's considerably smaller than before. I have been listening to music all day and browsing the interface every now and then using Fishbone skin. My FileCache folder is 3.39MB; 678 files; 4,342 folders. -- shabbs

[slim] Re: V6.5 huge FileCache

2006-10-03 Thread rbdavis
I spoke to soon - i haven't used SlimServer today (it was brough down again) and the cached has gone up from an initial 25MB to 450MB again. I'll look into running the script you mention, but i don't have the other think you mentioned installed so might not be possible... -- rbdavis

Re: [slim] Re: V6.5 huge FileCache

2006-10-01 Thread Michael Herger
This is very strange. These are the things we use the file cache for: Cover art HTTP responses Parsed XML The iTunes library is XML, isn't it? -- Michael - http://www.herger.net/SlimCD - your SlimServer on a CD

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread ModelCitizen
ModelCitizen;141559 Wrote: My cache directory is 246mb and contains a staggering 13,981 files in 4,286 folders. It seems that (at least) 4096 folders are sub folders of SlimServer\server\Cache\FileCache. This folder has 16 subfolders (called 0,1,2,3,4,5,6,7,8,9,a,b,c,d,e,f). Each of these

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread Ramage
All those folders (1-F) in the cache, are they produced by Lazy Search for indexing? -- Ramage P2 266MHz,Linux CC 3.2, SlimServer Version: 6.3.1 - 8278, Alien 1.04 P4 2.6GHz, Win XP, Slimserver Version: 6.5.0, Alien 1.06

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread ModelCitizen
Ramage;141609 Wrote: All those folders (1-F) in the cache, are they produced by Lazy Search for indexing? To answer my own question - maybe not as I don't have the Lazy Search on my v6.5.0. So what are they?? I don't have Lazy Search installed either. Each file seems to be contain

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread hickinbottoms
Ramage;141609 Wrote: All those folders (1-F) in the cache, are they produced by Lazy Search for indexing? To answer my own question - maybe not as I don't have the Lazy Search on my v6.5.0. So what are they?? You're right - they're not. All the Lazy Search indexing goes into the database.

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread Ramage
Apologies Hickinbottoms - checked your webpage after the post - duuur. ;-[] -- Ramage P2 266MHz,Linux CC 3.2, SlimServer Version: 6.3.1 - 8278, Alien 1.04 P4 2.6GHz, Win XP, Slimserver Version: 6.5.0, Alien 1.06 Ramage's

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread hickinbottoms
Ramage;141642 Wrote: Apologies Hickinbottoms - checked your webpage after the post - duuur. ;-[] No worries. The thing's so flippin' complicated these days I wouldn't be surprised if it was the culprit! I checked my FileCache and I don't remember having ever cleared it out. It's ~50Mb, ~7000

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread Ramage
Stuart I agree looks like tag info. I also noticed in mine that duplicate info from a previous scan of a different music directory has remained. Could this account for some of the inconsistencies experienced after repeat scans of the music directories?? What will happen if the cache is

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread radish
Just to drop in on the question of the 4096 directories arranged in a tree, that sounds like a hashmap to me. If you drill down until you find an actual file, you'll see the first 3 characters of it's name correspond to the directory path to find it. I'm guessing the filenames are hashes either

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread ModelCitizen
Ramage;141659 Wrote: Stuart I agree looks like tag info. I also noticed in mine that duplicate info from a previous scan of a different music directory has remained. Could this account for some of the inconsistencies experienced after repeat scans of the music directories?? What will

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread ModelCitizen
radish;141681 Wrote: Just to drop in on the question of the 4096 directories arranged in a tree, that sounds like a hashmap to me. If you drill down until you find an actual file, you'll see the first 3 characters of it's name correspond to the directory path to find it. I'm guessing the

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread andyg
So assuming we're only concerned with what's in the FileCache directory, I've attached a quick script that lists all the keys in the cache along with their size. The parent Cache directory also contains other things like compiled HTML templates and the MySQL data files. If you're interested in

Re: [slim] Re: V6.5 huge FileCache

2006-10-01 Thread Michael Herger
If you're interested in how FileCache works, here is the documentation: Ok, as this might be interesting for some of my plugins... This cache doesn't care about who (which module/plugin) put stuff in there? -- Michael -

[slim] Re: V6.5 huge FileCache

2006-10-01 Thread andyg
Nope, as long as you don't collide with any other key. -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

Re: [slim] Re: V6.5 huge FileCache

2006-10-01 Thread Michael Herger
Nope, as long as you don't collide with any other key. ...and Slim::Utils::Cache is a wrapper around it. Considering I create my own $cache=Slim::Utils::Cache-new and later do a $cache-cleanup, this will run the cleanup for _all_ items in the cache, not only those created by my plugin,

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread jth
My cache size is about 24 MB with a 120 MB library, mostly mp3 and flac - with standard tags (running on Linux). What kind of files and tags are in your library? -- jth jth's Profile:

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread ceejay
Do you really mean 0.5GB? While that sounds like a lot, if that has meant that your disc has filled up and crashed then you were already running pretty full? And I don't know whether thats a lot but my system right now this folder is showing 6824 files with 4.7MB of data occupying 27MB on the

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread rbdavis
I deleted all the files in the FileCache directory and closed SlimServer, and when I came back my hard drive had been filled again, disabling my computer. SlimServer's slim.exe service was still running. I closed the service, took Slim out of my Startup folder and rebooted my computer. Once

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread andyg
How long does it take to fill up? -- andyg andyg's Profile: http://forums.slimdevices.com/member.php?userid=3292 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread Mark Lanctot
rbdavis;141430 Wrote: Has SlimServer become a Trojan Horse virus, trying to destroy all our computers? It appears only yours... I just installed 6.5. I have a 65 GB music library. FileCache is 2.73 MB. So there's obviously something wrong with your installation, but still, if you have

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread radish
I have no idea what FileCache is actually holding, but on my system it's 21mb in ~5000 files. My library is ~12000 tracks taking well over 200GB. Thus, the size of the cache doesn't seem directly linked to the size of the library. Maybe a dev could chime in with some details of what it's actually

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread bpa
Looking at the contents of the files - it is a cache of any sort of web access - typically HTML pages but also opml. -- bpa bpa's Profile: http://forums.slimdevices.com/member.php?userid=1806 View this thread:

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread radish
So maybe cache size is linked to activity rather than library size. -- radish radish's Profile: http://forums.slimdevices.com/member.php?userid=77 View this thread: http://forums.slimdevices.com/showthread.php?t=28105

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread rbdavis
I haven't actually used new version of SlimServer to do anything yet - i have only opened the homepage. So there shouldn't be too much web access to cache. However I also just updated to the latest version of iTunes (just before i updated SlimServer). Don't know if that has any bearing...? Its

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread andyg
This is very strange. These are the things we use the file cache for: Cover art HTTP responses Parsed XML I think it would be useful to see what is actually in your cache when it is that large. Would you be able to install ActivePerl and run a small script?

[slim] Re: V6.5 huge FileCache

2006-09-30 Thread ModelCitizen
My cache directory is 246mb and contains a staggering 13,981 files in 4286 folders. My library is about 350gb (mostly flac). As I have been told to delete my cashe directory to get SlimServer to completely rebuild it's database I assumed that it was the index of my music. If this is the case