Re: [josm-dev] josm/jmapviewer / tilecache / single directory

[Florian Lohoff]

On Wed, Apr 03, 2013 at 12:00:13PM +0200, Dirk Stöcker wrote:
> 
> Hmm. Did you change any of the cache parameters in config? It should
> not get that large. Probably cache clean is broken, if so, please
> open a bug?
> 

I am living behind a 384KBit/s DSL and loading tiles is a pain in the
ass as it takes ages to fill a screen with tiles. 

So a large cache is VERY WELCOME. It got that large because i was
active in northern china which is a huge area.

I want that much data in my cache - But storing it into a single
directory is - uhm - broken - Filesystems are bad in storing huge
amount of files or directories into a single dir. This is why
all caches typically organize their files into trees - e.g. squid.

Normally josm had its cache dir set to something in /tmp which is even
more broken as /tmp is typically a tmpfs on most architectures. So using
josm fills up memory and swap and cache is deleted on reboot...

As sane default could be ~/.josm/tilecache but not a single directory.

Flo
-- 
Florian Lohoff f...@zz.de


signature.asc
Description: Digital signature
___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev

Re: [josm-dev] josm/jmapviewer / tilecache / single directory

[Vincent Privat]

Tickets #2887, #5309, #7256, #7682, #7762, #7770 and #8200 are related.
Le 3 avr. 2013 14:54, "Vincent Privat"  a écrit :

> There are already several bug tickets on this subject. Patches are always
> welcome :)
> Le 3 avr. 2013 12:02, "Dirk Stöcker"  a
> écrit :
>
>> On Wed, 3 Apr 2013, Florian Lohoff wrote:
>>
>>  i send an email a couple of months back about the jmapviewer tilecache
>>> used by josm using a flat directory for storing the tiles.
>>>
>>> Today now i stumbled that doing a find in the .josm directory takes
>>> upwards of 10 Minutes on my Quad i7 with a 7200 IDE Disk on
>>> Debian/Wheezy.
>>>
>>> Doing a cache cold "ls" in ~/.josm/tilecache/Bing Aerial Maps
>>> takes
>>>
>>> flo@p2:~/.josm/tilecache/Bing Aerial Maps$ time ls >/dev/null
>>> real9m3.151s
>>> user0m23.133s
>>> sys 0m26.474s
>>> flo@p2:~/.josm/tilecache/Bing Aerial Maps$ ls -1 | wc -l
>>> 1846091
>>>
>>> 9 Minutes 3 seconds for a ls - 1.8Mio files in a single directory.
>>>
>>> Flo
>>> PS: Dont get me wrong - large cache is good - but not like this.
>>>
>>
>> Hmm. Did you change any of the cache parameters in config? It should not
>> get that large. Probably cache clean is broken, if so, please open a bug?
>>
>> Ciao
>> --
>> http://www.dstoecker.eu/ (PGP key available)
>>
>>
>> __**_
>> josm-dev mailing list
>> josm-dev@openstreetmap.org
>> http://lists.openstreetmap.**org/listinfo/josm-dev
>>
>
___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev

Re: [josm-dev] josm/jmapviewer / tilecache / single directory

[Vincent Privat]

There are already several bug tickets on this subject. Patches are always
welcome :)
Le 3 avr. 2013 12:02, "Dirk Stöcker"  a écrit :

> On Wed, 3 Apr 2013, Florian Lohoff wrote:
>
>  i send an email a couple of months back about the jmapviewer tilecache
>> used by josm using a flat directory for storing the tiles.
>>
>> Today now i stumbled that doing a find in the .josm directory takes
>> upwards of 10 Minutes on my Quad i7 with a 7200 IDE Disk on
>> Debian/Wheezy.
>>
>> Doing a cache cold "ls" in ~/.josm/tilecache/Bing Aerial Maps
>> takes
>>
>> flo@p2:~/.josm/tilecache/Bing Aerial Maps$ time ls >/dev/null
>> real9m3.151s
>> user0m23.133s
>> sys 0m26.474s
>> flo@p2:~/.josm/tilecache/Bing Aerial Maps$ ls -1 | wc -l
>> 1846091
>>
>> 9 Minutes 3 seconds for a ls - 1.8Mio files in a single directory.
>>
>> Flo
>> PS: Dont get me wrong - large cache is good - but not like this.
>>
>
> Hmm. Did you change any of the cache parameters in config? It should not
> get that large. Probably cache clean is broken, if so, please open a bug?
>
> Ciao
> --
> http://www.dstoecker.eu/ (PGP key available)
>
>
> __**_
> josm-dev mailing list
> josm-dev@openstreetmap.org
> http://lists.openstreetmap.**org/listinfo/josm-dev
>
___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev

Re: [josm-dev] josm/jmapviewer / tilecache / single directory

[Dirk Stöcker]

On Wed, 3 Apr 2013, Florian Lohoff wrote:


i send an email a couple of months back about the jmapviewer tilecache
used by josm using a flat directory for storing the tiles.

Today now i stumbled that doing a find in the .josm directory takes
upwards of 10 Minutes on my Quad i7 with a 7200 IDE Disk on
Debian/Wheezy.

Doing a cache cold "ls" in ~/.josm/tilecache/Bing Aerial Maps
takes

flo@p2:~/.josm/tilecache/Bing Aerial Maps$ time ls >/dev/null
real9m3.151s
user0m23.133s
sys 0m26.474s
flo@p2:~/.josm/tilecache/Bing Aerial Maps$ ls -1 | wc -l
1846091

9 Minutes 3 seconds for a ls - 1.8Mio files in a single directory.

Flo
PS: Dont get me wrong - large cache is good - but not like this.


Hmm. Did you change any of the cache parameters in config? It should not 
get that large. Probably cache clean is broken, if so, please open a bug?


Ciao
--
http://www.dstoecker.eu/ (PGP key available)


___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev

Re: [josm-dev] josm/jmapviewer / tilecache / single directory

[Maarten Deen]

On 2013-04-03 11:21, Florian Lohoff wrote:

Hi,
i send an email a couple of months back about the jmapviewer tilecache
used by josm using a flat directory for storing the tiles.

Today now i stumbled that doing a find in the .josm directory takes
upwards of 10 Minutes on my Quad i7 with a 7200 IDE Disk on
Debian/Wheezy.

Doing a cache cold "ls" in ~/.josm/tilecache/Bing Aerial Maps
takes

flo@p2:~/.josm/tilecache/Bing Aerial Maps$ time ls >/dev/null
real9m3.151s
user0m23.133s
sys 0m26.474s
flo@p2:~/.josm/tilecache/Bing Aerial Maps$ ls -1 | wc -l
1846091

9 Minutes 3 seconds for a ls - 1.8Mio files in a single directory.


The same problem exists in Windows XP. After a while the directory gets 
so filled with files that viewing the directory takes a long time and 
deleting all files (and XP is horrible when deleting a lot of files in 
the explorer) is even impossible.

I always start a command prompt to delete files there.

In Windows XP JOSM has another problem: it creates large number of 
jar_cache*.tmp files in the temp directory. Some of them are tiles from 
the download screen (rename to .png and you see tiles), others are 
empty. They are not deleted after JOSM exists. I don't know if this also 
happens on Unix, I'll beter make a ticket for this I guess.


Regards,
Maarten



___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev

[josm-dev] josm/jmapviewer / tilecache / single directory

[Florian Lohoff]

Hi,
i send an email a couple of months back about the jmapviewer tilecache
used by josm using a flat directory for storing the tiles.

Today now i stumbled that doing a find in the .josm directory takes
upwards of 10 Minutes on my Quad i7 with a 7200 IDE Disk on
Debian/Wheezy.

Doing a cache cold "ls" in ~/.josm/tilecache/Bing Aerial Maps
takes 

flo@p2:~/.josm/tilecache/Bing Aerial Maps$ time ls >/dev/null
real9m3.151s
user0m23.133s
sys 0m26.474s
flo@p2:~/.josm/tilecache/Bing Aerial Maps$ ls -1 | wc -l
1846091

9 Minutes 3 seconds for a ls - 1.8Mio files in a single directory.

Flo
PS: Dont get me wrong - large cache is good - but not like this.
-- 
Florian Lohoff f...@zz.de


signature.asc
Description: Digital signature
___
josm-dev mailing list
josm-dev@openstreetmap.org
http://lists.openstreetmap.org/listinfo/josm-dev