i'm missing your point i think. if one thumbnail makes such a small
difference you already fit like 8000 in your cache? you're complaining
about the other 20%? you'll have to invent a better O(1) accessing scheme
than hash tables in this case.. :/

j.


On Wed, Sep 4, 2013 at 5:58 PM, Jose Carlos Garcia Sogo <[email protected]>wrote:

> The thing is that for the smaller thumbnails going from 79,99% to
> 80,01% is only a matter of a thumbnail, while we are missing thousands
> of thumbnails to be available, more if we have compression enabled.
>
> On Wed, Sep 4, 2013 at 12:13 PM, johannes hanika <[email protected]>
> wrote:
> > 80% is a common mark for hashtables to become inefficient. the hopscotch
> > hashing scheme we use claims to go as high as 90 or 95, i forget, but we
> > still use 80 as a soft limit (meaning if you're below 80, say 79, you
> always
> > get your new slot, even if it takes you to 95).
> >
> > j.
> >
> >
> > On Wed, Sep 4, 2013 at 12:01 PM, Jose Carlos Garcia Sogo <
> [email protected]>
> > wrote:
> >>
> >> Why do we have the 80% limit set?
> >>
> >> On Wed, Sep 4, 2013 at 11:45 AM, johannes hanika <[email protected]>
> >> wrote:
> >> > okay, cool. your cache memory size is just too small. 1.5G as in your
> >> > last
> >> > mail seems more reasonable, you might even try 2G.
> >> >
> >> > sure, it's a cache.. it throws out the stuff it thinks you don't need
> >> > any
> >> > more quite as urgently as other stuff, to stay within the given limit.
> >> >
> >> > -jo
> >> >
> >> >
> >> > On Wed, Sep 4, 2013 at 11:38 AM, Pascal Obry <[email protected]> wrote:
> >> >>
> >> >>
> >> >> Johannes,
> >> >>
> >> >> > just to be sure: is the cache just not very effective at what it
> does
> >> >> > or
> >> >> > are all the thumbnails always gone when you restart?
> >> >>
> >> >> > [mipmap_cache] level [i0] ( 200x 150) fill 171.19/213.97 MB (80.00%
> >> >> > in
> >> >> > 11797/16384 buffers)
> >> >> > [mipmap_cache] level [i1] ( 400x 300) fill 36.46/52.75 MB (69.12%
> in
> >> >> > 637/1024 buffers)
> >> >> > [mipmap_cache] level [i2] ( 800x 600) fill 16.94/52.74 MB (32.12%
> in
> >> >> > 74/256 buffers)
> >> >> > [mipmap_cache] level [i3] (1600x1200) fill 0.00/52.74 MB (0.00% in
> >> >> > 0/64
> >> >> > buffers)
> >> >> > [mipmap_cache] level [f4] fill 0/2 slots (0.00% in 0/4 buffers)
> >> >> > [mipmap_cache] level [f5] fill 2/2 slots (100.00% in 2/4 buffers)
> >> >> > [mipmap_cache] scratch fill 14.65/13.18 MB (111.11% in 2/4 buffers)
> >> >> > [mipmap_cache] level | near match | miss | stand-in | fetches |
> total
> >> >> > rq
> >> >> > [mipmap_cache] i0    |  91.67% |  91.67% |   -nan%  |  46.15% |
> >> >> > 100.00%
> >> >> > [mipmap_cache] i1    |   -nan% |   -nan% |   -nan%  |   0.00% |
> >> >> > 0.00%
> >> >> > [mipmap_cache] i2    |   -nan% |   -nan% |   -nan%  |   0.00% |
> >> >> > 0.00%
> >> >> > [mipmap_cache] i3    |   -nan% |   -nan% |   -nan%  |   0.00% |
> >> >> > 0.00%
> >> >> > [mipmap_cache] f4    |   -nan% |   -nan% |   -nan%  |   0.00% |
> >> >> > 0.00%
> >> >> > [mipmap_cache] f5    |   -nan% |   -nan% |   -nan%  |  53.85% |
> >> >> > 0.00%
> >> >>
> >> >> Using cache_memory to 536870912 it looks like the i0 cache is almost
> >> >> full (reaching 80% and not moving above). Do we have cache
> invalidation
> >> >> for old thumbnails in the case where a cache is full?
> >> >>
> >> >> I'm asking because testing with a cache_memory of 1536870912 seems to
> >> >> help... I still need to do more testing though.
> >> >>
> >> >> And this makes sense as I have observed this behavior since I have
> >> >> imported a large bunch of my images recently.
> >> >>
> >> >> Pascal.
> >> >>
> >> >> --
> >> >>   Pascal Obry /  Magny Les Hameaux (78)
> >> >>
> >> >>   The best way to travel is by means of imagination
> >> >>
> >> >>   http://v2p.fr.eu.org
> >> >>   http://www.obry.net
> >> >>
> >> >>   gpg --keyserver keys.gnupg.net --recv-key F949BD3B
> >> >>
> >> >>
> >> >>
> >> >>
> ------------------------------------------------------------------------------
> >> >> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012,
> more!
> >> >> Discover the easy way to master current and previous Microsoft
> >> >> technologies
> >> >> and advance your career. Get an incredible 1,500+ hours of
> step-by-step
> >> >> tutorial videos with LearnDevNow. Subscribe today and save!
> >> >>
> >> >>
> >> >>
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> >> >> _______________________________________________
> >> >> darktable-devel mailing list
> >> >> [email protected]
> >> >> https://lists.sourceforge.net/lists/listinfo/darktable-devel
> >> >
> >> >
> >> >
> >> >
> >> >
> ------------------------------------------------------------------------------
> >> > Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> >> > Discover the easy way to master current and previous Microsoft
> >> > technologies
> >> > and advance your career. Get an incredible 1,500+ hours of
> step-by-step
> >> > tutorial videos with LearnDevNow. Subscribe today and save!
> >> >
> >> >
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> >> > _______________________________________________
> >> > darktable-devel mailing list
> >> > [email protected]
> >> > https://lists.sourceforge.net/lists/listinfo/darktable-devel
> >> >
> >>
> >>
> >>
> >> --
> >> José Carlos García Sogo
> >>    [email protected]
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> >> Discover the easy way to master current and previous Microsoft
> >> technologies
> >> and advance your career. Get an incredible 1,500+ hours of step-by-step
> >> tutorial videos with LearnDevNow. Subscribe today and save!
> >>
> >>
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> >> _______________________________________________
> >> darktable-devel mailing list
> >> [email protected]
> >> https://lists.sourceforge.net/lists/listinfo/darktable-devel
> >
> >
>
>
>
> --
> José Carlos García Sogo
>    [email protected]
>
>
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
> _______________________________________________
> darktable-devel mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/darktable-devel
>
------------------------------------------------------------------------------
Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
Discover the easy way to master current and previous Microsoft technologies
and advance your career. Get an incredible 1,500+ hours of step-by-step
tutorial videos with LearnDevNow. Subscribe today and save!
http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk
_______________________________________________
darktable-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/darktable-devel

Reply via email to