Re: [Zope-dev] Zope Caches
On Fri, 22 Nov 2002, Shane Hathaway wrote: > Brian R Brinegar wrote: > > Okay, > > > > Tell me where I'm wrong or if I'm lucky and got it right. > > > > There is 1 client cache per thread on a ZEO client and 1 ZEO cache per ZEO > > client. The ZEO cache is shared between the threads. > > > > We have 3 machines 4 threads each that's 3 * 4 + 3 = 15 caches? Is this > > correct? If so what's cached in each of the caches? When accessing the > > cache parameters from the Control_Panel which caches am I managing? > > The control panel manages the ZODB cache, of which you have 4 per box. > Your custom_zodb.py manages the size of the ZEO cache. > > Are you using Zope 2.5 or 2.6? You'll really want 2.6 for this, since > it constrains the ZODB cache size much better. We're running 2.5 and I don't think it's going to be possible for us to upgrade to 2.6 until March because we have a heavily used production system. Currently we don't specify cache_size in our custom_zodb.py. I guess the default is 20 meg. Our Database (packed) is about 6 Gig. -Brian ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Okay, Tell me where I'm wrong or if I'm lucky and got it right. There is 1 client cache per thread on a ZEO client and 1 ZEO cache per ZEO client. The ZEO cache is shared between the threads. We have 3 machines 4 threads each that's 3 * 4 + 3 = 15 caches? Is this correct? If so what's cached in each of the caches? When accessing the cache parameters from the Control_Panel which caches am I managing? Thanks again, -Brian ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Brian R Brinegar wrote: Okay, Tell me where I'm wrong or if I'm lucky and got it right. There is 1 client cache per thread on a ZEO client and 1 ZEO cache per ZEO client. The ZEO cache is shared between the threads. We have 3 machines 4 threads each that's 3 * 4 + 3 = 15 caches? Is this correct? If so what's cached in each of the caches? When accessing the cache parameters from the Control_Panel which caches am I managing? The control panel manages the ZODB cache, of which you have 4 per box. Your custom_zodb.py manages the size of the ZEO cache. Are you using Zope 2.5 or 2.6? You'll really want 2.6 for this, since it constrains the ZODB cache size much better. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Dieter Maurer wrote: Brian R Brinegar writes: > We have diskless ZEO clients (Netboot). There is really no reason for our > ZEO clients to write their caches to the disk (RAM Disk). Can we turn this > off? To free up RAM for the other caches? With Zope 2.5 and Zeo 1.x, no cache is written unless you define "ZEO_CLIENT". Well, that's not quite correct. If you don't define ZEO_CLIENT, it writes a cache using tempfiles. That usually doesn't matter, but in this case it does matter since there are only RAM disks. One option might be to put the caches on a shared disk. This assumes that shared disk access is faster than accessing the ZEO server. However, since ZEO caches are generally relatively small for today's RAM sizes (20 MB), and there's only one such cache per box, just letting ZEO use the RAM disk seems optimal. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Brian R Brinegar writes: > We have diskless ZEO clients (Netboot). There is really no reason for our > ZEO clients to write their caches to the disk (RAM Disk). Can we turn this > off? To free up RAM for the other caches? With Zope 2.5 and Zeo 1.x, no cache is written unless you define "ZEO_CLIENT". Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
> > Thank you for your response. How does one determine if they have a > > "reasonably-sized" ZEO cache? In our case we have about 260,000 objects in > > the database with an ideal cache size of 10,000 objects. I have no idea > > what our hit/miss ratio is or how to find that out. Any assistance would > > be great! > > Try this: > > http://cvs.zope.org/ZODB3/ZEO/README.txt?rev=1.4&content-type=text/vnd.viewcvs-markup Simpler would be to check your log file for "cache flip" messages. If you get these more than a few times per day, you should consider doubling the cache size. --Guido van Rossum (home page: http://www.python.org/~guido/) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
> Thank you for your response. How does one determine if they have a > "reasonably-sized" ZEO cache? In our case we have about 260,000 objects in > the database with an ideal cache size of 10,000 objects. I have no idea > what our hit/miss ratio is or how to find that out. Any assistance would > be great! Try this: http://cvs.zope.org/ZODB3/ZEO/README.txt?rev=1.4&content-type=text/vnd.viewcvs-markup --Guido van Rossum (home page: http://www.python.org/~guido/) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Thank you for your response. How does one determine if they have a "reasonably-sized" ZEO cache? In our case we have about 260,000 objects in the database with an ideal cache size of 10,000 objects. I have no idea what our hit/miss ratio is or how to find that out. Any assistance would be great! Thanks again, -Brian Brinegar ECN Purdue University On Thu, 21 Nov 2002, Guido van Rossum wrote: > > We have diskless ZEO clients (Netboot). There is really no reason for our > > ZEO clients to write their caches to the disk (RAM Disk). Can we turn this > > off? To free up RAM for the other caches? > > That's a new use scenario for me. You can't turn the ZEO cache off. > > But I think you misunderstand the purpose of the ZEO cache. If you > don't have a reasonably-sized ZEO cache, you lose big because you have > to go to the server for *every* request. The ZEO cache caches a > different kind of data than the other caches, and it caches this data > *only* to disk, so it's not the case that it's wasting RAM disk space > by writing cached data to disk that's also in memory. > > --Guido van Rossum (home page: http://www.python.org/~guido/) > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
> We have diskless ZEO clients (Netboot). There is really no reason for our > ZEO clients to write their caches to the disk (RAM Disk). Can we turn this > off? To free up RAM for the other caches? That's a new use scenario for me. You can't turn the ZEO cache off. But I think you misunderstand the purpose of the ZEO cache. If you don't have a reasonably-sized ZEO cache, you lose big because you have to go to the server for *every* request. The ZEO cache caches a different kind of data than the other caches, and it caches this data *only* to disk, so it's not the case that it's wasting RAM disk space by writing cached data to disk that's also in memory. --Guido van Rossum (home page: http://www.python.org/~guido/) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
We have diskless ZEO clients (Netboot). There is really no reason for our ZEO clients to write their caches to the disk (RAM Disk). Can we turn this off? To free up RAM for the other caches? Thanks, -Brian On Thu, 21 Nov 2002, Shane Hathaway wrote: > Brian R Brinegar wrote: > > Not RAM Cache managers, but Database caches. > > In that case we still haven't narrowed it down. :-) You have 12 > in-memory ZODB caches (they can't be shared) and 3 on-disk ZEO caches. > Depending on your site, the ZODB cache can consume a lot of RAM, so Zope > 2.6 has a database activity graph to help you tune the ZODB cache size. > > Shane > > > On Thu, 21 Nov 2002, Shane Hathaway wrote: > > > > > >>Brian R Brinegar wrote: > >> > >>>Okay, > >>> > >>>I'm trying to better understand Caching within Zope. Is a cache created > >>>for each Zope Thread? Or one per Zope instance? > >>> > >>>We have 3 ZEO Clients with 4 Threads each. I want to know if we have 3 > >>>copies of the cache, or 12 copies of the cache. > >> > >>If you're talking about RAMCacheManager, you have 3 caches. It > >>carefully shares among threads. > >> > >>Shane > >> > > > > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Brian R Brinegar wrote: Not RAM Cache managers, but Database caches. In that case we still haven't narrowed it down. :-) You have 12 in-memory ZODB caches (they can't be shared) and 3 on-disk ZEO caches. Depending on your site, the ZODB cache can consume a lot of RAM, so Zope 2.6 has a database activity graph to help you tune the ZODB cache size. Shane On Thu, 21 Nov 2002, Shane Hathaway wrote: Brian R Brinegar wrote: Okay, I'm trying to better understand Caching within Zope. Is a cache created for each Zope Thread? Or one per Zope instance? We have 3 ZEO Clients with 4 Threads each. I want to know if we have 3 copies of the cache, or 12 copies of the cache. If you're talking about RAMCacheManager, you have 3 caches. It carefully shares among threads. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Not RAM Cache managers, but Database caches. -Brian On Thu, 21 Nov 2002, Shane Hathaway wrote: > Brian R Brinegar wrote: > > Okay, > > > > I'm trying to better understand Caching within Zope. Is a cache created > > for each Zope Thread? Or one per Zope instance? > > > > We have 3 ZEO Clients with 4 Threads each. I want to know if we have 3 > > copies of the cache, or 12 copies of the cache. > > If you're talking about RAMCacheManager, you have 3 caches. It > carefully shares among threads. > > Shane > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Caches
Brian R Brinegar wrote: Okay, I'm trying to better understand Caching within Zope. Is a cache created for each Zope Thread? Or one per Zope instance? We have 3 ZEO Clients with 4 Threads each. I want to know if we have 3 copies of the cache, or 12 copies of the cache. If you're talking about RAMCacheManager, you have 3 caches. It carefully shares among threads. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope Caches
Okay, I'm trying to better understand Caching within Zope. Is a cache created for each Zope Thread? Or one per Zope instance? We have 3 ZEO Clients with 4 Threads each. I want to know if we have 3 copies of the cache, or 12 copies of the cache. Thanks, -Brian ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
