I think this may have something to do with hibernate itself. I declared <jcs-cache usage-"read-only" on 7 of my domain objects (hence 7 threads). I tried removing jcs-cache from a few of my hibernate mappings I got it down to 4 threads (there was not a directly correlation between the number of threads running and the number of jcs-cached objects in my system). Is this just the way JCS works? Do there really need to be that many ElementEventQueues... I guess if you want very high throughput, you'd need lots of threads to handle all the cache puts and gets... Is hibernate possibly initializing JCS incorrectly? (here's the code it uses to access JCS http://cvs.sourceforge.net/viewcvs.py/*checkout*/hibernate/Hibernate2/src/net/sf/hibernate/cache/JCSCache.java?rev=1.5.2.3
One other strange thing is this log output for each domain object I have the jcs-cache flag set in:
WARN 14:39:40,674 (OptionConverter.instantiateByKey():189): ---> Could not find value for key jcs.region.gov.llnl.ais.domain.person.Person.cacheattributes
WARN 14:39:40,674 (CompositeCacheConfigurator.parseCompositeCacheAttributes():339): ---> Could not instantiate ccAttr named 'jcs.region.gov.llnl.ais.domain.person.Person.cacheattributes', using defaults.
Thanks for your help. I'll keep tweaking things and see what I can come up with. I can probably live with 7 threads if they just sit there. I'm just worried about them multiplying for some reason and hosing my app in production...
-nick
At 12:50 PM 10/30/2003 -0600, you wrote:
I'm surprised that it works with all those periods in the name of your region. I'm not sure this will parse correctly. Remove the periods. Replace them with _ and test.
You have the memory shrinker on but have not defined a maxlife seconds. I think the default in this case is to treat the element as if it is eternal. Basically, this starts a thread that iterates through the map and doesn't do anything else. Just set the shrinker to false.
I'd like to see what happens if the shrinker is off.
Aaron
> -----Original Message----- > From: Nicholas J. Dellamaggiore [mailto:[EMAIL PROTECTED] > Sent: Wednesday, October 29, 2003 11:22 PM > To: Turbine JCS Users List > Subject: RE: RE: ElementEventQueue question > > It is pasted lower down in the thread. Here it is again. I truncated out > some redundant sections for brevity. Thanks for your help. > > -nick > > # DEFAULT CACHE REGION (memory cache) > jcs.default=DC > jcs.default.cacheattributes=org.apache.jcs.engine.CompositeCacheAttribut es > jcs.default.cacheattributes.MaxObjects=10000 > jcs.default.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memory .l > ru.LRUMemoryCache > jcs.default.elementattributes=org.apache.jcs.engine.ElementAttributes > jcs.default.elementattributes.IsEternal=false > jcs.default.elementattributes.IsSpool=false > jcs.default.elementattributes.IsRemote=false > jcs.default.elementattributes.IsLateral=false > > # merged report categories cache > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory=DC > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattri bu > tes.MaxObjects=1000 > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattri bu > tes.MemoryCacheName=org.apache.jcs.engine.memory.lru.LRUMemoryCache > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattri bu > tes.UseMemoryShrinker=true > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattri bu > tes.ShrinkerIntervalSeconds=60 > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementatt ri > butes=org.apache.jcs.engine.ElementAttributes > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementatt ri > butes.IsEternal=false > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementatt ri > butes.IsSpool=false > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementatt ri > butes.IsRemote=false > jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementatt ri > butes.IsLateral=false > > # report categories cache > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory=DC > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.cacheattributes. Ma > xObjects=1000 > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.cacheattributes. Me > moryCacheName=org.apache.jcs.engine.memory.lru.LRUMemoryCache > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.cacheattributes. Us > eMemoryShrinker=true > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.cacheattributes. Sh > rinkerIntervalSeconds=60 > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribute s= > org.apache.jcs.engine.ElementAttributes > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribute s. > IsEternal=false > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribute s. > IsSpool=false > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribute s. > IsRemote=false > jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribute s. > IsLateral=false > > ############# etc > > At 12:04 AM 10/30/2003 -0600, you wrote: > >Paste your config file in an email. > > > > > -----Original Message----- > > > From: Nicholas J. Dellamaggiore [mailto:[EMAIL PROTECTED] > > > Sent: Wednesday, October 29, 2003 10:01 PM > > > To: [EMAIL PROTECTED] > > > Subject: Fwd: RE: ElementEventQueue question > > > > > > The thread problem is actually pretty bad. We left out app running > > > overnight and found like 30 threads ElementEventQueue threads > > > running! This is obviously a misconfiguration issue on our part. So, > >how > > > exactly do you set up cache.ccf so no auxillary cache is used? I'd > >rather > > > not introduce any more complexity our app (like a disk overflow > >cache)... > > > Thanks! > > > > > > -nick > > > > > > >Date: Sun, 26 Oct 2003 23:13:09 -0700 > > > >To: "Turbine JCS Users List" <[EMAIL PROTECTED]> > > > >From: "Nicholas J. Dellamaggiore" <[EMAIL PROTECTED]> > > > >Subject: RE: ElementEventQueue question > > > > > > > >Things are working as far as I can tell (things seem faster). I > >don't > > > >think I have an auxillary cache. Its all in memory (read-only > >caching). > > > I > > > >noticed some warnings at startup. The Hibernate forums said to ignore > > > >them. After looking over the output, I noticed that there are 7 > >errors > > > >(one for each thread, perhaps?) while trying to create an auxFactory. > >Do > > > >I need to add an auxillary cache? Or can I go on without one? The > >cache > > > >isn't mission critical. I just want to cache some read-only in a > > > clustered > > > >environment. Thanks for your quick reply > > > > > > > >-nick > > > > > > > >Here's my cache.ccf and the startup log output: > > > > > > > >cache.ccf (modified from http://hibernate.org/61.html) > > > > > > > ># DEFAULT CACHE REGION (memory cache) > > > >jcs.default=DC > > > > > >jcs.default.cacheattributes=org.apache.jcs.engine.CompositeCacheAttribu > >te > > > s > > > >jcs.default.cacheattributes.MaxObjects=10000 > > > > > >jcs.default.cacheattributes.MemoryCacheName=org.apache.jcs.engine.memor > >y. > > > lru.LRUMemoryCache > > > >jcs.default.elementattributes=org.apache.jcs.engine.ElementAttributes > > > >jcs.default.elementattributes.IsEternal=false > > > >jcs.default.elementattributes.IsSpool=false > > > >jcs.default.elementattributes.IsRemote=false > > > >jcs.default.elementattributes.IsLateral=false > > > > > > > ># merged report categories cache > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory=DC > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattr > >ib > > > utes.MaxObjects=1000 > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattr > >ib > > > utes.MemoryCacheName=org.apache.jcs.engine.memory.lru.LRUMemoryCache > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattr > >ib > > > utes.UseMemoryShrinker=true > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.cacheattr > >ib > > > utes.ShrinkerIntervalSeconds=60 > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat > >tr > > > ibutes=org.apache.jcs.engine.ElementAttributes > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat > >tr > > > ibutes.IsEternal=false > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat > >tr > > > ibutes.IsSpool=false > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat > >tr > > > ibutes.IsRemote=false > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat > >tr > > > ibutes.IsLateral=false > > > > > > > >###### REPEAT FOR OTHER OBJECTS > > > > > > > >Log output: > > > > > > > >... > > > > INFO 23:08:11,151 (SettingsFactory.buildSettings():99): ---> Query > > > > language substitutions: {} > > > > INFO 23:08:11,167 (SettingsFactory.buildSettings():110): ---> cache > > > > provider: net.sf.hibernate.cache.JCSCacheProvider > > > > INFO 23:08:11,167 (Configuration.configureCaches():930): ---> > > > > instantiating and configuring caches > > > > WARN 23:08:11,229 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > jcs.region.gov.llnl.ais.im.common.auth.IMGroup.elementattributes > > > > WARN 23:08:11,229 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > 'jcs.region.gov.llnl.ais.im.common.auth.IMGroup.elementattributes', > > > using > > > > defaults. > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,261 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > > > > > >jcs.region.gov.llnl.ais.im.common.auth.IMGroup.permissions.elementattri b > >ut > > > es > > > > WARN 23:08:11,261 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > > > > > >'jcs.region.gov.llnl.ais.im.common.auth.IMGroup.permissions.elementattr i > >bu > > > tes', > > > > using defaults. > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,261 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > > > > > >jcs.region.gov.llnl.ais.im.common.domain.org.LLNLOrgNode.elementattribu t > >es > > > > WARN 23:08:11,261 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > > > > > >'jcs.region.gov.llnl.ais.im.common.domain.org.LLNLOrgNode.elementattrib u > >te > > > s', > > > > using defaults. > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,261 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > > > > > >jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribut e > >s > > > > WARN 23:08:11,261 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > > > > > >'jcs.region.gov.llnl.ais.im.common.domain.ReportCategory.elementattribu t > >es > > > ', > > > > using defaults. > > > > WARN 23:08:11,261 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,276 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,276 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > > > > > >jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementat t > >ri > > > butes > > > > WARN 23:08:11,276 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > > > > > >'jcs.region.gov.llnl.ais.im.common.domain.MergedReportCategory.elementa t > >tr > > > ibutes', > > > > using defaults. > > > > WARN 23:08:11,276 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,276 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,276 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > jcs.region.gov.llnl.ais.domain.person.Person.elementattributes > > > > WARN 23:08:11,276 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > 'jcs.region.gov.llnl.ais.domain.person.Person.elementattributes', > >using > > > > defaults. > > > > WARN 23:08:11,292 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,292 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > WARN 23:08:11,292 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key > > > > > >jcs.region.gov.llnl.ais.im.common.auth.IMPermission.elementattributes > > > > WARN 23:08:11,292 > > > > (CompositeCacheConfigurator.parseElementAttributes():375): ---> > >Could > > > not > > > > instantiate eAttr named > > > > > >'jcs.region.gov.llnl.ais.im.common.auth.IMPermission.elementattributes' , > > > > using defaults. > > > > WARN 23:08:11,292 (OptionConverter.instantiateByKey():189): ---> > >Could > > > > not find value for key jcs.auxiliary.DC > > > >ERROR 23:08:11,292 (CompositeCacheConfigurator.parseAuxiliary():413): > >--- > > > > > > > >Could not instantiate auxFactory named "DC". > > > > INFO 23:08:11,604 (SessionFactoryImpl.<init>():112): ---> building > > > > session factory > > > >... > > > > > > > > > > > > > > > >At 12:47 AM 10/27/2003 -0600, you wrote: > > > >>That doesn't sound right. Those threads are trying to perform some > > > >>event to an auxiliary cache. Is everything working? Does the disk > > > >>cache have write access to the file? Do you have laterals that > >might be > > > >>blocked by a firewall? > > > >> > > > >>Aaron > > > >> > > > >> > -----Original Message----- > > > >> > From: Nicholas J. Dellamaggiore [mailto:[EMAIL PROTECTED] > > > >> > Sent: Sunday, October 26, 2003 11:41 PM > > > >> > To: [EMAIL PROTECTED] > > > >> > Subject: ElementEventQueue question > > > >> > > > > >> > Hi. I'm using JCS with hibernate and it's working great. I'm was > > > >>debugging > > > >> > in Eclipse and I happened to notice that there are 7 > > > ElementEventQueue > > > >> > threads started up. I know there are just sitting there blocking, > >but > > > >>I > > > >> > get > > > >> > worried about having lots of extra threads running around. Is > >there a > > > >> > setting to tweak the number of EventQueues? Thanks. > > > >> > > > > >> > -nick > > > >> > > > > >> > > > > >> > > >--------------------------------------------------------------------- > > > >> > To unsubscribe, e-mail: > > > >>[EMAIL PROTECTED] > > > >> > For additional commands, e-mail: > > > >>[EMAIL PROTECTED] > > > >> > > > >> > > > > > >>--------------------------------------------------------------------- > > > >>To unsubscribe, e-mail: > >[EMAIL PROTECTED] > > > >>For additional commands, e-mail: turbine-jcs-user- > > > [EMAIL PROTECTED] > > > > > > > >/** > > > > * Nicholas J. Dellamaggiore > > > > * Software Developer (AIS/IBIS) > > > > * Phone: x26585 > > > > * Office: B671 R2321 > > > > * ICQ: 162919183 AIM: wontonsoup79 > > > > */ > > > > > > /** > > > * Nicholas J. Dellamaggiore > > > * Software Developer (AIS/IBIS) > > > * Phone: x26585 > > > * Office: B671 R2321 > > > * ICQ: 162919183 AIM: wontonsoup79 > > > */ > > > > > > > > > --------------------------------------------------------------------- > > > To unsubscribe, e-mail: > >[EMAIL PROTECTED] > > > For additional commands, e-mail: > >[EMAIL PROTECTED] > > > > > >--------------------------------------------------------------------- > >To unsubscribe, e-mail: [EMAIL PROTECTED] > >For additional commands, e-mail: [EMAIL PROTECTED] > > /** > * Nicholas J. Dellamaggiore > * Software Developer (AIS/IBIS) > * Phone: x26585 > * Office: B671 R2321 > * ICQ: 162919183 AIM: wontonsoup79 > */ > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED]
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
/** * Nicholas J. Dellamaggiore * Software Developer (AIS/IBIS) * Phone: x26585 * Office: B671 R2321 * ICQ: 162919183 AIM: wontonsoup79 */
--------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
