Re: [Zope] Weird hangs on zope/plone.
I set the number of threads: zserver-threads 25 I set: pool-size 27 on zodb_db main I think you should rather use ZEO than raise number of threads to such a big value. Also there are some rules about pool-size. I don't remember exactly but seems to me that it is too small, but in general I suppose it has nothing to do with your problem... Situation you're seeing may appear if there is something that blocks all your threads, like all threads are waiting for RDBMS response... How can i run some kind of debug on zope (debug-mode on dont log anything more) to check this next time happen? Use DeadlockDebugger and if this doesn't help try: http://www.zopelabs.com/cookbook/1073504990 -- Maciej Wisniowski ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
Are you using any SQL connections or anything like that inside the Zope? Samuel Abreu de Paula wrote: Hi, i recently installed a plone site, but its acting weird! All start 2 weeks ago when i set this new site in production, on wednesday, and in thursday at beggining of the morning the instance just stop response. I restart the service, reboot the system and nothing bring back the instance, but suddenly back to normal. This happen on friday too, i find something about the livesearch_reply (some stuff from plone) that maybe its the cause of the problem, i fix it and the problem dont ocurr on weekend, but the same thing happened on monday, tuesday and wednesday again! I set the number of threads: zserver-threads 25 I set: pool-size 27 on zodb_db main and the problem was gone from last wednesday untill today, this morning the problem back, i search my entire logs for something that could help but i cant find nothing... The weirdest thing is yesterday i setup a second machine, with identical OS and zope/python version, and run the same site, for change machine purpose, but this morning both of machine was lock, i cant access zope in any of them. I look for any kind of cron job or something like that on operating system (RHEL 5) and didn't find nothing. Anyone have any idea where is the problem? Theres something like cron jobs inside zope/plone itself? How can i run some kind of debug on zope (debug-mode on dont log anything more) to check this next time happen? Thanks for the attention. Some info: OS: RHEL 5 Plone 2.5.1 # Zope version: (Zope 2.9.8-final, python 2.4.3, linux2) # Python version: 2.4.3 (#1, Dec 11 2006, 11:38:52) [GCC 4.1.1 20061130 (Red Hat 4.1.1-43)] # System Platform: linux2 # SOFTWARE_HOME: /opt/zope/zope-2.9.8/lib/python # INSTANCE_HOME: /opt/zope/portal # CLIENT_HOME: /opt/zope/portal/var # Process ID: 3570 (-1223578736) # Running for: 44 min 36 sec # sys.path: /opt/zope/portal/lib/python /opt/zope/portal/lib/python /opt/zope/zope-2.9.8/lib/python/Zope2/Startup /opt/zope/portal/Products/ATContentTypes/thirdparty /opt/zope/zope-2.9.8/lib/python /opt/zope/portal/bin /usr/lib/python24.zip /usr/lib/python2.4 /usr/lib/python2.4/plat-linux2 /usr/lib/python2.4/lib-tk /usr/lib/python2.4/lib-dynload /usr/lib/python2.4/site-packages /usr/lib/python2.4/site-packages/Numeric /usr/lib/python2.4/site-packages/PIL /usr/lib/python2.4/site-packages/gtk-2.0 /opt/zope/portal/Products/TextIndexNG2 ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev ) -- Peter Bengtsson, work www.fry-it.com home www.peterbe.com hobby www.issuetrackerproduct.com ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
Samuel Abreu de Paula wrote at 2007-10-9 10:32 -0300: All start 2 weeks ago when i set this new site in production, on wednesday, and in thursday at beggining of the morning the instance just stop response. I restart the service, reboot the system and nothing bring back the instance, but suddenly back to normal. This happen on friday too, i find something about the livesearch_reply (some stuff from plone) that maybe its the cause of the problem, i fix it and the problem dont ocurr on weekend, but the same thing happened on monday, tuesday and wednesday again! You can try to analyse problems like this with the DeadlockDebugger. If the DeadlockDebugger, too, does no longer respond, you need a C level debugger to attach to your Zope. This requires a Python build with debugging symbols (this is the default when you yourself have built Python) and some internal knowledge (come back should you need it). -- Dieter ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
On 10/9/07, Maciej Wisniowski [EMAIL PROTECTED] wrote: I set the number of threads: zserver-threads 25 I set: pool-size 27 on zodb_db main I think you should rather use ZEO than raise number of threads to such a big value. Also there are some rules about pool-size. I don't remember exactly but seems to me that it is too small, but in general I suppose it has nothing to do with your problem... Situation you're seeing may appear if there is something that blocks all your threads, like all threads are waiting for RDBMS response... How can i run some kind of debug on zope (debug-mode on dont log anything more) to check this next time happen? Use DeadlockDebugger and if this doesn't help try: http://www.zopelabs.com/cookbook/1073504990 DeadlockDebugger certainly helped me in a similar situation. I went through similar blind flailing machinations - modifying threads and pool sizes (in the end I found not a Zope or Plone coding problem but some of my Javascript code was inadvertently occasionally causing a tight looped remote access of a generated page --effectively a self inflicted DOS attack!) ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
2007/10/9, Maciej Wisniowski [EMAIL PROTECTED]: I set the number of threads: zserver-threads 25 I set: pool-size 27 on zodb_db main I think you should rather use ZEO than raise number of threads to such a big value. Also there are some rules about pool-size. I don't remember exactly but seems to me that it is too small, but in general I suppose it has nothing to do with your problem... Situation you're seeing may appear if there is something that blocks all your threads, like all threads are waiting for RDBMS response... How can i run some kind of debug on zope (debug-mode on dont log anything more) to check this next time happen? Use DeadlockDebugger and if this doesn't help try: http://www.zopelabs.com/cookbook/1073504990 -- Maciej Wisniowski When i google it i find a post somewhere saying about increase the number of threads and the number of the pool, but nothing about this limitation! :( I will test DeadlockDebugger, but the main problem is only happen in the morning (around 8:00am-10:00am. 2007/10/9, Peter Bengtsson [EMAIL PROTECTED]: Are you using any SQL connections or anything like that inside the Zope? Not SQL, but LDAP yes. 2007/10/9, Dieter Maurer [EMAIL PROTECTED]: You can try to analyse problems like this with the DeadlockDebugger. If the DeadlockDebugger, too, does no longer respond, you need a C level debugger to attach to your Zope. This requires a Python build with debugging symbols (this is the default when you yourself have built Python) and some internal knowledge (come back should you need it). -- Dieter Thanks, if deadlockdebugger dont solve i will try gdb! 2007/10/9, Brian Sullivan [EMAIL PROTECTED]: DeadlockDebugger certainly helped me in a similar situation. I went through similar blind flailing machinations - modifying threads and pool sizes (in the end I found not a Zope or Plone coding problem but some of my Javascript code was inadvertently occasionally causing a tight looped remote access of a generated page --effectively a self inflicted DOS attack!) Ok, it wasnt me who code the custom product of the site, i will try what was mentioned here and tomorrow i reply on the list. ty all! ^^ ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
When i google it i find a post somewhere saying about increase the number of threads and the number of the pool, but nothing about this limitation! :( What kind of limitation? Instead of raising number of threads on one zope instance you should just use few Zope instances with smaller number of threads. AFAIK it's more effective. I will test DeadlockDebugger, but the main problem is only happen in the morning (around 8:00am-10:00am. So install deadlockdebugger and look at it's output between 8:00-10:00. It may be safely used on production instances. Also check if some external resources like LDAP are not restarted/backed up or sth. like that at this time, or before (eg. there is a backup at night that causes 'something' wrong for connections from your zope and your users start working since 8:00 - thats when you see 'hangup'). -- Maciej Wisniowski ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
Re: [Zope] Weird hangs on zope/plone.
2007/10/9, Maciej Wisniowski [EMAIL PROTECTED]: What kind of limitation? Instead of raising number of threads on one zope instance you should just use few Zope instances with smaller number of threads. AFAIK it's more effective. I was talking about the limitation u say here: Also there are some rules about pool-size. I don't remember exactly but seems to me that it is too small, but in general I suppose it has nothing to do with your problem... I will search more about use of ZEO. Thanks. So install deadlockdebugger and look at it's output between 8:00-10:00. It may be safely used on production instances. Also check if some external resources like LDAP are not restarted/backed up or sth. like that at this time, or before (eg. there is a backup at night that causes 'something' wrong for connections from your zope and your users start working since 8:00 - thats when you see 'hangup'). I think is something on LDAP, Deadlockdebugger is running already and tomorrow i will have the answer. Thank u all... ___ Zope maillist - Zope@zope.org http://mail.zope.org/mailman/listinfo/zope ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope-dev )
