Re: [Zope-dev] SWAP issue
I installed the LeakFinder product and two most called references are: 1) DocumentTemplate.DT_Util.Eval 2) OFS.Image.File Do these classes have any prior history? Should I patch them or what other course can I take? Your help is much appreciated. Thanks Ahsan Imam Dieter Maurer [EMAIL PROTECTED] 09/05/02 13:14 PM Ahsan Imam writes: After starting zope eveything works fine for a while. Slowly the swap starts to swell up and after a few hours the machine has to be rebooted. The funny thing is that free shows that there is almost a gig of RAM free and swap keeps on growing. After a while the machine simply hangs. When it is Zope, then restarting Zope should free your swap again. This way, you can test whether Zope is the culprit and avoid rebooting your computer. When it is Zope, there probably is a resource leak. There is the LeakFinder product to localize such leaks. Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] SWAP issue
I introduced the LeakFinder product. However Friday, Saturday and Sunday are least busiest days on our site. Our main zope server is not swapping at all today. So I cannot replicate what happened yesterday or the day before. When I looked at the debug information section, it showed me the request that I had just made. I guess I will have to wait until a busy day. In an earlier mail I had named two references to classes (DocumentTemplate.DT_Util.Eval,OFS.Image.Image ). Should I be concerned with these? These are always topping the list. (Our site is very image intensive). Thanks Dieter Maurer [EMAIL PROTECTED] 09/06/02 11:57 AM Ahsan Imam writes: Is there a way catch that non terminating loop? This non-terminating loop is just a theory I have. I could be completely wrong. Are there other things I could look at for clues. When you have indeed a non-terminating loop (and you Zope is still responsive), you can find at least the request that triggered it: Go to Control_Panel -- Debug information and look at the bottom of this page. You will see the currently active requests. Dieter ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] SWAP issue
Hello All, I am currently running zope 2.5 and python 2.1.3. The machine has 2 gigs of rams and is running on Red Hat 7.2. After starting zope eveything works fine for a while. Slowly the swap starts to swell up and after a few hours the machine has to be rebooted. The funny thing is that free shows that there is almost a gig of RAM free and swap keeps on growing. After a while the machine simply hangs. I have recompiled python and zope. Turned on profiling. I have looked through the stupid.log. There are no core dumps either. I have also tried running zope with one thread. Does anyone have suggestions. Thanks ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] SWAP issue
The kernel is 2.4.7-10. Zope 2.5 on Red Hat 7.2 python 2.1.3 Here is what I think the problem is: Some object or code was introduced on Tuesday morning. The users are beginners so they could have introduced a never ending loop or something of that sort. I turned on profiling to see if thre was anything in particular consuming a lot of time. A the top of the list was Connection.py. Is there a way catch that non terminating loop? This non-terminating loop is just a theory I have. I could be completely wrong. Are there other things I could look at for clues. Toby Dickenson [EMAIL PROTECTED] 09/05/02 06:46 AM On Thursday 05 Sep 2002 2:58 am, Ahsan Imam wrote: Hello All, I am currently running zope 2.5 and python 2.1.3. Are you actually seeing the zope processes use too much memory? 2.5.x have a ZODB cache mechanism that does not respond well to memory pressure. If your application touches many objects per transaction then memory usage may grow out of control. 2.6 improves this significantly. The machine has 2 gigs of rams and is running on Red Hat 7.2. Which kernel? After starting zope eveything works fine for a while. Slowly the swap starts to swell up Memory that is not being actively used might as well be moved into swap, freeing the ram for more productive uses. This does not necessarily indicate a problem. and after a few hours the machine has to be rebooted. The funny thing is that free shows that there is almost a gig of RAM free and swap keeps on growing. Are you sure you are interpreting the output from 'free' correctly? It is often misinterpreted. (please post the output from 'free -m' if you are not sure.) After a while the machine simply hangs. I have recompiled python and zope. Turned on profiling. I have looked through the stupid.log. There are no core dumps either. I have also tried running zope with one thread. Does anyone have suggestions. you havent explained why you think this is a zope problem. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] FTP issue or Alternative
Hello All, I am trying to FTP images into various zope directories. Some of the images show in zope as 0k. When I check these out in the file system they are greater than 0k and I can view them. So I put like a 5 second sleep in my script before every image is ftp'ed. This method did reduce the number of 0k files however it did not eliminate the problem. I do not want to use the use 5 second method as the scripts takes a very long time to complete. Is there something I am not aware of? What other method can I use? Can I simply take a OS directory structure and import it into zope? I am not sure how. Can you point me some sample code or literature. Your help or guidance is much appreciated. Thanks Ahsan Imam ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope stops responding (Threads still present)
Hello All, Zope stops responding to requests, however when I check the zope process I see seven threads plus watchdog thread. ( ps auxww | grep z2 ). I am not sure why it stops responding. Actions taken to diagnose the problem: 1) I added the -M option and started logging to the debug file. 2) I am using the requestprofiler.py script to see which request in particular causes the problem (hangs). Everytime the request seems to be different. I make the same request and it runs without hanging zope. So I cannot duplicate the problem. I backup the Zodb every night and I have modified the stop script. I first kill the watchdog pid then I do a wget on http://$ZOPE_AUTH@$ZOPE_HOSTNAME:$ZSERVER_PORT/Control_Panel/manage_shutdown. Could this method of stopping zope be the cause? Also there are no core dumps. System Info RedHat 7.2 Zope 2.5.0 Python 2.1.3 Thanks Ahsan Imam ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope/Python crashing
Hello, I was going through the zope archive mail and saw message posted by Matthew T. Kromer regarding crashing problems with Python 2.1.2. It instructed to increase the #define PyTrash_UNWIND_LEVEL from 50 500. I just downloaded python 2.1.3. Do I still have to edit the object.h file before I compile it. Thanks ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Error 11
Did this restarting problem start with Zope 2.4.x? Was is there in 2.3.x because were are thinking of downgrading to 2.3.x? Thanks for your help Chris McDonough [EMAIL PROTECTED] 01/28/02 21:26 PM Hmm. This doesn't look any better. ;-) I'm not sure how to tell you to get more relevant information from gdb. Ahsan Imam wrote: Our site is so heavily dependent on the mysql connection that it would lose majority of the functionality. I added the -Z'' option and here is the command ps axww | grep z2 looks like: /usr/bin/python /usr/local/zope/z2.py -z /usr/local/zope -a zslave2.newtimes.com -Z '' -t 7 -w 8080 -p - -f - -m - -F 8889 -l /usr/local/zslave2/var/zope.log gdb #0 0x4008c8a5 in __sigsuspend (set=0x415cefbc) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45 45 ../sysdeps/unix/sysv/linux/sigsuspend.c: No such file or directory. in ../sysdeps/unix/sysv/linux/sigsuspend.c Chris McDonough [EMAIL PROTECTED] 01/28/02 16:45 PM You have a core file from the zdaemon process.. it's sorta useless as a result. If you want to get a meaningful core file, run Zope without ZDaemon (pass -Z '' to the start script). That said, we've confirmed crashbug problems in an installation with mysqlda in at least one customer site. Can you make this problem happen without mysqlda? Ahsan Imam wrote: Applied the db.py patch and no success. Currently dowloaded and installed the Zope 2.4.4 beta 1 Python Version python 2.1.2 ZMySQLDA Here is a little excerpt from gdb Would the following output have any special meaning? gdb python core #0 0x4008c8a5 in __sigsuspend (set=0x415cf19c) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45 45 ../sysdeps/unix/sysv/linux/sigsuspend.c: No such file or directory. in ../sysdeps/unix/sysv/linux/sigsuspend.c ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Error 11
Applied the db.py patch and no success. Currently dowloaded and installed the Zope 2.4.4 beta 1 Python Version python 2.1.2 ZMySQLDA Here is a little excerpt from gdb Would the following output have any special meaning? gdb python core #0 0x4008c8a5 in __sigsuspend (set=0x415cf19c) at ../sysdeps/unix/sysv/linux/sigsuspend.c:45 45 ../sysdeps/unix/sysv/linux/sigsuspend.c: No such file or directory. in ../sysdeps/unix/sysv/linux/sigsuspend.c Matthew T. Kromer [EMAIL PROTECTED] 01/25/02 15:13 PM Ahsan Imam wrote: Setting the variable did not help. I downloaded and built Python 2.1.2 yesterday. Products: zope-tinytable-0.8.2-2 zope-zmysqlda-2.0.7-5 Chris McDonough [EMAIL PROTECTED] 01/24/02 12:22 PM Sigh. Can you try to start Zope with the environment variable ZOPE_SECURITY_POLICY=PYTHON set to see if the problem continues? Are you using any database adapters or other C extensions? Are you sure that Zope is using the Python 2.1.2 that you installed? Try applying this patch to db.py in ZMySQLDA. It makes it so MySQLDA database connections reopen themselves when the DA object migrates between threads. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Error 11
Should I install a new version of mysqlda? Chris McDonough [EMAIL PROTECTED] 01/24/02 13:50 PM I'd suspect mysqlda. - Original Message - From: Ahsan Imam [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, January 24, 2002 3:40 PM Subject: Re: [Zope-dev] Error 11 Setting the variable did not help. I downloaded and built Python 2.1.2 yesterday. Products: zope-tinytable-0.8.2-2 zope-zmysqlda-2.0.7-5 Chris McDonough [EMAIL PROTECTED] 01/24/02 12:22 PM Sigh. Can you try to start Zope with the environment variable ZOPE_SECURITY_POLICY=PYTHON set to see if the problem continues? Are you using any database adapters or other C extensions? Are you sure that Zope is using the Python 2.1.2 that you installed? - Original Message - From: Ahsan Imam [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Thursday, January 24, 2002 12:57 PM Subject: [Zope-dev] Error 11 Hey Chris, 1) Installed Python 2.1.2 (with threads and without pymalloc) 2) Got the latest cvs built of zope 2.4. 3) Then compiled zope wo pcgi. 4) Even tried with the Zope 2.5 beta. Zope still keeps restarting every 10 to 15 minutes. Excerpt from the stupid.log: 2002-01-24T16:53:01 ERROR(200) zdaemon zdaemon: Thu Jan 24 09:53:01 2002: Aiieee! 21993 exited with error code: 11 -- 2002-01-24T16:53:02 INFO(0) zdaemon zdaemon: Thu Jan 24 09:53:02 2002: Houston, we have forked -- 2002-01-24T16:53:02 INFO(0) zdaemon zdaemon: Thu Jan 24 09:53:02 2002: Houston, we have forked -- 2002-01-24T16:53:02 INFO(0) zdaemon zdaemon: Thu Jan 24 09:53:02 2002: Hi, I just forked off a kid: 22007 -- 2002-01-24T16:53:04 PROBLEM(100) OFS.Application Duplicate Product name After loading Product 'Customizations' from '/usr/local/zslave2/Products', I skipped the one in '/usr/local/zope/lib/python/Products'. -- 2002-01-24T16:53:13 INFO(0) ZODB Opening database for mounting: '148382768_1011864262.427182' -- 2002-01-24T16:53:13 INFO(0) ZODB Mounted database '148382768_1011864262.427182' at /temp_folder -- 2002-01-24T16:53:13 INFO(0) Zope Default Object Creation /usr/local/zope/lib/python/../../import/Examples.zexp examples import file could not be found. -- 2002-01-24T16:53:13 INFO(0) ZServer HTTP server started at Thu Jan 24 09:53:13 2002 Hostname: node1.newtimes.com Port: 8080 -- 2002-01-24T16:53:13 INFO(0) ZServer FastCGI Server (V1.0) started at Thu Jan 24 09:53:13 2002 IP : zslave2.newtimes.com Port: 8889 Socket path : None ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
