[Zope-dev] plone.org - chrism_installer_branch

2002-09-17 Thread alan runyan

Hi.

just wanted to drop you guys a line and say that
chrism_installer_branch will save the world.
But I have some questions:

Chris said its based on HEAD.  Whats the 
difference between HEAD and Zope-2_6-branch?
I probably shouldnt be running HEAD in production?
I am having severe leakage here are some refoucnts:

DateTime - 62263
IOBucket - 32641
PloneFolder - 22766
User - 22196
PersistentMapping - 12846
CMFDefault.Document.Document - 12820

I have have the python security machinery turned on.

should I move to Zope2.6 branch instead of trying to
fight? what would I look at next?

~runyaga
 



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] plone.org - chrism_installer_branch

2002-09-17 Thread Matthew T. Kromer

alan runyan wrote:

Hi.

just wanted to drop you guys a line and say that
chrism_installer_branch will save the world.
But I have some questions:

Chris said its based on HEAD.  Whats the 
difference between HEAD and Zope-2_6-branch?
I probably shouldnt be running HEAD in production?
I am having severe leakage here are some refoucnts:

DateTime - 62263
IOBucket - 32641
PloneFolder - 22766
User - 22196
PersistentMapping - 12846
CMFDefault.Document.Document - 12820

I have have the python security machinery turned on.

should I move to Zope2.6 branch instead of trying to
fight? what would I look at next?

~runyaga
 
  


Zope-2_6-branch broke off from the head about 10 days ago; so that the 
head is now somewhat 'undefined.'  While fixes will be applied to both 
2.6 and the head, 2.6 is the point where stability will be focused on.

What it looks like to me btw is that your Documents are holding on to 
the root of the ZODB perhaps -- do you do anything that would cause that 
to be stored?  


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] limit to number of operations in a transaction?

2002-09-17 Thread Karl Anderson

Christopher N.Deckard [EMAIL PROTECTED] writes:

 I have roughly 1,500 people in the database.  I wrote a script to
 migrate the people.  Basically it does getProperty for each property
 on each person folder, then creates the new person object which uses
 XML.  Zope apparently cannot handle this number of operations in one
 transaction.  Zope gets slower and slower and eventually becomes on
 responsive.  It looks like the script has completed, but nothing is
 ever committed to the ZODB, and since Zope is unresponsive it must
 be restarted.  This, as expected, kills that entire transaction
 which was never committed.
 
 Is it known that large numbers of operations, such as above, in a
 single transaction can cause problems?  A transaction, of course,
 being a request, and an operation being something like
 manage_addProduct.  

In practice I've only seen problems when I'm dealing with lots of data
and need to be thinking about this anyway :)

 I've solved the problem by using xmlrpc and for person in people
 calling my migrate_person script for only one person at a time. 
 This is SO MUCH FASTER.  I previously ran the script that migrates
 all of the people, and after 8 hours it still had not completed.

As Jens replied, this is because the transactions are getting
committed for each person, and you can do this without xmlrpc by
committing in your script.

The possible drawback of committing after each person is that you're
committing a new version of the object being modified.  Depending on
how you're storing the stuff this can grow your ZODB - if every person
is a node in a single ParsedXML document, you'd be storing 1500
versions, each one person bigger than the last.

You can use transactions and subtransactions to juggle database size,
memory usage, and temp file usage.

-- 
Karl Anderson  [EMAIL PROTECTED]   http://www.monkey.org/~kra/

___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] plone.org - chrism_installer_branch

2002-09-17 Thread Chris McDonough

Alan,

You mentioned that you thought the chrism-install-branch was slow... do 
you see the slowness and the leakage when using the tip of the 2.6 branch?

- C


alan runyan wrote:
 Hi.
 
 just wanted to drop you guys a line and say that
 chrism_installer_branch will save the world.
 But I have some questions:
 
 Chris said its based on HEAD.  Whats the 
 difference between HEAD and Zope-2_6-branch?
 I probably shouldnt be running HEAD in production?
 I am having severe leakage here are some refoucnts:
 
 DateTime - 62263
 IOBucket - 32641
 PloneFolder - 22766
 User - 22196
 PersistentMapping - 12846
 CMFDefault.Document.Document - 12820
 
 I have have the python security machinery turned on.
 
 should I move to Zope2.6 branch instead of trying to
 fight? what would I look at next?
 
 ~runyaga
  
 
 
 
 ___
 Zope-Dev maillist  -  [EMAIL PROTECTED]
 http://lists.zope.org/mailman/listinfo/zope-dev
 **  No cross posts or HTML encoding!  **
 (Related lists - 
  http://lists.zope.org/mailman/listinfo/zope-announce
  http://lists.zope.org/mailman/listinfo/zope )

-- 
Chris McDonoughZope Corporation
http://www.zope.org http://www.zope.com
Killing hundreds of birds with thousands of stones


___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )



Re: [Zope-dev] plone.org - chrism_installer_branch

2002-09-17 Thread alan runyan

i dont believe so.. its plone.org thats doomed.
I cant reproduce the madness on my local boxen ;-(
its all very frustrating .. but I am learning to care less
which is a good thing ;-)

~runyaga

- Original Message -
From: Chris McDonough [EMAIL PROTECTED]
To: alan runyan [EMAIL PROTECTED]
Cc: [EMAIL PROTECTED]
Sent: Tuesday, September 17, 2002 5:25 AM
Subject: Re: [Zope-dev] plone.org - chrism_installer_branch


 Alan,

 You mentioned that you thought the chrism-install-branch was slow... do
 you see the slowness and the leakage when using the tip of the 2.6 branch?

 - C


 alan runyan wrote:
  Hi.
 
  just wanted to drop you guys a line and say that
  chrism_installer_branch will save the world.
  But I have some questions:
 
  Chris said its based on HEAD.  Whats the
  difference between HEAD and Zope-2_6-branch?
  I probably shouldnt be running HEAD in production?
  I am having severe leakage here are some refoucnts:
 
  DateTime - 62263
  IOBucket - 32641
  PloneFolder - 22766
  User - 22196
  PersistentMapping - 12846
  CMFDefault.Document.Document - 12820
 
  I have have the python security machinery turned on.
 
  should I move to Zope2.6 branch instead of trying to
  fight? what would I look at next?
 
  ~runyaga
 
 
 
 
  ___
  Zope-Dev maillist  -  [EMAIL PROTECTED]
  http://lists.zope.org/mailman/listinfo/zope-dev
  **  No cross posts or HTML encoding!  **
  (Related lists -
   http://lists.zope.org/mailman/listinfo/zope-announce
   http://lists.zope.org/mailman/listinfo/zope )

 --
 Chris McDonoughZope Corporation
 http://www.zope.org http://www.zope.com
 Killing hundreds of birds with thousands of stones



___
Zope-Dev maillist  -  [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://lists.zope.org/mailman/listinfo/zope-announce
 http://lists.zope.org/mailman/listinfo/zope )