[ZODB-Dev] Re: Memory Errors reading large ZODB

2007-08-12 Thread Jim Carroll
 
  Gary Poster wrote:
  you can call cache minimize after a threshold.. maybe every 100  
  iterations.
  sounds good, assuming you know you are not writing.
 

Fantastic!  My scripts are running without fail now (I used to have to
change them to pick up where they left off and re-run about four times.)

Thanks!
-Jim


___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev


[ZODB-Dev] Re: Understanding conflicts

2007-08-12 Thread Jim Carroll
Dieter Maurer dieter at handshake.de writes:

 
 Jim Carroll wrote at 2007-6-12 15:57 +:
  ...
 The code that's running essentially does:
 
add message to Persistent list in object
get_transaction().commit()
send_email()
 
 We are using Zodb 3.3a3, and ZEO 2.3a3.
 
 I've read that when a transaction retries, it re-runs 
code on the server side. 
 
 The ZODB by itself does not rerun anything.
 Zope (its ZPublisher) retries a request up to three times when it
 fails due to a ConflictError.
 

I'm not using Zope.  I've got a quixote application that's 
using ZODB and ZEO.

Somehow, the code that adds the message to the persistent 
list is running more than once.  I have read that ZEO will 
re-run python code on a retry, and I think this is what's 
causing the duplicated data.

In my mind, what I need is some sort of assurance that the 
Persistent List is only being appened to once.  For some 
reason the commit() is causing it to be appended more than 
once when there's a conflict error.

How can I isolate my transactions so that a conflict aborts 
the current transaction before re-trying?

Thanks,
-Jim

___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev


[ZODB-Dev] Error starting simplest ZEO instance

2007-08-12 Thread Jim Carroll

Hi I'm having trouble getting my web server started.  It's 
starting ZEO, but zeo never completes the startup process.  
The zdctl.py is wating forever for a runzeo which fails 
instantly with error code 2. 

Im running ZODB 3.3.1 on Python 2.4 on Ubuntu. 

I've tried a stand-alone startup to see what's going on 
and it tells me:

[EMAIL PROTECTED]:~/tmp# zdctl.py -p runzeo.py -a  -f Data.fs start
Error: invalid value for -m '18': invalid literal for int(): 18
For help, use /usr/bin/zdrun.py -h
. . . . . . . . . . . . . . . . . . . . . . . . . 
. . . .  (continues forever)


I stepped through runzeo (and zdctl) with pdb, and figured 
out that it's actually running: 

/usr/bin/python /usr/bin/zdrun.py -S schema.xml -b 10 
 -s zdsock -u www -x 0,2 runzeo.py -a  -f Data.fs -t 10 -m 18

the 18 that it's complaining about really is a valid int.

If I remove that parameter I get: 

[EMAIL PROTECTED]:~/tmp# /usr/bin/python /usr/bin/zdrun.py -S schema.xml 
-b 10 -s zdsock -u www -x 0,2 runzeo.py -a  -f Data.fs -t 10 


But I never get the messages that tell me that it's starting up correctly.

How can I get zdrun to accept -m 18 happly?

Thanks,
-Jim

___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev


Re: [ZODB-Dev] Error starting simplest ZEO instance

2007-08-12 Thread Marius Gedminas
On Sun, Aug 12, 2007 at 07:01:11PM +, Jim Carroll wrote:
 Hi I'm having trouble getting my web server started.  It's 
 starting ZEO, but zeo never completes the startup process.  
 The zdctl.py is wating forever for a runzeo which fails 
 instantly with error code 2. 
 
 Im running ZODB 3.3.1 on Python 2.4 on Ubuntu. 
 
 I've tried a stand-alone startup to see what's going on 
 and it tells me:
 
 [EMAIL PROTECTED]:~/tmp# zdctl.py -p runzeo.py -a  -f Data.fs start
 Error: invalid value for -m '18': invalid literal for int(): 18

Huh.

 I stepped through runzeo (and zdctl) with pdb, and figured 
 out that it's actually running: 
 
 /usr/bin/python /usr/bin/zdrun.py -S schema.xml -b 10 
  -s zdsock -u www -x 0,2 runzeo.py -a  -f Data.fs -t 10 -m 18

I'd be inclined to look for invisible control characters such as CR at
the end of that line.

Marius Gedminas
-- 
The moral of the story is that with a contrived example, you can prove
anything. Oops. No, that's not what I meant to say.
-- Joel Spolski


signature.asc
Description: Digital signature
___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev


[ZODB-Dev] Re: Error starting simplest ZEO instance

2007-08-12 Thread Jim Carroll

 That leaves me without any clues why zdrun is failing on my new machine.
 
 So, what's the best way to troubleshoot why zdrun just waits forever?
 I'm currently trying to figure out how dulcinea decides what to hand to
 zeod (zeoctl.)

I added the following line to my zeo.conf:
runner
  transcript /www/log/zeo.runner
/runner

and the transcript told me that it was looking for a script 
in the wrong directory.

Problem solved!

___
For more information about ZODB, see the ZODB Wiki:
http://www.zope.org/Wikis/ZODB/

ZODB-Dev mailing list  -  ZODB-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zodb-dev