Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
On Tue, 02 Jan 2001 15:33:03 -0500, Shane Hathaway <[EMAIL PROTECTED]> wrote: >But like I told ChrisW, I think BerkeleyStorage will fill the need that >PartitionedFileStorage was only partitially addressing. FileStorage has fewer license compatability issues. Im not yet sure about the extent of any problems this may cause. Toby Dickenson [EMAIL PROTECTED] ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] ANNOUNCE: PartitionedFileStorage
> But like I told ChrisW, I think BerkeleyStorage will fill the > need that > PartitionedFileStorage was only partitially addressing. How is the new BerkeleyStorage product coming along? /Magnus ### This message has been scanned by F-Secure Anti-Virus for Microsoft Exchange. For more information, connect to http://www.F-Secure.com/ ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Steve Alexander wrote: > > Shane Hathaway wrote: > > > > > BTW, Evan helped me find and correct a bug. You'll only run into it if > > you set your partition size to less than the size of the largest ZODB > > objects. > > The new version of FileStorage.py in PartitionedFileStorage for 2.3 > overwrites some of the changes made the FileStorage locking protocol in CVS. > > These are the ones using _commit_lock_acquire _commit_lock_release. Well, it's pretty easy to use diff and patch to correct it. But like I told ChrisW, I think BerkeleyStorage will fill the need that PartitionedFileStorage was only partitially addressing. OTOH I've been running it for a while now on my box and have had no signs of problems. Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Shane Hathaway wrote: > > BTW, Evan helped me find and correct a bug. You'll only run into it if > you set your partition size to less than the size of the largest ZODB > objects. The new version of FileStorage.py in PartitionedFileStorage for 2.3 overwrites some of the changes made the FileStorage locking protocol in CVS. These are the ones using _commit_lock_acquire _commit_lock_release. -- Steve Alexander Software Engineer Cat-Box limited http://www.cat-box.net ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Chris Withers wrote: > > Shane Hathaway wrote: > > > > I just realized I could use the "patch" command to backport. So I made > > a new tarball. Have fun! > > > > >http://www.zope.org/Members/hathawsh/PartitionedFileStorage/PartitionedFileStorage-0.0.1-2_2.tar.gz/view > > great :-) > > It's installed and running now. No problems yet, btu then I haven't seen > any partitioning either... how long doI have to wait? ;-) Until 512 MB. However, you can change the default partition size in FileStorage.py. Note that it behaves correctly with partitions of varying size, so you don't have to worry that it'll get confused if you set it to a partition size of 10 MB when your first partition is already 50 MB. BTW, Evan helped me find and correct a bug. You'll only run into it if you set your partition size to less than the size of the largest ZODB objects. --- PartitionedFile.py~ Wed Nov 22 16:14:27 2000 +++ PartitionedFile.py Mon Dec 11 12:01:18 2000 @@ -343,7 +343,7 @@ file = self.__seekToNextPartition() if file is not None: state = self.__state -toAppend = file.read(size) +toAppend = file.read(size - len(data)) data = data + toAppend else: break Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Shane Hathaway wrote: > > I just realized I could use the "patch" command to backport. So I made > a new tarball. Have fun! > > >http://www.zope.org/Members/hathawsh/PartitionedFileStorage/PartitionedFileStorage-0.0.1-2_2.tar.gz/view great :-) It's installed and running now. No problems yet, btu then I haven't seen any partitioning either... how long doI have to wait? ;-) cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Chris Withers wrote: > > Phil Harris wrote: > > > > Chris, > > > > Any hints/tips on how you did this (just to save me from having to do any > > work of course ;)) > > I just used WinZip to extract the tarball in the /ZODB directory. > Sadly, it didn't work, and won't do until the next version fo Zope is > released :-( I just realized I could use the "patch" command to backport. So I made a new tarball. Have fun! http://www.zope.org/Members/hathawsh/PartitionedFileStorage/PartitionedFileStorage-0.0.1-2_2.tar.gz/view Shane ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Phil Harris wrote: > > Chris, > > Any hints/tips on how you did this (just to save me from having to do any > work of course ;)) I just used WinZip to extract the tarball in the /ZODB directory. Sadly, it didn't work, and won't do until the next version fo Zope is released :-( cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Chris, Any hints/tips on how you did this (just to save me from having to do any work of course ;)) Phil - Original Message - From: "Chris Withers" <[EMAIL PROTECTED]> To: "Shane Hathaway" <[EMAIL PROTECTED]> Cc: <[EMAIL PROTECTED]> Sent: Thursday, November 23, 2000 10:31 AM Subject: Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage > Shane Hathaway wrote: > > What couldn't be tested by my limited resources: > > - Platforms other than Linux. > > I'm running this on my NT4 Workstation, not high load but I'll let you > know if anything weird happens (that isn't caused by me ;-) > > I wonder if this will help with the conflict errors I've been getting? > > cheers, > > Chris > > ___ > Zope-Dev maillist - [EMAIL PROTECTED] > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Shane Hathaway wrote: > What couldn't be tested by my limited resources: > - Platforms other than Linux. I'm running this on my NT4 Workstation, not high load but I'll let you know if anything weird happens (that isn't caused by me ;-) I wonder if this will help with the conflict errors I've been getting? cheers, Chris ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: PartitionedFileStorage
Thank Shane! -- Andy McKay, Developer. ActiveState. - Original Message - From: "Shane Hathaway" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Sent: Wednesday, November 22, 2000 1:48 PM Subject: [Zope-dev] ANNOUNCE: PartitionedFileStorage > For all who are interested in breaking database size barriers without > moving to Oracle or Berkeley Storage, here's something to try out. > > http://www.zope.org/Members/hathawsh/PartitionedFileStorage > > I *highly* recommend you back up Data.fs before installing. > > What is known to work: > - Reads and writes of logical files greater than 3 GB on versions of > Linux that support only 2 GB files. > - Undo and packing. > - Fast random reads and writes. > - Using simple binary concatenation to move back to a standard single > file. > - Using PartitionedFile completely independent of Zope or ZODB. > > What has not been tested, but will very likely work: > - Tranalyzer. > - Putting the partitions on different physical devices. (Poor man's > RAID :-) ) > > What couldn't be tested by my limited resources: > - Platforms other than Linux. > - Running this on a busy Zope site. (No, www.zope.org is not running > PartitionedFileStorage. :-) ) > > BTW to all in the U.S., Happy Thanksgiving! > > Shane > > ___ > Zope-Dev maillist - [EMAIL PROTECTED] > http://lists.zope.org/mailman/listinfo/zope-dev > ** No cross posts or HTML encoding! ** > (Related lists - > http://lists.zope.org/mailman/listinfo/zope-announce > http://lists.zope.org/mailman/listinfo/zope ) > ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
