[Zope-dev] Help! Getting there, I hope ...

2006-09-01 Thread Kris Adcock
Right, many thanks to those who have offered advice. I'm conscious that as
I've drifted from a coding topic then I'm probably in the wrong mailing list,
but everyone has been very patient up to now and I'm hoping that a fix is in
sight! :)

I have done a backup of the Dats.fs file (took three days!). I have used
fsdump and fstest to produce listings about my Data.fs file - fsdump produced
a 2.67GB textfile! I have tracked down the first entry that I believe begins
all the deletes:

tid=0367c03fc4325022 time=2006-08-26 08:31:45.983563 offset=749481328632
 user= admin description=/library/reference/manage_delObjects
 
If I'm right ... does that mean if I trim the Data.fs file to 749481328632
bytes long and start Zope off again, that the files should be restored? If
so, does anyone know of a good way of trimming such a large binary file down
to a specific size? I'm using Suse Linux as a server.

Cheers, and thanks again,

Kris.
www.danceswithferrets.org
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] Help! Need to extract files out of Data.fs!

2006-08-28 Thread Kris Adcock
Hiya,

My company has been using a Zope server to store some reference material, but
it has grown beyond belief, and I need to extract all the collected files
(about 1.3 terabytes!) from the Data.fs into distinct files onto a different
server.

Unfortunately, I've run into some problems. Firstly, the FTP transfer process
seems to be extremely slow, and if I try and transfer too large or deep a
folder structure in one go then things grind to a halt.

To beat this I've been carefully recreating the folder structure manually,
and copying things in easier-to-digest chunks. Unfortunately, because I was a
bit rushed over the weekend I have accidentally deleted about 130,000 files!

I've tried going through the Undo procedure, but the idea of manually
ticking 130,000 boxes (in pages of 20) and undoing them fills me with dread.
So ...

Please please /please/  does anyone happen to have the file format for
the Data.fs file so that I could write a C program to extract and recreate
the files and folders to another server? Or has anyone written such a program
already? If so, I'll happily have your children if you can help me out! As it
stands, I'm going to have to break it to the librarian (the poor man who has
been collating all the reference material for the last six months) that I've
lost half of his work, and blaming it on the poor FTP client in Windows seems
a bit lame!

If it helps: I'm running Zope 2.9.2 on a SuSE Linux box. I have full access
to the Linux box ... and a large hammer, if I need it! :(

Help!

Many thanks in advance,

Kris (considering giving up this computing job and going to live in a cave
somewhere).
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


[Zope-dev] Re: Help! Need to extract files out of Data.fs!

2006-08-28 Thread Kris Adcock
--- Philipp von Weitershausen [EMAIL PROTECTED] wrote:
 Kris Adcock wrote:

  I've tried going through the Undo procedure, but the idea of manually
  ticking 130,000 boxes (in pages of 20) and undoing them fills me with
 dread.
 
 Hmm, this is something I don't understand. You deleted 130,000 files in
 individual transactions? If you deleted the 130,000 files in one big
 transaction, all you have to do is undo this one transaction. That is,
 of course, provided that any subsequent transaction you made after
 deleting the files won't cause inconsistencies and potentially prevent
 the undo.

Perhaps the Windows FTP client chooses to scan through the folder structure
itself and individually delete each file? I'm certainly looking at 130,000
entries, anyway. I'd be much happier if I only had to undo one transaction!
:(

 
  Please please /please/  does anyone happen to have the file format
for
  the Data.fs file so that I could write a C program to extract and
recreate
  the files and folders to another server? Or has anyone written such a
 program
  already? If so, I'll happily have your children if you can help me out!
 As it
  stands, I'm going to have to break it to the librarian (the poor man who
 has
  been collating all the reference material for the last six months) that
 I've
  lost half of his work, and blaming it on the poor FTP client in Windows
 seems
  a bit lame!
 
 No need for a C program. The ZODB is a Python library, you can use
 Python to get at your data. The simplest way is to start the Zope debug
 shell via bin/zopectl debug. You will then have access to the root
 object in the interpreter prompt and can poke at your objects, including
 their history. Writing a script and running it via bin/zopectl run
 shouldn't be a big problem after that.

I'd better start reading my Python book, then ... 

Cheers!

Kris.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )


Re: [Zope-dev] Help! Need to extract files out of Data.fs!

2006-08-28 Thread Kris Adcock
--- Dennis Allison [EMAIL PROTECTED] wrote:
 
 Kris, 
 
 I assume you have a backup of the Data.fs.  If you do, nothing is really
 lost.
 
 Have you compressed the Data.fs?  There is an option in the control panel

Wouldn't this remove all the deleted files? Or is compression different to
packing?

Cheers,

Kris.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )