[Zope-dev] [Proposal] Drop Mount.py from ZODB 3.5

2005-06-02 Thread Tim Peters 
http://www.zope.org/Collectors/Zope/1800

describes some of the code problems with Zope's current way of mounting
databases.  ZODB 3.4 (still) has a Mount.py module, unused and untested by
ZODB.  Jim and I were both surprised today to discover that Zope (2.8) still
imports it, so we can't drop it for ZODB 3.4 (Zope 2.8, and the ZODB 3.4 it
uses, are both in beta).

We'd like to continue getting non-ZODB code out of the ZODB project, so
would like to drop Mount.py from ZODB 3.5.  Are any of zodb-dev's
"standalone" ZODB users making use of Mount.py?  I would be surprised by
that too, since Mount.py relies on other code (like Acquisition) that's
already been removed from the ZODB 3.3 and 3.4 lines.  I've been surprised
before, though ...

___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] application server standards

2005-06-02 Thread Dieter Maurer 
John Doe wrote at 2005-6-2 13:37 +0200:
> ...
>1> How scalable is Zope (& how)?

Quite good.

We handle in the order of a million (fat) requests per day per Zope instance.
We currently have 5 Zope instances all interfacing via ZEO to the
same ZODB (thus, we handle in the order of 5 million (fat) requests per day)

Static objects are served by an external cache such that Zope
is usually only contacted for non-static objects (that's why I spoke
about "fat" requests above).

>2> With regard to "web application standards" how does it
>comply:
> - HTTP protocol support

It support HTTP 1.0 and a bit of HTTP 1.1 (e.g. If-Modified-Since
and byte range requests for some appropriate object types).

But usually, you put an HTTP 1.1 compatible Web server before Zope
(e.g. Apache or Squid).

> - server-side code execution

What standards are you interested in?

> - client-side code execution

Its a web application *server*!

It does not help you with the client side
neither does it prevent you to use any client side technique you like...

> - easy integration of javascript for client side
>checking

See above.

Use as much JavaScript as you like...

> - any database adapters provided by the framework

Usually separate products (sometimes third party and commercial).
But for most well known databases...

> - communication standards integration

HTTP, FTP, WebDAV and XML-RPC by default.

I read about people that used CORBA or SOAP to call
out of Zope or made Zope an SOAP server.
I do not know about published solutions, however.

> - management tools and remote controls

You mean what by this?

The complete Zope management is via HTTP (and is easily extensible).
Therefore, it can be completely automated...

>3> How well does Zope rate in the security department?

I never heard that someone got operating system or even root access via Zope...

In the last few years there have been a few hotfixes -- usually
to fix problems in case you allow your visitors to create
executable content in your site. Security problems were
usually fixed very quick by a hotfix.

-- 
Dieter
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: Re: [Zope-dev] CorruptedDataError sniff !

2005-06-02 Thread Eric Brun 
> 
> Packing is the last thing you should be trying when you have
> corruption. 

In fact I discover the corruption during the pack.

 There's no mechanical, safe way to recover.  Please read
> this:
> 
> http://zope.org/Wikis/ZODB/FileStorageBackup

This is a great document. I think the origin of the corruption is my RAID 
controler so I have ask to the server owner to switch for a new server.

> 
> and start by using fstest, then fsrefs, as described there.



> 
> > I run  Zope 2.6.2 , ZEO 2 and ZODB 3.1
> 
> Just noting that it's harder to get help with old releases.

I have mount my zodb on a Zope2.7.6 and I'm working on this release to solve my 
problem.

fstest say all is ok.
fsrefs say that :
"
oid 0x37d8e5 BTrees._IIBTree.IIBTree
last updated: 2005-05-28 15:48:11.159195, tid=0x35D95942F9CD111L
refers to invalid object:
oid 0x5d4787 missing: 'BTrees._IIBTree.IIBucket'

oid 0x37d8ec BTrees._IOBTree.IOBucket
last updated: 2005-05-07 00:56:12.524043, tid=0x35D1BF8356F9844L
refers to invalid object:
oid 0x39c22b missing: 'BTrees._IIBTree.IIBTree'


..

etc
"


___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

Re: [Zope-dev] CorruptedDataError sniff !

2005-06-02 Thread Tim Peters 
[Eric Brun]
|> Houston, we've got big a problem !
>
> Here is the traceback in ZEO_EVENTS.log:
> ...
> CorruptedDataError: 968647571
> "
>
> And I can't pack the zodb, ...

Packing is the last thing you should be trying when you have
corruption.  There's no mechanical, safe way to recover.  Please read
this:

http://zope.org/Wikis/ZODB/FileStorageBackup

and start by using fstest, then fsrefs, as described there.

> I run  Zope 2.6.2 , ZEO 2 and ZODB 3.1

Just noting that it's harder to get help with old releases.

> I have tried to do a fsrecover, it removes a transaction. Then when I tried 
> to lunch
> a pack,

Packing isn't an error recovery procedure.

> I've got a very strange error about unpickling :

That suggests object pickles are corrupt too; fstest can't discover
that, and fsrecover can't repair that.  fsrefs _may_ (or may not) be
provoked into complaining, or even crashing, by it.

> "Error unpickling, ((UBTrees._IIBTreeqU... [lots of gibberish] ...
>
> I try to copyTransaction in a new Storage but it failed too.

This is a surprise ?  Seriously, "garbage in, garbage out"
applies here.  The garbage has to be repaired first.

> This is a production site.
> My last backup which is not corrupted date of Sunday morning !

Since fsrecover didn't work for you, you need to learn more about the
nature of the damage.  fstest, fsrefs, and fsdump are the basic tools
to start figuring that out.
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

[Zope-dev] application server standards

2005-06-02 Thread John Doe 
Hi All,

Im busy conducting an analysis on some python web
appplication servers.
I have a few questions with regard to Zope:

1> How scalable is Zope (& how)?
2> With regard to "web application standards" how does it
comply:
 - HTTP protocol support
 - server-side code execution
 - client-side code execution
 - easy integration of javascript for client side
checking
 - any database adapters provided by the framework
 - communication standards integration
 - management tools and remote controls
3> How well does Zope rate in the security department?

Thanks
_
For super low premiums, click here http://www.dialdirect.co.za/quote
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )

[Zope-dev] CorruptedDataError sniff !

2005-06-02 Thread Eric Brun 

Hi all,
Houston, we've got big a problem !

Here is the traceback in ZEO_EVENTS.log:
"
--
2005-06-02T11:45:21 INFO(0) zrpc-conn:193.49.250.194:37684 zeoLoad() raised 
exception: 968647571
Traceback (innermost last):
  File /data/ZeoCVS/lib/python/ZEO/zrpc/connection.py, line 234, in 
handle_request
  File /data/ZeoCVS/lib/python/ZEO/StorageServer.py, line 337, in zeoLoad
  File /data/ZeoCVS/lib/python/ZODB/FileStorage.py, line 694, in 
modifiedInVersion
(Object: /data/ZeoCVS/var/Data.fs)
CorruptedDataError: 968647571
"

And I can't pack the zodb, when I pack I've got this traceback :
"
--
2005-06-02T08:48:17 ERROR(200) zrpc:1193 Error raised in delayed method
Traceback (innermost last):
  File /data/ZeoCVS/lib/python/ZEO/StorageServer.py, line 865, in run
  File /data/ZeoCVS/lib/python/ZEO/StorageServer.py, line 402, in pack_impl
  File /data/ZeoCVS/lib/python/ZODB/FileStorage.py, line 1503, in pack
(Object: /data/ZeoCVS/var/Data.fs)
  File /data/ZeoCVS/lib/python/ZODB/fspack.py, line 680, in pack
  File /data/ZeoCVS/lib/python/ZODB/fspack.py, line 464, in findReachable
  File /data/ZeoCVS/lib/python/ZODB/fspack.py, line 478, in buildPackIndex
  File /data/ZeoCVS/lib/python/ZODB/fspack.py, line 180, in checkTxn
  File /data/ZeoCVS/lib/python/ZODB/fspack.py, line 170, in fail
CorruptedError: /data/ZeoCVS/var/Data.fs:968633329:invalid transaction status: 
'g'
"

I run  Zope 2.6.2 , ZEO 2 and ZODB 3.1

I have tried to do a fsrecover, it removes a transaction. Then when I tried to 
lunch a pack, I've got a very strange error about unpickling :
"Error unpickling, ((UBTrees._IIBTreeqUIIBucketqtqNt.((JÇü 
KJQ›KJyWKJ}WKJ06KJ­KJ®KJÃøKJœKKJKKJŸKKJ 
KKJ¡KKJ¢KKJ¦KKJ8KJÜS 
KJê!KJGF*KJ%D.KJ…Š.KJˆŠ.KJŠŠ.KJ;w/KJ>w/KJ?w/KJ~G0KJο1KJÁ3KJ'^7KJžš;KJ¢š;KJwû<KJzû<KJ{û<KJÄ>KJ#IGKJPLGKJ|IKJJKKJ¶ÊMKJŒ
 ]KJ ]KJŽ ]KJ’ ]KJš ]KJ› ]KJœ ]KJž ]KJ¡ 
]KJrdKJæãdKJèãdKJ¿gKJ¿gKJ]¸yKJÆozKJ¸|KJ¹|KJÁ|KJ 
…|KJ”‹}KJ–‹}KJ™‹}KJ›‹}KJC€KJIσKJJσKJd¹…KJf¹…KJ#[KJ÷–KJM»ŸKJNÖ´
 KJ×´ KJÚ´ KJÛ´ KJC) KJš… KJ©Ø¦ KJ¢Ò KJò™ê KJÀDô KJ×Dô KJû 
KJ$•R KJIr| KJ𵀠KJÛ$û 
KJ™‹}KJM»ŸKJKJò²KJó²KJô²KJ×ØKJ5´9KJ<´9KJ¯¾ãKJ/hûK"

I try to copyTransaction in a new Storage but it failed too.
This is a production site. 
My last backup which is not corrupted date of Sunday morning !

Please Help me 
___
Zope-Dev maillist  -  Zope-Dev@zope.org
http://mail.zope.org/mailman/listinfo/zope-dev
**  No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope )