Re: [Zope-dev] Operation Properties.
[Dieter Maurer] | Have a look at Date properties. They are already objects. Yes, you are correct. WarpFramework, which I'm using for this project has support for the type of properties I'm talking about. Rather, a framework for using properties. Getting similar behaviour into Zope was the point behind my post (sorry if I didn't make myself clear enough). ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Operation Properties.
'Evening, Zopistas.
I'm developing an accounting product right now, and one of the more
interesting aspects of how to solve this issue is how do handle
currencies. I've decided to let each entry (transaction) know about
the currency it was in. At a later stage, the user is given the
option to convert the currency to something else, but only for
display-purposes and nothing persistent.
This raises a number of interesting issues; I'll try to be brief.
- I'd like the currency-attribute itself to know about how how
display itself (ie. this shouldn't be a method of the class
containing the property).
- I'd like the currency-attribute itself to know how to convert
itself to other currencies.
This would allow me to say::
transaction.currency.set_amount_to(100.00)
transaction.currency.set_currency('FRF') # French Francs
And then this::
transaction.currency.display_in('NOK') # Norwegian kroners
would render the string::
NOK 125.00
for example. Or::
transaction.currency.convert_to('NOK')
would render the float::
125.00
or something like that. I'm not entierly sure of the API, yet.
The point is, I'd like to delegate attribute-behaviour to the
attribute itself. Currently, I don't see any easy way to do this with
Zope. I gather that there isn't either, based on the links I give
below. It seems that many projects are implementing their own
property-handling.
Summarizing: I'd like to volunteer time to a project/proposal that
would take care of properties once and for all. I'm proposing to
create a new property model where we have pluggable properties that
is more lously coupled with the management of properties and allows
the developer to add custom-made properties (much like
PlugginIndexes).
I also propose to make the property itself know how to render a widget
for it, given an environment. A property of type 'date', for example,
could render six HTML select-lists given a HTML-environment (year,
month, day, hour, minute (second, maybe), timezone).
The functionality of these widgets should be a separated from the
properties, naturally. It should also be pluggable. I'm thinking
pluggable in a site-wide context here.
Whatchya think?
http://warp-framework.sf.net/
http://demo.iuveno-net.de/iuveno/Products/SmartObjects/
http://www.zope.org/Members/faassen/Formulator/
http://dev.zope.org/Wikis/DevSite/Proposals/PropertyRevamp/
http://dev.zope.org/Wikis/DevSite/Proposals/PropertyManagerEvents/
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Operation Properties.
[Chris Withers] | Go look at ComputedAttributes... Yupp. But are you suggesting that ComputedAttributes are the end-all be-all solution to the problem I proposed, or only a part of it? As I see it, they hardly specify a framework for attributes. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Getting Unauthorized from __bobo_traverse__.
[Michael R. Bernstein] | On Wed, 2001-09-12 at 22:45, Erik Enge wrote: | | *scabbers off to the CVS* Thanks! :) | | Eeew! | | I hope you meant 'scampers', as I have horrific visions of what | 'scabbering off' would look like... Hehe! Oops... Yeah, that's what I meant. Ever since I started learing French my English has started to suck. Maybe it's only mental. ;-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Getting Unauthorized from __bobo_traverse__.
[Evan Simpson] | If you grab OFS/Traversal.py (I think) from the CVS root, it should | fix the problem. *scabbers off to the CVS* Thanks! :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Getting Unauthorized from __bobo_traverse__.
Hi!
I've have this custom __bobo_traverse__ hook:
def __bobo_traverse__(self, REQUEST, name):
Intercept the traversal
if name:
if hasattr(self, name):
return getattr(self, name)
When I call the object like this:
/objecta
ie. using __call__ (I guess); everything is ok. It renders the
index_html (which is a DTMLFile) as expected. However, when I do
this:
/objecta/index_html
it raises an Unauthorized on me. I can't understand why. I thought
it might have something to do with docstrings, so I tried this:
def index_html(self):
we have a doc string
return DTMLFile('index_html', globals())
And that worked (it didn't render the DTML, but I know how to fix
that). Making it go back to this:
index_html = DTMLFile('index_html', globals())
raised an Unauthorized on me again.
Here's the full traceback:
Traceback (innermost last):
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/ZPublisher/Publish.py, line
223, in publish_module
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/ZPublisher/Publish.py, line
187, in publish
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/ZPublisher/Publish.py, line
171, in publish
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/ZPublisher/mapply.py, line
160, in mapply
(Object: object_manager_index)
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/ZPublisher/Publish.py, line
112, in call_object
(Object: object_manager_index)
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/Shared/DC/Scripts/Bindings.py,
line 324, in __call__
(Object: object_manager_index)
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/Shared/DC/Scripts/Bindings.py,
line 354, in _bindAndExec
(Object: object_manager_index)
File /home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/App/special_dtml.py,
line 236, in _exec
(Object: object_manager_index)
File /home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/OFS/DTMLMethod.py,
line 182, in __call__
(Object: standard_html_footer)
File
/home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/DocumentTemplate/DT_String.py,
line 538, in __call__
(Object: standard_html_footer)
File /home/erik/development/zope-farm/OtherProducts/WarpFramework/user.py, line 89,
in on_access
(Object: api)
File /home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/OFS/Traversable.py,
line 223, in restrictedTraverse
(Object: api)
File /home/erik/development/zope-farm/Zope-2.3.1-src/lib/python/OFS/Traversable.py,
line 190, in unrestrictedTraverse
(Object: api)
Unauthorized: index_html
I also tried adding:
__allow_access_to_unprotected_subobjects__ = 1
just for good measure, but that didn't help either.
Any help on this is greatly appretiated. :-)
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Pre-process a REQUEST before Zope does anything else
[Dario Lopez-Kästen] | I need to be able do some processing for each and every request that | is sent to zope to determine some enviromental thingies, *before* | the request is processed by the main zope mechanisms. I'm not entirely sure, but you might be looking for something like this: URL:http://www.zope.org/Members/michel/Projects/Interfaces/BeforePublishingTraverse URL:http://www.mit.edu/afs/sipb/project/python/doc/DevGuide/ObjectPublishing.html __before_publishing_traverse__ (Yeah, I make an effort to find the worst URLs... ;-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Getting Unauthorized from __bobo_traverse__.
[Erik Enge]
| def index_html(self):
| we have a doc string
| return DTMLFile('index_html', globals())
|
| And that worked [...]
Actually it doesn't. Don't know why I thought it did.
This however does work:
index_html__roles__ = ['Manager']
def index_html(self):
we have a doc string
return DTMLFile('index_html', globals())
There's something here I don't understand. My __bobo_traverse__
raises an unauthorized:
def __bobo_traverse__(self, REQUEST, name):
Intercept the traversal
if name:
if hasattr(self, name):
return getattr(self, name)
self = my_object at somewhere
REQUEST = the correct mapping object
name = 'index_html'
If I comment the __bobo_traverse__ away, the one in Application.py is
used:
def __bobo_traverse__(self, REQUEST, name=None):
try: return getattr(self, name)
except AttributeError: pass
[snip]
I've snipped it, because in this case getattr() always works.
self = Application at somewhere
REQUEST = the correct mapping object
name = 'account'
And this one doesn't raise an Unauthorized (and the name is different
- maybe there is traversal going on elsewhere too?).
Anyone been there done that before?
Thanks in advance. :)
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] PersistentMapping
Hi, I'm trying to use PersistentMapping instead of a regular mapping object, but I'm running into some problems. When I add and remove stuff from the mapping it sometimes fail or removes the wrong thing. Do I need adapt my code to it, or should it be straight forward? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] How long below the radar?
[alan runyan] | I believe that before ZOPE can truely take off it will need a | miniVend like solution to get the PHP/CF/ASPers to ZOPE. What is miniVend? | I would like to see a Roadmap for ZOPE. Aye! ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] How long below the radar?
[[EMAIL PROTECTED]] | Other than: http://dev.zope.org/Resources/ZopeDirections.html? Well, it is from February. And besides, it describes what we have/semi-have now, and not what is planned for the future (for example, where do DC think Zope is in three, four or five years?) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Stephan Richter wrote: I think we need to setup a separate mailing list for this project. Can you do that? I think the discussion is getting too specific now. We can use the mk-zprod-devel mailinglist at thingamy.com: URL:http://www.thingamy.com/mailman/listinfo/mk-zprod-devel/ ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Stephan Richter wrote: All what the wizard will do is provide the user with a nice interface/GUI to enter the information. I will then pass the information to the above mentioned management methods and the MakeZProduct Product will then generate the code and save it to the file system. Oki. What I currently have is a Zope product that you instanciate (maybe in the context of the wizard) and that instance then provides you with those methods you wanted. The instance is the only thing persisten, since all else will be written out to files (it can quite easily be done to write them as persistent DTML Documents or somesuch if one wanted to pause the setup or something, but that's outside the scope of round 1). BTW, we will assume that the user that runs the Zope engine has write access to /ZOPE/lib/python/Products. Yeah. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] help with external method
On Fri, 29 Jun 2001, Edgardo Zulian wrote: I'm just new with Zope, and I m trying to make an external method with python that return me the names of the files that are in an especific folder of the Zope i.e:the folder: Root Folder/function_repository.. I'm not quite sure what you want to do, but you could try to add a a DTML Method in the folder which contained this: dtml-in objectValues() dtml-var id /dtml-in This would print all the names (I guess you ment id's) of the objects in that folder. HTH. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Tino Wildenhain wrote: Hm. a simple collection of questions? Certainly not. I talking of a whole mechanism, where you group input and output into contexts. From application view it would be an API, it schould work no matter if the input/ output is generated from and to HTML, WML, XML or even stand-allone GUIs. Could you give me an example of how this would work? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Stephan Richter wrote: Here my list of questions: 1. Will we create ZClass or Python Products? Python Products. Product-name 2. I think it should ask some more meta-data information here, such as License, Author(s), Description Yepp :) A list of images (like dtmldoc.gif and such) 3. Okay, here we should have a loop of enter images with upload functionality. The only problem is where do we save them in the mean time? Upload? Upload to where? mk-zprod (as it works today) creates a directory on your filesystem, and in that directory (which you just copy to your Products directory) it creates an img/ directory and puts them there. Or are you asking where the wizard should store them? (Which I thought it didn't have to.) If you want to set a default Catalog name 4. Okay, I do not work with the catalog; what do you need, just a name or the path? I think the WizardTreePage will help here. Just the name. :) If you want nice redirection after adding objects 5. Yep, how could that look like; should I provide users with a text area or what? In the dtml/ directory of mk-zprod you have Add2.dtml, that's the page the user is redirected to after adding an object. Maybe a text area with a suggestion (like Add2.dtml) in it? 7. Yeah, this is all the meta-data here, so that could go on one page. But you are missing a list of Base Classes. I have no clue where to get these from. I guess it is time to look into the ZClass code, but I think they use a separate Mechanism. The problem with the current product registry is that NO classes are listed anywhere, only their constructors, which is nothing worth in this case. Hubbliski. We could provide them with standard classes as defaults (Persistent, Explicit/Implicit, AccessControl) and suggest some others. I'm not too sure about the ZClass thing. 8. Should that just use the PropertyManager attribute _properties? Yepp. I usually add the 'default' key to each property dictionary and write a two liner in the __init__ method to generate the properties with their default... Why not just have: def __init__(self, attrib1, attrib2='something'): doc string self.attrib1 = attrib1 self.attrib2 = attrib2 which could come from such a description: attribs: name: attrib1 default value: None name: attrib2 default value: something What do you think? 9. Again, that would be a loop. But my question here would be: Are you using sub-classes that much. I have written one so far in all the products ... My latest projects sub-classes left, right and center. If we just have the logic for a recursive loop there the user could add as many as s/he wanted without it being much more work for us. Are coming to Berlin? Well, I was, but I'm moving to France the 8. of July and I've just come home (to Norway) from England. England, Norway, France, Germany, France all in just three weeks is a bit much :) (Oh, and I have to get an apartment in Antibes.) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Erik Enge wrote: name: attrib1 default value: None name: attrib2 default value: something No, that wouldn't work, because you might want None as the default for that attribute. Maybe Nothing, or somesuch then. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Stephan Richter wrote: Well, but where are the images coming from. The Wizard is a Web Frontend, so we would need to upload the images or copy them from somewhere else from the file system. From the filesystem of the user? BTW, the /img directory is non-standard. Better would be www/ since other products use it as well. Sure thing. (Although, www/ indicates to me .html pages and various other things too.) In fact, we only need to think about adding them with the right permissions to the directory. A piece of code in the __init__.py will do the rest: Yes. This is what mk-zprod does today :) 2. When the icon is uploaded, save it somewhere temporarily. At the end, when all questioning is done, add everything at once. This has the advantage that you can freely move back and forth until you finish the wizard. Sounds good :) def __init__(self, attrib1, attrib2='something'): doc string self.attrib1 = attrib1 self.attrib2 = attrib2 Because this is horribly ugly and unflexible when you have 20 attributes. I always have to change several places, if I modify, add or edit an attribute/property. Could you give me an example of how you would do it? (Then I could modify the mk-zprod code.) Well, we can describe that right away in the standard property dictionary form; then we do not need to parse or do anything else. Nice :) Well, I was, but I'm moving to France the 8. of July and I've just come home (to Norway) from England. England, Norway, France, Germany, France all in just three weeks is a bit much :) (Oh, and I have to get an apartment in Antibes.) Okay. It would have been a good place to discuss this further. Morten Petersen from Thingamy will be there, I'm sure he has some thoughts about it. Now, I looked at the mk-zprod code again. We need to make it a real Zope Product with a nice management API, so that I can use the functions from the Wizard. I'll start typing right now. I'll probably have something premature by tomorrow. If we define this API clearly, Ok. I'll just write up mk-zprod as a Python Product and the API is defined as I go. Then, you could have a look and we can unite on one API and I make the necessary changes in the code. Yeah? Unless, of course, you have some specific requests right away. Once the work, twice the reward! ;-) I like. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Thu, 28 Jun 2001, Stephan Richter wrote: For example we would need: manage_make_initializeProduct(...) manage_make_addClass(...) manage_make_addProperty(...) manage_make_addIcon(...) manage_make_addSubClass(mainClass, ...) I just realised something. How do you need this to work? With regards to the wizard. Should mk-zprod produce the files and add them to a folder in itself? Or should it return everything for the wizard to handle? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Tue, 26 Jun 2001, Stephan Richter wrote: Okay, okay...I stayed up and typed it down pretty quick (2 hours). I attached it to this mail. It is plain text, since I was too lazy to do it in HTML. It might be a little unstructured, but I am too tired to fix that now. So what does it do? :) What I'm thinking is this: maybe use SmartWizard to meta-program you Python Product; that creates a definition file(s) of some sort which is sent to mk-zprod; mk-zprod consults the WarpFramework do make sure we don't create too much work for ourselves, and also provides us with nice default HTML/DTML-pages, and finally, Formulator could be used to do validation on those HTML/DTML-pages. Or are we talking past eachother here? It would be very cool to have a tool like that. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL
On Wed, 27 Jun 2001, Paul Everitt wrote: It is a *desire* of ours to be GPL-compatible. Not a requirement, as it can be awfully tricky, complicated, and time-consuming to get there. But we've told people that we're intending to give it a shot. That's much appretiated :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?))
On Wed, 27 Jun 2001, Tino Wildenhain wrote: if there are always many objects to create, may be it would be better to have a generic mechanism for asking users and represent app-/management interfaces rather then copying all the stuff over and over? That's what mk-zprod does. Or rather, will do once I've made the interface friendlier. (If I didn't misunderstand you.) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)
On Tue, 26 Jun 2001, Giovanni Maruzzelli wrote: I'm not so picky about bloating, but adding a document of 1K adds some 400K, and keeps growing. : How much eat for you (I know you cataloged some 50K documents)? I can't remember, but surely not that much. I had some 30.000 documents that were about 30-60Kb on average (although some were several megabytes), in addition to around 50.000 other objects (documents, if you like) indexed. My Data.fs would've been around 2.5GB if my memory serves me correctly. As I said, I had loads of Indexes too. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)
On Tue, 26 Jun 2001, Eric Roby wrote: The bottom line to all this venting (and I am not trying to shoot the messenger here) is that I need to understand where my efforts should be focused. If I need to abandon ZClasses in lieu of pure Python, then I need to know that now so I don't waste any more time on these false starts. If your application can't be written in five minutes and you expect to use it more than once, you shouldn't use ZClasses - IMO. The only argument for ZClasses (that I had at the time) was that it was very easy and fast to set up a couple of classes and some instances. After I wrote mk-zprod, making Python Products is even faster than ZClasses, and certainly scales better. If you ask me, it would be better to streamline the Zope API a bit and focus the effort on making it easier to start developing Python Products at first go, instead of stopping by ZClasses. I can't see the rationale for ZClasses, but I'm sure there is one. Right? I seem to recall some fuzz about Python Products starting be alive in the Zope instance (ie. behaving much like ZClasses) in a future release. I don't know if that's a good thing or not, but if it means ditching ZClasses I'm all for it. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalogbloat problem (berkeleydb is a solution?))
On Tue, 26 Jun 2001, Morten W. Petersen wrote: How about meta-programming (designing) via the Zope interface, with UML or somesuch; automatically generating Python code, then enable designers to use a ZFormulator-ish product to edit the interface while a programmer can work on the 'backend' (emacs on a terminal)? What are you on my friend? ;-) How about writing the whole shebang in put in favourite editor here, as is done today? I don't see the need for any other change, but I do know that DC (or atleast I suspect this is why they made ZClasses) hopes to bring Zope-programming to a wider audience with ZClasses, and thus it might have a purpose in life. I don't know. Python is a very easy language to learn. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL
On 26 Jun 2001, Michael R. Bernstein wrote: DC has been up-fron about how they make money. They do so by selling development services using Zope as a toolkit/platform. Yes, and forcing those paying customers to use GPL is very hard (and not very nice, either). Well, I guess the issue is whether you think that redistribution of a proprietary version of Zope itself is a good or bad thing. No, that's not the issue, since I don't believe there will ever be a large successfull proprietary version of Zope. I think that is where we differ in opinions. Which is something that can only be tested by applying time on it :). As a possible scenario, let's suppose that someone wanted to create a content mangement solution for the southeast asian market. I just don't think it would be very successfull. Zope isn't the type of application that would be great as a closed-source one. I just can't see that happen; maybe I'm too naive. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Something better than ZClasses (was: Re: [Zope-dev] Re: Zcatalogbloat problem (berkeleydb is a solution?))
On Tue, 26 Jun 2001, Stephan Richter wrote: I looked at the code pretty quick. I like it from the first view. It is very clean and easy to see the functionality. I think, if you can define an ZPI for your communication, then it will be no problem to put a SmartWizard Class Generator Front-End on top of this product. What is ZPI? Well, the SmartWizard would be like the frontend for it. If you want to see an early non-SmartWizard-framework version, look at the ProiektorInstaller. Just imagine you can build installers like that in Zope. I hope to be done with the first version on Thursday. Great, will you let us know? I will upload the documents tomorrow though, since it is late here and I have to do some work still. Ok. I'll begin thinking about all the stuff I dreamt of making mk-zprod into. I think that we will be able to combine the two products easily, once the SmartWizard is in a semi-stable state. Sounds good to me :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)
Giovanni, which Zope version are you running? On Tue, 26 Jun 2001, Chris McDonough wrote: How many indexes do you have, what are the index types, and what do they index? Likewise, what about metadata? In your last message, you said there's about 20. That's a heck of a lot of indexes. Do you need them all? In my installation I have about 30 or 40 Position(Text)Index/KeywordIndex/FieldIndex. They don't bloat much, so I don't think that's the problem. (The problem might be that we have different views on what bloating is, though :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: Zcatalog bloat problem (berkeleydb is a solution?)
(I removed [EMAIL PROTECTED].) On Mon, 25 Jun 2001, Giovanni Maruzzelli wrote: Any hints on how to manage something like? We use both textindexes, fieldindexes, and keywordsindexes (textindex on string properties, fieldindexes on boolean and datetime, keywordindex on strings). Maybe one kind of indexes is to be avoided? Erik, any toughts? Well, after ChrisM told me about the behaviour of CatalogAwareness, and I removed that from my classes, my ZCatalog bloatness has evaporated. I really can't see any major bloat-problem on either memory-consumption or disk-space. (That was with Zope 2.3.2b2.) Which is very good for me, but doesn't necessarily help you much. :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL
On 25 Jun 2001, Michael R. Bernstein wrote: Other than keeping the door open for this eventuality, is there any other reason to choose a BSD style license over the GPL? Yes. A commercial one; an imperative one. If I make a Zope Python Product, I must license it as GPL to be able to redistribute. That's just unacceptable in my eyes. (It would probably go against my personal beliefs to do that, but in the business-would you can't barge in with a hard GPL-attitude all over your face and expect people do readily do business with you. That's why we need a transition period; 'till the catch up with us.) I, for one, am quite convinced that most of the revenue Zope help companies create out there is done by proprietary Zope Python Products. With Zope under GPL this wouldn't be possible. (Me thinks.) Unless I've misunderstood something (which is certainly possible), DC doesn't seem to have anything to lose by switching from a BSD style license to the GPL (or a GPL style license with an additional optional attribution clause), and quite a bit to gain. How do you suppose DC make their monies? I'm quite sure they can't license Zope under the GPL because they would intimidate their market too much with it (an assumption that could be wrong, naturally). Let's hope they go for a GPL-compatible one. I can't see what they would/could loose by using a BSD-style one, maybe you have some thoughts on that? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL
On Mon, 25 Jun 2001, Shane Hathaway wrote: (Paul says:) I think the goal should be for Zope and Python to converge on the same license, with perhaps the new license being some off-the-shelf license like Apache's. Wow, lobbying the management team at DC is pretty easy ;-). It's good to see that things will be resolved; thanks Shane. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Re: [Zope-dev]ZPL and GPL licensing issues
[Simon Michael] | Now you're talking. Seconded. Me too! And if the management team really needs alot of serious breakdowns as to why this is a problem (GPL-incompatability, that is) let me know and I'll drum up a nice little mail of my own. :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL licensing issues
On Fri, 22 Jun 2001, Shane Hathaway wrote: Now, if the ZPL were GPL compatible, the GPL would be in full effect for products. Digital Creations would automatically have the rights to redistribute derivatives of ZWiki. I believe DC would even be able to distribute ZWiki with Zope as long as any dependent products (such as CMFWiki) are also GPL'ed. Zope itself would not have to be GPL'ed since it does not depend in any way on ZWiki. Now I think I have two different answers to one of my fundamental questions in this discussion: if I have a GPL-compatible licensed product and I distribute it with a GPL product, do I need to relicense the former one to GPL? Because that is what I understand you to say. Others have said the opposite. This is very important. Because if you can't be compatible without escaping to have to relicense to GPL, the GPL is worthless to me. If your philosophy agrees with the GPL, I urge you to lobby DC to get the ZPL changed. : - DC has not changed the ZPL because there hasn't been any strong push to make it happen. [...] Make your voice heard. Keep in mind that many on the management team don't have time to read the zope-dev and zope lists. I hope that you guys at DC reading the list make them aware of the fact that many people as frustrated with this. And it is not a small issue, either, as I'm sure we are all too aware of. I'd love to lobby DC to start thinking about this, how do I get in touch with the management team? It would be great if we could discuss this on [EMAIL PROTECTED] (or similar) and have them read/comment on that list. To start off with, it would be great if we could see the rationale for the ZPL, and how they think it applies to the current situation. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL licensing issues
On Fri, 22 Jun 2001, Morten W. Petersen wrote: Yes, you can distribute a GPL-compatible licensed code with GPL licensed code without licencing the former under GPL. Take a look in the Linux-kernel source tree for example. Ok, good. Then Thingamy's intermediate solution will be to create a TPL which is basically the ZPL with the incompatible-clauses ripped out (number 4 and 7, I think). That way we are compatible with both the ZPL and the GPL. It's still a mess, though. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL licensing issues
On Wed, 20 Jun 2001, Gregor Hoffleit wrote: You're not allowed to distribute a derived work of GPL code with proprietary code incorporated. Ok, this is the situation. We in Thingamy usually create all our products under the GPL. Then we give the whole shebang to the client we have been working for and they have all the lovely rights that they should have. If they want to redistribute, they can. Then, we have the other clients, that's the clients that are scared shitless from the GPL because if someone gets ahold of the code, that is their business-processes, it could be devastating for their business. It is a semi-legitimate fear, but only if they have the intention of actually redistributing the code (eg. becomming software-vendors, which some actually want to do...). If I have the proprietory program P (that is the clients business-process workflow application *phew*) as a Zope Python Product and then we have Morten's GUM under the GPL, which also is a Zope Python Product, can P application utilise GUM without having to be relicensed as GPL? (And I realise that the word utilise is ambigous, that was intentional.) To ask again, if it was unclear: can I use GPL Zope Python Products with non-copylefted Zope Python Products without relicensing? It is imperative for me as a professional Zope-developer (ie, I charge for my services) to know the answer to that question, and I should think it is vital to other developers as well. Surely someone from DC already as the answer? Another question which I feel is very related, and to which I cannot get any real clarification: Can Zope run GPL Zope Python Products without being relicensed as GPL? All the GPL Zope Python Products I've writted as subclassed from Persistent, for example. I. e. if you want to use that GPL code in your work, you'll have to make the proprietary code available under a GPL-compatible license as well (not necessarily the GPL itself). use [...] in your work, what does that mean? Subclassing? Interaction between the products in a management-interface? The Zope license doesn't even get into the play here. It's all between the GPL and your proprietary license. Hm. What about a ZPL Zope Python Product and a GPL Zope Python Product? Isn't the problem exactly the same? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZPL and GPL licensing issues
On 21 Jun 2001, Federico Di Gregorio wrote: if your product derives from GUM or uses internal interfaces, no, you can't. if your product uses only well the defined external api or access gum through zope, then, imho, yes. Ok, that's good. Then it means we can potentially use GPL Zope Python Products with non-copyleft ones. good question. imho, licensing a zope product under gpl is a non-sense because you won't be able to use it (usually products inherit on zope classes) and respect the gpl at the same time. that's why i always release under a double license. i really hope dc will release zope under a gpl compatible license soon or later. Because if you have a gpl-compatible license you dont have to relicense to redistribute, right? yes. terrible, terrible problem. but, please don't see that as a license war. different people like different licenses for different reasons and that's Right (TM). this war is just all of us trying to cooperate to put free software to a better use. Amen to that :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Tue, 19 Jun 2001, Chris Withers wrote: I'm guessing this is the point at which your problems become mine? ;-) *evil laughter* Yes :-) We should write about it and publish it to the community... ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] ZPL and GPL licensing issues
On 20 Jun 2001, Federico Di Gregorio wrote: i am sure that the QPL and the ZPL are completely incompatible but nobody cares because nobody really thinks that one is better than the other... I might be misunderstanding here, if that's the case I appologies. Just to clarify, for us at Thingamy (and I'm quite sure this is the real case behind the license issues) it comes down to business-issues. I do very much care whether or not I can use a GPL Zope Python Product with my ZPL/TPL Zope Python Product. If I can't, and someone tells me I need to relicense my product as GPL it would be very bad. An example could be if I had application G, Z, P. G is a GPL'ed Zope Python Product, Z is a ZPL/TPL Zope Python Product and P is some proprietory stuff I developed for my client. Now, if the proprietory application P interacts with my Z application and Z needs to become GPL, then that would/could require the proprietary stuff I did for the client to become GPL as well. Then, I get hell. If the client has to disclose their business trade-secrets, the stuff that really makes them them, I'd be sued so hard I'd see stars for another three decades :) Or am I wrong (I'd absolutely love to be!)? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Mon, 18 Jun 2001, Andreas Jung wrote: These are good ideas to improve the TextIndex. I already encouraged Erik to put alltogether into a Fishbowl proposal, Which I would do, if I had time. Which I will have, but not for another two weeks. :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Sat, 16 Jun 2001 [EMAIL PROTECTED] wrote: Lexis-Nexis: Sean w/2 Upton (where w/2 is within 2 words) This wouldn't be hard to make happen. I don't know if it is better to do it before of after the parsers, though. Maybe a more userfriendly alias would be best as a default? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Fri, 15 Jun 2001, Chris McDonough wrote: Once you're satisfied with the implementation, would you be willing submit the module to the collector? Do you think you (or someone else for that matter) could have a look at [1] the method that returns the position in the document - positionInDoc() - to how that could be made to run much faster? Maybe it is how it used... It is too slow to be very useful when indexing large amounts of data. Anyway, I suck at making Python fast (or using it the right way, which ever I've fallen pray for this time ;-), and any hints would be greatly appretiated. I've been indexing and searching a lot this weekend, and bar that problem with the indexing-speed it seems ok and I have no issues submitting it to the Collector. [1] URL:http://nittin.net/erik/software/PositionIndex/PositionIndex.py ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Fri, 15 Jun 2001, Chris McDonough wrote: Once you're satisfied with the implementation, would you be willing submit the module to the collector? Will do. Have you thought about how users actually are to use exact-phrase? What I'm thinking I will do here (currently I've only been testing explicitly with adjoinedby in the query) is to insert adjoinedby in phrased searches: erik enge- erik adjoinedby enge erik ... enge - erik near enge What do you think? I'll be submitting PositionIndex.py and ResultList.py in a day or two. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Thu, 14 Jun 2001, Chris McDonough wrote: Excellent! I haven't looked at it in detail, but thanks very much for contributing it! Maybe we can roll some of this work into a position-aware Text Index It is actually a TextIndex on steoroids. Remove the _proximity attribute and a couple of methods and what you are left with is a standard TextIndex. So I think what you already have is a position-aware TextIndex. That's how I'm planning to use it anyway :) or maybe even a new kind of Pluggable Index. :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] SearchIndex/ZCatalog comments.
When writing the PossitionIndex, a bunch of questions arrised (Zope 2.3.2): This is from UnTextIndex.py Zope 2.3.2 line 250 (or there abouts). Why is the wordMap needed? def getEntryForObject(self, rid, default=None): Get all information contained for a specific object. This takes the objects record ID as it's main argument. wordMap = self.getLexicon(self._lexicon)._lexicon.items() results = self._unindex.get(rid, None) if results is None: return default else: return tuple(map(self.getLexicon(self._lexicon).getWord, results)) I thought we didn't make it into a BTree 'till it was 5?: else: if indexRow.get(documentId, -1) != score: # score changed (or new entry) if type(indexRow) is DictType: indexRow[documentId] = score if len(indexRow) 3: # Big enough to give it's own database record indexRow=IIBTree(indexRow) index[entry] = indexRow else: indexRow[documentId] = score shouldn't objects be object?: def index_object(self, documentId, obj, threshold=None): Index an object: 'documentId' is the integer id of the document 'obj' is the objects to be indexed do we need this is ZCatalog.py?: from SearchIndex import UnIndex, UnTextIndex this isn't true? what about keywordindexes (only 'Field' and 'Text' mentioned)?: class ZCatalog(Folder, Persistent, Implicit): ZCatalog object A ZCatalog contains arbirary index like references to Zope objects. ZCatalog's can index either 'Field' values of object, or 'Text' values. do we need this in UnTextIndex.py?: from Splitter import Splitter from ResultList.py: def __or__(self, x): return self.__class__( weightedUnion(self._dict, x._dict)[1], union(self._words, x._words), self._index, ) return self.__class__(result, self._words+x._words, self._index) two returns? Sorry if this is all mambo-jambo, or if it is already fixed in 2.4. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: PossitionIndex (was: Re: [Zope-dev] ZCatalog phrase indexingrevisited)
On Thu, 14 Jun 2001, Erik Enge wrote: To be really useful I think the PossitionIndex' _proximity dictionary needs to be turned into a BTree of some sort, but apart from that I don't know what is missing. It's now using BTrees. And I renamed it to PositionIndex (thanks to Chris Withers for this :-). And speed might be a problem, haven't really tested that yet. Will during the weekend though. I indexed 30.000 objects using PositionIndex and searching (both exact-phrase and near) is very fast. It doesn't seem to be bloated, either (the _proximity-attribute, that is). Do you guys have a testing-suite for indexes? Maybe some I can apply to this index of mine? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Advanced REQUEST inside Python Class Problem
On Sun, 10 Jun 2001, Stephan Richter wrote: But, if I try: dtml-var ObjectInstance, then I cannot use self.REQUEST, since the namespace is somehow not passed. Don't you have to use dtml-var ObjectInstance()? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] multiple servers!
On Mon, 11 Jun 2001, Stian Jenssen wrote: I wan't to run two webservers on the same machine one, zope/apache an one apache. Can I set it up with 2 ports eg. 8080 and 80 but how do I do it? Edit the z2.py file in your zope/ directory, look for HTTP_PORT and adjust that to your needs. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANN: ReplacingDateTime proposal
On Thu, 7 Jun 2001, Andreas Jung wrote: Feel free to review and comment the propsal to replace the current DateTime module of Zope by the mxDateTime module: From the proposal: License issues mxDateTime stands under the EGENIX Public License that is considered to be an Open Source license. It should be compatible to GPL except there is discussion about the choice of the law clause between R. Stallmann and M-A. Lemburg Shouldn't it be focused on compatability with the ZPL instead of the GPL? From what I hear, there still are issues with, for example, distributing Python Products as GPL with Zope. Anyone with better knowledge about this care to enlighten me? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANN: ReplacingDateTime proposal
On Fri, 8 Jun 2001, Stephan Richter wrote: See an earlier post on a different thread. Chris wrote that the license is BSDish and is therefore compatible with ZPL. This means that mxDateTime could be distributed with Zope. Yes, but in the proposal Andreas mentions the GPL, not the ZPL, and that is what throws me off. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] using php on zope
On Fri, 8 Jun 2001, Stian Jenssen wrote: Hi there! Hello :) I wan't to use php with zope, does anybody know how the header syntax shall look like? Tried diffrent syntaxes but i get wierd outputs, not as expected. Try this one: URL:http://www.zope.org/Members/Mamey/PHP. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Bulletproof ZCatalog proposal
On Thu, 7 Jun 2001, Shane Hathaway wrote: It really doesn't matter how many conflicts there are. Within a single transaction, 1 conflict is as bad as 100. Why? But I think I have a solution for all of the issues in conflict resolution. Whee! If you, or anyone else, is also interested in this, please show support (if only by saying please do this!) :-) I can't work on it unless I have a reason to. Please do this! ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Server hanging :-(
On Wed, 6 Jun 2001 [EMAIL PROTECTED] wrote: ... at least then we know what the exception is. : Again - try that code in an interactive interpreter if you really want to find out what's going on... Yeah, thanks, that would work as a workaround, but isn't this buggish behaviour? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 60GB Data.fs?
[no cross-posting, please] On Wed, 6 Jun 2001, Bjorn Stabell wrote: We're planning a Yahoo! Clubs like system that should scale to about 30, 000 users. Assuming about 3,000 groups and 20MB per group (group functionality includes photo albums), gives a database size of 60GB. Assuming on average 3,000 users per day, 20 page views per users, gives about 60,000 page views (not a lot, but if it's all dynamically generated?). You're going to need some serious hardware for that. You could do a lot with your setup though (ZEO, RDBMS, distributed application-programming) but I don't have much experience to share on that. In a scenario where each box (if you have several) has its own 60GB Data.fs I'd be worried about disk-activity for one. It seems to me (with my petty 1GB Data.fs) that it is the disks rather than ZODB itself that slows things down. At this scale, how would ZODB hold up with respect to memory use and speed? I've heard rumors that it loads an index into memory on start-up. I'm running a 1GB Data.fs with CompressedStorage here and that takes probably about 3-5 minutes on a 1GHz with 1GB RAM. I keep banging my head against it, but it just won't run faster. Let us know how that project progress, will you? :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 60GB Data.fs?
On Wed, 6 Jun 2001, Erik Enge wrote: I'm running a 1GB Data.fs with CompressedStorage here and that takes probably about 3-5 minutes on a 1GHz with 1GB RAM. I keep banging my head against it, but it just won't run faster. Oops, misleading you there. Actually, FileStorage uses about 40 seconds to initialize the Data.fs. Can't complain about that. (Although 60GB might not be too fun ;) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Server hanging :-(
On Wed, 6 Jun 2001, Richard Jones wrote: http://www.zope.org/Members/anthony/BarewordExcepts Feel free to find the bad except: and submit a patch... Ugh. There are tons of them... I'll see what I have time for. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: SV: [Zope-dev] 60GB Data.fs?
On Wed, 6 Jun 2001, Magnus Heino (Rivermen) wrote: Where can I get PartitionedFileStorage? Here: URL:http://www.zope.org/Members/hathawsh/PartitionedFileStorage Didn't show up in any searches, though. Maybe worth indexing? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 60GB Data.fs?
On Wed, 6 Jun 2001, Matt Hamilton wrote: Out of interest, is this startup time avoided when using BerkeleyDB as the storage? I know that it has its own indexes etc. so I am wondering if it no longer needs to load an index into memory. I'm not sure, but as I said in a previous oops-correcting-myself-mail it actually only uses 40 secs - FileStorage, that is. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] [Announce] API Documentation Fishbowl Project
On Mon, 4 Jun 2001, Amos Latteier wrote: I encourage you to check it out and leave your comments, criticisms, and suggestions. I like. That pretty much captures it :) There is one thing, though. Let's say I have this class NiceBigCar. The developers docs from what you suggest are fine, but how about semantics for adding users/clients/otherpersons docs as well? I know it's only documenting API's but surely the users use the API at some level too. Is it meant to be like this: NiceBigCar/ doc/ dev/ user/ for example? I love the AOP stuff and I can't wait to start fiddling with it (once TW is out for Python 2.1) and I just wonder if there is an easy way of combining this weaving-effect with documentation. I don't know, it might be out of scope, or maybe the proposal takes care of that already, just in a different way. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Server hanging :-(
On Sun, 29 Apr 2001, Erik Enge wrote: I'll try to do an hour or so of analysing this tomorrow, and I'll get back to you. :-) Well, now we all know what vikings believe an hour or so mean, don't we? I figured it out, I think. Let's say I have these two methods: def a(): b() def b(): a() If I call a(), then Zope dies and restarts without giving me any error at all. Anyone got a clue? Makes debugging a bit tedious sometimes. I added a couple of print's in the methods and it seem to call them both many times before dying. I seem to remeber some ExessiveRecursion or some such error that popped up on me a year or two ago, has that left for happier hunting fields? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] SearchIndex: is this behaviour in 2.4?
Hi, sorry I can't test this myself. I get this behaviour in 2.3.2, and I find it strange. I'd classify it as a bug. If I pass this query to a TextIndex: (word1 OR word2) AND (word3) it is first translated to this: [['word1', 'or', 'word2'], 'and', ['word3']] which is fine. But then, after query_hook() in GlobbinLexicon.py: [['word1', 'or', 'word2'], ['word3']] and then the default_operator (Or) is used (by parse2()/query() in UnTextIndex.py, I think), and turns it into: [['word1', 'or', 'word2'], 'or', ['word3']] kinda not what I wanted. Since I always use parens around OR's I can just set the default_operator to And and this solves my problem, but it's still not working correctly. Is this fixed in Zope 2.4? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: Zope 2.4.0 alpha 1 released
On Thu, 31 May 2001, Brian Lloyd wrote: Zope 2.4.0 alpha 1 has been released - you can download it from Zope.org: Cool stuff. I have a couple of comments, though. For future ref., should I post them to the Collector? - lib/python/Products/PluginIndexes/__init__.py is missing the ZPL - why is Catalog.gif in Products/ZCatalog and not in Products/ZCatalog/www like ZCatalog.gif? - the version.txt in lib/python/ says: Zope 2.4.0a1 (source release, python 1.5.2, linux2) which sounds a bit funny in my ears... Might be me, I dunno. The biggest one is the fact that I can't build it, but I think that's a problem with my Python installation. Once I've got it up and running I might do some actual testing, which I'm looking forward to! :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Bulletproof ZCatalog proposal
On Wed, 30 May 2001, Shane Hathaway wrote: I have written a proposal. So, if I understand correctly, when this is implemented, will the ZCatalog always resolve conflicts and never raise ConflictErrors? If there are no ConflictErrors in the main object system? I think I'm missing the point here. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Bulletproof ZCatalog proposal
On Thu, 31 May 2001, Shane Hathaway wrote: How did you miss the point? That's exactly the point! :-) Oh :) Right now ZCatalog randomly generates ConflictErrors even if there are no conflicts in the data being indexed. This is why I think I've missed a/the point: wouldn't it be better to figure out why ZCatalog randomly generates these ConflictErrors instead of making them disappear using other means? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] CompressedStorage
Hi, has anyone given this a good run? I'm a bit confused as to how to make it work. Do I just subclass it in FileStorage? Will it work with existing Data.fs or do I need to start anew, so to speak? Thanks. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] CompressedStorage
On 31 May 2001, Ty Sarna wrote: Zope basically uses whatever object custom_zodb.Storage is as the storage. Ahh... I can feel the zen pouring over me :) What you want to do is create a FileStorage, and wrap it with a CompressedStorage and use that. Your custom_zodb.py would look like: Great! I'll try it... [*] this is simplified for ease of explanation... it doesn't really work this way. Ahh... I feel the zen flowing back from wherever it came... ;-) BTW, DC people... you should feel free to include CompressedStoage in Zope. I'll second that. Also, I'm sure it would be appreciated if anyone (DC or not) took the time to write a HowTo on custom_zodb.py (hopefully more detailed and accurate than above) Much appretiated. I've been Zoping around for, hm, two years now and this is the first I hear about custom_zodb.py - Max M was right, it's hard to put all of Zope into ones head all at once :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wildcards in TextIndex query. Do they work?
On Thu, 24 May 2001, Michel Pelletier wrote: I don't think you are using a globbing vocabulary. I think I am: print_info(applic.Catalog(word='scripto*')) unsplitted ['scripto*'] unl: ['scripto*'] unq: [104623, 'or', 112198, 'or', 151568] Length: 6 Content: [mybrains instance at 1226d358, mybrains instance at 127bb540, mybrains instance at 12bd8138, mybrains instance at 127bb658, mybrains instance at 1226c620, mybrains instance at 12092eb0] print_info(applic.Catalog(word='(scripto*)')) unsplitted [] unsplitted ['scripto*'] unl: ['scripto*'] unsplitted [] unl: [['scripto*']] unq: ['scripto*'] unq: [['scripto*']] Length: 0 Content: [] the unsplitted, unl and unq are my debug flags, but you can see what happens: without parens the '*' has it's desired effect, with, it doesn't. Got a clue? Is this my bug, or ZCatalog's? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wildcards in TextIndex query. Do they work?
On Thu, 24 May 2001, Michel Pelletier wrote: I don't think you are using a globbing vocabulary. But globbing works for other queries. In the same catalog. If you are not using a glob vocab, I suspect it stripped out the ? and is hitting on 'eri'. Do you have that word anywhere? I tried searching for: eri and that gave me four results. No globbing, then? Then again, where did you get these objects? If you were looking at the wrong point in the code, the wildcards may not have been expanded yet. Could be it... [['erik', '...', '...', '...', 'enge']] Where do you see this? I can't reproduce it right now, I'll let you know if I see it again. Make sure you are using a globbing vocab. Note that you can't change a catalog's vocabulary once the catalog is made, so you have to make a new catalog. How can I change it for a new one? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Wildcards in TextIndex query. Do they work?
On Thu, 24 May 2001, Casey Duncan wrote: Works great for me. Perhaps you are using a Vocabulary that has Globbing turned off? I'm not sure, how do I check? This query works: wil?car* This doesn't: (wil?car* or something else) and (word1 and word2) I can't see that the query-parsers in UnTextIndex.py transforms them differently, but I might be missing something obvious. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog/TextIndex: searching for the exact phraseword1word2
On Sat, 19 May 2001, Chris McDonough wrote: 8 words. Not characters. But actually I just looked at the source and it's not even that. It's treated essentially as an AND query, because the UnTextIndex code doesn't store any proximity information between words. ( I knew this once, but I had forgotten. I've done alot of practical testing with it now, and it seems that the exact phrase query might be overrated. So far, the already-available query types have sufficed. I'll let the client to even more testing, but if they don't really need it, I can't justify spending time on it. Obviously :) Well, I know the above is a little hairy, but it's an outline. The first thing to do is to write a fishbowl proposal explaining why it should be done and perhaps how it can be done... As I said, if the client blahblablbalbah, then I'll try a fishbowl proposal. Thanks, anyway, though :-). ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog/TextIndex: searching for the exact phraseword1 word2
On Fri, 18 May 2001, Chris McDonough wrote: You should be able to do this with quotes around the words, but that feature is sort of only half-wired-up at this point. [snip] Currently, quotes around word do the same thing as parens around words (word1 NEAR word2). Sigh. What does NEAR mean, then? How near is NEAR? Is it in line for 2.4? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog/TextIndex: searching for the exact phraseword1 word2
On Sat, 19 May 2001, Chris McDonough wrote: I believe it means within 8 words in the current implementation... So, word1 NEAR wordlongerthan8characters wouldn't come up with anything? Or is it number of characters inbetween? Is it in line for 2.4? No, unfortunately. I'm not sure when it will be on the map. This is an area where someone outside of DC sufficiently motivated to make it work could help. Hey, I'll be glad to help. If you could show me the ropes I'll hack away like, uhm, a hacker! ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] ZCatalog/TextIndex: searching for the exact phrase word1 word2
Hiya, it basically says it in the subject. How can I search for word1 word2 without ZCatalog/TextIndex interpreting it as word1 or/and word2? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
On Tue, 15 May 2001, Chris McDonough wrote: I'll be curious to see the results. Hopefully you'll have better luck under 2.3.1b2. I've indexed about 410.000 objects now. A plain query with 'meta_type' and 'firstname' to searchResults takes about 3-4 seconds. Not too bad, but not that good either. I'm sure I can so something to make it faster, but other than index fewer objects (which I can't do, since I have more objects that needs to be indexed) I don't see what else I can do. Maybe one could design a framework of scalable Catalogs? Just like ZEO does for ZODB? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
On Thu, 17 May 2001, Chris McDonough wrote: I'd be curious to know how long a query that involves only a single field index takes, and how long a query that involves only a single text index takes... does each take a roughly equivalent amount of time? I might be able to check that for you later tonight or during the weekend. What I did to solve my problems was to throw a couple of objects around so that I now only have about 50k objects in the Catalog. Boy it's fast. I like! :) Or is one much faster than the other? If one is not much faster than the other, it's a Catalog issue. If one *is* much faster than the other, it's an Index issue. Have you guys at DC not done testing on this? Maybe we could set up a test-group for each module in Zope, say Catalog/ZCatalog/SearchIndex, that before each release, really beat the living shit about of it? A bit more coordinated. What's an acceptable query time for your application? Are you sorting the results via sort_on? Well, actually, the query time isn't that bad (now with only 50k objects), it's all the problems a big result-set drags along with it that really slows things down. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
On Thu, 17 May 2001, Chris McDonough wrote: Well, that's good, except I thought you couldn't get rid of objects? Muhahaha. I got those little bastards... :) Yes, but not with 1,000,000 objects (see lib/python/ZCatalog/tests/testCatalog.py). It would be nice to have such a report. If I have time, I'll give you such a report this weekend. No promises, though. That sounds good! At least for the Catalog. Want to be a tester? Sure! Just let me know a couple of days (I'd love a weeks notice, but that might be stretching it?) notice and I'll have a go at it and give plenty of feedback (if there is any, of course). Have you read 1984 by George Orwell? Maybe we could have a Hate Week for the Catalog once in a while. Just absolutely find everything one hated about it. Hate the Catalog Week ;) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
On Tue, 15 May 2001, Chris McDonough wrote: YourCatalog.catalog_object(newobject) as opposed from inheriting from CatalogAware and relying on manage_afterAdd or calling object.index_item() manually. That's really it. Well, if you put it that way :) *removing CatalogAwareness* (it's fairly DWIM-ish as well) DWIM? Both CatalogAware and CatalogPathAware need to be fixed somewhat (they need to be replaced with an observer-based cataloger). This is probably my fault at this point, but don't say I didn't tell you not to use them later. ;-) Hehe, ok :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
Thanks for the fast reply! On Tue, 15 May 2001, Chris McDonough wrote: Have you read http://www.zope.org/Members/mcdonc/HowTos/UpgradeToNewCatalog/index_html ? I suspect there will be improvement. Surely there will be improvement, but not of factors two or three, or more? And, I can do the who adding process again, so I don't need to convert the Catalog. If I do not uncomment those things in CatalogAwareness.py I get an error on SERVER_URL. I think it is resolve_url() that tries to make a run for it. What are you referring to when you say those things in the sentence above? Sorry, the lines 181-184 of CatalogAwareness.py: def index_object(self): A common method to allow Findables to index themselves. #if hasattr(self, self.default_catalog): #getattr(self,self.default_catalog).catalog_object(self,self.url()\ ) Have you seen the makerequest.py script inside of the lib/python/Testing directory? It does what you're trying to do when you set applic.REQUEST=REQUEST (the major difference being that it works ;-). I'll check that out. :-) If you read the Zope Developer's Guide testing and debugging chapter from its CVS repository, I believe it's documented in there. If you don't have the lib/python/Testing/makerequest.py file, look on cvs.zope.org for it. Will do :) I'll be curious to see the results. Hopefully you'll have better luck under 2.3.1b2. So I hope. I'll let you know when the results come through; probably tomorrow morning at the earliest. Thanks so far :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog, REQUEST, misc.
On Tue, 15 May 2001, Chris McDonough wrote: Probably not much difference on bare bulk indexing speed, but I'll bet that it finishes this time. ;-) We'll see :) I'd either make my own CatalogAware-alike mixin class that did things a bit differently than CatalogAware (perhaps didn't index on add, and didn't unindex on delete), or I'd just manage the whole lot completely manually. (How often will each of these million objects change?) Not often. But new objects will be added to them quite frequently. Catalog aware ones. CatalogAware is fairly ancient code at this point, and I don't think it was written with the mindset that there would be a million objects in any particular catalog. Hm... I'll give it some thought. If it works the way it is now, I'm sufficiently happy. If not: late nights making ErikAwareness ;). :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Server hanging :-(
On Fri, 27 Apr 2001, Chris Withers wrote: Well, I thought the upgrade to 2.3.2b2 would solve the problem but it hasn't :-( I have a (very important :-S) Zope instance which hangs at what seems like the slightest touch. Maybe I can help. I've seen similar behaviour, and by some chance I discovered what it was that was causing it - which might not be the same thing that is causing your problem. When, in my Zope Python Product, I call a method that does not exist, Zope dies, restarts and then is fine again. If something (another method or a browser perhaps) is calling this method again and again, Zope does a die, restart, rinse, repeat. I think the problem is that it doesn't throw the necessary Exception, or that it actually throws it, but it is somehow captured by a try-except that I've put out somewhere, so it doesn't show. The problem is fixed once I stop calling the non-existant method. I haven't had time to check whether this is the case with the latest version of Zope, but it is with Zope 2.3.1b1, at least. Maybe you have a method that is called when someone access that URL, but that method does not exist? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope Server hanging :-(
On Sun, 29 Apr 2001, Dieter Maurer wrote: Very strange! Indeed. Did you look in the log files? Have their been any core dumps? I'll try to do an hour or so of analysing this tomorrow, and I'll get back to you. :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 27 million objects.
On Thu, 26 Apr 2001, Dieter Maurer wrote: Are the imported object CatalogAware? They are. The old (pre 2.3.1) catalog implementation was know not to be very storage friendly. If a significant portion of the catalog indexes would be affected by imports, then you would see a quadratic storage increase. I'm using Zope 2.3.1b1 so that shouldn't be a problem? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 27 million objects.
On Thu, 26 Apr 2001, Chris McDonough wrote: This level of growth doesn't seem like a sane level of growth... what Zope version are you using? Zope 2.3.1b1 Someone told me that ZEO and bulk-adding could be a thing to look at... Isn't bulk-adding what you're doing now? It is, but I'm not using ZEO. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 27 million objects.
On Fri, 27 Apr 2001, Chris Withers wrote: Erik Enge wrote: I'm using Zope 2.3.1b1 so that shouldn't be a problem? Yes, it will be. [...] So the bug in Zope 2.3.1b1 which makes the ZODB grow dramatically is gone in Zope 2.3.2b2? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 27 million objects.
On Thu, 5 Apr 2001, Michael R. Bernstein wrote: I'm trying to find out of there is a point where you start getting non-linear performance penalties for additional objects (storing, retreiving, or indexing). I've just finished adding a somewhat small number of objects: 5000. For every 1000th object, the Data.fs seemed to grow to about 900MB; that's when things started going slow, in a non-linear fashion (this is more a hunch than something I payed much attention to). I paused the script (fancy Unix-command: ^Z) for every 1000th object, packed the database (which shrunk to 19.5MB! Hmpf.) and restarted the script (again, fancy Unix-command: fg). Then I was back to the same speed as I initially had. Does ZODB have a problem with big Data.fs files? Not that I know. However, I do have a really fast SCSI-subsystem here so that shouldn't be a big problem either. I did some copying around with a couple of gigs, and it seems that my hunch is right: ZODB does not have a problem with big Data.fs files, the hardware does. This could be caused indirectly by ZODB if it does too many operations on the file, but I'm not too conserned about that. Ie. a solution could be to have ZODB play around with the Data.fs at a less frequent pace, or do it in another fashion. However, that's not really solving any problems, unless ZODB is a total maniac with the filesystem. I'm converting to ReiserFS this afternoon, maybe that will improve things a bit. Someone told me that ZEO and bulk-adding could be a thing to look at... ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Splitter.c hack by Spisak; anyone have a Splitter.so?
Hola, please don't make me touch C or a ... erm... you know, one of those compiler-thingys. I don't like them. Does anyone have a nicely baked Splitter.c for Linux? The one that Spisak hacked to make it chew and swallow anything? Fhank you very much. :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] How to choose: Or, Not and And when using searchResults().
Hi, I was wondering, is there a way I can choose whether I want searchResults to Or, Not or And the search? Or do I need to combine searchResult calls and what not? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] How to choose: Or, Not and And when using searchResults().
On Wed, 18 Apr 2001, Chris McDonough wrote: You need to manually do unions or intersections on results from multiple calls to searchRequest currently. Is this a feature to be implemented? If not, why not? Oh, and by the way, "searchRequest"? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Catalog Indexes.
I need some help with indexes. I'm confused about what I can index in which Index. Which index does not remove numbers? Which of them do I use to index a telephone number (containing characters). What about email addresses? Special characters? *oink* Help... ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 27 million objects.
On Thu, 5 Apr 2001, Michael R. Bernstein wrote: I'm trying to find out of there is a point where you start getting non-linear performance penalties for additional objects (storing, retreiving, or indexing). I don't know, but I feel that is the case. Actually, I know it is the case, but I don't know what is causing it. I know what isn't helping though; CatalogAwareness. I added 2000 objects with XML-RPC. No other queries were done during that period. For each object about 70 DTML Method/Documents were added. The first couple of hundres went with a pace of 2-3 seconds per object. After that it started to get real slow, and when I reached about 500 I was down to 5 seconds per object. I killed that script, rewrote it to only add 20-25 DTML Methods/Documents and removed the CatalogAwareness and whoosh! Under 1 second for each object and it stayed like that for the entire 2000 objects. The server is a 1GHz thingy with 1GB RAM. It wasn't working too hard - it seemed. Meanwhile Erik, what approach *did* your programmer take? Well, the obviously more correct one. :) He just made the files (that I were going to index in a Catalog) stay on the filesystem and wrote some nice regexps to do the searching I though I needed the speed of the Catalog to do (yeah, yeah, I'm a rookie). Thanks Jim! :) I'll look forward to it. Ok, and you know what to do if you haven't heard from me and the year is not 2001 any more ;) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Catalog Indexes.
[observe the speed of Chris replying... *astounded* :)] On Mon, 9 Apr 2001, Chris Withers wrote: Erik Enge wrote: I'm confused about what I can index in which Index. Which index does not remove numbers? FieldIndex, KeyIndex Wow, KeyIndex? Is this a new one? Or did you mean KeywordIndex? Which of them do I use to index a telephone number How would you like to search that index? I'd like to find this telephone number (it is a string...): +44 1234 123456. Likewise... As above, passing the string to searchResults; "[EMAIL PROTECTED]" f ex. You probably want a FieldIndex but it might not be searchable in the way you want... Which one would? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] 27 million objects.
Hi, Michael. Sorry for taking so long getting back to you. The programmer solving our problems with the post codes has solved it in a different way than what I would've done (his method is way superior), so we're not ending up adding all addresses as Zope Objects. Therefore, I don't have any benchmark tests available. We are going to transfer some 10GB of data at a later stage though (within a month), and that could result in some tests being done - if so, I'll send you an email. :-) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Could not load state?
On Tue, 27 Feb 2001, Chris Withers wrote: I've started seeing errors like this: Hm. It might be related to the problem Andrew K. is seeing over at [EMAIL PROTECTED]? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Could not load state?
On Wed, 28 Feb 2001, Chris Withers wrote: Are there archives for that anywhere? There sure is... URL:http://lists.zope.org/pipermail/zodb-dev/2001-February/thread.html ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] REQUEST.steps
On Wed, 28 Feb 2001, Chris Withers wrote: Is it alright to rely on this attribute of the REQUEST object? Hm What is 'steps' in context of REQUEST? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope 2.3.1b1, strange things when ConflictError.
On Sun, 25 Feb 2001, Steve Alexander wrote: I wasn't reading the code clearly the first time around. By far the simplest place to return copied results from methodB is to change the last line to Thanks, it all works nice. Nearly, that is. The reverse problem is now gone. But the fact that every time I get a ConflictError it doesn't "flush" the 'objects' of methodB, and just seems to append to it, still remains. I only get this when a ConflictError occur. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope 2.3.1b1, strange things when ConflictError.
On Mon, 26 Feb 2001, Erik Enge wrote: I only get this when a ConflictError occur. Nope, it occurs every time I change to another object. I need to do some more testing here. It seems as if the 'objects' variable of 'methodB' is semi-persistent or something. Weired. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope 2.3.1b1, strange things when ConflictError.
On Mon, 26 Feb 2001, Steve Alexander wrote: Chris McDonough wrote: The use of a literal anonymous list in methodb's signature for "objects" may have something to do with the results you're getting on conflict. Try assigning "objects" to an empty list in the method body instead. Of course! I'm missing out on something here. Why is this an "of course"? What's a "literal anonymous list"? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Zope 2.3.1b1, strange things when ConflictError.
I have two nice methods. One of them (methodA) is called via the web. These belong to one class; classA. class classA: "doc string" def methodA(self): "doc string" objects = self.methodB(self) objects.reverse() attrib = '' for object in objects: attrib = attrib + 'some html' return attrib def methodB(self, object, skip=[], stop=[], objects=[]): "doc string" try: if object.meta_type in skip: return self.methodB(object.getParentNode(), skip, stop, objects) if object.meta_type in stop: raise AttributeError else: # I don't think I need this. if object not in objects: objects.append(object) else: raise AttributeError return self.methodB(object.getParentNode(), skip, stop, objects) except AttributeError: return objects Narrative story: The user calls methodA (from a instance of classA) through the web. methodA returns some nicely formatted HTML navigation links. methodB should traverse through the objects with getParentNode(), append the object in the list objects (if its meta_type is not listed in 'skip' or 'stop' - which are "skip meta_types" and "stop_meta_types" lists) and return them to methodA for formatting. The objects should be listed in the list that is returned sequentially and methodA would be required to do an objects.reverse() to make sure we are facing the right direction. First of all, this doesn't work very nicely. Every other time I refresh my webpage (ie. call methodA) it seems to reverse() the list returned from methodB on its own. That's strange. This results in: [instance1, instance2] and [instance2, instance1] every other time. *baffled* Now comes the part which really makes me want to go to my hotelroom and watch Life of Brian on BBC at 9.00pm; if I refresh the webpage quickly, and many times (not too quick or too many times; 2-5 times within 2-5 seconds) I get a ConflictError raised in my log - it doesn't take it up to the webpage. There is other stuff going on which causes the ConflictError to get raised (although, I'm only _reading_ from a ZCatalog, as far as I know anyway). Heres what I don't understand. When ever I get a ConflictError, the contents of the 'objects' attribute in methodB isn't "flushed". Thus, resulting in a very long navigation bar with repeating links. Let me repeat that: The attribute 'objects' of the method methodB appears to be persistent. Which it isn't of course. My best guess is that something is wrong with the logic when a ConflictError is raised. It would make kinda sense. Tracebacks, beers or other interesting things offered if needed. :) ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Minor typos/changes to ZCatalog.
On Fri, 23 Feb 2001, Chris McDonough wrote: The short answer is "you can't, easily". I'm a bit confused. Will FieldIndexes also behave like TextIndex, in that they remove stop words, digits and so forth? I think I've picked up somewhere that FieldIndexes treats the whole content of the attribute it indexes as one big chunk of .. erm... characters, and doesn't remove anythink? Correct? ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ZCatalog madness. (Must log in as emergencyuser.)
On Fri, 23 Feb 2001, Erik Enge wrote: Feedback and debug information coming your way as soon as possible :) Ok, I index DTML Methods, Python objects, and all different kind of things. Then I did a search, meta_type set to 'DTML Method' and it gave me an unauthorized. Strangeness. I've installed the latest Hotfix, but that didn't make any difference either. ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
