[Zope-dev] Plone Conference 2010 schedule published
Over 400 attendees are set to meet at the 8th annual Plone Conference for a week-long programme of training, talks and developer sprints from the 25th to 31st October at the Thistle Grand Hotel in Bristol, UK. Plone Conference 2010 registrations are open. Plone, an Open Source Content Management System used throughout the world has a massive following and Plone events are held around the globe. The largest of these is the annual Plone Conference and this year will be held in the UK. Plone is used for developing websites, intranet and portals for corporations, NGOs and the public sector. Organised by Netsight Internet Solutions, it promises to bring together developers, designers, end users and business people. This year an additional event is being planned as a one-day mini-conference on the 26th October called Plone in Business which will be aimed specifically at analysts, advisors, evaluators and information professionals looking to find out more about Plone and see a showcase of successful Plone projects from across the sectors. It will also see the launch of the JBoye Plone Community of Practice. The main part of the conference, from the 27th - 29th October, has over 50 scheduled talks from speakers from 19 countries and includes an 'unconference' day in which talks will be proposed by the attendees. Plone Conference 2010 scheduled talks include: * Easier and faster Plone theming with Deliverance * Design and Development with Dexterity * Enterprise Search in Plone with Solr * Boosting productivity with Plone-driven Plone development * Brasil.gov.br: Building a digital nation with Plone Alan Runyan, co-founder of Plone and president of Enfold Systems along with Alex Limi, fellow co-founder of Plone and now Firefox User Experience Lead at Mozilla will be delivering a keynote. There will also be a guest keynote by Richard Noble, OBE, project director of the Bloodhound SSC project attempting be build a car to pass the 1,000mph land speed mark. The conference falls at a great time, with the recent release of Plone 4, a product that raises the bar in the Content Management System market with a faster, more user-friendly and more refined version of the product. So far, registrations for the conference have come from over 30 countries around the world. To find out more about the conference and to register, visit http://ploneconf2010.org. ___ Zope-Dev maillist - Zope-Dev@zope.org https://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - https://mail.zope.org/mailman/listinfo/zope-announce https://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] catalog performance: query plan
Lennart Regebro regebro at gmail.com writes: I would be interested in seeing a bunch of Gurus sit down at some sprint and trying to come up with a catalog engine that is incremental and uses query plans. There is no reason that would not be stupidly fast. :) We can then make a new catalog that uses this engine but has the same API as the old one, to ship with some future version of Zope, say 2.12. There is the Plone Performance sprint we are hosting in Bristol, UK on the 11th - 14th Dec. http://plone.org/events/sprints/bristol-performance-sprint Whilst it is billed as a Plone sprint, of course much of the speedups can be done at the Zope level, so Zope-only developers are more than welcome :) This is exactly the kind of thing that I like hacking on personally, so would love to see it worked on at the sprint. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Understand. Develop. Deliver http://www.netsight.co.uk +44 (0)117 9090901 Web Design | Zope/Plone Development Consulting | Co-location | Hosting ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Python2.4 and Zope 2.7
Hi All, I'm having some trouble getting python2.3.4 running on FreeBSD 5.3b7 on an AMD Opteron, so for kicks tried python2.4rc3. It managed to pass the recursion regex test in test_re.py that was causing python2.3.4 to barf, but in trying to start Zope with python2.4rc3 I get the error below. Does anyone here know if Zope 2.7.0 should work with python 2.4? -Matt zeo1# bin/runzope /usr/local/lib/python2.4/whrandom.py:38: DeprecationWarning: the whrandom module is deprecated; please use the random module DeprecationWarning) Traceback (most recent call last): File /usr/local/Zope-2.7.0/lib/python/Zope/Startup/run.py, line 49, in ? run() File /usr/local/Zope-2.7.0/lib/python/Zope/Startup/run.py, line 18, in run opts = _setconfig() File /usr/local/Zope-2.7.0/lib/python/Zope/Startup/run.py, line 41, in _setconfig opts.realize(doc=Sorry, no option docs yet.) File /usr/local/Zope-2.7.0/lib/python/zdaemon/zdoptions.py, line 264, in realize self.load_configfile() File /usr/local/Zope-2.7.0/lib/python/zdaemon/zdoptions.py, line 308, in load_configfile self.zconfig_options) File /usr/local/Zope-2.7.0/lib/python/ZConfig/loader.py, line 43, in loadConfig return _get_config_loader(schema, overrides).loadURL(url) File /usr/local/Zope-2.7.0/lib/python/ZConfig/loader.py, line 71, in loadURL return self.loadResource(r) File /usr/local/Zope-2.7.0/lib/python/ZConfig/loader.py, line 183, in loadResource self._parse_resource(sm, resource) File /usr/local/Zope-2.7.0/lib/python/ZConfig/loader.py, line 234, in _parse_resource parser.parse(matcher) File /usr/local/Zope-2.7.0/lib/python/ZConfig/cfgparser.py, line 63, in parse section = self.end_section(section, line[2:-1]) File /usr/local/Zope-2.7.0/lib/python/ZConfig/cfgparser.py, line 116, in end_section self.context.endSection( File /usr/local/Zope-2.7.0/lib/python/ZConfig/loader.py, line 201, in endSection sectvalue = matcher.finish() File /usr/local/Zope-2.7.0/lib/python/ZConfig/matcher.py, line 170, in finish return self.constuct() File /usr/local/Zope-2.7.0/lib/python/ZConfig/matcher.py, line 212, in constuct v = v.convert(ci.datatype) File /usr/local/Zope-2.7.0/lib/python/ZConfig/info.py, line 65, in convert return datatype(self.value) File /usr/local/Zope-2.7.0/lib/python/Zope/Startup/datatypes.py, line 106, in importable_name package = __import__(n, g, g, component) File /usr/local/Zope-2.7.0/lib/python/DBTab/ClassFactories.py, line 18, in ? import OFS.Uninstalled File /usr/local/Zope-2.7.0/lib/python/OFS/Uninstalled.py, line 16, in ? import SimpleItem, Globals, Acquisition File /usr/local/Zope-2.7.0/lib/python/OFS/SimpleItem.py, line 27, in ? from CopySupport import CopySource File /usr/local/Zope-2.7.0/lib/python/OFS/CopySupport.py, line 549, in ? action ='manage_main',) File /usr/local/Zope-2.7.0/lib/python/DocumentTemplate/DT_String.py, line 474, in __call__ try: result = render_blocks(self._v_blocks, md) File /usr/local/Zope-2.7.0/lib/python/DocumentTemplate/pDocumentTemplate.py, line 202, in render_blocks cond=md[cond] File /usr/local/Zope-2.7.0/lib/python/DocumentTemplate/pDocumentTemplate.py, line 140, in __getitem__ v = self.dicts[key] File /usr/local/Zope-2.7.0/lib/python/DocumentTemplate/pDocumentTemplate.py, line 100, in __getitem__ raise KeyError, key KeyError: 'v' -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd.Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Design | Zope/Plone Development Consulting | Co-location | Hosting ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: Python2.4 and Zope 2.7
chrism wrote: FWIW, the fact that you get the error at that point means that cDocumentTemplate can't be imported (it's using pDocumentTemplate, which nobody uses since it's a fallback). This is probably the root of the problem. I suspect pDocumentTemplate would give the same error on any platform. I would start investigating why cDocumentTemplate fails to import. Doh! I bet it is because I have copied over the install from one of our other servers, and the C components will have been compiled with py2.3, and hence probably not imported successfully into py2.4. Before I realised this I did a fresh install, using Zope 2.7.3b2 and py2.4a3 and after I got all the modules I needed recompiled for py2.4 (PIL, GD, 4Suite, etc.) I started Zope and is still crashed with a Bus Error. Which was what I was getting with py2.3 on FreeBSD/AMD64. So it looks like it just gets a little further with py2.4, but there are still problems. I'll try and get the recursion limit a bit lower and see if that helps it get through. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd.Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Design | Zope/Plone Development Consulting | Co-location | Hosting ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] Re: http://collector.zope.org/Zope/1347 - Zeo help
Laurence laurence at fluxinc.com writes: I'm running FreeBSD 5.2.1 (Current as of last night) with Zope 2.7.0, Postgresql 7.4.2, Python 2.3.3 and psycopg-1.1.13. Laurence, Yes this sounds like the FreeBSD thread stack size being too small. If you compiled python from the ports, then look in the Makefile for somethink like WANT_REALLY_HUGE_STACK and set that. eg. make WANT_REALLY_HUGE_STACK=yes install clean -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd.Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Design | Zope/Plone Development Consulting | Co-location | Hosting ___ Zope-Dev maillist - [EMAIL PROTECTED] http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] CatalogAware Products and PropertyManager
On Thu, 13 Dec 2001, Dirk Datzert wrote: Hi, has anybody written a some hotfix-like product which makes the PropertyManager more CatalogAware ? I knew now that adding, changing, deleting properties of a CatalogAware object will not reindex the object, but I want to say that this would be a central point of interest of me. There is a similar Hotfix to make DTML Documents CatalogAware, I think it is called DocumentTools. It might work for what you are doing, or could be modifiable for your needs. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Zope server speed
On Thu, 6 Dec 2001, MANOTTI Alessandro wrote: I used Zope with DCOracle2 drivers to connect and extract 257000 (yes! it is a test... two hundred fiftyseven thousand records!) and Zope took more than 10 minutes, since I stopped it after that time (call SQL and print data via dtml-var ... TAG). That is quite a lot of records :) Out of interest, why test pulling out that many records? Does your application need to return that many records to the user? Can calculations be done in a stored procedure or something. I've never tried doing anything like this, so I don't really know what I'm talking about :) however I would have thought that it doesn't sound like a particularly realistic test (not that I know what your application does). I wonder how fast Zope is compared to CF in doing, say, 1000 repeat requests each of, say, 1000 records. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB
On Tue, 4 Dec 2001, Chris Withers wrote: (it can do boolean searches too, but the book is mainly about ranking). Please god tell me they cover phrase matching :-S No they don't really (if I remember right). I think they do talk about storing the position of the word in the document, so that could help. I need to dig the book out, I looked at it about 18 months ago. [snip headf*ck] Urm, maybe they'll take it a little slower than that? ;-) Yes they do. Condensing ~500 pages into one paragraph is a bit tricky :) -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB
On Tue, 4 Dec 2001, Casey Duncan wrote: Can you all recommend any other books on information retrieval? I was looking at Amazon last night, and I found a few that looked interesting, I'm just the type of guy that has to leaf through before I buy the damn thing. I guess I just need to find a good tech book store around here... Modern Information Retrieval by Ricardo Baeza-Yates and Berthier Ribeiro-Neto is pretty good too. Covers much more than just indexing (eg. user interfaces, languages, evaluation of effectiveness, distributed IR, Digital Libraries etc). If you are a member of the ACM there is lots of IR stuff in their digital library. Also the New Zealand Digital Library (www.nzdl.org) has some good links on it (the site can be quite slow at times) I think my first real proposal of any significance will be to replace the catalog with a truely industrial strength indexing bohemoth, that can be plugged into this whole component arch. thingamawhammy. BTW: I still wanna chat some time about this, I just need to decide when, perhaps late next week... I've normally got a window open on #zope most of the day (GMT), my nick is HammerToe (long story, that is not as interesting or painful as it sounds, and involves neither a hammer nor a toe). You might need to /msg me or beep me to get my attention :) -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Searching/Indexing/ZODB/SQL/BerkleyDB
On Thu, 29 Nov 2001, Chris Withers wrote: I would rather avoid having to use a relational database unless I have to. Perhaps the index pluggability could be made to support different backends (like FileStorage et al does). Yeah, unfortunately, the difficult bit is combining queries: gimme the results where index1=='fish' and index2 is between 2 and 5kg. if index1 is in SQL and index2 is in ZODB, for example, how would you go about efficiently combining results? Is there not a set datatype in python that could be used? Admittedly, most of the stuff in MG is about textual searches rather than exact searches (it can do boolean searches too, but the book is mainly about ranking). It uses an algorithm called the 'Cosine Ranking Algorithm'. Basically if you imagine an N-dimensional space, where N is the number of terms in your vocabulary and represent a document as a vector in that space whose direction is the composite of the terms that appear in it. You then represent a query string as a vector in the same space, the similarity between the document and the query is the angle between the two vectors... the smaller the angle the greater the similarity. Still with me? :) -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Catalog improvements
On Wed, 28 Nov 2001, Andreas Jung wrote: I think the software MG from the book Managing Gigabytes is GPLed and currently released as mg-1.21. Walking through the TOC of the book, it seems to be a very detailed sources about text processing and gives very much informations about different indexes types. But I miss some explanations about current data structures like suffix arrays or suffix tree that have several advantages for text processing compared to B-Trees. Suffix Trees/Tries take up a *lot* of space. But they are very fast, and useful for searching for substrings. The main gist of the stuff in 'Managing Gigabytes' is that it is possible to store an ascending list of integers in a compressed form, such that on average each integer requires only 4 bits to represent it. This is obviously much more compact than a straight list of 32 or 64 bit integers/longs (plus any overhead python adds to its inbuild list type). The other point is that you can read and decode the lists very quickly (you don't need to decompress the entire list first before reading it). Also consecutive numbers only take 1 bit of storage, this means that 'stopwords' that are normally omitted from indexes due to their very high frequency (and hence bloat of the index) can be stored very efficiently. One problem is that all of the research done in MG is based on much older hardware than is currently availible and they try to make certain optimisations, which nowadays don't save much time. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Catalog improvements
On Tue, 27 Nov 2001, Andreas Jung wrote: Is this code available for public ? Sort of :) It used to be around, but the server with it on is currently offline and in need of a new disk controller, so it is not to hand. It is also poorly commented :( and written in very highly optimised (read: illegible) C. The main bits needed from it are the routines to store an retrieve compressed lists of ascending integers (ie. used in indexes). I want to write a python wrapper around them and release a list-like python data structure that will allow efficient storage of indexes. The other bit is the code for doing the cosine ranking similarity comparison in order to rank the documents in order of relevance to a query. Most of the code is taken from the book/code 'Managing Gigabytes' by Witten, Moffat Bell (http://www.cs.mu.OZ.AU/mg/) The code is quite old now (1999) and designed for quite large systems, or reletively static text (ie. doesn't do incremental indexing very well). I worked on developing a 'forward' index which could be easily updated, and then inverted quite quickly on a regular basis (since it didn't need to parse the source text again). -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] How to aquire from Context?
Dear All, I have been trying to work out how to acquire a DTML method first by context rather than by containment. According to the ZDG (Great read, thanks guys!): -- snip -- Containment Before Context If in the example above suppose both a and b have an color attribute: a=C(a) a.color=green a.b=C(b) a.b.color=red a.x=C(x) print a.b.x.color # prints green Why does a.b.x.color acquire color from a and not from b? The answer is that acquisition acquires from the containment before context. -- snip -- Now that makes perfect sense to me and I can see why it happens as such. However what if I want print a.b.x.color to return red? The scenario is this: I have a directory structure: / standard_html_header side_bar folderA foo bar side_bar index_html index_html calls standard_html_header which in turn calls side_bar. If I access this via /folderA/index_html I still get the side_bar in the root not the one in folderA. This makes sense in respect to the above ZDG stuff. But how can I get it to work the way I want (/folderA/index_html uses folderA/side_bar)? I've searched zope.org and found plenty of explainaintions why this is so, but no good examples or workarounds as how to get around it :( Any ideas? -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Request for a Pluggin Index (NameIndex)
On Mon, 11 Jun 2001, Chris Withers wrote: Wow Matt, you seem to know what you're talking about :-) My final year University project was to create an Open Source mailing list archive :) I did quite a bit of reading into information retrieval and assorted algorithms and data structures. I had a prototype running for quite some time, but is currently down as I am wiping the machine to start again in python :) The original system was a mix of C/Perl/Python and returned results in XML which then were formatted via XSLT. Once I get a spare minute I am going to try and re-implement it in Python and using ZODB (with BerkeleyDB storage) I might try and port some of the code over to work as a PluggableIndex too. One of the main tasks is to write a python wrapper around my compression code. I will have to look more closely at how to write Python modules in C, as it does lots of bit twiddling which is in a very tight loop. The object will basically be a compressed list to which you can append ascending integers and will allow various fast union/intersection operations with other similar objects. This in itself may be sufficent to use in a PlugginIndex. If you get a chance to implement the index I asked about, please gimme a shout, I'd love to try it out... Unfortunately I don't have the time. Unless I can use it myself directly in a project we have funding for (or unless anyone wants to fund my time to develop it) I will have to wait until I have some more time on my hands. PS: Whereabouts in the UK are you? Bristol. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] 60GB Data.fs?
On Wed, 6 Jun 2001, Erik Enge wrote: I'm running a 1GB Data.fs with CompressedStorage here and that takes probably about 3-5 minutes on a 1GHz with 1GB RAM. I keep banging my head against it, but it just won't run faster. Out of interest, is this startup time avoided when using BerkeleyDB as the storage? I know that it has its own indexes etc. so I am wondering if it no longer needs to load an index into memory. Also how are the disks layed out? Is it possible to have, say, 5 disks each on their own (no RAID) and then split the data.fs over them using PartitionedFileStorage or similar. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Request for a Pluggin Index (NameIndex)
On Tue, 5 Jun 2001, Chris Withers wrote: Looks like you should write your own index type. Zope 2.4 comes with an PlugableIndex interface to allow third-party indexes to be integrated into the Catalog. Yeah, I know all that, and I'm very much looking forward to playing with this. :-) However, the email was an invitation for anyone who's interested and currently has time on their hands (yeah, I know, there's lots of us like that ;-) to have a go at writing the index type for me... I would like to help if I had time :) I think the most efficient way of doing what you want is to construct an index based on a 'Suffix Trie' this essentially allows matching of arbitrary substrings very quickly, the only problem is that it takes up a fair amount of space. The upside is that it can be updated and incrementally added to quite easily (unlike many inverted list implementations). I confess I have not had the chance to look at the pluggable index types in 2.4, but would really like to as I would like to port over some indexing code I was working on for another project that allows compressed storage of inverted lists for indexes. On average you can store a 32-bit document id/ref in around 4 bits, which means you save a lot of space and can keep stopwords in the lexicon (as an example try searching for 'to be or not to be' in an index that removes stopwords :). Not only do you save space, but due to the way the inverted list is read and decompressed you save time on disk access for large indexes as there is less to physically read. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ANNOUNCE: Zope 2.4.0 alpha 1 released
- the version.txt in lib/python/ says: Zope 2.4.0a1 (source release, python 1.5.2, linux2) which sounds a bit funny in my ears... Might be me, I dunno. Actually I have wondered something about that... Why does it always show up as linux2 even when not on linux? I'm on FreeBSD using a compiled from source python and Zope and it still shows up as Linux. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Randomness (RE: [Zope-dev] CoreSessionTracking 0.8)
On Fri, 25 May 2001, Chris McDonough wrote: Bummer. How long is the session data container timeout set for? Are you sure you're just not exceeding the timeout? The session timeout is 120 minutes. I am using an external SessionDataComainter stored in the normal undo-able ZODB (I'm not expecting that much traffic to it). Looking into it further I don't think it is a CST fault :) I think I have fixed the problem. It was me not setting _p_changed on an object with a dict after adding items to the dict. Hence the session wasn't being lost, just the conents of the cart itself were not very persistent :) I'll be able to confirm this later today. Yes, any sort of object can go into session data... there are some caveats documented in the helpfile (for instance, acquisition-wrapped objects shouldn't be stored in session data), but otherwise anything's game. I can't find anything about acquisition-wrapped objects in the helpfile, what is the problem with them? -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: Randomness (RE: [Zope-dev] CoreSessionTracking 0.8)
On Thu, 24 May 2001, Chris McDonough wrote: These it appears CST is unstable reports are helpful to an extent (from Bjorn, Joachim, and Howard), as it lets me know that something needs to be done to CST. However, a much more helpful report would be one which provides a repeatable test case which invariably reproduces the problem instead of one which states the symptoms and effects of the problem. Just to add myself to the list, I too am having problems with CoreSessionTracking :( I am trying to find a test case for the problem, but I really can't replicate it. It first I thought it was a cookie issue, but I am now noting down the session id generated and it stays the same even when my session data is lost, so I don't think it is that. what I experience: I add an item to my shopping cart system and it shows up fine, all state is maintained. If I however leave the page and not touch anything for a couple of minutes and then reload the page, the cart is now empty. I know this is not that helpful, but I'm trying to tie it down myself! One thing that I do need to check though -- I am right in assuming I can insert complex objects into the SessionData right? I have an 'Order' class that amongst other things has a dict containing instances of a 'Product' class. The Order instance is stored in the SessionData. As I said it appears to work fine and I can add and delete items from my Order fine. Just it randomly looses it now and then. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] Asyncore in an external method
Dear All, I have just written a parallel whois lookup as an external method. It uses Asyncore to handle the parallelism. It works fine from the command line, but I am now trying to use it within Zope with not much luck the request just hangs the server. I have just wondered, can this actually be done? I know Medusa uses asyncore -- can a method within Zope also use it? -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Optimizing Zope
On Tue, 3 Apr 2001, Stefan Bambach wrote: 2.) I tried running zope with apache's cgi, fastcgi over sockets, fastcgi over TCP/IP. Result: Slower than only Zope. Have you tried with a proxy in front? Perhaps try with Squid or Apache as an accelerating proxy in front, this may help with seving images which might free the rest of the server up to do other things. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
[Zope-dev] SessionDataManager oddness
Dear All,
I am trying to add session tracking to a Product of mine. I am trying
to add a SessionDataManager to a Folderish object in the __init__ method
of the class, but having troubles. I think I am importing everything:
from Globals import HTMLFile
from Globals import Persistent
from Globals import default__class_init__
import Acquisition
import AccessControl.Role
import OFS.Folder
from Products.ZCatalog import ZCatalog
from Products.BTreeFolder import BTreeFolder
from Products.CoreSessionTracking.SessionDataManager import SessionDataManager
from Products.CoreSessionTracking.SessionDataContainer import SessionDataContainerMount
from Products.CoreSessionTracking.SessionData import SessionData
try:
from Products.CoreSessionTracking.SessioningInterfaces import
SessionDataManagerInterface
except:
# pre-2.3 Zopes don't have an Interfaces module
class SessionDataManagerInterface:
pass
then in my __init__ method:
ob = SessionDataManager(
id='session_data_mgr', title='', path=None, timeout_mins=20)
self._setObject('session_data_mgr', ob)
However I get an attribute error when trying to add an intance of the
product. _sdc not found.
I have traced it using pdb, and from what I can find out it appears as if
it fails in _setObject. More specifically SessionDataContainerMount
seems to not returning the correct thing.
I have tried tracing the normal addition of a SessionDataManager in Zope
and it works fine. SessionDataContainerMount doesn't have an __init__
method, but it looks like when I add a S.D.M via the normal web interface
__of__ gets called, but when my product tries to add it __del__ gets
called.
Any ideas? I am at the end of my Zope internals knowledge if there is
anything else I can provide to help diagnose, let me know.
TIA,
Matt
--
Matt Hamilton [EMAIL PROTECTED]
Netsight Internet Solutions, Ltd. Business Vision on the Internet
http://www.netsight.co.uk +44 (0)117 9090901
Web Hosting | Web Design | Domain Names | Co-location | DB Integration
___
Zope-Dev maillist - [EMAIL PROTECTED]
http://lists.zope.org/mailman/listinfo/zope-dev
** No cross posts or HTML encoding! **
(Related lists -
http://lists.zope.org/mailman/listinfo/zope-announce
http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Search Features and Zope Directions Road Map
p.d. Right now I'm quite interested at the technology of searching and finding non structured content, in order to compose structured documents. For example, the guys at Vignette (StoryServer) say that its customers don't need to keyword anything in order to have a "related content" section. After the writer finishes a story, Take a look at http://beta.osdigger.com. It is a mailing list search engine I was working on about a year ago, unfortunately I've not had the time to work on it since. It is designed to scale to doing full text ranked searches on millions of email messages in under a couple of seconds on a single machine (currently PII-300). It has a 'two-step' search feature which brings back related terms to ones you put in (usually :). eg. type in 'scsi controller' and chances are it will return adaptec amongst the list of other terms. The idea is to prompt the user to be more specific with their search. I would love to take more time to work on it again, and would like to be able to access it from withing Zope and use it to catalog arbitary Zope object like ZCatalog does. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Introducing ZopePrints.
On Wed, 14 Feb 2001, Andy McKay wrote: Perhaps I need more beer but whats: F=MA? Force = Mass x Acceleration ie. the harder you kick the beer can the faster it will accelerate for any given amount of beer in it. a.k.a why kicking empty beers can hurt your toes less than kicking full ones. (why would you want to kick a full one...?) :) -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] ProxyPass and SiteAccess getting REMOTE_ADDR
On Mon, 12 Feb 2001, William Noon wrote: A simple fix to the proxy module (in proxy_http.c) will create a new header called 'Original-Addr' to contain the client's ip address. Here is a context diff against Apache 1.3.14 that should work even in the new 2.0 servers: FYI, there is an apache module that already does this. I can't remember the name offhand, but it creates a similar header called something like X-Original-Addr. The module works in two parts and is both 'client' and 'server', so that if you have two apache processes one prxying to the other, the first will generate the header, and the second will recognise it and set the appropriate variables. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Virtual Host Monster Paranoia
On Tue, 13 Feb 2001, Chris Withers wrote: Right, I really like the idea of these things but I am concerned about something that allows anonymous users to futz with traversal. Can someone put my fears to rest that using these won't let anonymous users do bad things to my sites? I use them in conjunction with Apache's mod_proxy to rewrite http://www.simpledomain.com to the long http://zopehost.foo.com/blah/blah/VirtualHostMonstser/blah/blah. The Zope host is behind a firewall, so anonymouse users cannot get to it directly. -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] Hard set port number in 2.3?
On Fri, 9 Feb 2001, Toby Dickenson wrote: Tim Ansell wrote: But now with zope 2.3.0 it keeps writing urls going to the firewall box on port 8080 instead of port 80 like it previously did. Anyone know how to fix this problem? Where i should look? I have noticed the same thing when I dived head-first into using V-H-M, and had to back-peddle quite quickly to SiteRoot. I noticed there was a commit two weeks ago to VirtualHostMonster.py, something about fixing paths, so I might give that a try and see if it fixes the problem :) -Matt -- Matt Hamilton [EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Co-location | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] Mail and zope
originated from but most e-mail clients discard custom headers but preserve a 'In-Reply-To' header with the original message-id. Don't count on it! :) I spent quite some time working on a full-text mailing list search/archive system and one of the things I wanted to do was preserve thread informtion. However it was surprising the number of MUAs that did not generate a In-Reply-To header. Mostly it was Microsoft Mail Client and quite a few similar internal mail systems with internet gateways. Also beware that many mailers use the NNTP standard of References: instead of in-reply-to. I would suggest using the Subject line instead and generate some sort of ticket number and store it in the subject line, and put a header in the message body instructing the user to not alter the subject. -Matt -- Matt Hamilton[EMAIL PROTECTED] Netsight Internet Solutions, Ltd. Business Vision on the Internet http://www.netsight.co.uk +44 (0)117 9090901 Web Hosting | Web Design | Domain Names | Colocation | DB Integration ___ Zope-Dev maillist - [EMAIL PROTECTED] http://lists.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://lists.zope.org/mailman/listinfo/zope-announce http://lists.zope.org/mailman/listinfo/zope )
