[Zope-dev] QueueCatalog bug when process all indexes imediatly is checked
Hi, this is with a svn checkout of QueueCatalog. When the process all indexes imediatly is checked I get: 2007-06-16 12:57:44 ERROR event.QueueCatalog error cataloging object Traceback (most recent call last): File /home/perry/Zope/instances/homewaeup/Products/QueueCatalog/QueueCatalog.py, line 425, in _process_queue update_metadata=not immediate_metadata) File /home/perry/Zope/instances/waeup/Products/CPSCore/PatchCMFCoreCatalogTool.py, line 206, in cat_catalog_object idxs = [i for i in idxs if self._catalog.indexes.has_key(i)] TypeError: iteration over non-sequence 2007-06-16 12:57:45 ERROR event.QueueCatalog error cataloging object Traceback (most recent call last): File /home/perry/Zope/instances/homewaeup/Products/QueueCatalog/QueueCatalog.py, line 425, in _process_queue update_metadata=not immediate_metadata) File /home/perry/Zope/instances/waeup/Products/CPSCore/PatchCMFCoreCatalogTool.py, line 206, in cat_catalog_object idxs = [i for i in idxs if self._catalog.indexes.has_key(i)] TypeError: iteration over non-sequence The error is caused by line 393 of QueueCatalog.py def _process_queue(self, queue, limit): Process a single queue catalog = self.getZCatalog() if self.getProcessAllIndexes(): #idxs = None this is wrong it must be idxs = catalog.indexes() else: cat_indexes = sets.Set(catalog.indexes()) immediate_indexes = sets.Set(self._immediate_indexes) if not immediate_indexes or immediate_indexes==cat_indexes: #idxs = None # do all of 'emalso here idxs = catalog.indexes() # do all of 'em Even after applying these changes, the queue still fills up, when process all indexes imediatly is checked. We wanted to disable the QueueCatalog for a mass-data import. -- Gruß Joachim ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] QueueCatalog
Joachim Schmitz wrote at 2007-6-13 13:37 +0200: with the help of QueueCatalog we were able to reduce the conflict errors from around 6000 per day to about 600. Now the question, where can I send questions,bugreports patches ? I think you can send questions into this list. Not sure, that we can provide answers, but you can try... -- Dieter ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] QueueCatalog
Hi, with the help of QueueCatalog we were able to reduce the conflict errors from around 6000 per day to about 600. Now the question, where can I send questions,bugreports patches ? -- Gruß Joachim ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] QueueCatalog moved to svn.zope.org
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Just FYI, since the product seems mostly orphaned I just moved it without asking anyone: http://svn.zope.org/Products.QueueCatalog jens -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (Darwin) iD8DBQFEWLyhRAx5nvEhZLIRAlx/AJ9FloMVzcXbzo++i/0uEsmjrALjfQCghFZG E1z1lCSj5Q0p+hnAyXPLDGA= =PTcA -END PGP SIGNATURE- ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] QueueCatalog Tool Inadvertantly Triggers Indexing
That's great. So, in your case, what triggers the processing of the queue? Did you write a cron job to run at a certain time? Did you modify the hardcoded sleep interval of the Processor.py? Do you manually run it through the ZMI using the portal_catalog 'Queue' tab? Other? -Original Message- From: Dieter Maurer [mailto:[EMAIL PROTECTED] Sent: Saturday, February 19, 2005 12:46 PM To: Ken Wasetis Cc: zope-dev@zope.org Subject: Re: [Zope-dev] QueueCatalog Tool Inadvertantly Triggers Indexing Ken Wasetis wrote at 2005-2-18 12:07 -0600: I've recently installed QueueCalalog (with PloneQueueCatalog) and either I don't understand how it is intended to work (lacks documentation), or it isn't working the way it's intended to. We are using QueueCatalog (a slightly optimized version) without problems. -- Dieter ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
RE: [Zope-dev] QueueCatalog Tool Inadvertantly Triggers Indexing
Ken Wasetis wrote at 2005-2-21 07:41 -0600: So, in your case, what triggers the processing of the queue? We have an external queue processor. Usually, it looks every second whether there is work to do and if so, processes the queue. -- Dieter ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
Re: [Zope-dev] QueueCatalog Tool Inadvertantly Triggers Indexing
Ken Wasetis wrote at 2005-2-18 12:07 -0600: I've recently installed QueueCalalog (with PloneQueueCatalog) and either I don't understand how it is intended to work (lacks documentation), or it isn't working the way it's intended to. We are using QueueCatalog (a slightly optimized version) without problems. -- Dieter ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
[Zope-dev] QueueCatalog Tool Inadvertantly Triggers Indexing
I've recently installed QueueCalalog (with PloneQueueCatalog) and either I don't understand how it is intended to work (lacks documentation), or it isn't working the way it's intended to. My objects, which are similar to the ATFile content type of Archetypes, have PDF or MS Word files attached and bog down Zope if indexing is done on the SearchableText index for these immediately, while users are logged in and doing work during the day. When I configure QueueCatalog to select all of my indexes except SearchableText as ones that should update immediately, it seems to successfully queue a new first object I've created in Plone (and not convert and index the object by doing a portal_transform on its 'file' attachment attribute. This is fine for the first object, but as soon as I attempt to create a second such object, the queue gets processed. The way I understand queue processing is, there are two things that would trigger the processing of the queue: 1) A site manager logs into the ZMI, goes to the portal_catalog's Queue tab and clicks the 'Process' button. 2) The Process class of the QueueCatalog product is a thread and (by default) is hardcoded to sleep for 60 seconds at a time. When it wakes up, it will process the queue. With that in mind, I modified the Process.py to increase the interval fro 60 to 6000 seconds, but my queue still gets immediately processed upon the creation of a second object. Is this a bug, or am I misusing or misunderstanding the tool's design? Thanks in advance for any help - I couldn't find any good pointers on how to use the product. Ken Wasetis SPR Inc. [EMAIL PROTECTED] ___ Zope-Dev maillist - Zope-Dev@zope.org http://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - http://mail.zope.org/mailman/listinfo/zope-announce http://mail.zope.org/mailman/listinfo/zope )
