What I'm really trying to get working is a queue -- multiple files might be added (1 zip per ticket in this case) by different users via a custom UI, but if 10 are added we still only want them processed one at a time.
I have logic in the first step to extract data to manage the queue. I have logic in each step to check if the $cpf:document-uri is tied to the item at the top of the queue. But it's the final step -- pulling the next item out the queue and getting it to the top of the flow that has me stuck. After working through several iterations it's starting to feel like implementing the queue within Info Studio is not the best approach? Thanks! On Thu, Sep 15, 2011 at 11:44 AM, Colleen Whitney <[email protected]> wrote: > Mattio, > > Conceptually, think of the flow as a pipline; you collect batches of > documents, process them, and pour them into the target database. Each > document moves through the flow, and the ticket is a way of tracking progress > of your documents through the flow. CPF does the heavy lifting on each > document that goes through the flow. In general, the problem you'll run into > with your approach, as I understand it, is that CPF is a state machine > operating on individual documents; if you try to restart the whole flow for > every document you handle, you'll run into trouble. > > If what you want to do is collect and unzip a zipfile, then process the > extracted files, I think you'll have better luck creating a custom collector > that unzips the files before they're inserted. You might even be able to > just nab the zipfile collector that Pete Aven has posted to the developer > site; if you don't use it verbatim it would give you a starting point). > > But I'm guessing here...can you say a little more about what you want to > accomplish? > > --Colleen > ________________________________________ > From: [email protected] > [[email protected]] On Behalf Of Mattio Valentino > [[email protected]] > Sent: Wednesday, September 14, 2011 2:19 PM > To: General Mark Logic Developer Discussion > Subject: [MarkLogic Dev General] Can I re-load an Information Studio ticket? > > I'm working on some custom XQuery logic for an Information Studio flow. > > If I have a handle on the document URI (from $cpf:document-uri) and I > have a handle on the ticket ID, is it possible for me to re-start the > flow for that ticket in code after it has already gone through the > flow once? > > I see infodev:ingest() which I've been trying to use, but that keeps > returning an empty sequence and doing nothing as far as I can tell. > Some steps in the flow log messages, but none of that is happening. > > If this should work, are there any tricks to getting it working with a > binary file, in this case a Zip? > > Thanks! > Mattio > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > _______________________________________________ > General mailing list > [email protected] > http://developer.marklogic.com/mailman/listinfo/general > _______________________________________________ General mailing list [email protected] http://developer.marklogic.com/mailman/listinfo/general
