2012/1/6 David Riccitelli <[email protected]>: > Hello guys, > > At the Zurich CreateJS Hackathon we started working on the asynchronous > jobs for Stanbol. More specifically we need a REST API that allows us to: > 1. start an enhancement job (passing its configuration data), > 2. check its status and progress, > 3. retrieve the results once the process is complete [1], > 4. cancel an ongoing job. > > We saw recently the release of the long-term jobs for the Reasoning > Services by Enrico Daga [2,3], and found that it can mostly satisfy the > above mentioned requirements with the exception of monitoring the actual > job progress. > > I talked with Rupert about it, and he's looking forward to the asynchronous > operations OSGI postEvent/sendEvent methods, which would allow us to > reshape the way the tasks are instantiated, their progress monitored and > managed. > > I would like to define with you the requirements for the asynchronous jobs > and a path in order to reach this goal, if you agree. > > In the meanwhile I've been implementing a raw EnhancerJob/EnhancerJobResult > implementation in order to enable the *commons.jobs* APIs to be used with > the *enhancer*, and I can share this work if you'd like.
I will also need that at some point: I am working with people developing an opensource tool chain for machine translation (Arabic to french or English) using http://wapiti.limsi.fr/ and http://www.statmt.org/moses/ that we could wrap as a stanbol service (by wrapping the command-line programs with temporary input and output files). However as the translation process can be much slower than shallow nlp analysis like NER and document categorization and having the ability to run engines asynchronous is definitely a prerequisite for such an integration. So please feel free to attach your code as a patch to jira or to push it online as a fork of https://github.com/apache/stanbol so that we can have a look and give comments towards merging such a feature into stanbol/commons & stanbol/enhancer. -- Olivier http://twitter.com/ogrisel - http://github.com/ogrisel
