As I have mentioned in the Wiki, there are two types of Job Workers. I'll explain the scenario using the newJobWorker.
What the NewJobWorker does is it goes to the Orchestrator table and pulls all the jobs which are marked "ACCEPTED" and submits them. But when there are multiple threads running at the same time we need to ensure that the same job doesn't get submitted more than once by different NewJobWorkers. It's the same with the HangedJobWorkers. I started this discussion to get everyone's opinion on how and where we should handle this synchronization issue. We need to do this in a way that, it will improve the performance. I hope I made myself clear. On Wed, Jan 22, 2014 at 1:24 PM, Marlon Pierce <[email protected]> wrote: > Hi Sachith, et al-- > > Can you say a little more about this? Did you cover it in your wiki > entry > (https://cwiki.apache.org/confluence/display/AIRAVATA/Orchestrator)? > Will Java's concurrency package not be adequate? > > > Marlon > > On 1/20/14 10:59 AM, Sachith Withana wrote: > > Hi all, > > > > There are race condition issues when using the multi-threaded > Orchestrator. > > We need to come up with a way to synchronize the threads. > > > > Does anyone have any experiences or ideas regarding the issue? > > > > > > On Mon, Jan 20, 2014 at 9:34 AM, Marlon Pierce <[email protected]> wrote: > > > >> This sounds like a good question for the architects@airavata list. > >> > >> > >> Marlon > >> > >> On 1/20/14 2:29 AM, Saminda Wijeratne wrote: > >>> Suresh suggested we use existing libraries. Does anyone have any > >> experience > >>> in using them? > >>> > >>> > >>> On Sun, Jan 19, 2014 at 3:55 PM, Lahiru Gunathilake <[email protected] > >>> wrote: > >>> > >>>> Hi Sachitha, > >>>> > >>>> > >>>> On Sun, Jan 19, 2014 at 6:41 PM, Sachith Withana <[email protected] > >>> wrote: > >>>>> Hi all, > >>>>> > >>>>> There are race condition issues when using the multi-threaded > >>>>> Orchestrator. > >>>>> > >>>> +1, There's another thread we agreed on this. (subject: Orchestration > >>>> Component implementation review). > >>>> > >>>> Lahiru > >>>> > >>>>> We need to come up with a way to synchronize the threads. > >>>>> > >>>>> Any suggestions? > >>>>> > >>>>> -- > >>>>> Thanks, > >>>>> Sachith Withana > >>>>> > >>>>> > >>>> -- > >>>> System Analyst Programmer > >>>> PTI Lab > >>>> Indiana University > >>>> > >> > > > > -- Thanks, Sachith Withana
