Re: Custom processor is failing for concurrency

2016-06-10 Thread Matt Foley
09, 2016 1:54 PM To: users@nifi.apache.org Cc: Kevin Verhoeven; Ki Kang Subject: RE: Custom processor is failing for concurrency Here is the code: https://github.com/kyada1/PutFileAzureDLStore/blob/master/nifi-azure-dlstore-bundle/nifi-azure-dlstore-processors/src/main/java/nifi/azure/dlstore/pro

RE: Custom processor is failing for concurrency

2016-06-09 Thread Kumiko Yada
i Kang <ki.k...@ds-iq.com> Subject: Re: Custom processor is failing for concurrency ​If there are multiple SDK calls that share the same problematic code (that is, multiple SDK methods that would interact with each other in a non-thread-safe way), then one must synchronize their calls to a

Re: Custom processor is failing for concurrency

2016-06-09 Thread Matt Foley
. From: Oleg Zhurakousky <ozhurakou...@hortonworks.com> Sent: Thursday, June 09, 2016 12:15 PM To: users@nifi.apache.org Cc: Kevin Verhoeven; Ki Kang Subject: Re: Custom processor is failing for concurrency +1, was just responding with the same. On Jun 9, 2016, at 3:11 PM, Matt

Re: Custom processor is failing for concurrency

2016-06-09 Thread Oleg Zhurakousky
nt: Thursday, June 09, 2016 11:49 AM To: users@nifi.apache.org<mailto:users@nifi.apache.org> Cc: Kevin Verhoeven; Ki Kang Subject: Re: Custom processor is failing for concurrency Hi Bryan, Does this mean that even I create the multiple threads in onTriger, I will still hit the Microsoft

Re: Custom processor is failing for concurrency

2016-06-09 Thread Matt Foley
age the problem action. --Matt F From: Kumiko Yada <kumiko.y...@ds-iq.com> Sent: Thursday, June 09, 2016 11:49 AM To: users@nifi.apache.org Cc: Kevin Verhoeven; Ki Kang Subject: Re: Custom processor is failing for concurrency Hi Bryan, Does this mean that even

Re: Custom processor is failing for concurrency

2016-06-09 Thread Bryan Bende
e threads > via UI might be the same thing. > > Thanks > Kumiko > -- > *From:* Bryan Bende <bbe...@gmail.com> > *Sent:* Thursday, June 9, 2016 11:26:10 AM > *To:* users@nifi.apache.org > *Cc:* Kevin Verhoeven; Ki Kang > > *Subje

Re: Custom processor is failing for concurrency

2016-06-09 Thread Kumiko Yada
From: Bryan Bende <bbe...@gmail.com> Sent: Thursday, June 9, 2016 11:26:10 AM To: users@nifi.apache.org Cc: Kevin Verhoeven; Ki Kang Subject: Re: Custom processor is failing for concurrency Kumiko, In general you shouldn't have to create threads in your proc

Re: Custom processor is failing for concurrency

2016-06-09 Thread Bryan Bende
ailto:kumiko.y...@ds-iq.com] > *Sent:* Sunday, June 5, 2016 6:28 PM > *To:* users@nifi.apache.org > *Cc:* Ki Kang <ki.k...@ds-iq.com>; Kevin Verhoeven < > kevin.verhoe...@ds-iq.com> > *Subject:* RE: Custom processor is failing for concurrency > > > > Thank you, Bryan.

RE: Custom processor is failing for concurrency

2016-06-09 Thread Kumiko Yada
Kumiko From: Kumiko Yada [mailto:kumiko.y...@ds-iq.com] Sent: Sunday, June 5, 2016 6:28 PM To: users@nifi.apache.org Cc: Ki Kang <ki.k...@ds-iq.com>; Kevin Verhoeven <kevin.verhoe...@ds-iq.com> Subject: RE: Custom processor is failing for concurrency Thank you, Bryan. I’m working wi

RE: Custom processor is failing for concurrency

2016-06-05 Thread Kumiko Yada
Thank you, Bryan. I’m working with Microsoft on this issue. Will keep you guys updated. Thanks Kumiko From: Bryan Bende [mailto:bbe...@gmail.com] Sent: Friday, June 3, 2016 2:32 PM To: users@nifi.apache.org Subject: Re: Custom processor is failing for concurrency It is hard to say for sure

RE: Custom processor is failing for concurrency

2016-06-03 Thread Kumiko Yada
processor is failing for concurrency Kumiko It appears that the current state of the source you linked in is not in sync with what is in the stack trace. Perhaps you have made some code modifications (e.g., line 218 is an empty line in code while it has a pointer in the star trace). In any

Re: Custom processor is failing for concurrency

2016-06-03 Thread Bryan Bende
It is hard to say for sure, but I think your NiFi processor is generally ok regarding thread safety, but I think there could be a problem in the Azure SDK code... RequestFactory has an instance of BaseUrl and every time RequestFactory.create() is called, it calls BaseUrl.url(). The

Re: Custom processor is failing for concurrency

2016-06-03 Thread Oleg Zhurakousky
Kumiko It appears that the current state of the source you linked in is not in sync with what is in the stack trace. Perhaps you have made some code modifications (e.g., line 218 is an empty line in code while it has a pointer in the star trace). In any event, from what I can see the error is