RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
@nifi.apache.org Subject: Re: Erroneous Queue has No FlowFiles message Peter, Thanks for the confirmation. I think there is some case were hitting here where some flowfiles are being swapped instead of added back to the active queue. The queue listing only returns the top 100 entries in the active queue

RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
pwicks) Sent: Friday, September 09, 2016 3:15 PM To: users@nifi.apache.org<mailto:users@nifi.apache.org> Subject: RE: Erroneous Queue has No FlowFiles message Matt, PutSQL is the end of the line, no downstream processors. Batch size is 1000, yes I have fragmented transactions

RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
: Friday, September 09, 2016 3:15 PM To: users@nifi.apache.org Subject: RE: Erroneous Queue has No FlowFiles message Matt, PutSQL is the end of the line, no downstream processors. Batch size is 1000, yes I have fragmented transactions set to false. nifi.queue.swap.threshold=2 --Peter From: Matt

RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
Subject: Re: Erroneous Queue has No FlowFiles message Peter, Would you be able to share what you've configured for the batch size of PutSQL (assuming that 'fragmented transactions' is disabled) and what your swap threshold is configured to (nifi.queue.swap.threshold in nifi.properties)? Also, what

Re: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Matt Gilman
gt; > > > *From:* Matt Gilman [mailto:matt.c.gil...@gmail.com] > *Sent:* Friday, September 09, 2016 8:51 AM > > *To:* users@nifi.apache.org > *Subject:* Re: Erroneous Queue has No FlowFiles message > > > > Peter, > > > > What is the processor downstream of the

RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
PutSQL. The 100k FlowFiles are all SQL Insert queries with associated attributys, generated by a JSONToSQL processor. From: Matt Gilman [mailto:matt.c.gil...@gmail.com] Sent: Friday, September 09, 2016 8:51 AM To: users@nifi.apache.org Subject: Re: Erroneous Queue has No FlowFiles message

Re: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Matt Gilman
on the same graph/same >> processor group. >> >> >> >> --Peter >> >> >> >> >> >> *From:* Matt Gilman [mailto:matt.c.gil...@gmail.com] >> *Sent:* Friday, September 09, 2016 5:25 AM >> >> *To:* users@nifi.apac

RE: Erroneous Queue has No FlowFiles message

2016-09-09 Thread Peter Wicks (pwicks)
o:gunjanpiyushd...@gmail.com>] Sent: Thursday, September 08, 2016 9:26 PM To: users@nifi.apache.org<mailto:users@nifi.apache.org> Subject: Re: Erroneous Queue has No FlowFiles message Hi Peter, once you post the request, your first step, you get a listing request reference handle UUID as par

RE: Erroneous Queue has No FlowFiles message

2016-09-08 Thread Peter Wicks (pwicks)
@nifi.apache.org Subject: Re: Erroneous Queue has No FlowFiles message Hi Peter, once you post the request, your first step, you get a listing request reference handle UUID as part of response. This UUID is used to perform the all the operations on the queue. This UUID is active until a DELETE request