Re: Long Polling Client

2020-10-14 Thread Clay Teahouse
; Thanks > > On Wed, Oct 14, 2020 at 1:25 PM Clay Teahouse > wrote: > >> Hello, >> I tried both getHTTP and invokeHTTP (but didn't try all options). What I >> need is to deal with the cases, such as SSE (Server Sent Events) which >> works with long polling. M

Re: Long Polling Client

2020-10-14 Thread Clay Teahouse
n > HTTP server then assumes the response will remain open and it should take > portions of the response and treat each as its own flowfile/object to pass > along? > > Thanks > > On Tue, Oct 13, 2020 at 6:31 PM Clay Teahouse > wrote: > >> Does NiFi have a processor that

Long Polling Client

2020-10-13 Thread Clay Teahouse
Does NiFi have a processor that can act as a client for a long polling server, for example an SSE server? More specifically, I want a client that can issue a HTTP GET request to a long polling server and accept stream of messages from the server (on the same connection). If there isn't one, which

JAVA 11

2019-10-15 Thread Clay Teahouse
Hello All, Does anyone know when NiFi will be available with Java 11? I have the latest version, 1.9.2. thanks Clay

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-06 Thread Clay Teahouse
1.9.2/org.apache.nifi.syslog.Syslog5424Reader/index.html > [3] > https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-record-serialization-services-nar/1.9.2/org.apache.nifi.text.FreeFormTextRecordSetWriter/index.html > > On Tue, Aug 6, 2019 at 10:08 AM Clay Teahouse > wrote

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-06 Thread Clay Teahouse
:26 AM Bryan Bende wrote: > Can you describe what you want to do with each message? > > Right now I’m not following why you need to parse them. > > On Tue, Aug 6, 2019 at 6:40 AM Clay Teahouse > wrote: > >> Bryan, >> Understood, but wouldn't then thi

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-06 Thread Clay Teahouse
en you have say 1k messages with all different > values for those fields. > > -Bryan > > On Mon, Aug 5, 2019 at 11:25 AM Clay Teahouse > wrote: > > > > Hi Edward, Bryan > > One more question regarding ListenSyslog. Is it possible to set batch > size > 1

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-05 Thread Clay Teahouse
ad for the >> socket. >> >> As soon as a connection has something available to read then a thread >> is spawned to start reading the connection until either no matter is >> available, or it is closed. >> >> On Fri, Aug 2, 2019 at 7:18 AM Clay Teahouse >>

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-03 Thread Clay Teahouse
ne thread for the >> socket. >> >> As soon as a connection has something available to read then a thread >> is spawned to start reading the connection until either no matter is >> available, or it is closed. >> >> On Fri, Aug 2, 2019 at 7:18 AM Clay Teahouse >

Re: Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-02 Thread Clay Teahouse
pears to have been written such that it gets all the requests > that have been received on that socket and processes them until either it > has no more requests left or process or that instance of the processor is > no longer scheduled to run. > > Hope that helps > > Edward &

Optimizing Performance of Apache NiFi's Network Listening Processors

2019-08-02 Thread Clay Teahouse
Hello All, I need to listen to and process thousands of persistent TCP connections. I have 10 nodes, each having 8 cores. My understanding is that with existing NiFi listening processors, such as ListnSyslog, a thread is utilized for each TCP connection. Does this scale? Do I need to write a

Re: flow.xml sync

2019-07-24 Thread Clay Teahouse
According to the NiFi documentation, zookeeper decides on the primary node, when the system starts. So that answers my question. Now my question is how to designate where to run the isolated processes without the NiFi UI? thanks. On Wed, Jul 24, 2019 at 4:50 AM Clay Teahouse wrote: >

flow.xml sync

2019-07-24 Thread Clay Teahouse
Hi Everyone, I have a cluster of multiple nodes. If I place flow.xml on all of them before starting the nodes, would that cause a conflict? If yes, can I disable syncing between the nodes? I do not want to have to decide on a primary node at the start up. In other words, can the primary node be

ListenRsyslog

2019-06-19 Thread Clay Teahouse
Hi All, What is the max number of TCP connections allowed with ListenRsyslog processor? thank you Clay