Re: Read incremental records from DB

Hi Siva, There was a similar question before, and Matt answered with an example flow template. http://apache-nifi-developer-list.39713.n7.nabble.com/Example-of-GenerateTableFetch-td14374.html You can use ExecuteSQL to execute the generated SQLs by GenerateTableFetch. Since ExecuteSQL returns

RE: [EXT] Re: java.lang.OutOfMemoryError: unable to create new native thread

Thanks Joe. It will definitely have to be something I do periodically, unfortunately. Calling nifi.sh dump right now fails since it can’t create any new threads… NiFi actually came back up for a little while shortly after this email, maybe some threads closed out. But I didn’t take the

Re: java.lang.OutOfMemoryError: unable to create new native thread

You’ll want to get thread dumps during the life of nifi to figure out the pattern of what is leaking threads. Often it will be around some tcp socket handling thread in something like sftp for example. Can be a config issue or a bug. Thanks Joe On Tue, Nov 14, 2017 at 8:32 PM Peter Wicks

Re: Using Regular Expression/Pattern matching

Hi, I believe the prefix property is treated literally as a prefix. i.e. think "starts with". S3 object keys are usually treated as a file path would be on a traditional file system, so following that convention the prefix property is allowing you to specify a "directory" to list in the S3

Read incremental records from DB

Hi, I would like to read incremental records using Maximum-value Columns from database table and write it into another table. For that I thought I can use GenerateTableFetch processor with Maximum-value column. This processor is returning only Select query with intended where clause and not

java.lang.OutOfMemoryError: unable to create new native thread

I've been getting the error: 2017-11-15 09:22:24,959 ERROR [NiFi Web Server-566674] org.apache.nifi.NiFi java.lang.OutOfMemoryError: unable to create new native thread at java.lang.Thread.start0(Native Method) at java.lang.Thread.start(Thread.java:714) at

Re: How to get DBCP service inside ScriptedLookupService

Eric, So I just learned ALOT about the bowels of the context and initialization framework while digging into this issue, and needless to say we will need a better way of making this available to scripts. Here's some info: 1) The ControllerServiceInitializationContext object passed into

Re: Hanging Processor: ExtractHL7Attributes

Hi, Can you check nifi-app.log file instead of bootstrap? You have a bulletin generated (red icon) and you should have more information in the nifi-app.log file. Thanks! 2017-11-14 14:37 GMT+01:00 Eric Thompson : > I am getting an error of 'Administratively Yielded

Hanging Processor: ExtractHL7Attributes

I am getting an error of 'Administratively Yielded for 1 sec due to processing failure' and the files that are triggering the error in the processor are not getting routed to the failure processor but seem to loop and stop up the first processor. Any ideas on how to resolve? I would expect

How to get DBCP service inside ScriptedLookupService

Hi Folks, I need to get an instance of DBCPService inside my ScriptedLookupService and for that I'm following Matt's post http://funnifi.blogspot.com.br/2016/04/sql-in-nifi-with-executescript.html In my groovy class I've overrided the initialize method and performing the lookup there but I'm

Re: Splunk Processor - Re-play

Hi Siva, The processor is storing a "state" in the state management back-end of NiFi (Zookeeper usually). There is no way for you to edit this value. However, some processors expose a property allowing you to manually set the initial value (Example GenerateTableFetch [1]) that the processor will