HIVE Controller service and convertJSONtoSQL processor

a UUID that represents my HIVEconnectionppool, then doesn't let me configure it. I am running version 2.1.1. Does the HIVE connection pool controller service work for anyone else? -- Corey Flowers Vice President, Onyx Point, Inc (410) 541-6699 cflow...@onyxpoint.com -- This account not approved

Re: Netflow parser

gt; Corey, > > I am currently assigned with a JIRA ticket to create this processor but I > have a few other tickets I am working one before I touch this one, so > unless someone has something to contribute I don't expect to get it ready > in time for 1.2. > > Cheers > > On Tue,

Re: NiFi Users: Powered by NiFi page

Name: Onyx Point Web: www.onyxpoint.com Industry: Commercial/Federal large scale data distribution system support and design Description: design large scale NIFI clusters for high volume ingest/egress and provide day to day operational support and maintenance. Sent from my iPhone > On Feb

Re: NiFi Users: Powered by NiFi page

Hey Joe, You can put us on their. Do you need a write up or anything about how we are using it? Corey Sent from my iPhone > On Feb 14, 2017, at 2:07 PM, Joe Witt wrote: > > NiFi Users > > I just realized we have a 'powered by nifi' page. It looks a >

Re: Nifi hardware recommendation

We actually use heap sizes from 32 to 64Gb for ours but our volumes and graphs are both extremely large. Although I believe the smaller heap sizes were a limitation of the garbage collection in Java 7. We also moved to ssd drives, which did help through put quite a bit. Our systems were

Re: 0.6.1 Master running out of heap space

This is probably because of your stats. All the stats across your cluster are kept within the NCMs heap space. Within Apache nifi it stores 1440 stats per processor, per minute. If you look in the conf file you will see the settings toward the bottom of the file. Sorry, I don't have a running

Re: "Processor requires an upstream connection" for FetchS3Object?

that error. I would love to know if there is a work around because I would also love to work with these processors within the next week or so. On Tue, Jan 12, 2016 at 9:16 PM, Russell Whitaker < russell.whita...@gmail.com> wrote: > On Tue, Jan 12, 2016 at 6:11 PM, Corey Flowers <cflow...@o

Re: "Processor requires an upstream connection" for FetchS3Object?

I haven't worked with this processor but I believe it is looking for the S3 list processor to generate the list of objects to fetch. Did you try that yet? Sent from my iPhone > On Jan 12, 2016, at 8:38 PM, Russell Whitaker > wrote: > > I'm running v0.4.1 Nifi, and

Re: "Processor requires an upstream connection" for FetchS3Object?

Ha ha! Well that would do it! :) Sent from my iPhone > On Jan 12, 2016, at 9:10 PM, Russell Whitaker <russell.whita...@gmail.com> > wrote: > >> On Tue, Jan 12, 2016 at 6:02 PM, Corey Flowers <cflow...@onyxpoint.com> >> wrote: >> I haven't worked with thi

Re: HDFS -> NiFi -> NiFi -> HDFS

Nifi will only keep the files in its repository until they are delivered to your second hdfs system. So basically nifi repositories are only temporary storage until the data has been processed and delivered. The only thing you would have to worry about is if the system can not be delivered and the

Re: queued files

These guys are right. The file to look in for the uuid is the nifi-app.log. Also if you wanted to see what the processor itself was doing, you could right click on the processor, get its uuid and while it is running, run (assuming it is on Linux): tail -F nifi-app.log | grep uuid This will just

Re: Nifi cluster setup - Safe mode error

Good morning! While you are running in a cluster you need to have a primary node selected. You can do this by opening the cluster icon in the upper right hand corner of your graph. You will see a list of your servers with ribbon icons on the right hand side. When you click the ribbon you have

Re: [DISCUSS] Feature proposal: Streamline visual flow design

I also think 1 and 2 seem like good ideas but having built hundreds of flows, I would not want a configuration window to open automatically when a processor is added to the graph. From an operations standpoint, you are designing the flow was you add and remove the processor to work through

Re: Nifi doesn't listen on port 8080 in some Linux distributions

, then it is probably your firewalls. On Thu, Aug 27, 2015 at 11:42 AM, Chris Teoh chris.t...@gmail.com wrote: Hey all, I've noticed trying to run Nifi on Centos 7 and a docker Ubuntu image doesn't seem to launch the server. Is there something I'm missing here? Kind regards Chris -- Corey