Re: NiFi web interface not starting

Thanks I will try this later at work. Yesterday at a quick glance in netstat it looked like the right pid was bound to 9090. Andy LoPresto schrieb am Di. 13. Juni 2017 um 01:53: > Hi Georg, > > Can you run a command to see if anything else is listening on those ports? > If

Re: How to ensure the rows moved into SQL?

Thanks for your response. i am having 10 files vary between number of rows. For example one file has contains 30 lakhs rows and one having 70 lakhs of rows.Since i have using two split text for split files with Line Split Count.hence "fragment.count" not worked in it. i have used nifi in

Unable to start NiFi on an EC2 instance

Good evening. I downloaded NiFi 1.3.0 to a linux EC2 instance in AWS I recently created. A uname -or tells me the version of Linux I am running: 4.9.20-11.31.amzn1.x86_64 GNU/Linux I tried to establish nifi as a service. I was the root user - not the nifi user - I changed to the bin directory of

Re: NiFi web interface not starting

Hi Georg, Can you run a command to see if anything else is listening on those ports? If another process is listening when NiFi tries to start, it should detect that and stop itself, but if something else started listening after or intermittently, it might be causing issues. The command lsof

Re: Merging Records

Yes, it worked! Thanks! Mika> On 06/12/2017 10:02 PM, Bryan Bende wrote: Mika, Are you receiving the log messages using the ListenTCP processor? If so, just wanted to mention that there is a property "Max Batch Size" that defaults to 1 and will control how many logical TCP messages can be

Re: Merging Records

Mika, Are you receiving the log messages using the ListenTCP processor? If so, just wanted to mention that there is a property "Max Batch Size" that defaults to 1 and will control how many logical TCP messages can be written to a single flow file. If you increase that to say 1000, then you can

Re: Merging Records

Mika, Understood. The JIRA for this is NIFI-4060 [1]. MergeContent is likely the best option for the short-term, merging with a demarcator of \n (you can press Shift + Enter/Return to insert a new-line in the UI), if that works for your format. Thanks -Mark [1]

Merging Records

Hi, what is the best way to merge records? I'm using a GrokReader, that spits out single json records. For efficiency I would like to merge a few hundred records into one flowfile. It seems there's no MergeRecord processor yet... Thanks! Mika>

Re: NiFi web interface not starting

Hi, to me it looks like NiFi is starting correctly, and only there is no access to the web interface. The curl is run from the same host. No firewall in between. I downloaded and extracted a fresh copy of the latest NiFi (1.3) and extracted it to a different folder. When started there, I could

Re: How to ensure the rows moved into SQL?

Prabhu, You can get a row count on the incoming CSV files by routing them through SplitText and using the “fragment.count” value as the total number of (non-header) lines, or by using an ExecuteStreamCommand with the command “wc -l” which counts the number of lines in text. With this

Re: NiFi web interface not starting

Hey, It looks like NiFi is correctly starting: 2017-06-12 18:02:09,570 INFO [main] org.apache.nifi.web.server.JettyServer NiFi has started. The UI is available at the following URLs: 2017-06-12 18:02:09,570 INFO [main] org.apache.nifi.web.server.JettyServer http://10.248.139.86:9090/nifi

Re: NiFi web interface not starting

Georg, Thanks for providing the logs. They look very normal and I'm not sure why it's not working without knowing more. Other than port 9090, any other customized properties/configuration? Any firewalls that could be preventing access to that port? Thanks Matt On Mon, Jun 12, 2017 at 11:19 AM,

Re: NiFi web interface not starting

Hi Matt, started vis bin/nifi.sh start Logs do not show anything interesting. Indeed, I see the mentioned lines, but a curl on http://localhost:9090/nifi returns curl: (52) Empty reply from server Bootstrap logs shows: 2017-06-12 18:01:50,459 INFO [main] o.a.n.b.NotificationServiceManager

Re: NiFi web interface not starting

Georg, The UI will be available once you see these log messages: 2017-06-09 09:02:37,208 INFO [main] org.apache.nifi.web.server.JettyServer NiFi has started. The UI is available at the following URLs: 2017-06-09 09:02:37,208 INFO [main] org.apache.nifi.web.server.JettyServer http://:/nifi

NiFi web interface not starting

After restarting my NiFi host no longer the NiFi web interface will start. >From the logs it looks like everything lese of NiFi is working fine. a curl to localhost: will return an empty response. What else can I try? The logs do not show any errors. Regards, Georg

How to ensure the rows moved into SQL?

Hi All, Since i need to know how to check all rows in csv moved in SQL Server. I have download csv files from HTTP. Just imagine i have 10 files i could move files one after another into SQL Server. i need to ensure if number of rows in csv moves correctly insert into SQL Server. For example