Re: Not able to ingest the csv data to RDBS Database

Your original example has 5 rows, a header and 4 value rows. Did you remove the header row for your current testing? If not, and you use a Header Line Count of 1, then each flow file probably has two lines in it, the header and the value row, and ReplaceText is probably matching the header lines

Re: [DISCUSS] NiFi MiNiFi C++ 0.2.0 Release

Thanks Aldrin. I'm working on wrapping up that final issue now On Wed, May 3, 2017 at 10:55 AM, Aldrin Piri wrote: > Looks like we have one last item scheduled [1] for this release version > with review under way since the last message. We've also uncovered and > remedied

Re: [DISCUSS] NiFi MiNiFi C++ 0.2.0 Release

Looks like we have one last item scheduled [1] for this release version with review under way since the last message. We've also uncovered and remedied a few build and test issues during that same time period which will make for nice additions. Upon conclusion of the review process for the

Re: failed to replicate request GET /NIFI-API/flow/process-groups/root to saxx:9090

ok, increased the timeout to 20 sec, and now I can see the console for sometime , less than a min, and with the same exception NIFI UI errors out.Please advice. -- View this message in context:

Re: Not able to ingest the csv data to RDBS Database

Hi , I tried with Header Line count 0 in SplitText Processor still getting the same result. I am trying with the header row. City,Count Mumbai,10 Mumbai,10 Pune,10 Pune,10 Do i need to add any processor -- View this message in context:

Re: NiFi unsecure cluster setup issue on Windows.

Hi, could it be that the windows firewall is enabled and blocking the ZK communication between nodes? Cheers On Wed, May 3, 2017 at 10:53 PM, shahbazatta wrote: > Hi, > I am trying to setup the 3 node NiFi but i am unable to set it up. I > already > setup it on

Re: Not able to ingest the csv data to RDBS Database

SplitText by line 1 and header count 1 Extract Text : City : (.*),.* Count : .*,(.*) ReplaceText : INSERT INTO CITY(City,Count) values ('${City}',${Count}) -- View this message in context:

NiFi unsecure cluster setup issue on Windows.

Hi, I am trying to setup the 3 node NiFi but i am unable to set it up. I already setup it on ubuntu and it is working fine but the same configurations not working on windows machines. I tried restarting all nodes, nifi service, etc but nothing works: Failed to determine which node is elected

Re: Not able to ingest the csv data to RDBS Database

Hi, Thanks for helping . I have modified the flow according to your suggestion. My flow consists of below processors. GetFile-->SplitText-->ExtractText-->ReplaceText-->PutSql. I have only 4 rows in my csv then why the SplitText queue contains huge MB of data. Also in PutSql how to specify the

Re: Not able to ingest the csv data to RDBS Database

Still not able to insert the data in table. I tested with PutFile instead of PutSql and file contains INSERT INTO CITY(city,count) VALUES('city',count) -- View this message in context:

Re: Not able to ingest the csv data to RDBS Database

I am just testing currently with a sample file containing only 4 rows. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Not-able-to-ingest-the-csv-data-to-RDBS-Database-tp15610p15637.html Sent from the Apache NiFi Developer List mailing list archive at

Re: Not able to ingest the csv data to RDBS Database

Do all the files look like that, or just the first one? If it is just the first one, then it is likely due to the header row in your CSV file. You may want to use RouteOnAttribute after SplitText to get rid of the header row (using fragment.index = 0), or I think you can use ReplaceText before

Re: [GitHub] nifi issue #1736: Nifi 3774

Thanks @YolandaMDavis. Yes. It's fine to apply. Sarah Olson m: 415-298-5573 Sent from my iPhone > On May 3, 2017, at 6:07 AM, YolandaMDavis wrote: > > Github user YolandaMDavis commented on the issue: > >https://github.com/apache/nifi/pull/1736 > >@thesolson

Re: Data Load

Hi Matt, I quickly developed this and this is how i could do this DataLake<-ExecuteSQL->ConvertAveroToJson->SplitJson->EvaluateJsonPath->ReplaceText->PutSQL->Postgres(onCloud) The problem is, this will not scale for huge volumes. Any thoughts? Regards Anil On Tue, May 2, 2017 at 12:07 PM,

Convert CSV File to JSON

Hi , I have a csv file which is provided by client having different column name. I wanted to covert the csv contents to JSON. Please advice -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Convert-CSV-File-to-JSON-tp15643.html Sent from the Apache NiFi

Save CSV file contents to database tables

Hi , We receive csv files from client. Each csv files contains different headers . We want to save the csv content in different tables . each table per csv and column name as per csv header. Please advice. -- View this message in context:

Re: Closing in on a NiFi 1.2.0 release?

Looks like all of the JIRAs have been resolved and we are in a good place. I'll begin kicking off the RC process. On Tue, May 2, 2017 at 5:48 PM, Andre wrote: > All, > > For some reason my canvas did not refresh after a process bounce (which > generally occurs) but

Re: EncryptContent issues after NIFI-1257 and NIFI-1259

Hello, I believe the EncryptContent "Public Keyring File" property is expecting the binary key that you generated in step 1. You do not need to export the public key into ASCII format. Kind Regards, -- Mike On Wed, May 3, 2017 at 6:40 AM, Athar wrote: > I am getting

Re: Data Load

Anil, When you say huge volumes, do you mean a large number of tables, or large tables, or both? For a large number of tables, you will likely want to upgrade to the upcoming NiFi release so you can use ListDatabaseTables -> GenerateTableFetch -> ExecuteSQL for the source part, although in

Re: Convert CSV File to JSON

If all the CSV files had the same number of columns, you might be able to use ExtractText -> SplitText -> ReplaceText to achieve this. However since your CSV files will have different column names, I will assume that there can be a different number of columns per file. In the upcoming NiFi

Re: [DISCUSS] NiFi MiNiFi C++ 0.2.0 Release

Hi Aldrin, One other issue came up in testing, which is that using the config.yml in the README file throws the following error: HW13384:nifi-minifi-cpp-0.2.0 brosander$ bin/minifi.sh run libc++abi.dylib: terminating with uncaught exception of type

Re: [DISCUSS] NiFi MiNiFi C++ 0.2.0 Release

Kevin, Thanks for the heads up. While I started the RM process I also noticed some issues with license for unused thirdparty modules in one of our thirdparty modules. I have a PR [1] up for review to fix this as well as the associated JIRA [2]. [1]

Re: Closing in on a NiFi 1.2.0 release?

Quick update... I ran into two issues that will need to be addressed to create the RC. I've created JIRAs for them and tagged them as 1.2: https://issues.apache.org/jira/browse/NIFI-3795 https://issues.apache.org/jira/browse/NIFI-3793 On Wed, May 3, 2017 at 2:41 PM, Bryan Bende

Re: NiFi-Neo4j Issues

Can you ping the Neo4j node from the NiFi node? Can you telnet from the NiFi node to the Neo4j port? I suspect it's a firewall issue too, just want to take NiFi out of the equation for now. Regards, Matt > On May 3, 2017, at 6:22 PM, dale.chang13 wrote: > > Hi All,

NiFi-Neo4j Issues

Hi All, At the bottom you can find my question. Note, I am positive this is more a network issue, but I cannot seem to figure out the solution. I tried posting this to the Neo4j Google+ board , and as a relevant NiFi-Neo4j Github issue

Re: EncryptContent issues after NIFI-1257 and NIFI-1259

Hi Mike, Thank you for quick response. But I have requirement where different users provide ASCII-armored format Keys (pubring.asc) and I have to encrypt the data through PGP algorithm by using those key. I can convert the ASCII-armored keys into binary through GPG commands. But now next

Re: EncryptContent issues after NIFI-1257 and NIFI-1259

I am getting this issue in even nifi 1.0.0 . I am using "PGP_ASCII_ARMOR" encryption algorithm. I performed the following steps. 1 ) I created the binary key using "GnuPG v2.0.14" and executed the "PGP" encryption algorithm. Its executing properly. 2) I exported the public key in ASCII