Extract the min and max date of the input file

2017-05-30 Thread suman....@cuddle.ai
Hi ALL, I want to extract the min and max date of the input csv file. I have a date column in that file. Also please let me know how to add some custom attribute depending on the date column value. Any help would be appreciated. -- View this message in context:

Not able to see the uploaded file in S3

2017-05-25 Thread suman....@cuddle.ai
Hi All, I have a simple flow consists of following processors. GetFile-->PutS3Object The flow is successful but not able to see the file in S3. When I checked NiFi DataProvenance of PutS3Object in details section i can see the below message. Details Auto-Terminated by failure Relationship in

Re: How to use ConvertRecord Processor

2017-05-18 Thread suman....@cuddle.ai
Hi, Thanks for your help . It worked. I used the following processors GetFile-->PutDatabaseRecord-->PutFile Only doubt i have is how to specify particular dataType for a column. For Eg: I have file like below and want to insert into the table with City as Varchar and Count as Integer in

How to use ConvertRecord Processor

2017-05-17 Thread suman....@cuddle.ai
Hi All, I am using nifi version 1.2.0. We have CSV files given by Vendor with random number of Columns in the file. We want to save the contents of the File in Postgres Database. I have created a Flow with the following processors. GetFile-->ConvertRecord-->ConvertJSONToSql--->PutSql In

Save CSV file contents to database tables

2017-05-03 Thread suman....@cuddle.ai
Hi , We receive csv files from client. Each csv files contains different headers . We want to save the csv content in different tables . each table per csv and column name as per csv header. Please advice. -- View this message in context:

Convert CSV File to JSON

2017-05-03 Thread suman....@cuddle.ai
Hi , I have a csv file which is provided by client having different column name. I wanted to covert the csv contents to JSON. Please advice -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Convert-CSV-File-to-JSON-tp15643.html Sent from the Apache NiFi

Re: Not able to ingest the csv data to RDBS Database

2017-05-03 Thread suman....@cuddle.ai
Hi , I tried with Header Line count 0 in SplitText Processor still getting the same result. I am trying with the header row. City,Count Mumbai,10 Mumbai,10 Pune,10 Pune,10 Do i need to add any processor -- View this message in context:

Re: Not able to ingest the csv data to RDBS Database

2017-05-03 Thread suman....@cuddle.ai
I am just testing currently with a sample file containing only 4 rows. -- View this message in context: http://apache-nifi-developer-list.39713.n7.nabble.com/Not-able-to-ingest-the-csv-data-to-RDBS-Database-tp15610p15637.html Sent from the Apache NiFi Developer List mailing list archive at

Re: Not able to ingest the csv data to RDBS Database

2017-05-03 Thread suman....@cuddle.ai
SplitText by line 1 and header count 1 Extract Text : City : (.*),.* Count : .*,(.*) ReplaceText : INSERT INTO CITY(City,Count) values ('${City}',${Count}) -- View this message in context:

Re: Not able to ingest the csv data to RDBS Database

2017-05-03 Thread suman....@cuddle.ai
Still not able to insert the data in table. I tested with PutFile instead of PutSql and file contains INSERT INTO CITY(city,count) VALUES('city',count) -- View this message in context:

Re: Not able to ingest the csv data to RDBS Database

2017-05-03 Thread suman....@cuddle.ai
Hi, Thanks for helping . I have modified the flow according to your suggestion. My flow consists of below processors. GetFile-->SplitText-->ExtractText-->ReplaceText-->PutSql. I have only 4 rows in my csv then why the SplitText queue contains huge MB of data. Also in PutSql how to specify the

Not able to ingest the csv data to RDBS Database

2017-05-02 Thread suman....@cuddle.ai
Hi , I have a csv file and i want to ingest the csv file data into the database. I have used getfile,RelaceText,PutSQL Processors. It's failing in replaceText Processor. File Sample : City,Count Mumbai,10 Mumbai,10 Pune,10 Pune,10 ReplaceText : INSERT INTO CITY(city,count) values