Hey Prabhu, I just finished up a csv processing flow myself and it looks like this:
CSV Flowfile -> InferAvroSchema -> ConvertCSVToAvro -> ConvertAvroToJson You can then use the ConvertJSONToSQL processor to finish things up. I would have liked to be able to go directly from CSV to JSON but I don't think there is a built-in processor that does that. - Nick On Mon, Jan 30, 2017 at 5:59 AM, Matt Burgess <[email protected]> wrote: > Prabhu, > > I agree with Mark; if you want to use ExecuteScript for this, I have > an example of splitting fields (using a bar | delimiter, but you can > change to comma) [1]. If you have quoted values that can contain > commas, then like Mark said you may want to look at writing a custom > processor, or using a third-party library such as OpenCSV [2], I have > an example on including such things in an ExecuteScript configuration > [3]. > > Regards, > Matt > > [1] http://funnifi.blogspot.com/2016/02/executescript- > explained-split-fields.html > [2] http://opencsv.sourceforge.net/ > [3] http://funnifi.blogspot.com/2016/02/executescript-using-modules.html > > On Mon, Jan 30, 2017 at 8:43 AM, Mark Payne <[email protected]> wrote: > > Prabhu, > > > > My guess is that you probably could find some way to do this with the > > standard out-of-the-box processors > > that come with NiFi. Perhaps by using Extract Text to extract the header > > columns, and then using ReplaceText > > and perhaps a few other processors. Going down this route though is > likely > > to be incredibly inefficient, though, > > and hard to understand/maintain. > > > > I think this is a great use case for either a custom processor or a > simple > > Groovy/Python script using the ExecuteScript > > Processor. > > > > Thanks > > -Mark > > > > On Jan 30, 2017, at 1:12 AM, prabhu Mahendran <[email protected]> > > wrote: > > > > I have a CSV data with 100 columns like below.., > > > > ,A,B,C,D,E,F,..........[upto 100 Header columns] > > Date,A1,B1,C1,D1,E1,F1..........[upto 100 Header columns] > > 30/01/2017 23:23:22,Majestic,32,2100.12....[upto 100 data columns] > > > > In data having first 2 header lines and 3 rd line is data in which i > > inserted with header lines in below format. > > > > In Database insert those data with following format. > > > > insert into data values('30/01/2017 23:23:22','A','A1','Majestic'); > > insert into data values('30/01/2017 23:23:22','B','B1,'32'); > > > > Please stop me if anything i'm doing wrong. > > > > Is this possible in apache nifi? > > > > Many thanks > > > > >
