Hi Bryan,
Thanks for your email!!
I need to set NiFi as the main orchestrator for all data movement and
transformation in my project . It would call Sqoop, call an API, call a
message bus (like Kafka or whatever) and handle scheduling – or even integrate
with an external scheduling program.It would be a single place where we can
easily see everywhere data is going , schedule it and monitor it. I think it
will make management much easier. I can put a CSV file and I can use NiFi to
watch the folder, and then grab the file and stick it in Hive or HDFS .If this
possible means how the data flow its working on here please give some
suggestions that more helpful for me to understand . Thanks &
Regards,Manikandan Kolanjinathan
Junior Software Engineer
Pinnacle Seven Technologies 0422-4208736, 4506535
www.pinnacleseven.comDelivering your business apps on cloud!
From: Bryan Bende <[email protected]>
To: [email protected]; [email protected]
Sent: Thursday, 18 August 2016 8:35 PM
Subject: Re: Apache NiFi Clarification
Hello,
NiFi can gather data from as many sources as needed. When data is brought into
NiFi it is written into NiFi's internal repositories and stored there as it
moves through the graph of processors, the data can then be delivered to any
desired system.
To bring data from a database to HDFS you would likely use the ExecuteSQL or
QueryDatabase processor to get the data out of the database, then some
intermediary processors if you need to convert the data, and then PutHDFS to
write the data to HDFS.
Thanks,
Bryan
On Thu, Aug 18, 2016 at 6:17 AM, <[email protected]> wrote:
Hi,
Good Day!
I Saw your Blogs and Videos its Pretty Interesting and I am new in Apache
Nifi.So i just want to know if the data will only to fetch into nifi or else
data can export to any other databases or API. I need to your guides I am
working on Nifi in My organization So i just to know how the flow to connect
with Sql Server Or Any other Databases and How can i create a data flow to
fetch the Server into Hadoop .but In my case its pretty different we need to
connect multiple API Data into Nifi and Transfer Via Sqoop To Hive .If in this
case we can choose Nifi . please give some guides about the Apache Nifi and
how the flow it will work . I am new to Apache Nifi So Please give Guides about
Apache Nifi in my case Thanks & Regards,Manikandan Kolanjinathan
Junior Software Engineer
Pinnacle Seven Technologies 0422-4208736, 4506535 www.pinnacleseven.
comDelivering your business apps on cloud!
