Hi Kan, Nifi is a good tool to build the dataflows which includes some transformations or copies of data are necessary. So, it might fulfill some part of your requirements.
If you already have existing system which generate and store information in existing databases, and other systems. You might also want to look at some of the distributed query engines like apache drill or prestosql, they can let you access the data in SQL format. - Vishal From: [email protected] At: 02/14/20 07:36:52To: [email protected] Subject: First Instance of Nifi Hi Nifi team, My company which is a bank in asia looking for a data integration solution to collect all distributed data across fragmented window and linux servers environment into a centralized data warehouse. We just came across Nifi and Minifi which seem to be capable for the integration and see what collaboration that we could come up with. I'm unable to reveal the name yet but very soon.. Here the data we would like to consolidate from distributed environments. - Order, Trade, Execution Messages across different systems (File and database Record (MSSSQL and Oracle)) - Audit Logs file (flat file and database record (MSSQL and Oracle) - Real time market database stream from third party via TCP - Fragmented historical data (flat file, multiple database instances in MSSQL) We would like to consolidate all into a single data warehouse and integrate all for ongoing collection. is Nifi will fit the application? Kan
