Yes, very much so. The program I'm on uses NiFi for everything from processing one off Excel spreadsheets, to database records (MySQL, Postgres, Oracle, etc.), to log files. We also have some custom use cases I can't go into that are very much off the beaten path and it still excels at its job.
With regard to your third use case, there's TCP listening support, but you might want to consider creating a simple TCP listener that pushes the data into Apache Kafka. The reason for that is because Kafka is really good for organizing and routing events going into a system like NiFi. Thanks, Mike On Fri, Feb 14, 2020 at 7:36 AM Kan Wong <[email protected]> wrote: > Hi Nifi team, > > My company which is a bank in asia looking for a data integration solution > to collect all distributed data across fragmented window and linux servers > environment into a centralized data warehouse. > > We just came across Nifi and Minifi which seem to be capable for the > integration and see what collaboration that we could come up with. I'm > unable to reveal the name yet but very soon.. > > Here the data we would like to consolidate from distributed environments. > > - Order, Trade, Execution Messages across different systems (File and > database Record (MSSSQL and Oracle)) > - Audit Logs file (flat file and database record (MSSQL and Oracle) > - Real time market database stream from third party via TCP > - Fragmented historical data (flat file, multiple database instances in > MSSQL) > > We would like to consolidate all into a single data warehouse and integrate > all for ongoing collection. > > is Nifi will fit the application? > > Kan >
