Re: Advice on orchestrating Nifi with dockerized external services

2019-04-11 Thread Eric Chaves
Hi Koji, that seems a pretty good idea, thanks for bringing it up! I wasn't aware of nifi nano but definitely will give it a shot. =) Thanks Em qua, 10 de abr de 2019 às 22:38, Koji Kawamura escreveu: > Hi Eric, > > Although my knowledge on MiNiFi, Python and Go is limited, I wonder if >

Re: Advice on orchestrating Nifi with dockerized external services

2019-04-10 Thread Koji Kawamura
Hi Eric, Although my knowledge on MiNiFi, Python and Go is limited, I wonder if "nanofi" library can be used from the proprietary application so that they can fetch FlowFiles directly using Site-to-Site protocol. That can be an interesting approach and will be able to eliminate the need of

Advice on orchestrating Nifi with dockerized external services

2019-04-10 Thread Eric Chaves
Hi Folks, My company is using nifi to perform several data-flow process and now we received a requirement to do some fairly complex ETL over large files. To process those files we have some proprietary applications (mostly written in phyton or go) that ran as docker containers. I don't think