Boris, Great. So have a process to load the periodic dataset into a lookup service. COuld be backed by a simple file, a database, Hive, whatever. Then have the live flow run against that.
This reminds me - we should make a Kudu based lookup service i think. I'll chat with some of our new Kudu friends on this. Thanks On Fri, Feb 22, 2019 at 12:25 PM Boris Tyukin <[email protected]> wrote: > Thanks Joe and Bryan. In this case I don't need to do it in real-time, > probably once a day only. > > I am thinking to trigger both pulls by generateflow processor, then merge > datasets somehow since flowfile id will be the same for both sets. And then > need to join somehow. > > Would like to use nifi still :) >
