Re: Writing enrichment data directly from NiFi with PutHBaseJSON

2018-06-12 Thread Carolyn Duby
I like the streaming enrichment solutions but it depends on how you are getting the data in. If you get the data in a csv file just call the flat file loader from a script processor. No special Nifi required. If the enrichments don’t arrive in bulk, the streaming solution is better. Thanks Ca

Re: Writing enrichment data directly from NiFi with PutHBaseJSON

2018-06-12 Thread Simon Elliston Ball
Good solution. The streaming enrichment writer makes a lot of sense for this, especially if you're not using huge enrichment sources that need the batch based loaders. As it happens I have written most of a NiFi processor to handle this use case directly - both non-record and Record based, especia

RE: Writing enrichment data directly from NiFi with PutHBaseJSON

2018-06-12 Thread Charles Joynt
Thanks for the responses. I appreciate the willingness to look at creating a NiFi processer. That would be great! Just to follow up on this (after a week looking after the "ops" side of dev-ops): I really don't want to have to use the flatfile loader script, and I'm not going to be able to writ