PutRecord sinks

2021-03-25 Thread Phillip Grenier
Looking for feedback on if 2 new sinks would be accepted by the community. 1. InvokeHttpSink: that would make an http request per record, to insert or update a remote end point 2. DistributredMapCacheSink: to insert records into the cache map by a key given a record path

Re: [DISCUSS] Release of Apache NiFi 1.13.0

2020-11-28 Thread Phillip Grenier
I wouldn't mind https://github.com/apache/nifi/pull/4554 making it in. Have seen a couple more instances where people have created custom processors to work around this PR. On Thu, Nov 26, 2020 at 11:10 AM Mike Thomsen wrote: > Also, for most of us (committers and community members), it's a >

Re: Parameter Contexts Expression Language scopes

2020-10-20 Thread Phillip Grenier
I also see this as a good idea, if only for transportability. If the dev environment is in a docker container and wants to use an environment variable to set the context, but in production where the sensitive values need more protection they can be set manually or in another way. Chris Sampson's

Re: request to review NIFI-7738, Provenance Search Events - add reverse query capability

2020-10-08 Thread Phillip Grenier
Pierre, I think this discussion brings up a valid conversation point. At some point a PMC member needs to approve the merge request, so from a contributors level what can we do to make that merge both easier and/or more likely to happen. That and how the community can help filter down the ever

Incorrect data provenance datetime

2020-09-23 Thread Phillip Grenier
I am running a 1.11.4 instance with adoptopenjdk 1.11. The timestamps on the data provenance events are off by ~2 months and the date on the system is correct. Thanks for any help, Phillip

Using ValidateRecord to validate schemas

2019-08-16 Thread Phillip Grenier
Would it be reasonable to add the details of the failures to the flow file attributes? I know they exist on the provenance event, but that can not be persisted easily to file for later analysis and correction. This also seems harder to locate for non-developers and flow designers. Thanks,

Re: question about Nifi Custom processor

2019-07-24 Thread Phillip Grenier
So a couple notes based on your debug statements. "2.1 -> 2.2" If you do not plan to provide an input to this processor and run it on cron or timer, you can just do the session.create at the top. This will create a new flowfile. If you do expect an incoming flow file just return in the null check