What you were seeing was a warning that nifi was intentionally slowing the flow thanks to back pressure from provenance indexing. By switching to volatile thee won't be any back pressure so yes you'll be faster.
Thanks Joe On Jun 10, 2016 4:51 PM, "Shaine Berube" < [email protected]> wrote: > So will that remove the error then? I'm really trying to remove all the > slow downs in this data flow. > > On Fri, Jun 10, 2016 at 2:23 PM, Joe Witt <[email protected]> wrote: > > > Shaine, > > > > You can switch to using volatile/transient provenance storage. To do > > this edit nifi.properties > > > > Find this entry > > > > # Provenance Repository Properties > > > > > nifi.provenance.repository.implementation=org.apache.nifi.provenance.PersistentProvenanceRepository > > > > Change the value to > > > > # Provenance Repository Properties > > > > > nifi.provenance.repository.implementation=org.apache.nifi.provenance.VolatileProvenanceRepository > > > > Restart and you'll have in-memory only provenance for a very small > > number of events. We will add ways to more efficiently index the > > provenance events so that even with full persistence on it will > > support the kinds of usage patterns that can stress the current > > approach. > > > > Thanks > > Joe > > > > On Fri, Jun 10, 2016 at 4:19 PM, Shaine Berube > > <[email protected]> wrote: > > > Any way I can stop this error? I mean, I love the provenance > recorder... > > > but I don't care enough about it to slow down the data flow. > > > > > > -- > > > *Shaine Berube* > > > > > > -- > *Shaine Berube* >
