UpdateRecord and arrays

2021-08-11 Thread Robert R. Bruno
Is there a way to use UpdateRecord to update the value of a record that is an array? In the example we have, we'd like to take a string from one field in the record which is a string and copy it into another field that is an array field but currently is null in the record. So something like:

Re: Broken pipe write failed errors

2021-06-01 Thread Robert R. Bruno
OkHttp in the 3.x > series. Thanks again for providing the feedback. > > Regards, > David Handermann > > On Tue, Jun 1, 2021 at 1:31 PM Robert R. Bruno wrote: > >> David, >> >> Quick update for you. We decided after a bit of troubleshooting with >&g

Re: Broken pipe write failed errors

2021-06-01 Thread Robert R. Bruno
connection or > write timeout property would be useful. > > Regards, > David Handermann > > On Sun, May 30, 2021 at 4:54 AM Robert R. Bruno wrote: > >> When seeing the error we put our timeouts values in the processor both to >> 5 mins as a test and still saw the errors a

Re: Broken pipe write failed errors

2021-05-30 Thread Robert R. Bruno
ues with socket >> handling. But had not seen it on Java 11 though may be possible. Is >> there a full stack trace? >> >> On Sat, May 29, 2021 at 12:00 PM Robert R. Bruno >> wrote: >> >>> We upgraded to java 11 when we upgrade to 1.13.2 we were on ja

Re: Broken pipe write failed errors

2021-05-29 Thread Robert R. Bruno
ixed. >> >> >> Juan >> >> On Sat, 29 May 2021 at 15:08, Robert R. Bruno wrote: >> >>> I wanted to see if anyone has any ideas on this one. Since upgrading to >>> 1.13.2 from 1.9.2 we are starting to see broken pipe (write failed) errors >>

Broken pipe write failed errors

2021-05-29 Thread Robert R. Bruno
I wanted to see if anyone has any ideas on this one. Since upgrading to 1.13.2 from 1.9.2 we are starting to see broken pipe (write failed) errors from a few invokeHttp processers. It is happening to processors talking to different endpoints, so I am suspecting it is on the nifi side. We are

A few quick questions

2021-05-28 Thread Robert R. Bruno
We recently moved to version 1.13.2 and are finally using the registry in earnest along with parameter contexts. Being able to store sensitive values is amazing! Had two quick questions: 1. Any good way to turn on/off all controller services in a process group for the UI? 2. Since you can

Re: Detect duplicate records

2020-08-15 Thread Robert R. Bruno
sme’s >> on the project, decided to shelve it. I don’t think I had gotten to the >> point of a jira. >> >> https://apachenifi.slack.com/archives/C0L9S92JY/p1589911056303500 >> >> On August 15, 2020 at 14:12:07, Robert R. Bruno (rbru...@gmail.com) >> wrote

Re: Detect duplicate records

2020-08-15 Thread Robert R. Bruno
koff < >> j...@thefribergs.com> wrote: >> >>> >> >>> In theory I would think you could use the ExecuteStreamCommand to use >> the builtin Operating System sort commands to grab unique records. The >> Windows Sort command has an undo

Detect duplicate records

2020-08-15 Thread Robert R. Bruno
I wanted to see if anyone knew is there a clever way to detect duplicate records much like you can with entire flow files with DetectDuplicate? I'd really rather not have to split my records into individual flow files since this flow is such high volume. Thanks so much in advance.

Re: MergeRecord performance

2020-06-01 Thread Robert R. Bruno
pping, not > OS-level swapping. > > Thanks > -Mark > > [1`] https://issues.apache.org/jira/browse/NIFI-7011 > > > On May 22, 2020, at 10:35 AM, Robert R. Bruno wrote: > > Sorry one other thing I thought of that may help. I noticed on 1.11.4 > when I would stop the

Re: MergeRecord performance

2020-05-08 Thread Robert R. Bruno
ute. I saw the same roughly 10% > performance degradation. > > I’m curious if you’re seeing more than that. If so, I think a template > would be helpful to understand what’s different. > > Thanks > -Mark > > > On Apr 24, 2020, at 4:50 PM, Robert R. Bruno wrote: >

Re: MergeRecord performance

2020-04-24 Thread Robert R. Bruno
gt; > Are you able to share a template and sample data which we can use to > replicate? > > Thanks > > On Fri, Apr 24, 2020 at 4:38 PM Robert R. Bruno wrote: > >> I wanted to see if anyone else has experienced performance issues with >> the newest version of nifi and Me

MergeRecord performance

2020-04-24 Thread Robert R. Bruno
I wanted to see if anyone else has experienced performance issues with the newest version of nifi and MergeRecord? We have been running on nifi 1.9.2 for awhile now, and recently upgraded to nifi 1.11.4. Once upgraded, our identical flows were no longer able to keep up with our data mainly at

Re: Who uses NiFi Cluster in Docker ?

2018-10-19 Thread Robert R. Bruno
Been running nifi cluster in a on-prem kubernetes cluster with a lot of success. We found using local disks volumes helped performance. On Fri, Oct 19, 2018, 03:21 Mike Thomsen wrote: > Guillaume, > > We also have a patch coming in 1.8 that exposes the clustering settings > through Docker, so

Re: Invalid header error

2018-01-11 Thread Robert R. Bruno
alues like we did > for context paths. I've created a JIRA for this option [1]. > > We'll make sure these get appropriately documented for folks running > behind a proxy. > > Thanks > > Matt > > [1] https://issues.apache.org/jira/browse/NIFI-4501 > > On We

Re: Invalid header error

2018-01-09 Thread Robert R. Bruno
I just ran into this as well while trying out 1.5.0-SNAPSHOT. What is the solution where you are running nifi behind a proxy? I tried setting nifi.web.http.host to my proxy ip but then nifi attempted to bind to this ip address. Hopefully I am missing something. If not any chance a config value