unsubscribe

2023-03-08 Thread dan young
unsubscribe

Unsubscribe

2023-03-03 Thread dan young

Re: Securing Nifi 1.11.4

2021-01-09 Thread dan young
Did you grant access to the provenance events to all the cluster nodes too? On Fri, Jan 8, 2021, 11:35 PM Cenk Aktas wrote: > Hello, > > > > We configured to admin UI on SSL with a self-signed certificate. > > Only one user is defined and it has all policies. > > We are not able to see any

Access Policy required to call REST endpoint?

2020-08-17 Thread dan young
Hello, I have a secure cluster that we just brought up, and have a flow that downloads the main Process groups via: GET /process-groups/{id}/download Gets a process group for download but we're seeing a 403 error, I think it's a policy issue, but not sure which one that should be set on.

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
, Aug 5, 2020 at 1:56 PM Mark Payne wrote: > No worries, thanks for following up and letting us know! > > Thanks > -Mark > > > On Aug 5, 2020, at 3:42 PM, dan young wrote: > > Hello, > > Sorry for all the noise...doohwas due to the realm in the > jaas.conf

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
en Sasl/Kerberos is setup correctly? > > In addition to the nifi configs you showed, you would also need a jaas > conf file specified in bootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrote: > >>

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
ootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrote: > >> Hello Mark, >> >> Attached is a dump from one of the nodesI replaced the domain related >> entries with X/x. I'm not

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
erberos is setup correctly? > > In addition to the nifi configs you showed, you would also need a jaas > conf file specified in bootstrap.conf and in that file you would need the > jaas entry for the ZK client. > > On Wed, Aug 5, 2020 at 3:02 PM dan young wrote: > >> He

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
o a DEBUG level, > really. It should not be concerning. A thread dump, though, would show us > exactly where it’s at. > > Thanks > -Mark > > > On Aug 5, 2020, at 2:02 PM, dan young wrote: > > Hello, > Running nifi 1.11.4, 3 X secure cluster mode and have enabled > kerber

cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

2020-08-05 Thread dan young
Hello, Running nifi 1.11.4, 3 X secure cluster mode and have enabled kerberos/sasl, upon trying to startup the cluster, they seem to get stuck in : 2020-08-05 17:10:18,907 WARN [main] o.a.nifi.controller.StandardFlowService There is currently no Cluster Coordinator. This often happens upon

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
so > not sure how it could be authenticating as different identities. > > > On Mon, Jul 6, 2020 at 2:27 PM dan young wrote: > >> Correct, the leader seems to work, but not the components it seems. >> Is there some additional config setting I might be missi

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
) at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ... 17 common frames omitted On Mon, Jul 6, 2020 at 11:59 AM Bryan Bende wrote: > You set CreatorOnly in the ZK > state manager ? > > On Mon, Jul 6, 2020 at 1:40 PM dan young wrote: > >> Fat fi

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
) at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.createNode(ZooKeeperStateProvider.java:360) at org.apache.nifi.controller.state.providers.zookeeper.ZooKeeperStateProvider.setState(ZooKeeperStateProvider.java:321) ... 17 common frames omitted On Mon, Jul 6, 2020 at 11:39 AM dan young wrote: > Hello Bryan, > &g

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
Hello Bryan, Making some progressany insight into this error with GenerateTableFectch processor? On Mon, Jul 6, 2020 at 10:47 AM Bryan Bende wrote: > Have you configured this in nifi.properties? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 P

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
ies? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 PM dan young wrote: > >> Hello, >> >> And a follow up on this, if I delete the znode in zookeeper, the leaders >> is written to the /nifi znode, but the ACL is open, 'world';'anyone I >> do have

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
wrote: > Have you configured this in nifi.properties? > > nifi.zookeeper.auth.type=sasl > > > On Mon, Jul 6, 2020 at 12:43 PM dan young wrote: > >> Hello, >> >> And a follow up on this, if I delete the znode in zookeeper, the leaders >> is written to

Re: zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
in kerberos env? Dano On Mon, Jul 6, 2020 at 10:36 AM dan young wrote: > Hello everyone, > > I'm trying to configure the zookeeper state provider in NiFi to use the > Access Policy of CreatorOnly vs Open using DIGEST vs Kerberos. I believe > I've setup zookeeper correctly for t

zookeeper SASL/Digest authentication....

2020-07-06 Thread dan young
Hello everyone, I'm trying to configure the zookeeper state provider in NiFi to use the Access Policy of CreatorOnly vs Open using DIGEST vs Kerberos. I believe I've setup zookeeper correctly for this, and partly Nifi, but when I startup nifi cluster, we seem to get stuck with the following:

Zookeeper ACL question

2020-06-26 Thread dan young
Hello, I was looking at setting up zookeeper with basic password ACL in a small cluster. Looking at the Nifi docs it mentions something about Username/Password,vs using Kerberos, in the Zookeeper Access Control under the state providers.

Re: Move flow into process group

2020-06-17 Thread dan young
Did you try to copy and then paste them? On Wed, Jun 17, 2020, 9:12 AM PeterEttery wrote: > Good day - > > I'm busy getting to grips with Nifi, using v1.11.4, and would like to move > some processors into a group. > > I can select the processors on the canvas, but can't get them into a group: >

Re: UpdateAttribute processor question...

2020-04-22 Thread dan young
it > would require a code change there, with a default practice being “order as > received". > > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > He/Him > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Apr 22, 2020, at 12:04

UpdateAttribute processor question...

2020-04-22 Thread dan young
Hello, I haven't been able to figure out if this is doable with a single UpdateAttrbute processor, but is it possible to create an attribute that references a different attribute you're setting in the same UpdateAttribute processor? ie. UpdateAttribute a = "foo" b = "bar" c =

Re: what happen to the 1.11.2 download?

2020-02-25 Thread dan young
u'll want to grab 1.11.3. > > Thanks > > > > On Tue, Feb 25, 2020 at 8:18 AM dan young wrote: > >> Hello, >> >> I see the 1.11.2 download is not working, there's a 1.11.3 now. Is there >> a reason it was pulled and should we not be running it in production? >> >> Regards, >> >> Dano >> >

what happen to the 1.11.2 download?

2020-02-25 Thread dan young
Hello, I see the 1.11.2 download is not working, there's a 1.11.3 now. Is there a reason it was pulled and should we not be running it in production? Regards, Dano

nifi toolkit 1.11.x expression language test.

2020-02-21 Thread dan young
Hello, I'm using this as a reference to test some expression language on the command line: https://gist.github.com/mattyb149/13b9bceeace1f7db76f648dfb200b680 This works fine; λ ~/software/nifi-tools groovy testEL-1.9.2.groovy -D dt "2020-02-21 12:00:00" '${dt:toDate("-MM-dd

Re: zookeeper connection string question/clarification

2020-02-20 Thread dan young
e > > Andy LoPresto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Feb 20, 2020, at 3:18 PM, dan young wrote: > > Hello, > > Using Nifi 1.11.1 in cluster mode with external zo

Re: zookeeper connection string question/clarification

2020-02-20 Thread dan young
e...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Feb 20, 2020, at 3:18 PM, dan young wrote: > > Hello, > > Using Nifi 1.11.1 in cluster mode with external zookeeper. Does the > nifi.zookeeper.connect

zookeeper connection string question/clarification

2020-02-20 Thread dan young
Hello, Using Nifi 1.11.1 in cluster mode with external zookeeper. Does the nifi.zookeeper.connect string in the nifi.properties need to change from say: nifi.zookeeper.connect.string= 10.xxx.x.xxx:2181,10.xxx.x.xxx:2181,10.xxx.x.xxx:2181 nifi.zookeeper.connect.string=

Re: timing on release of 1.11.2 ?

2020-02-18 Thread dan young
Great, thank you Joe! Regards Dano On Tue, Feb 18, 2020, 8:41 AM Joe Witt wrote: > it is under vote now. so within a day or so possibly > > thanks > > On Tue, Feb 18, 2020 at 9:26 AM dan young wrote: > >> Howdy folks, >> >> Just curious what the wor

timing on release of 1.11.2 ?

2020-02-18 Thread dan young
Howdy folks, Just curious what the word on the street for releasing 1.11.2 Regards, Dano

Re: zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
/zookeeperReconfig.html On Wed, Feb 12, 2020, 5:53 PM 노대호Daeho Ro wrote: > In my memory, > > zookeepr 3.5.6 needs the new form of zookeeper string such as > > server.1=0.0.0.0:2888:3888;2181 > > > where the ip is yours. > > Hope this help you. > > > 2020년 2월 13일 (

Re: zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
:participant} Regards, Dano On Wed, Feb 12, 2020 at 9:49 AM Joe Witt wrote: > Dan, > > Not sure what others see but for me your email cuts off in the middle of a > line. > > You might want to file a JIRA with your observation/logs. > > Thanks > > On Wed, Feb 12, 202

zookeeper error message - nifi 1.11.1/zookeeper 3.5.6

2020-02-12 Thread dan young
Hello, We're seeing the following messages in nifi logs on our cluster nodes. Using Nifi 1.11.1 and zookeeper (not embedded) version 3.5.6 Functionality seems not to be impacted, but wondering if there's something else going on or the version of zookeeper we're using is causing this.

Re: can't ush data to bigQuery

2019-09-26 Thread dan young
yea, the arrayswe use jq to flatten and format all our JSON glad to see you got it! dano On Thu, Sep 26, 2019 at 6:54 AM Nicolas Delsaux wrote: > Oh well, i've understood my last error : incorrect flow files (with JSOn > arrays) were stuck in the queue. > > I removed them and ... to

Re: Running NiFi on Google Cloud

2019-07-28 Thread dan young
Hello Márcio, We've been running NiFi clusters for almost 3 years now at Looker on AWS. We will be moving these over to GCP in the future. My main recommendation is to ensure that you're using something like Ansible to help with the deployment and configuration of the cluster. We use a lot of

Re: UI/canvas question.

2019-07-26 Thread dan young
; -Mark > > > On Jul 25, 2019, at 11:21 PM, dan young wrote: > > Hello, > > We have a processor that we terminated via the UI, and now on the canvas I > see what I believe is the active thread count and then a 1 between > parenthesis (1) .. See attached screen shot. Also

UI/canvas question.

2019-07-25 Thread dan young
Hello, We have a processor that we terminated via the UI, and now on the canvas I see what I believe is the active thread count and then a 1 between parenthesis (1) .. See attached screen shot. Also in on the processor that we killed, we see that an indicator in red with the (1). What do these

Re: DistributeLoad across a NiFi cluster

2019-07-09 Thread dan young
If you're going to upgrade, I would recommend jumping to the latest version, 1.9.2 as of today. We ran into some issues in 1.8 with this feature that was fixed in 1.9.x. We're running 1.9.2 now with this feature now in production. Regards Dano On Tue, Jul 9, 2019, 6:58 AM wrote: > The feature

1.9 release date?

2019-02-16 Thread dan young
Heya folks, Any insight on 1.9 release date? Looks like a lot of goodies and fixes included... Regards, Dano

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-02-08 Thread dan young
he rest of the flow or > do they get lost/dropped? > > -Chad > > *From: *dan young > *Reply-To: *"users@nifi.apache.org" > *Date: *Thursday, January 17, 2019 at 7:49 PM > *To: *NiFi Mailing List > *Subject: *Re: flowfiles stuck in load balanced queue; nifi 1.

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-01-17 Thread dan young
> Sent from my iPhone > > On Jan 17, 2019, at 6:59 PM, dan young wrote: > > Hello Mark, > > We're seeing "stuck" flow files again, this time within a PG...see > attached screen shots :( > > > > On Fri, Dec 28, 2018 at 8:43 AM Mark Payne wrote: > >

Re: Preferred schema registry

2019-01-15 Thread dan young
We used the AvroSchemaRegistry Dano On Tue, Jan 15, 2019, 12:51 PM Mike Thomsen What schema registry are others using in production use cases? We tried > out the HortonWorks registry, but it seemed to stop accepting updates once > we hit "v3" of our schema (we didn't name it v3, that's the

Re: flowfiles stuck in load balanced queue; nifi 1.8

2019-01-05 Thread dan young
his and figure > it all out - would not have been able to > figure it out without you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote: > >

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-28 Thread dan young
ithout you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote: > > Hello Mark, > > I just stopped the destination processor, and then disconnected the node > in que

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-28 Thread dan young
out you spending the time to debug the issue! > > Thanks > -Mark > > [1] https://issues.apache.org/jira/browse/NIFI-5919 > > > On Dec 26, 2018, at 10:31 PM, dan young wrote: > > Hello Mark, > > I just stopped the destination processor, and then disconnected the node >

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-26 Thread dan young
ting that you restart with the connection’s source and destination > stopped. Just to make sure that the FlowFile didn’t just get processed > quickly on restart. > > Sent from my iPhone > > On Dec 26, 2018, at 7:55 PM, dan young wrote: > > Heya Mark, > > If we res

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-26 Thread dan young
es: > > 1) The Queue's Count is wrong, because it somehow did not get decremented > (perhaps a threading bug?) > > Or > > 2) The Count is correct and the FlowFile exists, but somehow the reference > to the FlowFile was lost by the FlowFile Queue (again, perhaps a threadi

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
I forgot to mention that we're using the OpenId Connect SSO . Is there a way to run these command via curl when we have the cluster configured this way? If so would anyone be able to provide some insight/examples. Happy Holidays! Regards, Dano On Sun, Dec 23, 2018 at 3:53 PM dan young wrote

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
] o.a.n.w.a.c.AccessDeniedExceptionMapper identity[anonymous], groups[none] does not have permission to access the requested resource. Unknown user with identity 'anonymous'. Returning Unauthorized response. On Sun, Dec 23, 2018 at 3:50 PM dan young wrote: > Hello Mark, > > I have a queue again with

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-23 Thread dan young
in question. This gives us > a lot of information about the internals of Connection. The easiest way to > get that Processor ID is to just click on the > processor on the canvas and look at the Operate palette on the left-hand > side. You can copy & paste from there. If you

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-19 Thread dan young
the threads > with no work to do. Which is what I would expect. > The question is: "Why does it not think there's work to do?" So the > diagnostics and DEBUG logs will hopefully answer that, > once you get back into that state again. > > Thanks > -Mark > > > On Dec 19,

Re: flowfiles stuck in load balanced queue; nifi 1.8

2018-12-19 Thread dan young
your browser is fine) > /nifi-api/processors//diagnostics > > Where is the UUID of either the source or the destination > of the Connection in question. This gives us > a lot of information about the internals of Connection. The easiest way to > get that Processor ID is to just click

Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-12-15 Thread dan young
t; Have looked through the logs to see if there are any WARN or ERROR's > indicating what's going on? > > > > Thanks > > -Mark > > > > > > On Nov 12, 2018, at 9:06 AM, dan young wrote: > > > > Hello, > > > > We have two processor

Re: Load Balancing connection issue

2018-12-03 Thread dan young
We've been seeing issues , three times now, where it seems like a flowfile is stuck in a load balanced queue. We're not able to empty the queue or view the flowfile that appears to be in the queue. The only resolution for use right now is to detach the node where the Flowfile is in the queue, then

Re: NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-11-12 Thread dan young
il we reboot the next one to get as much performance as possible. It > must be a bug in this new Load Balancing/Round Robin queue… any comments > from the devs? > > > > Cheers Josef > > > > *From: *dan young > *Reply-To: *"users@nifi.apache.org" > *Date: *M

NiFi 1.8 and stuck flowfile in Load Balanced enabled queue

2018-11-12 Thread dan young
Hello, We have two processor groups connected via the new Load Balancing/Round Robin queue. It seems that a flowfile is "stuck" in this queue. I've been watching it for some time now. Is there any way to trouble shoot what is stuck in the queue and why? or maybe remove it? I've tried to

Available SQL fn in QueryRecord??

2018-10-26 Thread dan young
Hello, Is there a list or somewhere we can find all the available SQL functions available in QueryRecord? Regards Dano

NiFi 1.8 release date?

2018-10-16 Thread dan young
Any ideas on when 1.8 might be dropping? Regards, Dano

Re: Anyone using HashAttribute?

2018-09-05 Thread dan young
Presto > alopre...@apache.org > *alopresto.apa...@gmail.com * > PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > > On Sep 5, 2018, at 4:09 PM, dan young wrote: > > We're using it as well, in the same/similar fashion as being discussed in > the thread... >

Re: Anyone using HashAttribute?

2018-09-05 Thread dan young
We're using it as well, in the same/similar fashion as being discussed in the thread... Dano On Wed, Sep 5, 2018, 10:07 AM Brandon DeVries wrote: > Andy, > > We use it pretty much how Joe is... to create a unique composite key. It > seems as though that shouldn't be a difficult functionality

Re: Title: Feature needed - ConvertJSONToCSV processor

2018-08-07 Thread dan young
You could look at using ExecuteStreamCommand + JQ. We use this pattern a lot... Regards Dano On Tue, Aug 7, 2018, 5:09 AM Mahendra prabhu wrote: > Expected behaivor is similiar to this task created - > https://issues.apache.org/jira/browse/NIFI-4398 I couldnt achieve this > using

Re: [ClojureVerse] Summaryb

2018-06-14 Thread dan young
On Wed, Jun 13, 2018, 9:19 PM ClojureVerse summary < notificati...@clojureverse.org> wrote: > A brief summary since your last visit on May 31 > [image: ClojureVerse] > > > > Since your last visit > *16* *1* >

Nifi toolkit grape dependecies

2018-05-22 Thread dan young
Hello, I'm trying to run the Nifi Expression testing groovy tool with 1.6.0 and am getting the following dep errorNifi 1.4 and 1.5 works fine. I tried to also download via grape in the groovy cli the jackson-core and it doesn;t work for the 2.9.4 version 2.9.5 works fineany ideas? I

Re: First steps with Nifi

2018-05-11 Thread dan young
Awesome! NiFi is an amazing tool. As Joe mentioned the docs are a great place to start along with the Hortonworks forums. Although we don't use HDP, the content is still very relevant. Start simple and iterate...Install on your laptop and start moving bits! Regards Dano On Fri, May 11, 2018,

NiFi 1.6

2018-04-05 Thread dan young
any updates on when 1.6 is going to drop? dano

ExecuteStreamCommand - 1.5

2018-02-02 Thread dan young
Just wanted to shout out and thank you for adding the "nonzero status" to the ExecuteStreamCommand in NiFi 1.5! Has really simplified my exception handling kudos! Regards, Dano

Re: all of our schedule tasks not running/being scheduled....

2018-01-30 Thread dan young
gt; bin/nifi.sh dump > > And ideally send the full contents of the logs directory in a tar.gz > > tar czvf nifilogs.tar.gz logs > > Thanks > Joe > > On Tue, Jan 30, 2018 at 8:43 AM, dan young <danoyo...@gmail.com> wrote: > > Hello Koji, > > > >

Re: all of our schedule tasks not running/being scheduled....

2018-01-30 Thread dan young
gt; Thanks, > Koji > > On Tue, Jan 30, 2018 at 1:10 PM, dan young <danoyo...@gmail.com> wrote: > > Hello, > > > > We're running a secure 3 node 1.4 cluster. Has anyone seen any behaviour > > where the cluster just stops scheduling the running of flowfiles

all of our schedule tasks not running/being scheduled....

2018-01-29 Thread dan young
Hello, We're running a secure 3 node 1.4 cluster. Has anyone seen any behaviour where the cluster just stops scheduling the running of flowfiles/tasks? i.e. cron/timer, just don't run when they're suppose to. I've tried to stop and restart a processor that is say set to run ever 900sec, but

Re: unable to search provenance repository

2018-01-17 Thread dan young
; Well, I think i'm hoping it was the restart and not the change of > shard size because one I can understand and the other I cannot :) > > If you think you run into this again can you please get thread dumps > and share them? > > Thanks! > > On Wed, Jan 17, 2018 at 10:41 A

Re: unable to search provenance repository

2018-01-17 Thread dan young
> > On Tue, Jan 16, 2018 at 7:26 PM, dan young <danoyo...@gmail.com> wrote: > > Hello, > > > > We're running a secure 3 node 1.4 cluster, and for some reason we're not > > able to search processor provenance event. i.e. trying to search a for a > >

unable to search provenance repository

2018-01-16 Thread dan young
Hello, We're running a secure 3 node 1.4 cluster, and for some reason we're not able to search processor provenance event. i.e. trying to search a for a particular event by filename, but the results always come back empty, even though when I view the provenance event history I can see the event.

Re: unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-06 Thread dan young
ry, you > can even use the same properties already defined for your truststore and I > believe your processor will start working. > > Please let me know if I have misdiagnosed or if there are issues with the > workaround. > > Thanks, > Josh > > On Tue, Dec 5

Re: unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-05 Thread dan young
Also, please file a JIRA for this. There is definitely a bug that > needs to be addressed if you can make an NPE happen. > > Thanks > > On Mon, Dec 4, 2017 at 12:27 PM, dan young <danoyo...@gmail.com> wrote: > > Hello, > > > > > > I'm working on migrat

unable to start InvokeHTTP processor in secure Nifi 1.4.0 cluster....

2017-12-04 Thread dan young
Hello, I'm working on migrating some flows over to a secure cluster with OIDC. When I try to start an InvokeHTTP processor, I'm getting the following errors in the logs. Is there some permission/policy that I need to set for this to work? or is this something else? Nifi 1.4.0 2017-12-04

Re: Authorization and Multi-Tenancy functionnalities Evaluation -> Unable to locate initial admin error

2017-11-17 Thread dan young
Thanx Bryan, On a side note, after beating my skull against a sharp pen all for a few hours and losing about a pint of blood... I was able to get this working. One thing to note that wasn't clear to me initially, is that you need to add all the cluster nodes into both the userGroupProvider and

Re: How to start a flow with attributes from the state store?

2017-10-20 Thread dan young
Same here, works great! On Fri, Oct 20, 2017 at 7:27 AM Mike Thomsen wrote: > I can vouch for this method. I have two flows for a client that use > GenerateFlowFile to build a JSON DSL query for ElasticSearch and are > executed on a timer. Works quite well with

Re: Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
hema. Maybe this helps. > > > > Rgds, > > > > Uwe > > > > > > Gesendet: Mittwoch, 04. Oktober 2017 um 16:55 Uhr > > Von: "Mark Payne" <marka...@hotmail.com> > > An: "users@nifi.apache.org" <users@nifi.apache.org> > >

Re: Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
.org> > > > > Betreff: Re: Nifi 1.4: problem with QueryRecord Precessor > > Dan, Uwe, > > > > This is something that I will be looking into shortly. It is a known > issue > > that exists in both 1.3 > > and 1.4. This occurs whenever there is

Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
sort of failure, when > the processor attempts > to route the FlowFile to 'failure'. This occurs most often when there is a > problem obtaining the > schema for the Record. Can you check your logs and see what other error > may be present > in the logs? > > Thanks > -M

Re: Nifi 1.4: problem with QueryRecord Precessor

2017-10-04 Thread dan young
We're seeing the same thing. Works fine in 1.3 Dano On Wed, Oct 4, 2017, 8:13 AM Uwe Geercken wrote: > Hello, > > I have created a flow: GetFile >> QueryRecord >> Putfile. GetFile reads an > avro file. QueryRecord has one property/sql and the result is routed to > PutFile.

Re: Parameterizing the nifi flow

2017-08-13 Thread dan young
We've done something similar as Carlos outlines here. Works really great Dano On Sun, Aug 13, 2017, 9:39 AM Carlos Manuel Fernandes (DSI) < carlos.antonio.fernan...@cgd.pt> wrote: > Hi Vikram, > > > > I had the same requirements like you , and my solution is a service: > > > >

NiFi 1.2?

2017-03-22 Thread dan young
Any update on when 1.2 might be released into the wild? Regards, Dano

Re: Most popular processors

2017-03-17 Thread dan young
Hey Pere, Here's a list of the processors we use the most often, not in any order... UpdateAttribute InvokeHTTP ExecuteScriptCommand ExecuteScript PutS3Object PutSNS GetFile/PutFile RouteOnAttribute HandleHttpRequest/Response GenerateFlowFile EvaluateJsonPath GenerateTableFetch ExecuteSQL