NiFi listed on Cloud Native Landscape

FYI - NiFi is now listed here: https://raw.githubusercontent.com/cncf/landscape/master/landscape/CloudNativeLandscape_latest.jpg https://github.com/cncf/landscape#current-version Ryan

Re: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

Might want to be careful about that because Avro 1.8 added the support for logical types and removing that could break parts of the Record API like the date/timestamp functionality. On Wed, Nov 15, 2017 at 3:41 PM, Matt Burgess wrote: > Thomas, > > You can file an

Re: How to get DBCP service inside ScriptedLookupService

Hi Folks, after thinking about my scripted components I decided to ditch the ScriptedLookup in favor of writing a InvokeScriptedProcessor that seems more aligned with the proper use explained so far. I've implemented the base script as outlined and added some Properties into my

Re: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

Thomas, You can file an Improvement or New Feature Jira [1] asking for the enhancement. Ironically Avro 1.4.0's Schema.parse() method does allow the dollar sign, but we use Avro 1.8.x now which is apparently more strict. I am toying around with a PegasusSchemaRegistry using the

RE: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

Hello Mike, Thanks for your answer. Do you know how can i ask for an enhancement request for this feature? Regards Thomas DENIMAL De : Mike Thomsen [mailto:mikerthom...@gmail.com] Envoyé : mercredi 15 novembre 2017 19:58 À : users@nifi.apache.org Objet : Re: NIFI 1.4.0 - PutMongo - How to

Re: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

Also, I'll use this thread to bring something about PutMongoRecord into the mailing list for other Mongo users to see. PutMongoRecord cannot support more than document replacement updates because the Mongo update operators use "$" which is an illegal starting character in Avro. So you cannot

Re: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

Not right now. It wouldn't be too hard to add for 1.5. Would supplying a comma-separated list of top-level keys be enough? Something like: siren,nic I am not sure how you'd handle something like "something.siren,another.nic" if that's possible (I know you can supply update operators like that,

Re: Use YARN instead of NPM in Web-UI Module Build

Hi Scott, I build and run it locally, it works fine. But I did not do more test. I just open the ui and checked the jolt processor. Tommorow I'll deploy on server and use it. I hope it will work. If there are any other problems about the ui, I'll post it here. Thanks for you help. On Wed, Nov

Re: NIFI 1.4.0 - PutMongo - How to use composite key for "Update Query key" parameter ?

No one with the same issue ? On 2017-11-04 14:18, DENIMAL Thomas wrote: > Hello ,> > I'm using NIFI 1.4.0 with Mongodb 3.2.17.> > > > > Is it possible to use a composite key for "Update Query key" parameter with > PutMongo processor ?> > My collection "primary key" is a

Re: Powered By NiFi - supplier PR request

Thanks Aziz. I have updated the site with Hastings Group. Cheers. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Nov 15, 2017, at 3:59 AM, Aziz Tarafder > wrote: > > Hi

Re: Encrypting values in custom variable registry files

Ok, I think I get what you're saying. The problem I'm facing is that GetMongo currently does not have a sensitive field definition for password, so it looks like I have to specify a connection string like this: mongodb://${mongo.user}:${mongo.password}@${mongo.ip}:${mongo.port} So our ideal

Re: Use YARN instead of NPM in Web-UI Module Build

Does the web app work now as well? On Wed, Nov 15, 2017 at 11:29 AM, Scott Aslan wrote: > ./node/yarn/bin/yarn install? > > Sorry, I am not familiar with yarn but what I am trying to get you to do > is run the yarn that is installed by the frontend-maven-plugin...but if >

Re: Use YARN instead of NPM in Web-UI Module Build

./node/yarn/bin/yarn install? Sorry, I am not familiar with yarn but what I am trying to get you to do is run the yarn that is installed by the frontend-maven-plugin...but if adding the missing dependencies in the packge.json fixed the issue that is good news! On Wed, Nov 15, 2017 at 11:14 AM,

Re: Encrypting values in custom variable registry files

At this point there is support for sensitive component properties which mean no matter what the value is (whether it is an actual value or a string referencing a variable key) we will ensure it is always encrypted in config files and never returned to any client even in encrypted form unless there

Re: Use YARN instead of NPM in Web-UI Module Build

Hi Scott, The command in step 2 is not working. bash: ./node/yarn: is a directory I manually add the missing dependencies on package.json then build nifi, it works. I think this would be a solution? On Wed, Nov 15, 2017 at 4:57 PM, Scott Aslan wrote: > This is only a

Re: Encrypting values in custom variable registry files

Based on this, https://issues.apache.org/jira/browse/NIFI-2653, it looks like I cannot encrypt the property that holds the MongoDB password if it is in the variable registry file. Is that correct? Thanks, Mike On Wed, Nov 15, 2017 at 9:25 AM, Mike Thomsen wrote: > The

Re: putdatabaserecord

which logs do i need to check On Wed, Nov 15, 2017 at 10:04 AM, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > Could you check share the logs? Remember PostreSQL does not follow SQL > standard >

Re: Use YARN instead of NPM in Web-UI Module Build

This is only a guess: It looks like a few modules the angular material depend upon are not being downloaded. Try this: 1. cd /nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework/nifi-web/nifi-web-ui/target/frontend-working-directory 2. ./node/yarn install Let's see if that runs

Re: Use YARN instead of NPM in Web-UI Module Build

Hi Scott, I changed it to yarn, the build is success. But when I try to run the nifi, the ui is empty (only a background, no other components). It's missing some angular peer dependencies: angular-min.js, angular-messges.min.js, angular-aria.min.js and angular-animate.min.js In Jenkins build,

Re: Use YARN instead of NPM in Web-UI Module Build

Hello, Yarn should only be downloading the client side dependencies at build time so I think what you are proposing will work just fine. You will need to update the web-ui pom to install and run yarn instead of npm but the package.json is already there and should work. -Scott Aslan On Wed, Nov

Re: putdatabaserecord

Could you check share the logs? Remember PostreSQL does not follow SQL standard : *"Quoting an identifier also makes it case-sensitive, whereas unquoted names are always folded to lower case. For

putdatabaserecord

All, I am using putdatabaserecord to insert into a postgres table. The input is a flat json record that is being read by a jsonpath reader. The data will be inserted but when i look at the table it appears that all of the data is null. I also tried using a json tree reader and that didnt work

Encrypting values in custom variable registry files

The encrypt-config tool can encrypt sensitive properties in nifi.properties, but can it be set up to also go into the files specified with the registry property as additional sources of properties? Thanks, Mike

Re: How to get DBCP service inside ScriptedLookupService

Matt, Mark, thanks for the great explanations! I'm learning a lot! :) So I went down the road described but I'm getting another error: groovy.lang.MissingMethodException: No signature of method: org.apache.nifi.lookup.script.ScriptedLookupService$1.getProperty() is applicable for argument types:

FW: FW: Powered By NiFi - supplier PR request

Hi NiFi team, We would like to have Hastings Group added to https://nifi.apache.org/powered-by-nifi.html with the following information: Company: Hastings Group Industry: Insurance Summary: Hastings Group is a fast growing, agile, digitally focused general insurance provider providing services

Use YARN instead of NPM in Web-UI Module Build

Hi, We are building the NIFI from the source code. In the web-ui module, can we use yarn instead of npm? Will the yarn have side effect in nifi? Little background: We need to download all of those stuff use internal artifactory without proxy. And the npm install do not support non-proxy hosts

Groovy:remove all namespace from xml

I want to romeve namespaces from my xml response(now i am working inside nifi environment,so i have to use groovy utilities) here is my code , but it throws FlowfFileHandlingException, what should i change to make this code work?: import org.apache.commons.io.IOUtils import

Re: GetSFTP error

Hello, I haven't tried it myself, but from the stacktrace and Jsch souce code, I think you should specify a file in pkcs8 format, instead of pkcs12. Jsch will leave keypair null if it fails to parse it, that may be the cause of the NullPointerException. For converting a pem file to a pkcs8,