Re: Run Nifi in IntelliJ to debug?

breakpoints within your code. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 27, 2020, at 9:08 AM, Darren Govoni wrote: > > Hello, >So i was able to get intelliJ to debug nifi but onl

Re: Securing MiNiFi

We’ll try to clean up the NiFi docs, but vendor documentation is out of our control. Glad it’s working for you now. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 21, 2020, at 17:46, sco

Re: Securing MiNiFi

you just not share that portion? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 21, 2020, at 11:18 AM, scotty wrote: > > Hi, > > Here's the info: > >

Re: [EXT] sslcontext certs

components reference those parameters in the path properties. [1] https://nifi.apache.org/docs/nifi-docs/html/user-guide.html#Parameters Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 15, 2020, at 7

Re: Securing MiNiFi

MiNiFi’s flow definition is persisted in the config.yml file. You should examine that file for the plaintext URL below and update it with the HTTPS URL (protocol & port). That will indicate that it should connect over TLS. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He

Re: Securing MiNiFi

You can use the toolkit to generate another “server/node” certificate just as you did for the NiFi instance (do this from the same toolkit instance & directory to ensure both are signed by the same CA) and this will generate both the keystore and truststore JKS to use for MiNiFi.

[ANNOUNCE] Apache NiFi CVE-2020-9486, CVE-2020-9487, CVE-2020-9491, CVE-2020-13940

values in plaintext. Mitigation: Implemented Argon2 secure hashing to provide a deterministic loggable value which does not reveal the sensitive value. Users running any previous NiFi release should upgrade to the latest release. Credit: This issue was discovered by Andy LoPresto and Pierre

Re: WebSocket Service - Using Trusted Certificates

s there a reason you’re using web sockets between two NiFi instances? The NiFi Site-to-site protocol [1] offers a number of advantages. [1] https://medium.com/@abdelkrim.hadjidj/hub-and-spoke-architectures-with-nifi-site-to-site-communications-at-any-level-a-nifi-1-10-a8702f77c66e Andy LoPres

Re: Jks password migration issue

#encrypt_config_tool <https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#encrypt_config_tool> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 27, 2020, at 6:52 AM, sanjeet ra

Re: Connect NiFi to MongoDB(Atlas)

This was discussed in the Slack channel [1] and NIFI-7768 [2] was filed to address it. [1] https://apachenifi.slack.com/archives/C0L9VCD47/p1598402012117700 [2] https://issues.apache.org/jira/browse/NIFI-7768 Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint

Re: Site to Site with multi-entry keystore?

certificate trust; the user identity is proxied in the request itself and used for authorization)? Have you checked the logs/nifi-app.log and logs/nifi-user.log files to see what identity the incoming authentication request is presenting? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com

Re: SSL/LDAP Configuration

, you can copy/paste as many as you want to define them. Again, this is not the ideal situation; most of this should be possible through the UI but I’m not sitting there to diagnose the issue. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: SSL/LDAP Configuration

all my usual resources available, but hopefully this guides you in the right direction. If not, please let me know and tomorrow I can provide more specific instructions. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F6

Re: Flow.xml.gz gets overwritten with Empty Flow.xml

very interested in pursuing this approach. [1] https://issues.apache.org/jira/browse/NIFI-6999 <https://issues.apache.org/jira/browse/NIFI-6999> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 &g

Re: NiFi 1.12.0 - KeyStores with multiple certificates are not supported

stantial refactoring in the core framework and is not planned for any immediate attention. [1] https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#wildcard_certificates Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4

Re: Nifi takes too long to start(~ 30 minutes)

instance? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 16, 2020, at 10:28 PM, Mohit Jain wrote: > > Hi Pierre, > > No, the election process takes only a minute or two max, reaching

Re: FetchSFTP: Rename file on move

You can also use an UpdateAttribute processor to change the “filename” attribute, which is what any “file persistence” processor (PutSFTP, PutFile, etc.) will use when writing the file out. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: Data Provenance Stops Working

tes> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 10, 2020, at 10:00 AM, Shawn Weeks wrote: > > I’m running a three node NiFi Cluster on AWS EC2s using integrated Zookeeper &g

Re: Get all available variables in the InvokeScriptedProcessor

can define dynamic properties on the processor config and reference those directly in code (see any existing processor source for examples). Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 9, 2

Re: External Access using InvokeHTTP_Test processor and StandardSSLContextService

, obtain the public certificate of that endpoint and manually create a truststore containing that cert. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 7, 2020, at 1:14 AM, Valentina Ivanova wr

Re: Get all available variables in the InvokeScriptedProcessor

variables starting with prefix: def varsStartingWithABC = this.binding.variables.findAll { k,v -> k.startsWith(“a.b.c”) } Find all attributes starting with prefix: def attrsStartingWithABC = flowfile.getAttributes().findAll { k,v -> k.startsWith(“a.b.c”) } Andy LoPresto

Re: External Access using InvokeHTTP_Test processor and StandardSSLContextService

lqw/index.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 6, 2020, at 6:32 AM, Jorge Machado wrote: > > Hi Dan, > > Seems like this is a jvm issue. &g

Re: cluster stick in "Attempted to register Leader Election for role 'Cluster Coordinator' but this role is already registered"

you mean n...@x.net <mailto:n...@x.net>?” Or even potentially trying to do case-conversion internally as a fallback. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Aug 5, 2020, at 2:50 PM, dan yo

Re: SSL/LDAP Configuration

https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#ldapusergroupprovider <https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#ldapusergroupprovider> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C

Re: SSL/LDAP Configuration

er-tls-ssl-against-active-directory#post1908811> [2] https://devconnected.com/how-to-search-ldap-using-ldapsearch-examples/ <https://devconnected.com/how-to-search-ldap-using-ldapsearch-examples/> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E

Re: Nifi security of local filesystem and hdfs in multitenant hdfs use cases

processes are running as a single OS user, so all of the keytabs will need to be readable by that OS user, and the OS can’t detect which Java process is acting as which application user. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4

Re: Template not saving parameter context assignment

segments directly to/from a NiFi instance without NiFi Registry but they are not released yet. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul 28, 2020, at 2:00 PM, bsavard wrote: > > Hi, >

Re: Issue with Secured NiFi on kubernetes using Helm charts

misunderstanding your statement, but I am curious why the toolkit can’t run on the node — if you don’t have Java available, how does NiFi itself run? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul

Re: Issue with Secured NiFi on kubernetes using Helm charts

/nifi-docs/html/administration-guide.html#security_configuration <https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#security_configuration> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7

Re: Processor setup - Outbound Proxy Config

://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi/nifi-proxy-configuration-nar/1.11.4/org.apache.nifi.proxy.StandardProxyConfigurationService/index.html Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: PutFile set Last Modified Time without file.creationTime

/nifi-docs/html/expression-language-guide.html#todate <https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#todate> [2] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#format Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

org/json.html#> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 29, 2020, at 7:41 AM, Myklebust, Bjørn Magnar > wrote: > > Andy, just a quick followup on this. > > I wanted to test a

Re: unsubscribe

Please send a message to users-unsubscr...@nifi.apache.org <mailto:users-unsubscr...@nifi.apache.org> to unsubscribe. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 29, 2020, at 8:36 AM

Re: Duplicate Attribute Values in Extract Text Processor Output

line (minus the final character) into an attribute, and then sends the values to Syslog. You may want to look at the record processors to improve the performance and simplicity of the flow substantially. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

using the Groovy script to perform those steps in tandem is probably the most performant and logical approach here. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 24, 2020, at 11:25 PM, Mykleb

Re: Duplicate Attribute Values in Extract Text Processor Output

. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 25, 2020, at 8:27 AM, muhyid72 wrote: > > Dear All > I need an information about Flow Files Attribute of Extract Text Processor. >

Re: Replacing a base64-encoded field in a JSON-document with its decoded/converted value

pe this helps. [1] https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#base64decode <https://nifi.apache.org/docs/nifi-docs/html/expression-language-guide.html#base64decode> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5

Re: 3 node of nifi generating 3 different flow files

Sanjeet, Did you stop every node in the cluster before deleting these files? Can you share the actual output of the log files? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 18, 2020, at 5:15

Re: 3 node of nifi generating 3 different flow files

Sanjeet, If this is for a new cluster, you can delete the flow.xml.gz file from all nodes and restart NiFi. When the nodes start up again, they will create the new flow definition file on each node respectively with the synced root process group ID. Andy LoPresto alopre...@apache.org

Re: 3 node of nifi generating 3 different flow files

secure these values and you want to migrate to a new key. When starting a new cluster, set the nifi.sensitive.props.key value to the desired value on all cluster nodes, and NiFi will automatically encrypt and decrypt the sensitive processor properties with it. Andy LoPresto alopre

Re: AmazonDocumentDB

If that was the issue, you can also import those PEM files into a Java Keystore (.jks) file and configure the SSL Context Service your Mongo processors use to reference it as a truststore. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F

Re: In memoriam of Jeff Storck

Jeff loved mocks, both friendly impressions and in his tests. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 15, 2020, at 12:12 PM, Jeremy Dyer wrote: > > This is shocking and heartbrea

Re: MergeContent resulting in corrupted JSON

contributors with a date in the last couple years, I trust it much more than even code by those same people from 5 years ago (which was likely written even longer ago than that; time “starts” from the initial import in 2014). Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: NiFi Expression Language in UpdateAttribute

Russell, I think it would be fine to include an example like this in the Expression Language Guide. You can submit a PR to add that if you like. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun

Re: Expression language null value

uide> [4] https://nifi.apache.org/developer-guide.html <https://nifi.apache.org/developer-guide.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 11, 2020, at 7:40 AM, Fabrizio Sp

Re: MergeContent resulting in corrupted JSON

and delegate that to an implementation, or I could have a giant switch statement and the raw crypto primitive code all in a giant spaghetti method/callback definition. I know I would prefer the former. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC

Re: MergeContent resulting in corrupted JSON

It may just be a copy/paste or retyping issue, but in the example you provided, I see unpaired double quotes (the hexBytes values have trailing quotes but not leading ones), which could be causing issues in parsing… Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: Execute Script - Groovy get attribute

It also seems like you would rather set the flowfile batch count as a _property_ on the ExecuteScript processor and obtain it from the session, rather than check a specific flowfile for an attribute which may or may not exist. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He

Re: Prometheus reporting task

At a quick glance it does not look like there is much logging. Perhaps Matt Burgess can offer more context around this? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jun 1, 2020, at 2:45 PM, Pave

Re: Prometheus reporting task

.nabble.com/Metrics-via-Prometheus-tp9102p9107.html <http://apache-nifi-users-list.2361937.n4.nabble.com/Metrics-via-Prometheus-tp9102p9107.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 >

Re: Accessing flow attributes from ExecuteStreamCommand

t or InvokeScriptedProcessor, in which case the NiFi session API is available to your code and you can interact directly with attributes. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 28, 202

Re: Error to connect using ConsumeAMQP processor

t? I suspect the issue is with Docker networking making those ports available to resolve within the other container. Have you followed the steps in [1]? [1] https://www.rabbitmq.com/troubleshooting-networking.html <https://www.rabbitmq.com/troubleshooting-networking.html> Andy LoPre

Re: ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

Thanks Eric. Glad to know what the issue was and this should help people in the future. Always appreciate when people follow up and document a solved problem for the benefit of the community. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6

Re: Connecting Controller Services Automatically

Yes, I should have clarified this. Thanks Bryan. This is the solution for the generic use case. The original question was about reducing the controller to only a single instance of a specific controller service implementation, which is how the tangent got started. Andy LoPresto alopre

Re: Connecting Controller Services Automatically

manual manipulation of the flow.xml.gz in various environments and frequent restarts of the NiFi service. I do not recommend this. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 23, 2020, at 11

Re: Connecting Controller Services Automatically

If you want the process to be completely automated, you would have to enforce the controller service IDs to be identical across environments. Otherwise deployment would need a manual intervention to reference the specific controller service in the proper component. Andy LoPresto alopre

Re: Connecting Controller Services Automatically

constraints on future flow development. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 22, 2020, at 3:01 PM, Eric Secules wrote: > > Hello everyone, > > I am running into an issue

Re: Use of SNI routing in Nifi ?

you have a specific desired scenario, I can try to analyze it, but the entire concept of having multiple NiFi services or NiFi + other services be exposed on the same port and use SNI to differentiate seems unnecessary to me. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him

Re: Use of SNI routing in Nifi ?

Hi Pat, Are you asking if NiFi’s internal web server supports SNI or if NiFi processors/framework connecting to external services can resolve SNI? Maybe some more context around your question would help us answer. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: ExecuteProcess processor with TLS1.2 error: "failed setting cipher list"

. 3. Run curl -vvv to see increased verbosity output. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On May 22, 2020, at 8:08 AM, Eric Chaves wrote: > > Hi folks, > > I have a flow

Re: Secure Nifi with DigiCert

certificate, which you the user (your browser) verify and decide to trust. When you visit a NiFi instance which is secured and has no other authentication mechanism configured, the only way to authenticate is to present a client certificate. Andy LoPresto alopre...@apache.org alopresto.apa

Re: NiFi and real-time data lake

Thanks Boris, this is really interesting to read and I appreciate that you’re sharing it with the community. We’re glad NiFi can help with these important use cases. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B

Re: Is provenance data preserved when processors are deleted?

endorsement, but there are other metadata storage systems like Apache Atlas [1] which you may want to look at for longer retention and some of the features you’re looking for, like a UI for lineage graphs. [1] https://atlas.apache.org/#/ <https://atlas.apache.org/#/> Andy LoPresto alopre...@apac

Re: ConsumeIMAP certificates issue

the following truststores, one at a time, in this order: 1. JRE cacerts (copy the actual cacerts and ensure you have a backup before you start modifying it) 2. The NiFi truststore configured in nifi.properties Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint

Re: POST multipart/form-data with Invokehttp

ExecuteProcess and ExecuteStreamCommand both allow shell commands to be run; ExecuteProcess does not allow incoming flowfiles but ExecuteStreamCommand does. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: OIDC Redirect loop

easy way to validate this would be to change the stateful set # to 1 node and attempt the same sequence of operations. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 27, 2020, at 8:12 AM,

Re: UpdateAttribute processor question...

but would still not provide the result you’re expecting. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 22, 2020, at 12:38 PM, Andy LoPresto wrote: > > Dan, > > Unfortunately I don

Re: UpdateAttribute processor question...

, but I think currently the API doesn’t request that order so it would require a code change there, with a default practice being “order as received". Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69

Re: Avro Single Object Binary Encoding

ira/projects/NIFI/issues> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Apr 20, 2020, at 2:59 AM, nathan.engl...@bt.com wrote: > > Hi There, > > Apologies if this has been asked bef

Re: Include parent fields into the output record fields in XML data

CSV. You can also use the QueryRecord processor to perform SQL-like queries over large datasets in a flowfile which might be helpful in forming the output you’re looking for. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E

Re: Storing output of shellscript in s3 bucket

r with the path in the filename attribute (update using an UpdateAttribute processor if necessary). I would recommend the first option as a cleaner and more robust solution. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E

Re: How to iterate over all dynamic properties in python invokeScriptedProcessor?

ndex.html> [2] https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/nifi/models/processor_config_dto.py <https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/nifi/models/processor_config_dto.py> [3] https://github.com/Chaffelson/nipyapi/blob/master/nipyapi/canvas.py#L225 <htt

Re: alternate web root directory?

perhaps the ability to inject a path prefix, but I expect it to be a high level of effort to implement. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Mar 18, 2020, at 9:25 AM, Wyllys Ingersoll >

Re: Nifi - Python SDKs

the NiFi flow directly and be reusable without external dependencies. You can also use the ExecuteProcess or ExecuteStreamCommand processors to invoke shell commands, including calling an external Python script. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com He/Him PGP

Re: zookeeper connection string question/clarification

Thanks Dan. If it works, we can update the MG with that example as well. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 20, 2020, at 3:28 PM, dan young wrote: > > ok, great thank you. Yes, we

Re: zookeeper connection string question/clarification

Sorry, I should have elaborated that I was referencing the link from the MG. I realize you’re using external ZK and this is for embedded. Yes, I believe you will need to change the format of your connection string. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint

Re: zookeeper connection string question/clarification

number may be) Add the client port to the end of the server string eg: server.1=localhost:2888:3888;2181 [1] https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance <https://cwiki.apache.org/confluence/display/NIFI/Migration+Guidance> Andy LoPresto alopre...@apache.org a

Re: NiFi user and access rights

the respective MiNiFi agents running as that user) and communicate the necessary data back to a central processing instance. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Feb 12, 2020, at 6:54

Re: Can jetty reload keystore credentials dynamically?

. Please file a Jira for this specifically and include it in the linked epic. [1] https://github.com/eclipse/jetty.project/issues/918 <https://github.com/eclipse/jetty.project/issues/918> [2] https://issues.apache.org/jira/browse/NIFI-5458 <https://issues.apache.org/jira/browse/NIFI-54

Re: NiFi Cluster setup

e-nifi-1-0-0-cluster-setup/ <https://pierrevillard.com/2016/08/13/apache-nifi-1-0-0-cluster-setup/> [4] https://pierrevillard.com/2017/05/11/monitoring-nifi-introduction/ <https://pierrevillard.com/2017/05/11/monitoring-nifi-introduction/> Andy LoPresto alopre...@apache.org alopre

Re: Need help for TLS implementation with CA signed certificates

https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#tls_intermediate_ca [3] https://nifi.apache.org/docs/nifi-docs/html/toolkit-guide.html#tls_external-signed_ca Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7

Re: SSLContextService configuration

org/> [4] https://issues.apache.org/jira/browse/NIFIREG-288 <https://issues.apache.org/jira/browse/NIFIREG-288> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jan 3, 2020, at 10:50 AM, Etienne Jo

Re: NiFi Cluster - Every Node is Named localhost

Did you set the nifi.web.https.host= value, nifi.remote.input.host= value, and nifi.cluster.node.address= value in nifi.properties? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Dec 10, 2019, at 6:59

Re: Clarification regarding NiFi registry

to the registry instance as necessary. [1] https://nifi.apache.org/docs/nifi-registry-docs/index.html <https://nifi.apache.org/docs/nifi-registry-docs/index.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7

Re: Encrypting passwords - Nifi 1.10.0

=aes/gcm/256” line following it) and tries to decrypt the plaintext value, that would cause the exception to be thrown. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Dec 9, 2019, at 2:22 PM, Juan Pa

Re: Encrypting passwords - Nifi 1.10.0

html/user-guide.html#encrypted-provenance> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Dec 8, 2019, at 8:01 PM, Juan Pablo Gardella > wrote: > > Hello all, > > I am trying to prot

Re: NiFi Upgrade 1.9.2 to 1.10.0 - LDAP Failure

m/ldap-result-code-reference-core-ldapv3-result-codes/#rc-confidentialityRequired <https://ldap.com/ldap-result-code-reference-core-ldapv3-result-codes/#rc-confidentialityRequired> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BA

Re: How to replace multi character delimiter with ASCII 001

I haven’t tried this, but you might be able to use ${"AQ==“:base64Decode()} as AQ== is the Base64 encoded \u0001 ? Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Nov 6, 2019, at 12:25 PM, Shawn Week

Re: Converting long string to JSON format.

I think you could accomplish this using ConvertRecord. For the Record Reader, use a CSVReader with the delimiter character set to |, and for the Record Writer, use a JsonRecordSetWriter. You may have to use a ScriptedRecordSetWriter to parse the key/value pair tokens out individually. Andy

Re: Nifi Single Instance mode to Cluster Mode

(Removing dev@; only use one list please) Hi Bimal, That error generally means the encryption key used to decrypt the sensitive value was not correct — i.e. not the key used to encrypt the value originally. It sounds like you will need to contact the vendor for this specific issue. Andy

Re: How to deploy NiFi processors change to multiple NiFi instances?

://nifi.apache.org/docs/nifi-registry-docs/html/administration-guide.html#event-hooks Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 28, 2019, at 1:38 AM, Edward Armes wrote: > > Hi Lei, > >

Re: Curious about Best Practices for Deployment of Workflows

-with-apache-nifi/ <https://dataworkssummit.com/san-jose-2018/session/sdlc-with-apache-nifi/> [2] https://nifi.apache.org/registry.html <https://nifi.apache.org/registry.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BA

Re: ElasticSearchClientServiceImpl not working for secured ElasticSearch

/html/rfc6125#section-6.4.4 <https://tools.ietf.org/html/rfc6125#section-6.4.4> s_client example: $ openssl s_client -connect -debug -state -cert -key -CAfile Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7

Re: High CPU consumption

unit test identification. [1] https://nipyapi.readthedocs.io/en/latest/readme.html <https://nipyapi.readthedocs.io/en/latest/readme.html> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Oct 15, 2019

Re: Implement heartbeat from remote servers

instance. There you could set a value in the Distributed Map Cache for each server which has pinged in and the timestamp, and then use another processor to check on a determined schedule for the presence/absence of certain values in the cache. Andy LoPresto alopre...@apache.org alopresto.apa

Re: Nifi Cluster Untrusted Proxy Error

/20803/how-does-ssl-tls-work/20847#20847 <https://security.stackexchange.com/questions/20803/how-does-ssl-tls-work/20847#20847> [2] https://dzone.com/articles/ssl-in-java <https://dzone.com/articles/ssl-in-java> Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprin

Re: My nifi no more serve admin interface

the best wording/approach to intercept at the exact point where the wrong decision seemed like the right one is helpful to the entire community. Thanks. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On

Re: Certificates in Truststore

change, you can use it (actually the corresponding private key) to sign as many user certificates as you want without requiring any changes to the deployed truststore (truststores if in a clustered environment). Please let me know if anything above is not clear. Andy LoPresto alopre...@apache.org

Re: flow.xml sync

result of the ZK election at runtime. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul 24, 2019, at 3:08 AM, Clay Teahouse wrote: > > According to the NiFi documentation, zookeeper decides on th

Re: Docker nifi doesn't support OpenID Connect ?

expected. Andy LoPresto alopre...@apache.org alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 > On Jul 3, 2019, at 8:09 AM, Nicolas Delsaux wrote: > > Hi, > > I've read on Docker hub that nifi docker container doesn't

  1   2   3   4   5   >