Re: Error reading remote resource when building NIFI from source

Your Maven version is below the required 3.8.6 and the recommended 3.9.0. Could you upgrade and give it another attempt? If that does not solve the problem, please provide more of the build log for review. On Sat, Feb 11, 2023 at 05:14 oyeyemi rafiu owolabi via users < users@nifi.apache.org>

Re: Securing MiNiFi

I believe those URLs are provided by NiFi itself. Sharing your configured nifi.remote.input.* properties would be helpful. Doesn’t seem like it is secured. On Mon, Oct 19, 2020 at 15:53 scotty wrote: > Hi, > > I don't see any URL in the config.yml other than the correct HTTPS one. The >

Re: hello I wanna ask somthing about apache minifi

Hi Jaeyoung, Please only address one list with your messages. Removing dev. Currently minifi, and its surrounding efforts, only work with and are supported on Java 8. Using a prior version should clear up that problem. Please let us know if you encounter any other issues. --aldrin On Wed,

Re: Can someone confirm if bug NIFI-5830 is fixed on docker hub images

and > volumes (docker-compose down -v) and restarted it came with 1.11 version > and the error was indeed gone. > > Sorry for the inconvenience. > > Cheers, > > > > Em dom., 15 de mar. de 2020 às 21:26, Aldrin Piri > escreveu: > >> Hi Eric, >> >> I

Re: Can someone confirm if bug NIFI-5830 is fixed on docker hub images

Hi Eric, I can only speak to the image, but as it is tagged in 1.9.0, the associated code will also be in what the community offers through Docker Hub. We make use of the released convenience binaries for constructing the image. Some things that would help us investigate further: Could you

Re: Nifi installation - port 8080 being used even nifi installed with a different port

Hi Sam, Please only send to one list. Providing this response to users only. The port and process you are seeing is actually related to the ZooKeeper instance from what the clustered setup. The upgraded version of ZooKeeper enabled this server by default. We have accounted for this in

Re: High CPU consumption

ned. > > One more question: Is it normal that the father java process has very low > consumption while the child process related to logback jar is the one that > is eating up all the CPU ? > Please take a look at the attached image. > > Thanks, > > LC > > ----

Re: High CPU consumption

Luis, please feel free to give us some information on your flow so we can help you track down problematic areas as well. On Sun, Oct 13, 2019 at 3:56 PM Jon Logan wrote: > You should put a profiler on it to be sure. > > Just because your processors aren't processing data doesn't mean they are >

Re: Installing and running Nifi first time on Mac

Hi Feargal, The brew installation process doesn’t need any direct interactions with the installation. Once installed, you can use the typical start/stop/status commands as Arpad showed from anywhere on your file system unless you need to change configurations. Could you please let us know

Re: Minifi could not start CaptureChangeMySQL processor

Hi there, You will need to provide the CDC NAR as part of your MiNiFi installation as it is not bundled with the default distribution. With all the great work that went into supporting extensions into registry, I hope to have some additional tooling to make this process much easier. On Thu, Jul

Re: Atlas Support in NiFi 1.9.2

This was by choice as it is quite large. There are two paths you can choose between to get access to that extension: * you can perform a build yourself, activating the 'include-atlas' profile in Maven (e.g. - mvn clean package -Pinclude-atlas), or * you can download the NAR from one of the Maven

Re: Variables handling in MiNiFi

Hi Luis, There was an initial attempt at providing this support in MiNiFi [1] that would likely be worth renewing discussion on and can certainly appreciate the utility that bit of functionality would provide. I would be interested in hearing a bit more about your intended use for the variables

Re: Adding NiFi processors to MiNiFi

Hi there, The processor you are referencing was only provided in 1.8.0 as per the associated JIRA [1]. You would need to use that version of those artifacts in this scenario. We are a bit lacking on docs, but the path you took is correct, just be mindful of the version where a given component

Re: Minifi S2Sreporting

Aurélien, This is unfortunately a gap in functionality. The simplest course would likely be for an implementation of a site to site status reporter [1] to cover the functionality absent. Another option would be for us to generically support reporting tasks (we currently only do that for

Re: nifi-toolkit docker images

Hi Charlie, One will be pushed, please check in about 30 minutes. While NiFi is driven via automated builds, some of our Docker Hub repos require manual steps that can only be performed by certain folks on the PMC. Thanks for pointing out this was missing! --aldrin On Tue, Oct 30, 2018 at 9:58

Re: ConsumeMQTT processor causing resource issues when deployed in MiNiFi

being second to start, suffered from the non-unique client id when trying to connect to the broker. I'm trying to figure out more specifically what triggers this issue but have stubbed an initial ticket out [2]. Thank you for taking the time to report this and provide information on your

Re: ConsumeMQTT processor causing resource issues when deployed in MiNiFi

directory of MiNiFi > > nifi-mqtt-nar-1.7.0.nar > nifi-standard-services-api-nar-1.7.0.nar > > > List of files in MiNiFi lib directory is attached. > Have also attached MiNiFi log file. > > > Regards, > Patricia > On Wednesday, 3 October 2018, 17:43:27 BST, Aldrin P

Re: Nifi fetching files

Hi Tom, You can make use of the minimum file age property on ListFile to ignore a file until it has reached the desired 10 minute buffer. On Fri, Oct 12, 2018 at 9:59 AM Tomislav Novosel wrote: > Hi Nifi team, > > my usecase is to list files and fetch files using ListFile and FetchFile >

Re: ConsumeMQTT processor causing resource issues when deployed in MiNiFi

thread isn't possible. Could be a > resource leak. To Aldrin's point though I'd say the thread dump would > be really helpful. In fact, I'd recommend grabbing a few at different > time intervals such as shortly after launch, after a 'while' when > things are working well, and 'wh

Re: ConsumeMQTT processor causing resource issues when deployed in MiNiFi

Hello Patricia, Could you provide more details about JVM properties that you tried configuring? Please also let us know the relevant versions of MiNiFi and NiFi you are using. If possible, providing the flow you are attempting to run would be helpful. Otherwise, if you could get into specifics

Re: Nightly Builds of Nars/NiFi

Hi Ryan, This is an often requested bit of process of ASF projects, however one that is not frequently carried out nor is it something that aligns well with the core tenets of what a release is. The important thing to keep in mind is that releases conducted by the NiFi community, or other ASF

Re: MiNiFi contents-repository config problem

Great, thanks! Will put that on my list to scope out and will move conversation over to the issue. On Tue, Jan 16, 2018 at 10:32 AM, Saulo wrote: > Hi Aldrin, > > > Sure, I have just created the issue with the information we shared and > attached the file. > > Issue link:

Re: MiNiFi contents-repository config problem

Hi Saulo, It looks like the config unfortunately got stripped from the upload. Would you mind opening an issue at https://issues.apache.org/jira/projects/MINIFI/issues and attaching it there please? On Tue, Jan 16, 2018 at 9:50 AM, Saulo wrote: > Hi Aldrin, > > >

Re: MiNiFi contents-repository config problem

Hi Saulo, Might you be able to specify the version you are using? If possible, could you also share your config.yml? The second point is expected behavior as the config file is transformed into nifi.properties. However, the items you are trying to adjust are not enabled as archiving is

Re: HandleHttpRequest

> >> no flowfiles are being generated. a template of what >> >> On Wed, Jan 3, 2018 at 4:24 PM, Aldrin Piri <aldrinp...@gmail.com> wrote: >> >>> Are you receiving an incoming FlowFile in the HandleHttpRequest? >>> >>> Could you sh

Re: HandleHttpRequest

Are you receiving an incoming FlowFile in the HandleHttpRequest? Could you share a template? Alternatively, as a bit of inspiration, you could also evaluate the Hello_NiFi_Web_Service.xml [1] from https://cwiki.apache.org/confluence/display/NIFI/Example+Dataflow+Templates to see if there is

Re: minifi release and mapping that to the nifi release

Hi Juan, We need to have this documented in terms of the core NiFi library versions used in MiNiFi Java. The general contract is that we can support extensions in the same manner that the framework libraries of NiFi does. This had a few hurdles which will be resolved with MINIFI-408 [1]. I'll

Re: MiNiFi & Certs/Keys

I am a far cry from a cert pro, but it looks like the results are what I would anticipate given your reuse of nifi_server.key.pem in your JKS. I don't think you are far away from your intended setup and should be able to create another "user" cert for your minifi instance(s), as you had for your

Re: Capture Change Mysql Processor is unable to start using minifi

Unfortunately templates exported from NiFi do not contain Controller Services that are not referenced by one of the selected extensions. As a result, yes, this would be another Controller Services entry. Something to the effect of the following should work: - id: name: Map Cacher Server

Re: Capture Change Mysql Processor is unable to start using minifi

Do you also have a DistributedMapCacheServer controller service configured in your config? I do not see one of these instantiated in your log. This would explain why the client service is getting the connection refused events. On Mon, Oct 16, 2017 at 9:53 AM, rakesh

Re: Capture Change Mysql Processor is unable to start using minifi

Looks as though the cache was never started and it was then not possible to connect to it. Are there other errors when the flow initializes concerning the cache's initialization? On Mon, Oct 16, 2017 at 8:23 AM, rakesh wrote: > Hi Aldrin, > > Thanks for your help. The

Re: Capture Change Mysql Processor is unable to start using minifi

Hi Rakesh, The nifi-distributed-cache-client-service-api.jar is the issue. Building off latest master, that does not appear in the lib directory for me. Perhaps that was accidentally copied? The nifi-standard-services-api-nar contains the aforementioned jar. As a general point of

Re: Capture Change Mysql Processor is unable to start using minifi

The library in question is, in fact one that was troublesome and removed in MINIFI-403. Could you please share what your lib directory looks like and please verify the hash you built from for 0.2.1? I revisited the work I did for 403 and am able to use the flow provided there that is also making

Re: MiniFi

Hi Vikram, This is not currently possible. There has been some initial work and some discussion on C2 capabilities that are in progress of being designed/built out [1][2]. There is heartbeating and providing operations for an agent to carry out that has an initial implementation in C++. There

Re: Using MiNiFi as a library from with a Java program

Hello, Neither NiFi nor MiNiFi (Java) is currently packaged as such. Would you be able to expand upon your use case of publishing to Kafka and/or what facets of MiNiFi you are looking to utilize? There may be other avenues that get you toward your solution. Thanks, Aldrin On Tue, Sep 26, 2017

Re: Using invokeHTTP with binary compression enabled endpoints

Hi Raman, InvokeHTTP can send data of any format. The issue at hand is that specifying a content type does not performa any transformation of the source flowfile content to transmit. Rather, this is just establishing the Content-Type header. To that end, what you are seeking is certainly

Re: List of processors supported by MiNiFi 0.2.0

Hi Jeremy, Thanks for bringing the lack of a listing to our attention. We actually have documentation created to support this [1] but failed to actually publish and/or reference it anywhere. We address that with MINIFI-379 [2]. To the issue at hand, it is possible to make use of NARs from NiFi

Re: Control and Command information between MiniFi and NiFi

Hi Vikram, Good questions and thought out process in this email. Your approach seems valid and a fairly typical use case which we are working on supporting well. 1) At this time, you cannot do so directly from NiFi. I think based on some of the initial discussions and work that has been

Re: NiFi Docker

Sounds great. Will keep an eye out for it. Thanks! On Tue, Aug 1, 2017 at 10:50 AM, ddewaele wrote: > Great also have some ideas about this. I'll log a JIRA and elaborate > on > those. > > We can then see on how to move this forward. (willing to do a pull request >

Re: Using QueryDatabaseTable processor in MiNiFi

eps again and it worked fine so it was total user > failure somewhere on my part. I am curious as to where I went wrong so I am > trying to reproduce it to see if it's worth any documentation updates. > > Thanks, > Jeff > > > On Thu, Jul 27, 2017 at 10:09 AM, Aldrin Piri <ald

Re: MiNiFi on Ubuntu Core

Hi Pierre & Gabor, There is no work to this that I know of nor can I find any issues tracking this in JIRA. Gabor, if you would be willing to contribute to the effort, I would encourage you to create a JIRA so there is a central place to track and discuss the effort. Thanks! --aldrin On Mon,

Re: some processors runs only once in NiFi

For GetHTTP, this processor makes use of ETags[1] to prevent downloading the same resource repeatedly. I would speculate that this is the case for the resource you are specifying. As for ListHDFS, could you specify what version you are using? There have been some bugs concerning how this was

ASF NiFi HipChat room now available

Hey folks, Thanks to the ASF Infra team we have a public HipChat room available. The hope for this is to serve as another avenue for communication as well as facilitating discussion for cases such as those when something more direct than GitHub comments is appropriate. The room is reachable via

Re: [ANNOUNCE] Apache NiFi 1.2.0 release

Juan, Just wanted to follow up that INFRA was most helpful and able to trigger our build for us. The associated Hub repo is available at https://hub.docker.com/r/ apache/nifi/ docker run -P apache/nifi:1.2.0 will pull/run an instance On Wed, May 10, 2017 at 11:26 AM, Aldrin Piri <aldr

Re: [ANNOUNCE] Apache NiFi 1.2.0 release

Hey Juan, We had a small issue with the auto-build process. Will be working with INFRA to get that generated and hope to have resolved shortly. On Wed, May 10, 2017 at 11:19 AM, Juan Pablo Gardella < gardellajuanpa...@gmail.com> wrote: > The release notes mention an official image docker. Do

Re: Configure duration to push to RPG in AWS (IoT flow)

Hi Varsha, When you are talking about flows, are these separate instances of MiNiFi or different parts of your overall configuration? Is there a reason the collected data is written to and then read from disk? I/O costs are amplified when running off of SD cards which can be quite slow. Not

Re: How to identify MiNiFi source edge devices

Jeff, Could you expand upon what a device id is in your case? Something intrinsic to the device? The agent? Are these generated and assigned during provisioning? How are you making use of these when the data arrives at its desired destination? What you are expressing is certainly a common

Re: Security between MiNiFi and NiFi

Hi Varsha, The preferred mechanism for accomplishing this is via Site to Site and Remote Processing Groups [1]. This makes use of the configured Security Properties [2]. For other means of data egress, these would vary depending on specific processor or extension used. [1]

Re: MiNiFi's differentiator

Hey Jeff, Just to hone in a bit more, MiNiFi would likely consume from some of the work surrounding the Command and Control [1] efforts. There is some initial work under way which should serve as a nice foundation to start exploring a more full featured and richer implementation. Certainly plan

Re: Configure ExecuteSQL in MiNiFi

Hi Jeff, This support was provided and is slated for 0.2.0 via MINIFI-154 but has not yet been released pending NiFi 1.2.0. From your question you had on another issue yesterday, I believe you are building from master so you should have the requisite functionality needed. For SQL work, relevant

Re: Preserve or replace 'state' directory during upgrade - NiFi 1.1.2

Mark beat me to the reply but it does appear our documentation is lacking. I've opened up an issue to include/improve this aspect in one of our upgrade and/or admin guides. https://issues.apache.org/jira/browse/NIFI-3665 Good question and thanks for reaching out. On Thu, Mar 30, 2017 at 7:31 PM,

Re: RouteOnContent--how to specify the promised dynamic relationship?

Russell, Your expectations are inline with the functionality of the processor. You can add dynamic relationship via a dynamic property in the processor properties tab. The plus (+) located at the top right will let you first specify a property name (Treated as the relationship) and its value

Re: How does lib_community get included in NiFi nar search path?

Hi Jim, lib_community is not one of the default directories NiFi searches. You can update nifi.properties to include additional paths via properties such as those outlined in the System Administrator's guide in Core Properties for nifi.nar.library.directory [1]. The description of this follows:

Re: Connection cannot be established

Hi Otmane! Dropping dev to BCC. We do not currently have support for this in the processor as currently released and is an outstanding JIRA issue [1]. On that issue, a community member has an implementation that may work for you but also seems dependent on the core library of the processor

Re: Cannot Restart Nifi

to 5 > > 3- reboot my Linux box, and then attempt to start NiFi > > 4- if 3 fails, rm -rf ./flowfile_repository on this, my dev box. Start > nifi, > > get in there, and eliminate that Python logging. Find another way to log > > results to a system file, perhaps using a NiFi proce

Re: Cannot Restart Nifi

t > NiFi to come back up. > > Please tell me: while I am in a dev state right now, had I been in a > production state what would have been the repercussions of deleting in its > entirety the flowfile_repository, which includes all its journal files? > > Thanks very much in

Re: Cannot Restart Nifi

Repo should get you going. You can additionally remove the content repo, but this should be cleaned up by the framework as no flowfiles will point to said content. Aldrin Piri Sent from my mobile device. > On Mar 28, 2017, at 06:12, James McMahon <jsmcmah...@gmail.com> wrote: >

Re: NiFi Users: Powered by NiFi page

Hi Giovanni, GoDataDriven has been included. Thanks! On Wed, Feb 15, 2017 at 11:48 AM, Giovanni Lanzani < giovannilanz...@godatadriven.com> wrote: > Hi Joe, > > You can put GoDataDriven (https://godatadriven.com) > Summary: GoDataDriven, a Dutch service company in the data science and >

Re: GetTwitter - Security/Certificate Issue

ux server that we use as our ‘sandbox’ to > try new things (nifi in this case), so I can definitely upgrade the yum > package. As for your second question, the server runs on my company’s > network, but other than that I don’t see any other considerations. Any > thoughts? > &g

Re: GetTwitter - Security/Certificate Issue

you need any additional > info to help diagnose the issue! > > > > Thanks, > > > > Dan > > > > > > *From:* Aldrin Piri [mailto:aldrinp...@gmail.com] > *Sent:* Tuesday, January 31, 2017 2:20 PM > *To:* users@nifi.apache.org > *Subject:* Re:

Re: GetTwitter - Security/Certificate Issue

Hi Dan, The GetTwitter processor does not make use of an Apache NiFi SSLContextService so the certificate chain issues are likely more tied to the JVM/OS specifically. Did a quick check on some of the instances I am running and Twitter seems to be operating normally. Could you share some more

Re: Minifi question

Hi Juan, The FlowStatus mechanism aids in inquiring about the current state of a running instance. Additional details about this can be found in the admin guide: https://github.com/apache/nifi-minifi/blob/master/minifi-docs/src/main/markdown/System_Admin_Guide.md#status-reporting-and-querying

Re: Custom processors in MiNiFi

Hi, Aakash! To my knowledge, I have not seen any discussion about such processors on the lists specifically although have heard people mentioning assorted libraries that might be a good fit for the NiFi ecosystem's intended purposes. There has been some foundational work such as the following

Re: Apache nifi FLow.xml guidance

dropping dev list Hi Matt, Could you provide additional details and/or a flow of what you have attempted to do thus far? Are you looking to filter out .doc files but allow images? On Mon, Jan 23, 2017 at 4:29 AM, mtn jira wrote: > Hi All, > > I am new to Apche nifi and we

Re: Process Group singleton

thing that could be referenced from anywhere > (like a RPG). > > Yari > > On 27 December 2016 at 16:14, Aldrin Piri <aldrinp...@gmail.com> wrote: > >> Hi Yari, >> >> The concept you are looking for has been discussed a bit and a draft >> feature prop

Re: Processors and

Hi Andreas, 1) There is nothing from a framework perspective that provides this. However, a typical option is to make use of an attribute from an upstream processor to help categorize and handle the data. Attributes written vary from processor to processor or can be explicitly set/updated using

Re: SplitJson:GC Overhead Limit Exceeded

The backing library of the Json processors does indeed require loading the entire doc into memory. We should make sure this consideration is documented if not already. Could be an interesting idea to not tie SplitJson to this library given that it might not need all the functionalities of

Re: attributesToJSON order

Hey Paul, Could you highlight the use case you are looking to address or shortcoming that has emerged because of this? No strong qualms with providing it, just not sure I am tracking where this becomes problematic. Thanks, Aldrin On Thu, Oct 20, 2016 at 3:23 PM, Paul Gibeault (pagibeault) <

Re: Build failure under CentOS 6.7

Hey Michael, Can you confirm the JDK is installed and available from your build? Does `javac -version` return appropriately? Is JAVA_HOME set? If not, could you set it to the location of your JDK? If it is, can you verify the bin directory associated with it contains a javac? The culprit

Re: upstream system is invalid

Hey Niraj, What the error is covering is that this processor requires input and does not act as a source processor. Instead, this processor will perform operations based on FlowFile input and will make use of incoming FlowFile's attributes in order to select items from DynamoDB. Said attributes

Re: Processor that Decompresses Files?

Hi Keren, NiFi comes with an UnpackContent [1] processor which should take care of this for you. Let us know if it comes up short in terms of your needs. --aldrin [1] https://nifi.apache.org/docs/nifi-docs/components/org.apache.nifi.processors.standard.UnpackContent/ On Wed, Oct 5, 2016 at

Re: Processor that Decompresses Files?

Indeed, CompressContent would be the right one. UnpackContent is tailored toward managing FlowFiles. On Wed, Oct 5, 2016 at 9:47 AM, Joe Percivall wrote: > Hello Keren, > > The "decompress" mode is an option of the CompressContent[1] processor and > should solve your

Re: Idea needed to get XL from SharePoint using NiFi

Hi Ram, Accomplishing this task would require some effort beyond those items currently bundled with NiFi. I am not well versed in Sharepoint internals, but it seems like there is an available REST API [1] that would allow you to access files and folders [2]. Depending on the nuances of

Re: PutS3 object returns jvm out of memory

Hi Selvam, As mentioned, please keep messages to the one list. Moving dev to bcc again. Archiving is only applicable for that content which has exited the flow and is not referenced by any FlowFiles currently in your processing graph, similar to garbage collection in Java. For this particular

Re: Minifi question

HI Gunjan, In terms of creating and sending data, certainly seems feasible, but might be a bit heavy handed for your testing purposes. Did you have some more specific ideas in mind or a more pointed example of how you would do this? The way I have typically handled this personally for this kind

Re: dynamic getTwitter ?

One consideration for why it does not support EL is due to client the processor is wrapping that registers with a given endpoint. EL would require this disconnect/reconnection process to potentially happen on every FlowFile presented to the processor (some smart caching could certainly lessen the

Re: Strategy To collect from hundreds of servers?

Hi Kirk, To echo what Andy said, MiNiFi seems like a likely solution and I feel like a lot of the design and principles the community came up with when the topic was first discussed get close the functionality you are looking for. We are pretty early on with this effort, but the notion of

Re: EvaluateJsonPath processor question

Igor, Seems perfectly reasonable. If the path is not found, an empty value will result. You can control in the processor properties as to whether or not this is a warn worthy event or if it should be ignored; the configuration you would likely desire in this case. Let us know if this does not

Re: Nifi Combiner Processor?

[7764] 01490007:6: f42579b7: > Session variable*s* 'session.policy.result' set to ‘allow' > 'session.logon.page.errorcode' set to ‘0' 'session.assigned.webtop' set to > '/Common/mobilevpn_webtop’ 'session.assigned.uuid' set to > 'tmm.uuid./Common/mobilevpn_access-policy.C069850’ ' > sess

Re: Nifi Combiner Processor?

Hi Shaun, While there is no explicit processor that will carry this out in one action, I believe we have the tools in place for you to accomplish the functionality with our standard processors. Not sure I have your exact case, but the way I approached this is through the following sample data:

Re: Writing files to MapR File system using putHDFS

Hi Ravi, Could you provide some additional details in terms of both your NiFi environment and the MapR destination? Is your NiFi a single instance or clustered? In the case of the latter, is security established for your ZooKeeper ensemble? Is your target cluster Kerberized? What version are

Re: Standard SSL context always requires keystore/truststore?

Hi Andrew, Certainly don't disagree that it is confusing for people that come from other environments where this "just works." I don't know we've ever found a path forward that was executed upon. We've grappled with this a few times, one such discussion is [1]. I did a quick search through

Re: Best way to process the process the requests in batch

Kumiko, In terms of increasing throughput from the standpoint of the NiFi framework, it is possible to increase the number of concurrent tasks on the processor under the Scheduling tab when configuring. This will allow more processes to execute simultaneously providing greater throughput. Along

Re: Scheduling approach

/nifi-docs/html/user-guide.html#Configuring_a_Processor [2] http://nifi.apache.org/docs/nifi-docs/rest-api/index.html On Mon, May 23, 2016 at 9:09 AM, Ravisankar Mani <rrav...@gmail.com> wrote: > Hi Aldrin Piri, > > > Thank you for your response. > > yes you are correct

Re: Scheduling approach

Hi Ravi, If my understanding is correct, you would like the processor to run immediately and then every 5 minutes after? If so, this could be accomplished with the Timer Driven scheduling strategy and specifying a Run Schedule of 5 minutes. Cron will get you a specific time enabling you to

Re: How to extract scalar info of json array using EvaluateJsonPath processor?

n it to a user defined attribute in the processor. > > { "results" : [ { "name" : "Jane Doe", "id" : "1" }, { "name" : > "John Doe", "id" : "2" } ] } > > Thanks for all your help. > > Thanks, &

Re: How to extract scalar info of json array using EvaluateJsonPath processor?

Hi Keith, Scanning over some of the docs, it does not appear that JsonPath supports a count operator but could possibly be used to extract from your source document that could possibly be manipulated using something like allDelinatedValues [1]. Certainly not the most elegant approach, but could

Re: ConvertAvroSchema locale default error

Hi Conrad, Not very knowledgeable in Avro by any means, but did do a cursory glance over the code during a build. Based on your snippet of stacktrace, it appears the culprit is the incorrect use of "==" in lieu of ".equals." The lines in question are: final String localeProperty =

Re: NiFi cluster question

Igor, Your thoughts are correct, and without any additional configuration, the GetTwitter processor would run on both nodes. The way to avoid this is to select the "On primary node" scheduling strategy which would only have the processor run on whichever node is currently primary. PutHDFS has

Re: ReplaceText processor configuration help

Hi Igor, That should certainly be possible. Would you mind opening up a ticket ( https://issues.apache.org/jira/browse/NIFI) and providing a template of your flow that is causing the issue? Thanks! On Mon, Apr 25, 2016 at 10:09 AM, Igor Kravzov wrote: > Thanks Pierre.

Re: remote zookeeper cluster with Nifi

Hi Madhukar, It is possible. You will need to configure the cluster-provider in conf/state-management.xml to reflect the configuration for your standalone ZK cluster on each of the instances. On Sun, Apr 10, 2016 at 3:54 PM, Madhukar Thota wrote: > We have a

Re: Few doubts about NiFi cluster

Hi Sudeep, Answers to your questions: 1) In a clustered environment, each processor will have the same configuration the flows are identical across each node in the flow with the NCM establishing mutations across each instance via a two-phase commit. Through the mentioned scheduling strategy,

Re: nifi.content.repository.archive.max.retention.period

Andre, Sorry this got lost in the mail pile. Your assumptions are correct and that is the anticipated behavior. Has this been a reproducible and/or persistent issue (the lack of archiving causes disk consumption to grow unbounded)? If so, any level of context you can provide to the flow such

Re: custom processor development : problems with scops in parent POM

Hello! Are you trying to incorporate this into the repository check out or a standalone bundle? In the case of the latter, could you confirm you have established a project dependency structure such as that outlined in the Wiki [1]? Not only is a provided scope needed to be able to

Re: unsubscribe

Hello, You can unsubscribe by mailing the following email address users-unsubscr...@nifi.apache.org. All of our mailing list information is available at http://nifi.apache.org/mailing_lists.html. On Thu, Mar 24, 2016 at 9:50 AM, Tauzell, Dave wrote: > > > > >

Re: NIFI NGINX as reverse proxy

michail.salic...@gmail.com> wrote: > I forgot to mention, since you asked, for zeppelin, elasticsearch, kibana > and others services ssl termination and reverse forwarding works just fine, > only NIFI is giving me troubles. > > Regards, > Michail > > On Mon, Mar 1

Re: NIFI NGINX as reverse proxy

Michall, A bit outside of the NiFi realm, but I have done similar myself previously. Do you have your server block (likely the one containing this location block) established with the appropriate certificates and a listen statement with ssl listed after the port? From memory, I do not believe

Re: User Authentication with username and password

Uwe, Definitely been a frequently requested item by the community and as Andy pointed out, it is quite nuanced in getting just right in a way that manages to get as close to that delicate balance between usability and security short of the computer encased in concrete on the bottom of the ocean

Re: Mutiple dataflow jobs management(lots of jobs)

Hi Yan, We can get more into details and particulars if needed, but have you experimented with expression language? I could see a Cron driven approach which covers your periodic efforts that feeds some number of ExecuteSQL processors (perhaps one for each database you are communicating with)

Re: Script that outputs to a folder

Hello Dave, Your prescribed approach certainly seems reasonable using the default components. The alternative to make everything work in flow would be to get your script utilizing input and output streams in lieu of the files. Additionally, depending on the scripting language, if you are working

  1   2   >