Fwd: Question about NiFi CLI Presentation

-- Forwarded message - From: Ahmed Sulieman Elgorashi Date: Thu, May 21, 2020 at 2:49 PM Subject: Question about NiFi CLI Presentation To: ' Hi, I watched your presentation video about SDLC with Apache NiFi on YouTube. It is outstanding, thank you. I am currently resear

Re: question about Nifi Custom processor

session.transfer(output, REL_ORIGINAL); should be session.transfer(inputFlowFile, REL_ORIGINAL); On Wed, Jul 24, 2019 at 3:35 PM Mike Thomsen wrote: > Also, here is a pattern we tend to use for reading using try-with > > > FlowFile output = session.create(inputFlowFile); //create linkage

Re: question about Nifi Custom processor

Also, here is a pattern we tend to use for reading using try-with FlowFile output = session.create(inputFlowFile); //create linkage in provenance try (InputStream is = session.read(inputFlowFile); OutputStream os = session.write(output);) { //Do stuff with streams. is.close(); os.clos

Re: question about Nifi Custom processor

Two problems I see right here are this: flowfile = session.create(); flowfile = session.get(); The second call will replace the newly created flowfile that comes from session.create() with either null or the next element in the queue. That will result in you having a flowfile created in the

Re: question about Nifi Custom processor

So a couple notes based on your debug statements. "2.1 -> 2.2" If you do not plan to provide an input to this processor and run it on cron or timer, you can just do the session.create at the top. This will create a new flowfile. If you do expect an incoming flow file just return in the null check

question about Nifi Custom processor

Hello, I am writing my first custom processor. I followed the example here https://www.nifi.rocks/developing-a-custom-apache-nifi-processor-json/ In the settings, I have /tmp/jsoniput/sample1.json file The source code; public void onTrigger(final ProcessContext context, final ProcessSession

Re: Question about nifi-env.sh

I've opened NIFI-5573 () for this On Mon, Aug 27, 2018 at 12:38 PM, Lars Francke wrote: > Peter, > > thanks for the comments. > It seems as if Joe and you are in agreement. > I'd be in favor of changing it to the way Hadoop, HBase and other projec

Re: Question about nifi-env.sh

Peter, thanks for the comments. It seems as if Joe and you are in agreement. I'd be in favor of changing it to the way Hadoop, HBase and other projects do it because for me this behaviour was very surprising (and inconsistent). But I understand your reasoning and won't put up an argument :) The s

Re: Question about nifi-env.sh

Hi Lars! The idea you proposed - to set only what has not been set already - makes sense, however it may cause unexpected side effects in deployments where there are environment variables hidden by nifi-env.sh. This is theoretical, but I can imagine situations where operators tried to set variable

Re: Question about nifi-env.sh

Maybe I should explain what I'm doing and where my last two issues came from as well.[1] I'm trying to run NiFi in an environment where the tarball is extracted (as downloaded from Apache) but I don't have write access to that directory at all. So _all_ files NiFi writes need to go into another di

Re: Question about nifi-env.sh

Thanks for the quick response Joe. Yes, I assumed as much that's why I wanted to discuss here first before I open an issue. On Fri, Aug 24, 2018 at 4:01 PM, Joe Witt wrote: > Lars > > I dont know the specifics of what went into various bits there but > thanks for being careful/discussing it - n

Re: Question about nifi-env.sh

Lars I dont know the specifics of what went into various bits there but thanks for being careful/discussing it - need folks like mark payne and yolanda davis and others who wrote some of those bits to comment. I say this because these scripts/start routines are super heavily used for deployment pr

Question about nifi-env.sh

Hi, I'm trying to use the environment variables NIFI_PID_DIR and NIFI_LOG_DIR to change those directories. Unfortunately nifi-env.sh is being called by nifi.sh which overrides them without any way to override them. To make it even more confusing the path for NIFI_PID_DIR is different than the de

the question about nifi cache auto clear default(5 min)

Hi I found that in/out will be cleared after 5 min. the same as the report an = error/warn/debug But I don't' want it auto clear or I can change the time . I don't' found = configuration anywhere. How should I do ? Thank you very mach. Best Regards, Zhichao.xu

Re: Question about Nifi

Check out the nifi-app.log file under $NIFI_HOME/logs. This is also customizable by editing the conf/logback.xml file. Andrew On Wed, Oct 18, 2017, 7:58 AM ☆★☆★☆ <1506877...@qq.com> wrote: > Hi, > > I am using nifi to develop some custom plugin(By Java), > can you please tell me after I use get

Question about Nifi

Hi, I am using nifi to develop some custom plugin(By Java), can you please tell me after I use getLogger().error(), or use getLogger().info()?? where can I find the log file, where is the log file's path and filename BR

Re: Hello, I have a question about nifi and need help

Hello, Sorry to hear that you've encountered the issue. That is a known one, already fixed and will be released in the next version. https://issues.apache.org/jira/browse/NIFI-2824 Regards, Koji On Wed, Nov 9, 2016 at 12:16 PM, 万一 wrote: > I am a developer of nifi. I have a question(nifi versi

Hello, I have a question about nifi and need help

I am a developer of nifi. I have a question(nifi version is 1.0.0 release) : I use nifi cluster (3 nodes). When i configure the personal process by advanced page, it can't be saved. I try to catch the exception, the info is : Node 192.168.20.119:8110 is unable to fulfill this request due

Re: Question about NiFi HA

Chris, Absolutely: https://cwiki.apache.org/confluence/display/NIFI/High+Availability+Processing Thanks Joe On Thu, Mar 31, 2016 at 5:06 PM, McDermott, Chris Kevin (MSDU - STaTS/StorefrontRemote) wrote: > Hey, guys and gals. I’m pretty new to NiFi so its quite possible, if not > likely, that

Question about NiFi HA

Hey, guys and gals. I’m pretty new to NiFi so its quite possible, if not likely, that I am missing something. That said, would someone please comment on this observation. conclusion and and questions. My observation is that FlowFiles get queued in local queues on individual nodes and those f