Calling getLogger() from @OnScheduled, @OnStopped, etc.

I seem to crash NiFi JUnit test runner when I have code that calls getLogger()or attempts to make use of the product of calling getLogger()in situations where some context (probably) is missing like methods annotated for call at "special" times. This makes sense, but is there a technique I can

Re: Calling getLogger() from @OnScheduled, @OnStopped, etc.

L511 [2] https://github.com/apache/nifi/pull/2628/files#diff-e9cfa232683ae75b1fc505d6c9bd3b24R447 Andy LoPresto alopre...@apache.org <mailto:alopre...@apache.org> /alopresto.apa...@gmail.com <mailto:alopresto.apa...@gmail.com>/ PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4  BACE 3C6E F65

Re: Calling getLogger() from @OnScheduled, @OnStopped, etc.

assigning null to the variable. Generally you should just call getLogger() whenever it is needed, or you could assign it to a variable from inside OnScheduled. On Thu, Apr 12, 2018 at 5:28 PM Russell Bateman wrote: Thanks for responding, Andy. I am able to use it, like you, in onTrigger().

Latest NiFi customs?

After a couple of years absence from NiFi (prior to Java 9), I find myself just now back in a developer role in a company that uses NiFi. (This is a pleasant thought, I might add, as I believe that NiFi rocks.) I have inherited an existing implementation that's sorely aged and, though I've goog

NAR extensions warning during build

In /pom.xml/, I have:   *org.apache.nifi*   *nifi-nar-maven-plugin*   *3.5.1*   *true* I get this, which isn't fatal, when my NAR is built. I would like a) to know to what "extension(s)" this refers (related to the plug-in configuration in /pom.xml/?), b) where to put extension docu

Re: NAR extensions warning during build

... https://github.com/apache/nifi/blob/master/pom.xml#L492 Does the same thing happen using 1.3.1? On Thu, May 30, 2019 at 1:02 PM Russell Bateman wrote: In /pom.xml/, I have: *org.apache.nifi* *nifi-nar-maven-plugin* *3.5.1* *true* I get this, which isn't fatal, when

Re: nifi

It's short for "Niagra files" in the sense that you're meant to think of huge flows of files like water over the falls . On 7/5/19 6:00 AM, Arpad Boda wrote: "nye fye" (nī fī) is the preferred pronunciation. https://nifi.apache.org/faq.html On F

Re: [board report] Apache NiFi - July 2019

I mulled over whether it's appropriate to ask within this context. I guess I'll ask. Slap me if I have badly chosen, but where is NiFi respective to "modern" JDK versions? Is that too much detail for the audience of this periodic report? Thanks. On 7/10/19 11:15 AM, Joe Witt wrote: Team, I

StateManager race condition potential

I'm assuming that the StateManagerprotects itself against race conditions for the consuming (custom) processor, but I'd like confirmation on that. Let's say something simple like we get an integer out of state to which we can add one to get the next (piece of work to do), then immediately bump

Re: Java 11 build support is live!

Yes, at the risk of adding nothing more than a "me too," I nevertheless wish to add my thanks. Good job! On 8/15/19 12:04 PM, Jeff wrote: Apache NiFi Developers, Apache NiFi can now be built with Java 11! Thanks to those that helped with the review and committing of several PRs to get us to t

Re: Azure Event Hub Processors Upgrade Problem

I can probably help, Sunny. I made some notes a few years ago on doing this. How this is done on later versions hasn't changed I don't think. Check out http://www.javahotchocolate.com/notes/nifi.html#20160323. Russ Bateman On 8/22/19 11:12 AM, Sunny Zhang wrote: Hi there, I’m a dev from Mi

Re: [DISCUSS] Time based release cycles

Kafka is first-rate, rock-star technology, just as is NiFi. It would be nice to find something from Kafka elaborating on how this regular and accelerated release cadence is working out for them, how much more work it's been, what problems they've experienced, etc. I show their releases over t

NiFi 1.10.0 JRE clarification...

Looking at the release notes, I see: * Apache NiFi can now be built on either Java 8 or Java 11! When built on Java 8 it can run on Java 8 or Java 11. The implications of this statement make me ask: * At https://nifi.apache.org/download.html, how is it built? JDK 11? * Can I run it using

Unable to update processor...

I have a custom processor that I have updated (in potentially breaking ways and I know it), but I cannot seem to make NiFi 1.10.0 open its mouth and swallow it. I have copied my NAR file to /1.10.0/custom-lib/; there is no other version (in the /lib/ subdirectory for example). When I bounce NiF

Re: Unable to update processor...

-lib/ subdirectory or something. On 1/13/20 2:44 PM, Russell Bateman wrote: I have a custom processor that I have updated (in potentially breaking ways and I know it), but I cannot seem to make NiFi 1.10.0 open its mouth and swallow it. I have copied my NAR file to /1.10.0/custom-lib/; there is

View Usage brings up (default) Apache NiFi Overview documentation

My custom processor's usage, which should come from the @CapabilityDescription annotation of the class containing the onTrigger() method, nevertheless is nothing more than the Apache NiFi Overview. I am able to place an instance on the canvas via the processor Component Tool (so, the custom pro

Re: View Usage brings up (default) Apache NiFi Overview documentation

for my capability description, properties, relationships, etc. Also, I am using the @Tags annotation to add a couple of quick-find tags: neither of these are showing up when I go to create an instance of the processor. This is also likely a clue to what I'm doing wrong. Thanks, Russ On 1/24/20

Re: View Usage brings up (default) Apache NiFi Overview documentation

Addendum: the @TagsI add are not showing up in the tag field at the left, but when I scroll down in the processor list and see my new custom processor, I do see these tags listed next, to its right. On 1/27/20 3:27 PM, Russell Bateman wrote: Perhaps I made my question less clear that I could

Re: View Usage brings up (default) Apache NiFi Overview documentation

pa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 On Jan 27, 2020, at 2:30 PM, Russell Bateman wrote: Addendum: the @TagsI add are not showing up in the tag field at the left, but when I scroll down in the processor list and see my new custom processor, I do

Re: View Usage brings up (default) Apache NiFi Overview documentation

g alopresto.apa...@gmail.com PGP Fingerprint: 70EC B3E5 98A6 5A3F D3C4 BACE 3C6E F65B 2F7D EF69 On Jan 28, 2020, at 7:02 AM, Russell Bateman wrote: Thanks, Andy, no offense taken. I tried this in Chrome and Firefox, but am still getting that default page. My sample flow also contains an insta

Re: View Usage brings up (default) Apache NiFi Overview documentation

d I now get the documentation to work. This is the answer, but why can't I build using one /pom.xml/ and the simpler project structure? Russ On 1/28/20 10:33 AM, Russell Bateman wrote: Andy, The processor is really called NoOp (not CustomProcessor), it's a straight, pass-through th

Re: View Usage brings up (default) Apache NiFi Overview documentation

an 28, 2020, at 1:49 PM, Russell Bateman wrote: Andy, I have formulated, on the basis of posts I've seen over the years, that there are two ways to build a NAR containing one's own, custom processors, what I term a /single-module product/ and a /multi-module product/. mostly based on w

Re: Need to have my email added

Eric, If I understand what you're asking, you just need to sign up properly. Check out community information at https://nifi.apache.org/mailing_lists.html . Best regards. On 2/20/20 9:23 AM, Butts, Eric wrote: I need to have my email added to forum discussion buttse...@hotmail.com

additionalDetails.html styles

I would like to get what I'm offering in /additionalDetails.html/ for my custom processor to use the same font style used down the left-hand column listing processors (under /NiFi Documentation/). I'm not an idiot when it comes to HTML/CSS, however, I have been unable in experimenting to see ho

Re: additionalDetails.html styles

ndles/nifi-hbase-bundle/nifi-hbase-processors/src/main/resources/docs/org.apache.nifi.hbase.PutHBaseCell/additionalDetails.html On Thu, Feb 20, 2020 at 12:20 PM Russell Bateman wrote: I would like to get what I'm offering in /additionalDetails.html/ for my custom processor to use the same

How to preclude user-defined properties...

...in a custom processor. I have a custom processor (that I wrote) and, in on-canvas configuration, the dialog allows the user to create custom properties. I have no need of any and wish to help my down-streamers by removing the option of creating any user-defined properties. How is this accom

Re: How to preclude user-defined properties...

27;s certainly something that could be improved, I believe. Thanks -Mark On Feb 25, 2020, at 3:18 PM, Russell Bateman wrote: ...in a custom processor. I have a custom processor (that I wrote) and, in on-canvas configuration, the dialog allows the user to create custom properties. I have no

Managing custom processor logging statements during JUnit testing

I'm interested in getting log statements that may occur from my *custom processor* code at the INFO, DEBUGand TRACElevels when running unit tests for it. This means that I would like to set (programmatically at runtime or by configuration) what I am used to setting in /${NIFI_ROOT}///conf/logba

Re: Managing custom processor logging statements during JUnit testing

On Mar 6, 2020, at 12:13 PM, Russell Bateman wrote: I'm interested in getting log statements that may occur from my *custom processor* code at the INFO, DEBUGand TRACElevels when running unit tests for it. This means that I would like to set (programmatically at runtime or by configuration

Reading the incoming flowfile "twice"

In my custom processor, I'm using a SAX parser to process an incoming flowfile that's in XML. Except that, this particular XML is in essence two different files and I would like to split, read and process the first "half", which starts a couple of lines (XML elements) into the file) not using t

Re: Reading the incoming flowfile "twice"

ig for me to put them into temporary memory, say, a ByteArrayOutputStream. Russ On 3/27/20 10:03 AM, Mike Thomsen wrote: session.read(FlowFile) just gives you an InputStream. You should be able to rerun that as many times as you want provided you properly close it. On Fri, Mar 27, 2020 at 11:

Re: Reading the incoming flowfile "twice"

rite as many times as you need. just keep using the resulting flowfile reference into the next call. On Fri, Mar 27, 2020 at 5:06 PM Russell Bateman wrote: Mike, Many thanks for responding. Do you mean to say that all I have to do is something like this? public void onTrigger( final

Re: Reading the incoming flowfile "twice"

Thanks for looking at this again if you can, Russ On 3/27/20 3:08 PM, Joe Witt wrote: you should be able to call write as many times as you need. just keep using the resulting flowfile reference into the next call. On Fri, Mar 27, 2020 at 5:06 PM Russell Bateman wrote: Mike, Many than

Re: Reading the incoming flowfile "twice"

> > > I left off the code that prints, "And now, we'll go on to the SAX > > parser..." It's in the next flowfile = session.write( ... ). I have unit > > tests that verify the good functioning of > > copyCxmlHeaderAndDocumentToOutput(). The SAX error occurs be

Re: Reading the incoming flowfile "twice"

a ByteArrayOutputStream. Just a thought. On Sun, Mar 29, 2020 at 12:16 AM Russell Bateman wrote: Joe and Mike, Sadly, I was not able to get very far on this. It seems that the extend to which I copy the first half of the contents of the input stream, I lose what comes after when I try to read aga

Re: Reading the incoming flowfile "twice"

tream when doing the non-sax part? If you consume the stream right up to the sax part ( the stream POS is at the start of the xml ) then you can just pass the stream to sax as is can’t you? On March 30, 2020 at 16:23:27, Russell Bateman (r...@windofkeltia.com) wrote: If I haven't worn out

Re: Reading the incoming flowfile "twice"

an ‘original’ relationship or whatever makes sense for you. Hope this helps! -Mark On Mar 30, 2020, at 4:23 PM, Russell Bateman <mailto:r...@windofkeltia.com>> wrote: If I haven't worn out my welcome, here is the simplified code that should demonstrate either that I have

Re: Reading the incoming flowfile "twice"

tStream in) { processWithSaxParser(in, out); } }); } }); session.transfer(output, REL_SUCCESS); session.remove(original); Thanks -Mark On Mar 31, 2020, at 2:04 PM, Russell Bateman wrote: Mark, Thanks for getting back. My steps are: 1. Read the "first half"

Re: Reading the incoming flowfile "twice"

And, also *out*? On 3/31/20 12:35 PM, Russell Bateman wrote: Wait, where is *modified*from? Thanks On 3/31/20 12:24 PM, Mark Payne wrote: Russ, OK, so then I think the pattern you’d want to follow would be something like this: FlowFile original = session.get(); if (flowFile == null

Re: Reading the incoming flowfile "twice"

(Oh, I see where *out*comes from, but not *modified*.) On 3/31/20 12:35 PM, Russell Bateman wrote: Wait, where is *modified*from? Thanks On 3/31/20 12:24 PM, Mark Payne wrote: Russ, OK, so then I think the pattern you’d want to follow would be something like this: FlowFile original

Re: Reading the incoming flowfile "twice"

emove( original ); } This seems very close to working for me; I don't see anything wrong and just need to plug in my SAX parser. This modified session is a new pattern for me (and a useful one). Thanks! On 3/31/20 12:44 PM, Russell Bateman wrote: (Oh, I see where *out*comes from, but not *mod

...not the most recent version of this FlowFile within this session...

In /pom.xml/ I specify using NiFi framework libraries from 1.13.2. There are peculiar reasons (that we are trying to fix) that inhibit us from moving forward as all of our customer machines are running 1.1.2. (Don't shoot me, I'm not DevOps, but just the guy who writes custom processors.) I

Re: ...not the most recent version of this FlowFile within this session...

Yes, what you described is what was happening, Mark. I didn't display all of the code to the session methods, and I did re-read the in-coming flowfile for different purposes than I had already read and written it. So, I wasn't helpful enough. In the end, however, I had forgotten, immediately af

Re: [DISCUSS] 1.x Maintenance

hnical folk the wizardry while it's going down. Thanks to all. Russell Bateman On 7/2/24 14:05, Matt Burgess wrote: There have been some ongoing discussions [1,2] about what to bring back for PRs to 1.x vs trying to push forward with 2.x. There are of course great points from everyone. On t

MockProcessorLog in NiFi 1.0.0...

I'm porting our 0.7.1 base forward to begin using 1.0.0. I haven't figured out a way around this in my JUnit testing: ComponentLog log = new MockProcessorLog( "SectionScoringIdentifier (simulated)", SectionScoringIdentifierPropertiesTest.class ); MockProcessorLog causes a NoClassDefExcep

Fwd: MockProcessorLog in NiFi 1.0.0...

using NoSuchMethodErrors. I'm not finding clear examples out there of people using ComponentLog in 1.0.0 or my pre-1.0.0 practices were shabby. Thanks. Forwarded Message Subject:MockProcessorLog in NiFi 1.0.0... Date: Wed, 9 Nov 2016 15:19:57 -0700 From: Russell B

Re: MockProcessorLog in NiFi 1.0.0...

ache/nifi/blob/master/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/main/java/org/apache/nifi/processors/standard/PutFile.java#L188 -Bryan On Wed, Nov 9, 2016 at 5:28 PM, Russell Bateman < russell.bate...@perfectsearchcorp.com> wrote: Also, I'm still having trouble with

Re: MockProcessorLog in NiFi 1.0.0...

g getLogger()" which for 1.0 was refactored to "ComponentLog getLogger()" as part of NIFI-1811. So I'm not sure that there would be a way to move to these changes without building against 1.x. On Wed, Nov 9, 2016 at 5:51 PM, Russell Bateman < russell.bate...@perfectsearch

Global property for custom processor

I've written a custom processor for some trivial profiling, time-stamping, time-since, histogram-generating, etc., but would like the ability to turn all instances completely off without having to visit each instance in the UI. If it works out, I might consider even leaving some instances in pr

Re: Global property for custom processor

seful because you're testing right now? Does the above idea make sense or do you have other suggestions? Thanks Joe On Wed, Nov 30, 2016 at 3:14 PM, Russell Bateman wrote: I've written a custom processor for some trivial profiling, time-stamping, time-since, histogram-generating,

Another holiday request...

In pursuit of yet more wacky functionality, I wondered about a good way to get a NiFi user's attention (yeah, the person standing looking at the UI) when some condition, threshold, etc. is met as detected by a custom processor. In view of the season, is it possible to turn the processor represe

Re: Another holiday request...

t with proper level. This will issue a bulletin both on the processor (and visually indicate a note) as well as add it to a global list of bulletins. By default processors ignore anything lower than WARN, but this is adjustable in processor settings. Andrew On Thu, Dec 1, 2016 at 5:47 PM Russell Bat

Whither NiFi directories and files once NiFi running?

/nifi.properties/ locations, such as nifi.content.repository.directory.default, are typically specified as relative paths, but I suppose they could be arbitrarily complex. Whatever the case, I need to discover the actual path to the content subdirectory at runtime not because I want to create,

Re: Whither NiFi directories and files once NiFi running?

ust provide a nice mechanism to do what you're seeking. Having said this, please do also consider just using an external monitoring service for things like directory usage,etc.. Since you're only needing this information for passive usage purposes in

ComponentLog missing from 0.7.1 JAR...

I've had this problem with an old version for some time (I'm really concentrating more on NiFi 1.x now) and I have to fix it. I'm pulling my hair out a bit. We eliminated all use of ProcessorLogeven in this older code that we're trying to keep running on 0.7.1 and maintaining when we must. In

Re: ComponentLog missing from 0.7.1 JAR...

m the NiFi API JAR and it should of course be satisfied at runtime. What am I missing here? (It's probably staring me in the face, but I don't see it.) On 12/06/2016 02:26 PM, Russell Bateman wrote: I've had this problem with an old version for some time (I'm really conc

Re: ComponentLog missing from 0.7.1 JAR...

Wed, Dec 7, 2016 at 10:26 AM, Russell Bateman wrote: This should be a simple matter of linking and loading. I mean, if I build/link using /nifi-api-0.7.1.jar/ then load on NiFi 0.7.1, there's no way that any symbol of NiFi origin, in this case, ComponentLog, should go absent. That symbol

Re: ComponentLog missing from 0.7.1 JAR...

Bryan, I'm sorry. I have found the problem and it's entirely my fault. I've been updating /nifi-0.7.1/lib/ with the wrong NAR without realizing that it's the wrong NAR. Thank you for looking and I'm sorry to have wasted your time. Russ On 12/07/2016 09:39 AM, Rus

Re: how to aad a specified counter in nifi

Aldrin, Forgive me for commandeering this thread. My down-streamers are asking for a custom "counting" processor because of what from their point of view is an unreliable volatility in the counts that the UI displays. In particular, they want to know how many documents they're feeding into ou

Re: how to aad a specified counter in nifi

) { session.adjustCounter("SampleScriptCounter", 1, false); session.transfer(flowFile, REL_SUCCESS); } The performance may not be optimal, but you can experiment with counters immediately. Thanks, James On Fri, Dec 9, 2016 at 7:56 AM, Russell Bateman wrote: Aldrin, Forg

Re: how to aad a specified counter in nifi

wFile = session.get(); if (flowFile != null) { session.adjustCounter("SampleScriptCounter", 1, false); session.transfer(flowFile, REL_SUCCESS); } The performance may not be optimal, but you can experiment with counters immediately. Thanks, James On Fri, Dec 9, 2016 at 7:56 AM, Russell

Adding JVM arguments when running NiFi...

I've doctored /conf/bootstrap.conf/ to contain these additional lines: java.arg.15=-XX:+UnlockCommercialFeatures java.arg.16=-XX:+FlightRecorder java.arg.17=-XX:StartFlightRecording=duration=120m,filename=recording.jfr In the end, NiFi's grumpy about this and won't start (from /logs/

Re: Adding JVM arguments when running NiFi...

re not getting love. I'll get back at it tomorrow and report back. On 12/14/2016 11:05 AM, Russell Bateman wrote: I've doctored /conf/bootstrap.conf/ to contain these additional lines: java.arg.15=-XX:+UnlockCommercialFeatures java.arg.16=-XX:+FlightRecorder java.a

Re: Adding JVM arguments when running NiFi...

trick. Perhaps we're not ordering the arguments in the same manner supplied. Will need to look into that. Thanks Joe On Wed, Dec 14, 2016 at 9:00 PM, Russell Bateman wrote: Of course, as many have done, I've run Java applications with JFR enabled using these options against this very

Legacy Authorized Users File approach not working?

I'm working on securing NiFi 1.1.0 with SSL. As I'm following a tutorial [1] written for 0.x, I'm attempting to use the legacy option in /conf/authorizers.//xml/: file-provider org.apache.nifi.authorization.FileAuthorizer ./conf/authorizations.xml ./conf/users.xml

Re: Legacy Authorized Users File approach not working?

s.xml. If you are converting an existing 0.x instance there is a way to auto convert that through a property in authorizers.xml, and it should be explained in the admin guide as well. Hope that helps. -Bryan On Fri, Dec 16, 2016 at 5:21 PM Russell Bateman wrote: I'm working on securing

Re: Legacy Authorized Users File approach not working?

tance, can you elaborate on "it was not working"? You should be able to point set "Legacy Authorized Users File" in authorizers.xml to point to your old file, and leave the Initial Admin blank. On Tue, Dec 20, 2016 at 2:17 PM, Russell Bateman wrote: Just getting time to re

Re: Legacy Authorized Users File approach not working?

ory to get back to a clean state. Thanks, Bryan On Tue, Dec 20, 2016 at 5:10 PM, Russell Bateman wrote: Bryan, As I'm new to setting this up (why I'm tackling this at all), I initially looked toJames Wing's tutorial <http://www.batchiq.com/nifi-c onfiguring-ssl-auth.html&g

Re: Legacy Authorized Users File approach not working?

0, 2016 at 3:19 PM, Russell Bateman wrote: Thanks, Bryan. I will try this again. Meanwhile, I've been studying our 0.x LDAP twists and I am starting to feel sure I can replicate them in 1.x. Both avenues will be useful to us. (But, I really liked nifi-toolkit and your tutorial.) Best, Russ

Re: Adding JVM arguments when running NiFi...

s (did you know this?) the use of non-numeric options for the position of /N/. Russ On 12/14/2016 11:05 AM, Russell Bateman wrote: I've doctored /conf/bootstrap.conf/ to contain these additional lines: java.arg.15=-XX:+UnlockCommercialFeatures java.arg.16=-XX:+FlightRecorder

Re: Adding JVM arguments when running NiFi...

with the same numbers and one of them is overridden. Thanks -Mark On Jan 18, 2017, at 10:22 AM, Russell Bateman wrote: For my own purposes, I fixed this in 0.7.1 /nifi-bootstrap///src/main/java/org/apache/nifi/bootstrap/RunNiFi.java/, but at Joe's suggestion, I created JIRA NIFI-3364 ho

Re: [DISCUSS] Idea for visual access control policy application

Telescopic then that there might be flow one has no access to see as well as other flow one can see but not change? Then do we have flow to which one can add, but not subtract, etc.? Can one detach from a protected flow? Can one stop/start protected flows? If a protected flow cannot be stopped,

Cadmium rods?

Can we get cadmium rods? Our down-streamers are complaining, and I have some experience through testing myself, of NiFi getting into molasses where the only solution is to bounce it. Here are some comments from my users that I hope are helpful. "I'm getting really burned out over the issue

Re: Cadmium rods?

sumably related to long startup times due to a large content repository needing to be evaluated. This I believe should be far more efficient in recent releases. Can you advise what release you're running on? How large of a content repository in terms of file count are you referring to? Thanks Jo

Re: Moving ZIP and TAR.GZ "formats" into an explicit profile

Maven profiles could be used to sort this out, one for just the zip, another for just the tarball and a third, maybe the default, to continue working the way it has been working. On 02/02/2017 09:09 AM, Aldrin Piri wrote: I think this could be useful. Only caveat is that I'm sure there are fo

Re: Two more updated video tutorials

I don't want to spam this forum unduly, but I want to say that what you're doing, Jenn, is hugely appreciated. I pass your links out. I'm a developer of custom processors mostly and really was writing processors to solve problems months before trying to write actual, production flows of any con

Reporting tasks as processor properties

Reading the docs on Reporting Tasks, it seemed to me that they said that hooking (my word) a reporting task up as a property to a processor is the preferred way [1]. I wanted to confirm this as I have yet to stumble upon a coded reporting task sample that does this (or, should I say, a processo

Sensitive-value properties

1. Where are the values of sensitive-value properties stored? 2. How do they work? (if not obvious from #1) 3. Can /flow.xml.g//z/ be copied wholesale or in part to another instance of NiFi? Thanks, Russ

Re: Sensitive-value properties

or if you didn't set one in both instances which means you have the same. If you had different keys then one instance wouldn't be able to decrypt the values from the other instance. Thanks, Bryan On Fri, Feb 17, 2017 at 2:35 PM, Russell Bateman mailto:r...@windofkeltia.com>> wro

NiFi logging framework (stay in or work outside)

This question may arise a little out of naivety on my part. I need to create a new separate log, not to log the stuff I'm already logging and that appears nicely in /nifi-app.log/, but a sort of auditing log to which I'll write with comparative infrequency and very little verbosity. I'd like t

Re: Closing in on a NiFi 1.2.0 release?

+1 for component versioning in NiFi 1.2! On 03/08/2017 12:40 PM, James Wing wrote: Bryan, I'm 100% in favor of you and Matt Gilman doing all the hard work. Oh, and uh... thanks! :) So the alternatives are: a.) Release 1.2.0 sooner (?), but without component versioning b.) Delay 1.2.0 (?) to inc

Re: Connection Issue

Anil, Typically, your custom processor should have a property, something like public static final PropertyDescriptor DBCP_SERVICE = new PropertyDescriptor.Builder() .name("Database Connection Pooling Service") .description("The Controller Service that is used to obt

Creating new sessions...

The ability to create a new session is conferred by extending AbstractSessionFactoryProcessor(in lieu of AbstractProcessorwhich further restricts Processor, among other things, removing the session factory) giving one the option of calling sessionFactory.createSession(). This begs the question

Re: Creating new sessions...

le, if there is some asynchronous process going on. Does that make sense? Thanks -Mark On Mar 17, 2017, at 12:45 PM, Russell Bateman wrote: The ability to create a new session is conferred by extending AbstractSessionFactoryProcessor(in lieu of AbstractProcessorwhich further restricts Processor

Re: [SUGGESTION] Annotation for memory intensive processors (i.e. those that load content into memory)

Joe, I just up-voted this JIRA entry. Our down-streamers are having fits with stuff like this and we have enough custom processors that I'm certain they're confused as to which ones they do what with, etc. This feature (or multiple such annotations) would be comparatively simple to implement

Is there a way to prohibit auto-termination...

...of a relationship? In some of our custom processors, we'd like to remove the possibility from our user of ever auto-terminating, in particular, selected processors' failure relationships. (I realize that the user can "drain" the failures away into paths that amount to auto-termination, but

Re: Is there a way to prohibit auto-termination...

erward. I'm not sure I'd be a big fan of restricting it personally. Thanks Joe On Fri, Mar 24, 2017 at 4:55 PM, Russell Bateman wrote: ...of a relationship? In some of our custom processors, we'd like to remove the possibility from our user of ever auto-terminating, in

Processor missing when attempting Add Processor

I've built a NAR containing a custom processor that loads in NiFi, but the processor cannot be found. At the top of /TikaProcessor.java/, I have, among other annotations, this: @Tags( { "tika" } ) I've tried a number of things to solve this, like making it the only NAR besides just the set Ni

Re: Processor missing when attempting Add Processor

(Yeah, sorry, that is only a typo in my e-mail.) On 03/28/2017 04:36 PM, Andre wrote: Russell, Not sure if this is a typo but have you noticed this? p//rocessor.Processor Cheers On 29 Mar 2017 8:57 AM, "Russell Bateman" wrote: I've built a NAR containing a custom processo

Re: Processor missing when attempting Add Processor

owser cache out and reloading the entire canvas. I have had some funny behaviours before with a stale cache not seeing anything. On Tue, Mar 28, 2017 at 5:57 PM, Russell Bateman wrote: I've built a NAR containing a custom processor that loads in NiFi, but the processor cannot be

Re: Processor missing when attempting Add Processor

Thanks! I'll write some kind of blog post on this once we figure it out. http://www.windofkeltia.com/preview/ On 03/28/2017 04:59 PM, Joseph Niemiec wrote: Sure please share, I have alittle time tonight. On Tue, Mar 28, 2017 at 6:53 PM, Russell Bateman wrote: Thanks, I have tried th

Re: Processor missing when attempting Add Processor

e the content of your /src/main/resources/META-INF/services/org.apache.nifi.processor.Processor file? You also have this entry in some pom's which I dont have in my NAR projects. org.apache.nifi nifi-nar-maven-plugin 1.0.1-incubating true On Tue, Mar 28, 2017 at 7:09 PM, Russell Bate

Re: Processor missing when attempting Add Processor

s which I dont have in my NAR projects. org.apache.nifi nifi-nar-maven-plugin 1.0.1-incubating true On Tue, Mar 28, 2017 at 7:09 PM, Russell Bateman wrote: Thanks! I'll write some kind of blog post on this once we figure it out. http://www.windofkeltia.com/preview/ On 03/28/2017

Re: Processor missing when attempting Add Processor

, Mar 28, 2017 at 7:48 PM, Russell Bateman wrote: Joseph, You're right. Somehow, /nifi-tika-1.0.1.jar/ is not found among the myriad JARs under /META-INF/bundle//d-dependen//c//ies/ in the NAR. I thought I'd seen it in there, but I had not looked hard enough. I'll have to revi

Re: Processor missing when attempting Add Processor

Thanks, Joseph. The changed (parent) /pom.xml /plus the new NAR (which still doesn't work for me) are on that path. Russ On 03/28/2017 06:09 PM, Joseph Niemiec wrote: org.apache.nifi nifi-nar-maven-plugin 1.1.0 true

Re: Processor missing when attempting Add Processor

#nars org.apache.nifi nifi-nar-maven-plugin 1.1.0 true On Tue, Mar 28, 2017 at 7:50 PM, Joseph Niemiec wrote: its called tika-1.0.1.jar without the nifi prefix in the bundled depnds. On Tue, Mar 28, 2017 at 7:48 PM, Russell Bateman

Re: Processor missing when attempting Add Processor

inside the nars packaged maven depends. Looking at the new parent pom can you change the last zero to a 1 ? 1.0.1 to 1.1.1 On Tue, Mar 28, 2017 at 8:27 PM, Russell Bateman wrote: Both pom.xml and NAR updated (and still not working) on windofkeltia.com/preview. On 03/28/2017 06:22 PM, Joseph Nie

Re: Processor missing when attempting Add Processor

With these changes, I'm still not seeing /TikaProcessor/ in the list. On 03/28/2017 06:38 PM, Russell Bateman wrote: (Sheesh. I apologize for trying to do something else concurrently. I meant no disrespect. I'm on board now and the changes are up there again. I'm awaiting NiFi

Re: Processor missing when attempting Add Processor

No problem. I'll upload a tarball as soon as I can get it rolled up. On 03/28/2017 06:43 PM, Joseph Niemiec wrote: ugghh.. Any objection to sharing your src project ziped/tared up? On Tue, Mar 28, 2017 at 8:42 PM, Russell Bateman wrote: With these changes, I'm still

Re: Processor missing when attempting Add Processor

8/2017 06:54 PM, Bryan Bende wrote: It looks like the processors JAR has the service loader file in META_INF instead of META-INF... inflated: META_INF/services/org.apache.nifi.processor.Processor On Tue, Mar 28, 2017 at 8:44 PM, Russell Bateman wrote: No problem. I'll upload a tarball as

  1   2   3   >