Redis has three modes standalone, sentinel, and cluster.
Sentinel is an HA configuration with replicas and auto failover, but each
node has a full copy of the data.
Cluster is a sharded key space so data is divided among the nodes.
In order to implement atomic compare and set operations required
Hello,
It looks like InvokeHttp creates an instance of the OkHttp client in
the onScheduled method which is called when the processor is started,
and when it creates the client it will specify a hostname verifier to
always accept whatever the trusted hostname is. So the issue is that
if trusted ho
As James pointed out, there are alternate implementations of the DMC
client that use external services that can be configured for high
availability, such as HBase or Redis.
When using the DMC client service, which is meant to work with the DMC
server, the server is a single point of failure. In a
; What are this properties up to?
>
> Regards,
> Tom
>
>
>
> On Fri, 8 Feb 2019 at 15:25, Bryan Bende wrote:
>>
>> The message about "Kerberos service ticket login not supported by this
>> NiFi Registry" means that one of the following pr
The message about "Kerberos service ticket login not supported by this
NiFi Registry" means that one of the following properties is not
populated:
nifi.registry.kerberos.spnego.principal=
nifi.registry.kerberos.spnego.keytab.location=
On Fri, Feb 8, 2019 at 8:20 AM Tomislav Novosel wrote:
>
> Hi
Hi Josef,
Thanks for the heads up. Submitting a patch or pull request and
letting everyone know is generally the correct approach.
To get it into a release will require a committer with Kudu experience
to have time to review the change.
Thanks,
Bryan
On Wed, Feb 6, 2019 at 9:27 AM wrote:
>
>
vice. But how do I update all of my NiFi
> > components that reference the controller service by ID. Is there a
> > straightforward way to do this?
> >
> > Thanks
> >
> > -Tim
> >
> >
> > > On Feb 1, 2019, at 11:09 AM, Bryan Bende wrote:
>
> a glance it doesn’t appear to be working for me. Has this use case been
> tested before or am I running into a new issue?
>
> -Tim
>
> Sent from my iPad
>
> > On Feb 5, 2019, at 8:41 AM, Bryan Bende wrote:
> >
> > Tim,
> >
> > Unfortunately th
of my NiFi components that
> reference the controller service by ID. Is there a straightforward way to do
> this?
>
> Thanks
>
> -Tim
>
>
> > On Feb 1, 2019, at 11:09 AM, Bryan Bende wrote:
> >
> > Tim,
> >
> > For moving between registries the
s group to replace the contents of the
> “versionedFlowCoordinates” JSON object’s identifiers with the new IDs?
>
> Or is there a better way to insert parent and child process groups via my
> scripts?
>
> -Tim
>
> On Jan 31, 2019, at 6:25 PM, Bryan Bende wrote:
>
> Hi Tim,
>
Hello,
Just wanted to add that it is probably still good practice to back up the
database, or use an external highly available DB.
As we build out the registry we will be storing more information in the
database, and not all of it will come from git, so at some point the entire
database may not b
Hi Tim,
I think the second option is the correct approach. The higher level
versioned PG is the way of saying that the lower level PGs work together as
a cohesive unit.
-Bryan
On Thu, Jan 31, 2019 at 7:00 PM Tim Dean wrote:
> I am trying to automate deployment of a NiFi flow with several versi
Hello,
This should be fixed in master, just hasn’t been released yet.
https://issues.apache.org/jira/browse/NIFI-5830
Bryan
On Sat, Jan 26, 2019 at 8:04 AM wrote:
> FYI
>
>
>
> I’ve just created a bugreport – I don’t think this is expected behavior.
> https://issues.apache.org/jira/browse/NIF
the reference may not have the updated
> destination, and I have to loop until the new destination is reflected in the
> remote process group reference. So, I thought that by "refreshing" NIFI or
> that remote process group, I don't have to loop and wait.
>
> Regards
Hello,
What exactly do you mean by "refresh"?
If you mean update, then yes, anything you can update in the UI, you
can update through the REST API.
Thanks,
Bryan
On Fri, Jan 18, 2019 at 1:29 PM mohammed shambakey wrote:
>
> Hi
>
> Is it possible to use NIFI restapi to refresh all, or specific
There is now a JIRA and PR that should address this issue:
https://issues.apache.org/jira/browse/NIFI-5961
Thanks.
On Mon, Jan 14, 2019 at 2:23 AM wrote:
>
> Thanks Chad for confirming it.
>
> @Bryan Bende: how shall we continue here? I understand that it isn't a high
> pr
Mike,
Do you have anymore details about why the Hortonworks schema registry
stopped working?
I have used it before and didn’t have any issues.
Thanks
Bryan
On Tue, Jan 15, 2019 at 8:38 PM dan young wrote:
> We used the AvroSchemaRegistry
>
> Dano
>
> On Tue, Jan 15, 2019, 12:51 PM Mike Thoms
Hello,
The last release (1.8.0) introduced a new feature called load balanced
connections which can be used to converge data from all nodes down to one
node. You would make the connection right before merge content load balance
to a single node.
Thanks,
Bryan
On Tue, Jan 15, 2019 at 11:17 PM Ji
Hello,
ZooKeeper is not used at all in stand alone mode.
In a cluster it used for leader election, as well as to store state for
processors that maintain state, such as source processors that keep track
of a time stamp or id.
-Bryan
On Wed, Jan 16, 2019 at 7:49 AM Erik Anderson wrote:
> Our N
Hello,
In ListenHttp the base path is essentially the servlet mapping, so I
think it is either mapped to "/" which is everything, or it is mapped
to "/{basePath}".
You might be able to get more flexible path matching using
HandleHttpRequest with the path regex property.
-Bryan
On Mon, Jan 14, 2
Hello,
Currently this information isn't exposed via the REST API, although it
is available on the back-end and could be added. Right now there is an
end-point like "/flow/processor-types" which is used to retrieve the
list of processors when adding a new processor, but this response
doesn't have t
ial name... Even if I just click "Change version" and
> select another one than the current, my second PG changes the name back to
> the initial value.
>
> Btw. we use NiFi Registry 0.2.0.
>
> Cheers Josef
>
>
>
>
>
> On 08.01.19, 17:23
Hi Josef,
That sounds like a possible bug. I think the PG name is supposed to
remain unchanged.
I wasn't able to reproduce this though... in step 5 when you change
the "abc" group, what type of change are you making?
I did the following...
1) Create PG "A" and save to registry
2) Import PG "A"
Hello,
There is a CLI command for it. I’m not at a computer right now, but if you
launch the CLI and type help you can see all the commands.
Thanks,
Bryan
On Tue, Jan 1, 2019 at 8:46 AM Jeff Zemerick wrote:
> Hi,
>
> Is it possible to add a NiFi Registry client via a properties file/CLI?
> I'
You’ll need to get the token that was obtained when you logged in to the
SSO and submit it on the curl requests the same way the UI is doing on all
requests.
You should be able to open chrome dev tool tools while in the UI and look
at one of the request/responses and copy the value of the 'Authori
Hi Pat,
I’m personally not that familiar with Hive, but for those that are, they
will probably need to know what version of NiFi you are using since some
bugs have been fixed along the way.
Thanks,
Bryan
On Wed, Dec 19, 2018 at 4:59 PM Pat White wrote:
> Hi Folks,
>
> Using kerberos auth in N
What happens when you try to decrypt it? Is there an error?
On Tue, Dec 18, 2018 at 2:16 PM Scott Howell
wrote:
> I am trying to decrypt a file that was encrypted using the EncryptContent.
> I think I am missing something when it comes to decrypting a file.
>
> We storing the encrypted file in s
I know you mentioned staying schema agnostic, but if you went with the
record approach then this sounds like a good fit for the HBase lookup
service.
Steps 3-5 would be using LookupRecord with an HBaseLookupService where
you lookup by row id, and put the results into the current record.
I'm not s
PutDatabaseRecord needs the content of the flow file to match a schema
that lines up with your DB table.
So if you have table with a field called "json_content" then you need
a schema with that field and your flow file content would need to be
something like:
{
"json_content" :
}
There may be
Currently NiFI's Parquet integration is based on Parquet's Avro
support which is calling the AvroSchemaConvertor, there is not
anything else out of the box that I know of.
>From looking at the code quickly, I am not sure if there is a clean
way to tell to Parquet to tell Avro not to validate.
The
I think this is actually in Parquet's Avro code, so we'd have to see
if there was a way to pass a flag to Parquet so that it didn't perform
the schema validation.
On Wed, Dec 12, 2018 at 10:32 AM Matt Burgess wrote:
>
> You can try using an AvroSchemaRegistry and put your RecordWriter's
> schema i
>From your original email, option 1 is the correct approach. You are
right that it is performing extra deserialization/serialization, but
this is necessary to deal with the encoded schema references which
really are modified Avro records.
In option 2, if you take a whole bunch of records where the
This is probably more complicated than what you are looking for, but
could you use HTTP site-to-site [1]?
You would send the flow files to an output port and they'd be sitting
there until something transferred them from the output port.
I'm not sure though if you can get only one flow file at a t
Hello,
Is your Hortonworks schema registry kerberized?
Also, do you have a jaas file specified in bootstrap.conf?
There is some Kerberos related code in a static block in the
SchemaRegistryClient that could throw an exception and result in
NoClassDefFound.
Thanks,
Bryan
On Wed, Dec 5, 2018 at
aking changes to the pom file to use mapr hbase client
> libraries.
>
> Thanks,
> Ravi Papisetti
>
> On 30/11/18, 12:56 PM, "Bryan Bende" wrote:
>
> Ravi,
>
> The NullPointerException means that the Map-R version of the HBase
> client (1.1.
Ravi,
The NullPointerException means that the Map-R version of the HBase
client (1.1.8-mapr-1703) is returning null for either
getClusterStatus() or getMaster().
Whatever version you were using before this was probably not returning
null. It would probably be a question to MapR as to why that ver
Peter,
I feel like this came up before, and unfortunately I'm not sure there
is currently a solution.
I think ultimately there needs to be some kind of force upgrade so you
can ignore the local changes and take whatever is available.
The only thing I can think of, but haven't tried, is if you ha
David, yes putting the DB URL into the variable registry should work.
Ed, I'm ok with opening a JIRA for that, I feel like it may have come
up before, but can't remember if there is already a JIRA.
On Thu, Nov 29, 2018 at 3:13 PM David Gallagher
wrote:
>
> @Bryan Bende, @Pierre,
stem to maintain - we already have quite a few to keep our admins
> busy :)
>
> At least I have choices... :)
>
> Thanks again for your help!
>
> On Thu, Nov 29, 2018 at 1:33 PM Bryan Bende wrote:
>>
>> I also meant to add that NiFi does provide a "state manag
Bryan,
>> What if we refer controller services not only by UUID, but also by name (at
>> least in registry).
>> then, during deployment, if matching CS by UUID doesn't exist, we could
>> check all available CS by a name, and if there is only one matching by type
>&
planation, Bryan! it helps!
>
> Boris
>
> On Thu, Nov 29, 2018 at 12:26 PM Bryan Bende wrote:
>>
>> Boris,
>>
>> Yes the "distributed" name is confusing... it is referring to the fact
>> that it is a cache that can be accessed across the cluster
I, or some scripts, to
import the flows, then we can probably build some kind of convention
into those commands, or add additional commands to help with the
situation.
On Thu, Nov 29, 2018 at 12:51 PM Bryan Bende wrote:
>
> Hi Dave,
>
> Currently there isn't a built in way
Hi Dave,
Currently there isn't a built in way to make this automatic...
The issue is that the versioned flow in registry has the
PutDatabaseRecord with the DBCP Pool property set to a UUID that only
existed in the original environment the flow was created in.
When you import the flow to another
Boris,
Yes the "distributed" name is confusing... it is referring to the fact
that it is a cache that can be accessed across the cluster, rather
than a local cache on each node, but you are correct that that DMC
server is a single point of failure.
It is important to separate the DMC client and s
That is correct for the ConsumeKafka processor, but this question was
about the producer side :)
I believe you can make a producer ahead of time, and then specify the
topic when making a call to actually send a message, at least that
what it looks like the code does in all the PublishKafka variant
PutKafka doesn't support dynamic topic names, but it is a fairly old
processor and should only be used with a 0.8.0 Kafka broker.
I think the PublishKafka variants (0.9, 0.10, 0.11, 1.0, 2.0) should
all support dynamic topic names.
On Tue, Nov 20, 2018 at 10:12 AM l vic wrote:
>
> Hi,
> I have to
I think we would need to build some type of feature into registry to truly
support this. Possibly a more specific policy for proxies so that we could
say Dev NiFi can proxy read and write requests, and prod NiFi can only
proxy read requests. Currently it would only really work if you had
separate K
Hello,
It would really be best to use Maven as NiFi's NAR Maven plugin will
ensure that you are building the proper structure and will make things
easy for you.
Otherwise it would be up to you to somehow create the appropriate NAR
structure (and if it ever changes you would have to update your
pr
Hello,
Thanks for bringing this to our attention.
Most likely this happened as a result of upgrading the version of
spring-data-redis used by the redis bundle [1].
Looks like it should be an easy fix, but unfortunately wouldn't be
available in a release for a little while.
Thanks,
Bryan
[1] h
Charlie,
0.3.0 is the latest stable release, looks like we just have to update the
website, thanks for pointing this out!
-Bryan
On Tue, Nov 6, 2018 at 7:21 PM Charlie Meyer <
charlie.me...@civitaslearning.com> wrote:
> Hi,
>
> On https://nifi.apache.org/registry.html I see 0.2.0 as the most re
Not sure if this is what you are asking for, but ListenHttp and
HandleHttpRequest both do this.
They start an embedded Jetty server on a different port, unrelated to
NiFi's web server, and they are not part of NiFi's security model,
although they can be secured with 2-way TLS, or basic auth (I tth
Hello,
When you change a processor to use a controller service that is
contained with in the versioned process group then it is considered a
local change because all components are in the same process group
under version control.
If the controller service lives outside the versioned process group
Hello,
You can just connect the success relationship of ConsumeKafka (or any
processor) to two different follow on processors, no need to use any
special processor to duplicate.
-Bryan
On Fri, Nov 2, 2018 at 11:28 AM l vic wrote:
>
> Hello,
> I need to create 2 independent paths of execution f
How big are the initial CSV files?
If they are large, like millions of lines, or even hundreds of
thousands, then it will be ideal if you can avoid the line-by-line
split, and instead process the lines in place.
This is one of the benefits of the record processors. For example,
with UpdateRecord
You haven't said which processor/service you are using, but you may want to
check the docs for that component to see whether it supports expression
language from flow file attributes, some only support variable registry.
Most of the elastic search processors look like the host only supports
variab
Glad you were able to get it working.
Regarding the super user comment... I don't think it has to be a super
user, but it has to be a user that has permissions to perform the
action. For your example of "nifi pg-import" it would have to be a
user that has write permission to the parent process gro
Hello,
Currently templates still have the issue mentioned in that JIRA, but
if you are trying to move flows between environments I would recommend
taking a look at NiFi Registry which will be much more powerful than
templates, and a versioned flow saved to registry will contain all of
the controll
Currently I don't think there is a way that config value can be set without
a code change, but if you want to create a JIRA it would probably make
sense to expose that as a property in the processor to toggle between true
and false, or we can also allow make it so that any dynamic properties get
pa
-registry-bootstrap.log
On Wed, Oct 24, 2018 at 5:24 PM Bryan Bende wrote:
>
> Can you try editing cli.sh and near the end where it actually executes
> the CLIMain, edit the line to add the -D for SSL handshake debugging
> so it looks like this:
>
> exec "${JAVA}" -c
Can you try editing cli.sh and near the end where it actually executes
the CLIMain, edit the line to add the -D for SSL handshake debugging
so it looks like this:
exec "${JAVA}" -cp "${CLASSPATH}" ${JAVA_OPTS:--Xms128m -Xmx256m}
-Djavax.net.debug=ssl:handshake org.apache.nifi.toolkit.cli.CLIMain
443; will use this address for sending
> heartbeat messages
>
> 2018-10-24 13:34:12,174 INFO [Process Cluster Protocol Request-2]
> o.a.n.c.c.node.NodeClusterCoordinator Received Connection Request from
> :8008; responding with DataFlow that was elected
>
> 2018-10-24 13:34:1
screenshots
> taken on those. Please note that host’s FQDNs have been removed.
>
>
>
> -Original Message-
> From: Bryan Bende
> Sent: Wednesday, October 24, 2018 9:25 AM
> To: users@nifi.apache.org
> Subject: Re: NiFi fails on cluster nodes
>
>
>
> Many s
With the CLI using the keystore/truststore from NiFi you shouldn't get
an SSL handshake error at all, regardless of whether it was a command
against NiFi or NIFi Registry.
After the SSL handshake the command could still fail based on whether
the identity of the CLI has permissions to execute the c
lls you anything.
>
>
>
> BTW, what does “a different location in the same ZK” mean?
>
>
>
> -Original Message-
> From: Bryan Bende
> Sent: Tuesday, October 23, 2018 3:02 PM
> To: users@nifi.apache.org
> Subject: Re: NiFi fails on cluster nodes
>
>
&
So you're saying the CLI properties for the keystore and truststore
match exactly what is in your nifi.properties for the nifi.security
properties?
Basically these should be identical...
nifi.properties
nifi.security.keystore=
nifi.security.keystoreType=
nifi.security.keystorePasswd=
nifi.securi
In order to perform any action against a secure registry or NiFi you
will need to authenticate, just like if you went to one of the UI's in
your browser and you provided a client cert in your browser, or logged
in with LDAP/Kerberos/etc.
By specifying a truststore you are only verifying the server
27;s exactly the case.
>
> -Original Message-----
> From: Bryan Bende
> Sent: Tuesday, October 23, 2018 2:44 PM
> To: users@nifi.apache.org
> Subject: Re: NiFi fails on cluster nodes
>
> So you can get into each node's UI and they each show 1/1 for cluster nodes?
&g
-cluster-setup
On Tue, Oct 23, 2018 at 2:43 PM Bryan Bende wrote:
>
> So you can get into each node's UI and they each show 1/1 for cluster nodes?
>
> It doesn't really make sense how the second node would form its own cluster.
> On Tue, Oct 23, 2018 at 2:20 PM Saip, Al
ut 4000 for client /:50412
>
>
>
> I apologize for bugging you with all this, converting our standalone NiFi
> instances into cluster nodes turned out to be much more challenging than we
> had anticipated…
>
>
>
> -Original Message-
> From: Bryan Bende
> S
.xml file. Thank you so much for pointing me in the right direction!
> Now, in order to add another node, should I copy users.xml and
> authorizations.xml from the connected node to it, or remove them there
> instead?
>
>
>
> -Original Message-
> From: Bryan Bende
e nifi-user.log also contains
>
>
>
> 2018-10-23 12:17:01,916 WARN [NiFi Web Server-224]
> o.a.n.w.s.NiFiAuthenticationFilter Rejecting access to web api: Untrusted
> proxy CN=, OU=Devices, OU=NIH, OU=HHS, O=U.S. Government,
> C=US
>
>
>
> From your experience, what
mean that we will need to re-create all users and
> groups that we had in the original standalone NiFi instance?
>
> -----Original Message-
> From: Bryan Bende
> Sent: Monday, October 22, 2018 12:48 PM
> To: users@nifi.apache.org
> Subject: Re: NiFi fails on cluster nodes
we use that new authorizers.xml? I’m asking
> since we have the same LDAP authentication/authorization settings in the
> latter.
>
>
>
> Thank you,
>
>
>
> Alexander
>
>
>
> -Original Message-
> From: Bryan Bende
> Sent: Monday, October 22, 2018 1
Method.invoke(Method.java:498)
>
> at
> org.springframework.expression.spel.support.ReflectiveMethodExecutor.execute(ReflectiveMethodExecutor.java:113)
>
> at
> org.springframework.expression.spel.ast.MethodReference.getValueInternal(MethodReference.java:129)
>
&
> wrote:
> >
> > Thanks Bryan. I will take a look now. Regarding nifi-app.log, I will
> > look for it. Wasn't sure if I had to configure something for the
> > binary version to write the log, or set it's verbosity.
> > On Fri, Oct 19, 2018 at 12:27 PM
Can you look in the template using a text editor and find the element
for the processor you are referring to, and look for the "bundle"
elements and see if the bundle info (group, artifact, version) in the
template matches the info for the processor in the UI?
Also would be helpful to see the stac
Hello,
Bytes in is the # of bytes read from incoming flow files. Since source
processors don't have incoming flow files they will never have bytes
in or flow files in.
-Bryan
On Thu, Oct 18, 2018 at 11:25 AM Dominique De Vito wrote:
>
> Hi,
>
> While running a ConsumeKafka processor, I noticed t
wrote:
>
> Took a look at the pull request and that should handle the issue I was
> seeing. Is there going to be an issue with the directory being left there if
> something else fails? For my case the empty directory is fine.
>
>
> Thanks
>
> Shawn Weeks
>
> ____
Hi Shawn,
The way the processor works is the following...
1) Perform checks to try and ensure the completion strategy will work later
2) Perform the fetch and if successful then transfer to success and
commit the session
3) Perform the completion strategy
The issue is if the completion fails in
Maybe a Wait processor with an expiration of 60 mins? If you never use
a Notify processor then its basically just going to wait til the
expiration.
On Mon, Oct 15, 2018 at 4:10 PM Peter Wicks (pwicks) wrote:
>
> A coworker and I were working on a problem where we needed to delay a group
> of Flow
; or upgrade SolrJ to 6.6.
>
> I just tried the flow on the Lab systems running Nifi 1.7 and Kerberos
> authentication worked. Looks like we are going to be doing an upgrade.
>
>
> -Original Message-
> From: Bryan Bende [mailto:bbe...@gmail.com]
> Sent: Monday, O
What is the syntax issue connecting EvaluateJsonPath to RouteOnAttribute ?
On Mon, Oct 15, 2018 at 1:21 PM N, Vyshali wrote:
>
> Hi,
>
>
>
> I’m not appending the “status” attribute to the input json content. I’m just
> using as a parameter for comparison
>
> I tried the same way connecting Evalu
fine. Just out of curiosity, what version of java are you
> running? Does anyone know which version of SolrJ is using the the 1.6
> putsolrcontentstream?
>
> -Original Message-
> From: Bryan Bende [mailto:bbe...@gmail.com]
> Sent: Friday, October 12, 2018 2:08 PM
>
ecure' is set to 'true', since otherwise,
> NiFi would require values for 'nifi.web.http.host' and 'nifi.web.http.port'.
> We have a cert that is used to serve HTTPS requests to the NiFi web UI, and
> it works just fine.
>
> -Original Message-
This is not related to ZooKeeper... I think you are missing something
related to TLS/SSL configuration, maybe you set cluster protocol to be
secure, but then you didn't configure NiFi with a keystore/truststore?
On Mon, Oct 15, 2018 at 9:41 AM Mike Thomsen wrote:
>
> Not sure what's going on here
The cluster configuration section of the admin guide [1] is
independent of whether it is embedded or external zookeeper.
The only real difference is you won't set
nifi.state.management.embedded.zookeeper.start=true, but besides that
you all of the other config would be the same whether using embed
Hello,
You cannot reference flow file content from expression language, so
whatever you want to route on will need to be extracted into a flow
file attribute.
You can use EvaluateJsonPath with something like status =
$.result.status then in RouteOnAttribute ${status:equals('OK')}
Thanks,
Bryan
I've only done it against Solr cloud, but I don't know a reason why it
wouldn't work against standalone Solr.
Nothing is jumping out at me as being wrong with your config. My JAAS
config was the following:
SolrJClient {
com.sun.security.auth.module.Krb5LoginModule required
useKeyTab=true
ke
The RPG URL can be edited after importing to the next environment, and it
should be ignored when comparing against the flow in registry so it won’t be
seen as a change that needs to be committed. So although you can’t use a
variable, you should still be able to version control a flow with an RPG
Generally the larger the heap, the more likely to have long GC pauses.
I'm surprised that you would need a 70GB heap given NiFi's design
where the content of the flow files is generally not held in memory,
unless many of the processors you are using are not written in an
optimal way to process the
How are you currently defining schemas and transforms? or are you free
to choose depending what works best for building the data flow?
If you are willing to use JOLT to define the transform then you have a
few options...
1) As Joe mentioned, you can send the GUID in a header which becomes a
flow
Scott,
I would think that you would upgrade dev to the latest version, in
this case 1.7.1, then make sure all your flows are working properly
and commit any updates to the registry. For example any of the process
groups that involved PutSFTP would need to be committed because of the
new properties
ff the state? Or maintain the
> state as is but just don't consider it?
>
> -
> Sivaprasanna
>
> On Tue, Sep 25, 2018 at 7:54 PM Bryan Bende wrote:
>>
>> I like that approach too.
>> On Tue, Sep 25, 2018 at 10:21 AM Pierre Villard
>> wrote:
>> >
ut doing something similar for List processors? If there is no
>> > incoming connection, then they continue to behave as they always have.
>> > If there is an incoming connection and no flow file, no work is
>> > performed. If there is an incoming connection with available
Hi Martijn,
The request for the "list" processors to support incoming flow files
comes up frequently. The issue is that the list processors are meant
to continuously watch a given directory/bucket and maintain state
about what has been seen and only find newer stuff. So if you let the
processor su
horizations.xml file and restarted nifi to check if login works.
>
>
>
> Regards,
> Dnyaneshwar Pawar
>
>
> -Original Message-
> From: Bryan Bende
> Sent: Wednesday, September 19, 2018 6:40 PM
> To: users@nifi.apache.org
> Subject: ***UNCHECKED***
The main issue is that although NiFi has a lot of similar
functionality to a workflow ETL tool, it is really a data flow tool
that is meant to be used in more of a streaming fashion where there is
no concept of "finished" or "complete" because there is a constant
flow of data.
>From a scheduling p
Shawn,
I believe this issue [1] is the fix you are looking for, but
unfortunately isn't in a release yet, but should be in the next one.
As a work around, you may be able to list everything with ListHDFS and
then send the results to a RouteOnContent that routes any content
matching your .bat rege
ttached, if i am missing
> more verbose part I apologize
>
> On Thu, Sep 20, 2018 at 12:53 PM Bryan Bende wrote:
>>
>> The REST API documentation [1] for the method you are using says:
>>
>> NameLocation Type Description
>> id path
ot;id" must actually be "groupId", then it works... As usual, Nifi
> documentation is vague or misleading
>
> On Thu, Sep 20, 2018 at 12:38 PM Bryan Bende wrote:
>>
>> That means there is no process group with the id you specified.
>> On Thu, Sep 20, 2018
301 - 400 of 884 matches
Mail list logo
