Hello
If going from 8 nodes with many errors to 1 node with few errors then you
likely hit max connection limits on the sftp server. You can change that
value on fhe sftp server. How many concurrent tasks do you allow the
processor. If Y tasks you will want Y times 8 connections allowed.
Mike
If nothing is in the logs on the impacted node or anything else in the
cluster you will want to grab a thread dump on the affected node and see
what is actually happening. There has to be logs though If you have a
large back log then you could be waiting for the initial repository
Hello
The Apache NiFi team would like to announce the release of Apache NiFi 1.21.0.
Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute data. Apache NiFi was made for dataflow. It
supports highly configurable directed graphs of data routing,
transformation,
Hello
The Apache NiFi team would like to announce the release of Apache NiFi 1.20.0.
Apache NiFi is an easy to use, powerful, and reliable system to
process and distribute
data. Apache NiFi was made for dataflow. It supports highly
configurable directed graphs
of data routing, transformation,
Hello
The Apache NiFi team would like to announce the release of Apache NiFi
1.20.0.
Apache NiFi is an easy to use, powerful, and reliable system to process and
distribute
data. Apache NiFi was made for dataflow. It supports highly configurable
directed graphs
of data routing, transformation,
Joe
I dont recall the specific version in which we got it truly sorted but
there was an issue with our default settings for an important content repo
property and how we handled mixture of large/small flowfiles written within
the same underlying slab/claim in the content repository.
Please check
int.interval=300 secs
> nifi.flowfile.repository.always.sync=false
> nifi.flowfile.repository.retain.orphaned.flowfiles=true
>
> -Joe
> On 7/12/2023 11:07 AM, Joe Witt wrote:
>
> Joe
>
> I dont recall the specific version in which we got it truly sorted but
> there was an issue with our default setti
And looks like with NiFi 2.0 though we will drop the Hortonworks Schema
Registry as shown here [1]. If maintenance becomes more active for it we
could revisit as needed.
[1] https://issues.apache.org/jira/browse/NIFI-11095
On Wed, Jul 19, 2023 at 12:32 PM Joe Witt wrote:
> Hello
>
Hello
You will want to check with Cloudera for the status of the Schema Registry
in question here. From a NiFi point of view we will continue to integrate
with schema registries we see in common usage and it should be set up well
to plug in new ones and phase older ones as we go. Support for
H. Interesting. Can you capture these bits of fun in a jira?
Thanks
On Fri, Jul 7, 2023 at 7:17 PM Mike Thomsen wrote:
> After doing some research, it appears that is a wonky
> setting WRT how well it's honored by logback. I let a GenerateFlowFile >
> LogAttribute flow run for a long
Hello
Can you describe how you would use this information?
These kinds of details and more are present in provenance data now.
Thanks
On Wed, May 24, 2023 at 7:45 AM Chirthani, Deepak Reddy <
c-deepakreddy.chirth...@charter.com> wrote:
> Is there any chance where Processor_ID or
-- Forwarded message -
From: Joe Witt
Date: Sun, Jun 11, 2023 at 9:27 PM
Subject: [ANNOUNCE] Apache NiFi 1.22.0 release.
To:
Hello
The Apache NiFi team would like to announce the release of Apache NiFi 1.22.0.
Apache NiFi is an easy to use, powerful, and reliable system
Greg
Yeah seems likely there is a build issue with the RPM profile. I think we
just dont have enough people exercising that thing often enough anymore and
so when it breaks it is silent. The only thing we meant to have an RPM for
as far as I recall was the nifi assembly itself but perhaps we had
Nilesh,
These processors generally are not memory sensitive as they should
only ever have small amounts in memory at a time so it is likely this
should work well up to 100s of GB objects and so on. We of course dont
really test that much but it is technically reasonable and designed as
such. So
Hello
NiFi doesn't offer an SCP specific processor. Instead you would use
List/FetchSFTP to pull from the target directory and remote source server
(and recurse to subdirs as desired) and then use PutSFTP to write to the
target directory (including subdirs as desired) of the remote destination
This [1] blog seems amazingly appropriate and wow do we need these/any such
fields we intend to truly honor in a prominent place in the docs. Super
useful...
[1] https://jameswing.net/nifi/nifi-internal-fields.html
Thanks
On Thu, Feb 15, 2024 at 8:35 AM Mark Payne wrote:
> Jim,
>
> You can
Agreed - thanks for the details. Can you create a JIRA with it while
you're at it? Either way it will get attention I'm sure.
Thanks
On Tue, Dec 19, 2023 at 10:18 AM Shawn Weeks
wrote:
> If I revert to 1.23.2 the issue goes away. Seems like there might be a bug
> in the H2 to Xodus migration
Etienne,
Are you using our nifi poms as your parent pom of your extensions? I do
wonder if perhaps we should offer one that doesn't tie to all our ASF-isms
Thanks
On Sat, Dec 9, 2023 at 10:54 AM Etienne Jouvin
wrote:
> Hello all;
>
> Since now, I never push my extensions to any Nexus or
Thanks so much to all involved and David for driving this to completion!
It looks great
On Mon, Jan 8, 2024 at 11:17 AM David Handermann <
exceptionfact...@apache.org> wrote:
> Team,
>
> Thanks to a collaborative effort from several designers and
> developers, the Apache NiFi project website
Aaron,
The usual suspects are memory consumption leading to high GC leading to
lower performance over time, or back pressure in the flow, etc.. But your
description does not really fit either exactly. Does your flow see a mix
of large objects and smaller objects?
Thanks
On Wed, Jan 10, 2024 at
e started, I will do a concise and thorough description in the
> ticket.
> Sincerely,
> Jim
>
> On Wed, Jan 31, 2024 at 12:12 PM Joe Witt wrote:
>
>> James,
>>
>> Makes sense to create a JIRA to improve UnpackContent to extract these
>> attributes in t
James,
Makes sense to create a JIRA to improve UnpackContent to extract these
attributes in the event of a zip file that happens to present them. The
concept of lastModifiedDate does appear easily accessed if available in the
metadata. Owner/Creator/Creation information looks less standard in
Hello
Can you share more about which authentication and authorization provider
you're using with NiFi today?
Also would be good to share which other authentication/authorization
providers your organization could leverage as then it is a question of
which ones are supported out of the box.
h will normally be overwritten). I'm
> running version 1.23.2.
>
> Regards,
> *Shamsudeen Jameer*Data Operations ManagerPriority
> shamsudeen.jam...@prth.como: (516) 345-5015 M: (917) 374-6599‒‒
>
>
>
> On Tue, Apr 30, 2024 at 6:01 PM Joe Witt wrote:
>
>> Hello
Hello
The key output is
java.lang.OutOfMemoryError: Java heap space
Review batch property options to limit response sizes in the database calls.
Thanks
On Tue, Mar 19, 2024 at 6:15 AM wrote:
> Hello
>
> I got the executeSQL processor does the sql command "select * from
> public.table1"
>
Deepak
In Apache we don't have mechanisms to verify/validate that but indications
are that it should work just fine.
Thanks
On Fri, Jun 14, 2024 at 10:47 AM Chirthani, Deepak Reddy <
c-deepakreddy.chirth...@charter.com> wrote:
> Hi,
>
>
>
> Writing this email to get a confirmation for if
James
You may be able to use alternative JSON components such as those with
record readers/writes.
You could certainly write a nifi processor in either Java or Python that
would do this and be super efficient.
The processor you've chosen just isn't very flexible in regards to larger
objects and
901 - 927 of 927 matches
Mail list logo
