Elasticsearch doesn't have a CDC-like capability (it doesn't maintain a
transaction log or such), so that approach isn't possible.
What I've done previously is to maintain an audit log in a separate index
within elasticsearch to track what data I've previously posted, e.g. this might
be the las
Eric,
It is important to note that Java process memory usage consists of multiple
factors beyond the maximum heap size. Kubernetes limits are based on total
memory usage, so it is essential to account for all Java memory elements
when specifying Kubernetes memory limits.
The following article has
I have but the processor is not working, and it's not giving an error
message.
I saw controller services like ADLSCredentialsControllerService to
configure a managed identity for PutADLS, was wondering if there is an
equivalent controller service for PutEventHub, where I could configure a
system-as
One further question - what is the recommended way of checking for updates
in an index and fetching new records in a similar manner to
GenerateTableFetch for an sql DB?
Thanks
On Thu, Aug 17, 2023 at 7:21 AM Richard Beare
wrote:
> Sounds perfect. Thanks
>
> On Thu, Aug 17, 2023 at 5:11 AM Chris
Eric
Try using 2GB for the heap and seeing that helps. I also believe there are
specific pod settings youll want to use to avoid it getting nuked by k8s.
This blog may give you great things to consider
https://home.robusta.dev/blog/kubernetes-memory-limit
Thanks
On Wed, Aug 16, 2023 at 3:29 PM
My nifi.properties uses the filesystem repository implementations for
everything except the component status repository. So it's sticking to the
defaults. Could the VolatileComponentStatusRepository be what's eating up
my memory. It would fit well with the use pattern of the test framework
creating
Hi,
I was wondering what the recommendation is for how much memory to start the
nifi jvm with and then how much to set the docker container memory limit as
a function of the jvm memory setting.
I have nifi started with -xms and -xmx set to 4gb and docker memory
resource limits of 8GB on the conta
Sounds perfect. Thanks
On Thu, Aug 17, 2023 at 5:11 AM Chris Sampson wrote:
> What you describe sounds like the processor is working as designed &
> documented, i.e. it will restart the same query once it has reached the end
> of the paginated scroll (or search_after, or point-in-time) query.
>
What you describe sounds like the processor is working as designed &
documented, i.e. it will restart the same query once it has reached the end of
the paginated scroll (or search_after, or point-in-time) query.
Instead, it sounds like you want to try using the
PaginatedJsonQueryElasticsearch [
You might check if your RHEL8 was installed with FIPS mode enabled
(fips-mode-setup --check). FIPS can limit available ciphers which would
affect TLS in Java.
-- Mike
On Tue, Aug 15, 2023 at 1:38 PM Mike Thomsen wrote:
> I had similar thoughts and told them to start working with different
> f
Hi Sean,
PutAzureEventHub processor has "Use Azure Managed Identity" property. Have
you tried it?
Regards,
Peter Turcsanyi
On Wed, Aug 16, 2023 at 8:24 PM Sean Davis wrote:
> Hello,
>
> I'm trying to configure a PutAzureEventHub processor using system-assigned
> managed identity.
> I don't see
Hello,
I'm trying to configure a PutAzureEventHub processor using system-assigned
managed identity.
I don't see a controller service or a different processor that would allow
me to configure the managed identity in NiFi.
I was wondering if there is any way to configure this in NiFi?
Thanks,
Sean.
Hello,
Thanks for the question. The api documentation [1] does provide info about
the endpoint and its parameters, but it doesn't provide the specifics on
exactly what is supported for that parameter. In reviewing the code however
I can see that information (see FlowResource[2]). I will create a
Hello YolandaWhere is the document about accepted parameter to set after “includedRegistries”Thanks for helpEnvoyé à partir de l'app mail mobile sur 14/08/2023 le 17:38, Yolanda Davis écrivit:
Hi,
I am using the SearchElasticSearch (1.20.0) processor to retrieve all
documents (~20M) from an index, process and eventually return results to a
new index, although for this test I'm retrieving and processing then
discarding. I'm using opensearch.
My problem is that the process restarts after
15 matches
Mail list logo
