Matt Burgess [mailto:mattyb...@apache.org]
Gesendet: Montag, 11. Mai 2020 23:00
An: users@nifi.apache.org<mailto:users@nifi.apache.org>
Betreff: Re: Possible memory leak in PutHive3Streaming?
Martin,
There were two memory leaks a while back, one in NiFi code and one in Hive
client code (brought
Martin,
There were two memory leaks a while back, one in NiFi code and one in
Hive client code (brought in as a dependency for the Hive 3
components). NiFi has fixed their side in 1.9.0 (via NIFI-5841 [1])
and Hive has fixed their side in 3.1.1 (via HIVE-20979 [2]). Until
NiFi 1.11.4, we were stil
Martin,
I don’t know a lot about Hive. The log message you’re noting there is
definitely coming from Hive’s client, but I can’t say whether or not it’s
anything that should actually be concerning in terms of Java memory/heap. Is
the NiFi heap size actually set to a max of 130 GB? (That would be
Hi,
I'm using the PutHive3Streaming processor to write round about 30,000 avro
records into a Hive table (round about 150 GB). This works for a while but the
used memory is increasing over the time. And after some thousands records, the
memory is full.
When I remove the PutHive3Streaming proce
