Our current installations are running on NiFi 1.1.2, I think. Recently,
the company wanted to move up in the world. So, we don't have that
continuous experience. We started on 0.7.1.
We're running Java 8 on CentOS 8, I think.
Personally, I run Linux Mint (Ubuntu, corrected) for development. I
We didn't want to make deletion or modification of a shipped component
to be a required part of its installation since we don't produce the
NiFi download. We'd rather install it as it comes.
On 10/13/20 4:45 PM, Matt Burgess wrote:
Ouch! It does happen on the loading of the NAR to ensure the
Ouch! It does happen on the loading of the NAR to ensure the native library
gets loaded. If you are not using Hive I’d think you could safely delete the
nifi-hive-nar and it shouldn’t happen. Hard to tell why the native library
couldn’t be installed though.
> On Oct 13, 2020, at 6:26 PM,
No, we don't even use (nor have we ever used) Hive in our flows. It's
just there and we didn't want to modify the NiFi download. Should this
not even happen if we're not using it?
On 10/13/20 4:24 PM, Matt Burgess wrote:
Ugh now I remember, that version of Hive uses a version of Snappy that
Ugh now I remember, that version of Hive uses a version of Snappy that doesn’t
create a unique path under /tmp, do you have multiple PutHiveStreaming
processors in the flow? I don’t think that works because we can’t load a single
native library into multiple classloaders.
> On Oct 13, 2020,
I see
-rwxr-xr-x. 1 nifi nifi 48432 Oct 13 13:48
snappy-1.0.5-libsnappyjava.so
in //tmp/. Therefore, not a permissions issue? Launching this way works:
$ ( export
LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/snappy-1.0.5-libsnappyjava.so" &&
/opt/nifi/bin/nifi.sh start )
but
IIRC this is likely a permissions issue, Xerial Snappy tries to unzip the
native library to the location pointed to by “java.io.tempdir” which on *nix
defaults to /tmp. Does the NiFi user have write access to that directory? If
not you can change the Java temp dir or set it specifically for
Should I be seeing this in the log of a vanilla NiFi installation on CentOS?
ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to
java.util.ServiceConfigurationError:
org.apache.nifi.processor.Processor: Provider
org.apache.nifi.processors.hive.PutHiveStreaming could not be
