I found that instead of dealing with nifi client certificate hell, the
nifi-toolkit cli.sh will work just fine for testing the readiness of the
cluster. Here is my readiness script which seems to work just fine with in
kubernetes with the apache/nifi docker container version 1.12.1
IIRC this is likely a permissions issue, Xerial Snappy tries to unzip the
native library to the location pointed to by “java.io.tempdir” which on *nix
defaults to /tmp. Does the NiFi user have write access to that directory? If
not you can change the Java temp dir or set it specifically for
Ugh now I remember, that version of Hive uses a version of Snappy that doesn’t
create a unique path under /tmp, do you have multiple PutHiveStreaming
processors in the flow? I don’t think that works because we can’t load a single
native library into multiple classloaders.
> On Oct 13, 2020,
Ouch! It does happen on the loading of the NAR to ensure the native library
gets loaded. If you are not using Hive I’d think you could safely delete the
nifi-hive-nar and it shouldn’t happen. Hard to tell why the native library
couldn’t be installed though.
> On Oct 13, 2020, at 6:26 PM,
Should I be seeing this in the log of a vanilla NiFi installation on CentOS?
ERROR [main] org.apache.nifi.NiFi Failure to launch NiFi due to
java.util.ServiceConfigurationError:
org.apache.nifi.processor.Processor: Provider
org.apache.nifi.processors.hive.PutHiveStreaming could not be
We didn't want to make deletion or modification of a shipped component
to be a required part of its installation since we don't produce the
NiFi download. We'd rather install it as it comes.
On 10/13/20 4:45 PM, Matt Burgess wrote:
Ouch! It does happen on the loading of the NAR to ensure the
No, we don't even use (nor have we ever used) Hive in our flows. It's
just there and we didn't want to modify the NiFi download. Should this
not even happen if we're not using it?
On 10/13/20 4:24 PM, Matt Burgess wrote:
Ugh now I remember, that version of Hive uses a version of Snappy that
Hi,
I am seeing lot of issues with our data when using putdatabase with
jsontree reader. JSON is valid when I checked actual data but NIFI is
complaining about non closeable input stream. May I know how to resolve
this?
Here is sample json and error message
error = 'Unrecognized character
I see
-rwxr-xr-x. 1 nifi nifi 48432 Oct 13 13:48
snappy-1.0.5-libsnappyjava.so
in //tmp/. Therefore, not a permissions issue? Launching this way works:
$ ( export
LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/snappy-1.0.5-libsnappyjava.so" &&
/opt/nifi/bin/nifi.sh start )
but
Did you say that the same line of code works fine for secured clusters too.
I asked because nifi-toolkit has a separate set of parameters asking for
certificates and everything else related to secure clusters.
On Tue, Oct 13, 2020 at 12:14 PM Wyll Ingersoll <
wyllys.ingers...@keepertech.com>
Hello,
I have two environments and one NiFi server in each one. How can I compare
which flows and processors that I have in each one?
I have until 5 levels of grouping.
NiFi Home --> First --> Second...
Thank you!
Does NiFi have a processor that can act as a client for a long polling
server, for example an SSE server?
More specifically, I want a client that can issue a HTTP GET request to a
long polling server and accept stream of messages from the server (on the
same connection).
If there isn't one, which
Our current installations are running on NiFi 1.1.2, I think. Recently,
the company wanted to move up in the world. So, we don't have that
continuous experience. We started on 0.7.1.
We're running Java 8 on CentOS 8, I think.
Personally, I run Linux Mint (Ubuntu, corrected) for development. I
Hi community
I have some issues with the InvokeHTTP process. Sometimes the process does
not receive a response from the web server and the process hangs in a
waiting state without timing out.
I use nifi version 1.12.1, and the settings for the InvokeHTTP process is
as follow:
Penalty duration 30
14 matches
Mail list logo
