Hello,
Unfortunately it isn't really that easy...
The way NiFi is setup you aren't really supposed to be modifying the
classpath, other than adding new NARs to the lib directory.
Each NAR has it's own classloader and isolates the dependencies so
that other NARs don't impact each other, and all NARs see any JARs
directly in the lib directory. Adding all the WASB JARs to the lib
directory would make them visible to the Kite processors, but would
also likely cause unintended side effects in other processors.
We built a specific framework level capability to handle what you are
wanting to do...
You would add a new PropertyDescriptior to the processor like:
public static final PropertyDescriptor ADDITIONAL_CLASSPATH_RESOURCES
= new PropertyDescriptor.Builder()
.name("Additional Classpath Resources")
.description("A comma-separated list of paths to files and/or
directories that will be added to the classpath. When specifying a " +
"directory, all files with in the directory will be
added to the classpath, but further sub-directories will not be
included.")
.required(false)
.addValidator(StandardValidators.NON_EMPTY_VALIDATOR)
.dynamicallyModifiesClasspath(true)
.build();
The framework will see the "dynamicallyModifiesClasspath" part and
will automatically add these resources to the class loader for the
given instance of the processor.
The above example property is from the HDFS processors and is how we
handled the WASB situation for Put/Get/List HDFS.
Hopefully this helps.
-Bryan
On Fri, Sep 29, 2017 at 10:45 AM, Giovanni Lanzani
<[email protected]> wrote:
> Hi,
>
> I am trying to append to a Kite Dataset. All is well when I'm using a local
> file, but as soon as I try to do it on HDFS on Azure (thus HDInsight, thus
> wasb protocol, i.e. Blob Storage) the StoreInKiteDataset processor is
> unhappy as the JARs to write using the wasb protocol are not in the class
> path.
>
> Assuming I find where these JARs are... How do I add them to the class path?
> Or is it not so easy as that?
>
> Cheers, and thanks in advance (I've googled/Duckduckgoed quite a bit)
>
> Giovanni
