Hi Bryan,

Thank you for getting back to me. Yes, that’s correct we compiled with the 
ozone profile.

G

Sent from Proton Mail for iOS

On Mon, Jul 25, 2022 at 18:12, Bryan Bende <bbe...@gmail.com> wrote:

> Hello,
>
> Did you build your own NiFi off 1.16.1 using the profile
> "include-hadoop-ozone", and then used PutHDFS and that is what
> generated the error in your attached logs?
>
> -Bryan
>
> On Mon, Jul 25, 2022 at 11:08 AM Giorgio <g...@protonmail.com.invalid> wrote:
>>
>> Hello,
>>
>> I would like to report a potential bug that affects NiFi 1.16.1. Our current 
>> setup consists of a cluster of 3 nodes and the aim is to build a workflow 
>> that can write to both HDFS and Apache Ozone. To this end, we have 
>> configured two distinct PutHDFS processors. The configuration of these two 
>> processors is such that one points to HDFS and the other one to Ozone using 
>> two different core-sites configuration files. The PutHDFS processor that 
>> points to Ozone uses OFS as protocol.
>>
>> When we try running the workflow, however, we run into problems. 
>> Essentially, this seems to be caused by conflicting libraries that are 
>> instantiated by the two processors, thus generating an error.
>>
>> We have found a way to circumvent this problem but this required us to build 
>> a custom PutOzone processor that better encapsulates the way the libraries 
>> are instantiated.
>>
>> We are not sure whether this is a known issue. Please find attached the 
>> relevant log lines.
>>
>> Regards,
>>
>> Giorgio
>>
>>
>> Sent with Proton Mail secure email.

Reply via email to