Hey Pierre,

This has solved the issue for me. Thank you!

From: Pierre Villard <pierre.villard...@gmail.com>
Sent: 23 February 2024 13:59
To: users@nifi.apache.org
Subject: Re: Using PutIceberg to insert into a table in S3 fails with 
ClassNotFoundException

I believe that you'd need to build the processor with specific profiles enabled 
which is not the case in the default build that we provide for convenience.

In nifi-inceberg-bundle, you could do something like
maven clean install -Pinclude-hadoop-aws
And use the generated NARs in your NiFi deployment

HTH,
Pierre

Le ven. 23 févr. 2024 à 03:25, Doğukan Levendoğlu | Obase 
<dogukan.levendo...@obase.com<mailto:dogukan.levendo...@obase.com>> a écrit :
Hello,

I am trying to test the PutIceberg processor but having some difficulty.

I've created my own docker image on top of the official image by adding these 
nars:
[cid:image001.png@01DA666B.CD3446A0]

My HiveCatalogService configuration is as follows:
[cid:image002.png@01DA666B.CD3446A0]
Hadoop configuration, for brevity I am sharing it as key=value:
core-site.xml:
                fs.s3a.endpoint=minio:9000
                fs.s3a.access.key=minioadmin
                fs.s3a.secret.key=minioadmin
                fs.s3a.path.style.access=true
                fs.s3.connection.ssl.enabled=false
hive-site.xml:
                hive.metastore.uris=thrift://0.0.0.0:9083<http://0.0.0.0:9083>
                hive.metastore.warehouse.dir=s3a://warehouse/
                hive.metastore.try.direct.sql=false
                hive.metastore.try.direct.sql.ddl=false
                ... postgres related configurations ...

This is the error I am getting:
[cid:image003.png@01DA666B.CD3446A0]

Is there something I am missing? Could anyone get this to work?

Thank you,
Dogukan


obase
Tel: 0216 527 30 00
Fax: 0216 527 31 11
[https://obase.com/social/facebook.svg]<https://www.facebook.com/obasesocial>[https://obase.com/social/twitter.svg]<https://twitter.com/obasesocial>[https://obase.com/social/linkedin.svg]<https://tr.linkedin.com/in/obase>

[https://obase.com/Content/images/logo.svg]<http://www.obase.com/>

Bu elektronik posta ve onunla iletilen bütün dosyalar sadece göndericisi 
tarafindan almasi amaclanan yetkili gercek ya da tüzel kisinin kullanimi 
icindir. Eger söz konusu yetkili alici degilseniz bu elektronik postanin 
icerigini aciklamaniz, kopyalamaniz, yönlendirmeniz ve kullanmaniz kesinlikle 
yasaktir ve bu elektronik postayi derhal silmeniz gerekmektedir. OBASE bu 
mesajin icerdigi bilgilerin doğruluğu veya eksiksiz oldugu konusunda herhangi 
bir garanti vermemektedir. Bu nedenle bu bilgilerin ne sekilde olursa olsun 
iceriginden, iletilmesinden, alinmasindan ve saklanmasindan sorumlu degildir. 
Bu mesajdaki görüsler yalnizca gönderen kisiye aittir ve OBASE görüslerini 
yansitmayabilir.

Bu e-posta bilinen bütün bilgisayar virüslerine karsi taranmistir.

This e-mail and any files transmitted with it are confidential and intended 
solely for the use of the individual or entity to whom they are addressed. If 
you are not the intended recipient you are hereby notified that any 
dissemination, forwarding, copying or use of any of the information is strictly 
prohibited, and the e-mail should immediately be deleted. OBASE makes no 
warranty as to the accuracy or completeness of any information contained in 
this message and hereby excludes any liability of any kind for the information 
contained therein or for the information transmission, recepxion, storage or 
use of such in any way whatsoever. The opinions expressed in this message 
belong to sender alone and may not necessarily reflect the opinions of OBASE.

This e-mail has been scanned for all known computer viruses.

Reply via email to