Hadoop dependencies are also compileOnly in Iceberg, so you also need to
add Hadoop packages such as hadoop-common and hadoop-client in your project
dependency.
-Jack Ye
On Wed, Jun 30, 2021 at 10:35 AM Huadong Liu <huadong...@gmail.com> wrote:
> Hi, I made a shadowJar with *org.apache.hive:hive-metastore:3.1.2 and got
> errors:*
>
>
> *Exception in thread "main" java.lang.NoClassDefFoundError:
> org/apache/hadoop/mapred/JobConf at
> org.apache.hadoop.hive.conf.HiveConf.initialize(HiveConf.java:5141) at
> org.apache.hadoop.hive.conf.HiveConf.<init>(HiveConf.java:5109) at
> org.apache.iceberg.hive.HiveClientPool.<init>(HiveClientPool.java:48) at
> org.apache.iceberg.hive.HiveClientPool.<init>(HiveClientPool.java:43) at
> org.apache.iceberg.hive.HiveCatalog.<init>(HiveCatalog.java:78) at
> com.gradle.iceberg.HadoopToHive.main(HadoopToHive.java:52)*
>
> The error is gone with *org.apache.hive:hive-metastore:2.3.6 in
> gradle.build. *
>
> *dependencies {*
> * compile 'org.apache.iceberg:iceberg-hive-metastore:0.11.1'*
> * compile 'org.apache.hive:hive-metastore:3.1.2' *
> *}*
>
> hadoop-common Any idea how to fix this? Thank you.
>
