butaozhang commented on issue #2576:
URL: https://github.com/apache/iceberg/issues/2576#issuecomment-838045977
@marton-bod Thanks for giving guidance. I test and it works! Here is the
correct config:
```
set hive.vectorized.execution.enabled=false;
set hive.execution.engine=tez;
```
By the way, can SparkSQL(version3.0) read hive_Ice tables? I try to add jar
hive-iceberg-handler-4.0.0-SNAPSHOT.jar to sparkSQL classpath and make ddl
query of the hive_ice table, but didn't succeed. Error like the following:
```
./spark-sql --jars /data/hive-iceberg-handler-4.0.0-SNAPSHOT.jar
spark-sql> select * from ice_tbl;
21/05/11 16:03:37 ERROR thriftserver.SparkSQLDriver: Failed in [select *
from ice_tbl]
java.lang.ExceptionInInitializerError
at
org.apache.iceberg.mr.hive.HiveIcebergSerDe.initialize(HiveIcebergSerDe.java:135)
at
org.apache.hadoop.hive.serde2.SerDeUtils.initializeSerDe(SerDeUtils.java:533)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:450)
at
org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:437)
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:281)
at
org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:263)
at
org.apache.hadoop.hive.ql.metadata.Table.getColsInternal(Table.java:641)
at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:624)
at
org.apache.spark.sql.hive.client.HiveClientImpl.liftedTree2$1(HiveClientImpl.scala:431)
at
org.apache.spark.sql.hive.client.HiveClientImpl.convertHiveTableToCatalogTable(HiveClientImpl.scala:430)
at
org.apache.spark.sql.hive.client.HiveClientImpl.$anonfun$getTableOption$3(HiveClientImpl.scala:424)
at scala.Option.map(Option.scala:230)
Caused by: java.lang.RuntimeException: Cannot find method: get
at
org.apache.iceberg.common.DynMethods$Builder.build(DynMethods.java:454)
at
org.apache.iceberg.common.DynMethods$Builder.buildStatic(DynMethods.java:522)
at
org.apache.iceberg.mr.hive.serde.objectinspector.IcebergObjectInspector.<clinit>(IcebergObjectInspector.java:46)
... 111 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
