[
https://issues.apache.org/jira/browse/IMPALA-13284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871816#comment-17871816
]
Quanlong Huang commented on IMPALA-13284:
-----------------------------------------
The other error is Apache Hive3 doesn't support STORED BY ICEBERG STORED AS
AVRO:
{code:sql}
CREATE EXTERNAL TABLE IF NOT EXISTS functional_parquet.iceberg_avro_format (
int_col int,
string_col string,
double_col double,
bool_col boolean
)
STORED BY ICEBERG STORED AS AVRO
LOCATION
'/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_avro_format';{code}
Needs to add the jar of iceberg-hive-runtime to the CLASSPATH of Hive:
{code:sql}
add jar
$IMPALA_HOME/fe/target/dependency/iceberg-hive-runtime-${IMPALA_ICEBERG_VERSION}.jar;
{code}
and modify the DDL to be
{code:sql}
CREATE EXTERNAL TABLE IF NOT EXISTS functional_parquet.iceberg_avro_format (
int_col int,
string_col string,
double_col double,
bool_col boolean
)
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
LOCATION '/test-warehouse/iceberg_test/hadoop_catalog/ice/iceberg_avro_format';
ALTER TABLE functional_parquet.iceberg_avro_format SET
TBLPROPERTIES('write.format.default'='avro');
{code}
Don't need to add the jar for CDP hive3 since CDP Hive3 has the jar of
hive-iceberg-handler in its lib folder:
$IMPALA_HOME/toolchain/cdp_components-49623641/apache-hive-3.1.3000.7.3.0.0-128-bin/lib/hive-iceberg-handler-3.1.3000.7.3.0.0-128.jar
> Loading test data on Apache Hive3
> ---------------------------------
>
> Key: IMPALA-13284
> URL: https://issues.apache.org/jira/browse/IMPALA-13284
> Project: IMPALA
> Issue Type: Task
> Components: Infrastructure
> Reporter: Quanlong Huang
> Assignee: Quanlong Huang
> Priority: Major
>
> When building on Apache Hive3, there are some failures in loading test data,
> e.g.
> {noformat}
> ERROR: ALTER TABLE functional_parquet.iceberg_lineitem_sixblocks CONVERT TO
> ICEBERG
> Traceback (most recent call last):
> File "/media/quanlong/hdd-backup/impala-apache-hive/bin/load-data.py", line
> 195, in exec_impala_query_from_file
> result = impala_client.execute(query)
> File
> "/media/quanlong/hdd-backup/impala-apache-hive/tests/beeswax/impala_beeswax.py",
> line 191, in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> File
> "/media/quanlong/hdd-backup/impala-apache-hive/tests/beeswax/impala_beeswax.py",
> line 382, in __execute_query
> handle = self.execute_query_async(query_string, user=user)
> File
> "/media/quanlong/hdd-backup/impala-apache-hive/tests/beeswax/impala_beeswax.py",
> line 376, in execute_query_async
> handle = self.__do_rpc(lambda: self.imp_service.query(query,))
> File
> "/media/quanlong/hdd-backup/impala-apache-hive/tests/beeswax/impala_beeswax.py",
> line 539, in __do_rpc
> raise ImpalaBeeswaxException(self.__build_error_message(b), b)
> ImpalaBeeswaxException: ImpalaBeeswaxException:
> INNER EXCEPTION: <class 'beeswaxd.ttypes.BeeswaxException'>
> MESSAGE: AnalysisException: CONVERT TO ICEBERG is not supported for managed
> tables{noformat}
> This is due to the table is created as a managed table in Hive.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
