[
https://issues.apache.org/jira/browse/IMPALA-11999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17700340#comment-17700340
]
Andrew Sherman commented on IMPALA-11999:
-----------------------------------------
Stacktrace from catalog log
{code}
W0313 09:30:43.576596 14738 HadoopTableOperations.java:347] Error trying to
recover version-hint.txt data for
/test-warehouse/test_execute_rollback_83e8c4b8/hadoop_catalog_test/test_execute_rollback_83e8c4b8/iceberg_execute_rollback/metadata/version-hint.text
Java exception follows:
INVALID_BUCKET_NAME org.apache.hadoop.ozone.om.exceptions.OMException: Bucket
or Volume name has an unsupported character : _
at
org.apache.hadoop.ozone.client.rpc.RpcClient.verifyBucketName(RpcClient.java:713)
at
org.apache.hadoop.ozone.client.rpc.RpcClient.getBucketDetails(RpcClient.java:1092)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:267)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:241)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.readFile(BasicRootedOzoneClientAdapterImpl.java:351)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.open(BasicRootedOzoneFileSystem.java:211)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:958)
at
org.apache.iceberg.hadoop.HadoopTableOperations.findVersion(HadoopTableOperations.java:318)
at
org.apache.iceberg.hadoop.HadoopTableOperations.refresh(HadoopTableOperations.java:104)
at
org.apache.iceberg.hadoop.HadoopTableOperations.current(HadoopTableOperations.java:84)
at
org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.create(BaseMetastoreCatalog.java:186)
at org.apache.iceberg.catalog.Catalog.createTable(Catalog.java:75)
at
org.apache.impala.catalog.iceberg.IcebergHadoopCatalog.createTable(IcebergHadoopCatalog.java:66)
at
org.apache.impala.service.IcebergCatalogOpExecutor.createTable(IcebergCatalogOpExecutor.java:88)
at
org.apache.impala.service.CatalogOpExecutor.createIcebergTable(CatalogOpExecutor.java:3692)
at
org.apache.impala.service.CatalogOpExecutor.createTable(CatalogOpExecutor.java:3315)
at
org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:450)
at
org.apache.impala.service.JniCatalog.lambda$execDdl$3(JniCatalog.java:282)
at
org.apache.impala.service.JniCatalogOp.lambda$execAndSerialize$1(JniCatalogOp.java:90)
at org.apache.impala.service.JniCatalogOp.execOp(JniCatalogOp.java:58)
at
org.apache.impala.service.JniCatalogOp.execAndSerialize(JniCatalogOp.java:89)
at
org.apache.impala.service.JniCatalogOp.execAndSerialize(JniCatalogOp.java:100)
at
org.apache.impala.service.JniCatalog.execAndSerialize(JniCatalog.java:230)
at
org.apache.impala.service.JniCatalog.execAndSerialize(JniCatalog.java:244)
at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:281)
E0313 09:30:43.576925 14738 JniUtil.java:176] Error in CREATE_TABLE
test_execute_rollback_83e8c4b8.iceberg_execute_rollback issued by jenkins. Time
spent: 2ms
I0313 09:30:43.577097 14738 jni-util.cc:288]
org.apache.impala.common.ImpalaRuntimeException: Error making 'createTable' RPC
to Hive Metastore:
at
org.apache.impala.service.CatalogOpExecutor.createIcebergTable(CatalogOpExecutor.java:3778)
at
org.apache.impala.service.CatalogOpExecutor.createTable(CatalogOpExecutor.java:3315)
at
org.apache.impala.service.CatalogOpExecutor.execDdlRequest(CatalogOpExecutor.java:450)
at
org.apache.impala.service.JniCatalog.lambda$execDdl$3(JniCatalog.java:282)
at
org.apache.impala.service.JniCatalogOp.lambda$execAndSerialize$1(JniCatalogOp.java:90)
at org.apache.impala.service.JniCatalogOp.execOp(JniCatalogOp.java:58)
at
org.apache.impala.service.JniCatalogOp.execAndSerialize(JniCatalogOp.java:89)
at
org.apache.impala.service.JniCatalogOp.execAndSerialize(JniCatalogOp.java:100)
at
org.apache.impala.service.JniCatalog.execAndSerialize(JniCatalog.java:230)
at
org.apache.impala.service.JniCatalog.execAndSerialize(JniCatalog.java:244)
at org.apache.impala.service.JniCatalog.execDdl(JniCatalog.java:281)
Caused by: org.apache.iceberg.exceptions.RuntimeIOException: Failed to refresh
the table
at
org.apache.iceberg.hadoop.HadoopTableOperations.refresh(HadoopTableOperations.java:126)
at
org.apache.iceberg.hadoop.HadoopTableOperations.current(HadoopTableOperations.java:84)
at
org.apache.iceberg.BaseMetastoreCatalog$BaseMetastoreCatalogTableBuilder.create(BaseMetastoreCatalog.java:186)
at org.apache.iceberg.catalog.Catalog.createTable(Catalog.java:75)
at
org.apache.impala.catalog.iceberg.IcebergHadoopCatalog.createTable(IcebergHadoopCatalog.java:66)
at
org.apache.impala.service.IcebergCatalogOpExecutor.createTable(IcebergCatalogOpExecutor.java:88)
at
org.apache.impala.service.CatalogOpExecutor.createIcebergTable(CatalogOpExecutor.java:3692)
... 10 more
Caused by: INVALID_BUCKET_NAME
org.apache.hadoop.ozone.om.exceptions.OMException: Bucket or Volume name has an
unsupported character : _
at
org.apache.hadoop.ozone.client.rpc.RpcClient.verifyBucketName(RpcClient.java:713)
at
org.apache.hadoop.ozone.client.rpc.RpcClient.getBucketDetails(RpcClient.java:1092)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:267)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getBucket(BasicRootedOzoneClientAdapterImpl.java:241)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneClientAdapterImpl.getFileStatus(BasicRootedOzoneClientAdapterImpl.java:645)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.getFileStatusAdapter(BasicRootedOzoneFileSystem.java:908)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.getFileStatus(BasicRootedOzoneFileSystem.java:892)
at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1742)
at
org.apache.hadoop.fs.ozone.BasicRootedOzoneFileSystem.exists(BasicRootedOzoneFileSystem.java:956)
at
org.apache.iceberg.hadoop.HadoopTableOperations.getMetadataFile(HadoopTableOperations.java:241)
at
org.apache.iceberg.hadoop.HadoopTableOperations.refresh(HadoopTableOperations.java:106)
... 16 more
I0313 09:30:43.577109 14738 status.cc:129] ImpalaRuntimeException: Error making
'createTable' RPC to Hive Metastore:
CAUSED BY: RuntimeIOException: Failed to refresh the table
CAUSED BY: OMException: Bucket or Volume name has an unsupported character : _
@ 0xfa1bb1 impala::Status::Status()
@ 0x17e3a06 impala::JniUtil::GetJniExceptionMsg()
@ 0xf8fbb0 impala::JniCall::Call<>()
@ 0xf71a95 impala::Catalog::ExecDdl()
@ 0xf56db8 impala::CatalogServiceThriftIf::ExecDdl()
@ 0xf2989a impala::CatalogServiceProcessorT<>::process_ExecDdl()
@ 0xf2a423 impala::CatalogServiceProcessorT<>::dispatchCall()
@ 0xe8be01 apache::thrift::TDispatchProcessor::process()
@ 0x12c1940
apache::thrift::server::TAcceptQueueServer::Task::run()
@ 0x12ae183 impala::ThriftThread::RunRunnable()
@ 0x12afe37
boost::detail::function::void_function_obj_invoker0<>::invoke()
@ 0x18bf058 impala::Thread::SuperviseThread()
@ 0x18bfe61 boost::detail::thread_data<>::run()
@ 0x23b78e7 thread_proxy
@ 0x7f0120166ea5 start_thread
@ 0x7f011d071b0d __clone
E0313 09:30:43.593353 14738 catalog-server.cc:180] ImpalaRuntimeException:
Error making 'createTable' RPC to Hive Metastore:
CAUSED BY: RuntimeIOException: Failed to refresh the table
CAUSED BY: OMException: Bucket or Volume name has an unsupported character : _
{code}
> TestIcebergTable.test_execute_rollback fails in Ozone build
> -----------------------------------------------------------
>
> Key: IMPALA-11999
> URL: https://issues.apache.org/jira/browse/IMPALA-11999
> Project: IMPALA
> Issue Type: Bug
> Reporter: Daniel Becker
> Assignee: Andrew Sherman
> Priority: Blocker
> Labels: broken-build
>
> A build using the Ozone file system failed with the following test failures:
> query_test.test_iceberg.TestIcebergTable.test_execute_rollback
> query_test.test_iceberg.TestIcebergTable.test_expire_snapshots
> {code:java}
> query_test/test_iceberg.py:267: in test_execute_rollback
> TBLPROPERTIES ({1})""".format(tbl_name, catalog_properties))
> common/impala_connection.py:214: in execute
> return self.__beeswax_client.execute(sql_stmt, user=user)
> beeswax/impala_beeswax.py:191: in execute
> handle = self.__execute_query(query_string.strip(), user=user)
> beeswax/impala_beeswax.py:369: in __execute_query
> self.wait_for_finished(handle)
> beeswax/impala_beeswax.py:390: in wait_for_finished
> raise ImpalaBeeswaxException("Query aborted:" + error_log, None)
> E ImpalaBeeswaxException: ImpalaBeeswaxException:
> E Query aborted:ImpalaRuntimeException: Error making 'createTable' RPC to
> Hive Metastore:
> E CAUSED BY: RuntimeIOException: Failed to refresh the table
> E CAUSED BY: OMException: Bucket or Volume name has an unsupported
> character : _
> {code}
> The issue came after IMPALA-11482 was merged, it may be related.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
