jiaojietao opened a new issue, #9568:
URL: https://github.com/apache/hudi/issues/9568
A clear and concise description of the problem.
**When Doris queries Hudi, an error was reported that the partition metadata
file of Hudi cannot be opened.**
Steps to reproduce the behavior:
1). Creating a hivecatalog in Dorise
CREATE CATALOG hive PROPERTIES (
'type'='hms',
'hive.metastore.uris' = 'thrift://172.0.0.1:9083',
'hive.metastore.sasl.enabled' = 'true',
'hive.metastore.kerberos.principal' = 'your-hms-principal',
'hive.metastore.kerberos.kerberos' = 'your.keytab'
'dfs.nameservices'='your-nameservice',
'dfs.ha.namenodes.your-nameservice'='nn1,nn2',
'dfs.namenode.rpc-address.your-nameservice.nn1'='172.21.0.2:8088',
'dfs.namenode.rpc-address.your-nameservice.nn2'='172.21.0.3:8088',
'dfs.client.failover.proxy.provider.your-nameservice'='org.apache.hadoop.hdfs.server.namenode.ha.ConfiguredFailoverProxyProvider',
'hadoop.security.authentication' = 'kerberos',
'hadoop.kerberos.keytab' = '/your-keytab-filepath/your.keytab',
'hadoop.kerberos.principal' = '[email protected]',
'yarn.resourcemanager.principal' = 'your-rm-principal',
'hive.version' = '1.1.0'
);
2). Execute the following SQL to query the data
select * from hive.hudi.table ；
3). For the same table, execute the following SQL query to report an error.。
select count(*) from hive.hudi.table；
**Expected behavior**
1). Doris logs reported an error as follows
Being able to read parquet files correctly, but unable to read ".hoodie_
Partition_ Metadata" file
**Environment Description**
* Hudi version : 0.12.0
* Doris version : 2.0.0
* Hive version : 2.1.1
* Hadoop version :3.0.0
* Storage (HDFS/S3/GCS..) :HDFS
* Running on Docker? (yes/no) :no
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
