Ritesh Shukla created HDDS-8496:
-----------------------------------
Summary: Hive with s3a connector hits KEY_NOT_FOUND
Key: HDDS-8496
URL: https://issues.apache.org/jira/browse/HDDS-8496
Project: Apache Ozone
Issue Type: Bug
Components: Ozone Manager
Affects Versions: 1.4.0
Reporter: Saketa Chalamchala
Error: seen
{code:java}
... 16 more
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to rename
output from:
[s3a://obs-bucket-link/mytable1/.hive-staging_hive_2023-04-23_07-38-52_965_8384866535295320062-1/_task_tmp.-ext-10000/_tmp.000000_3]
to:
[s3a://obs-bucket-link/mytable1/.hive-staging_hive_2023-04-23_07-38-52_965_8384866535295320062-1/_tmp.-ext-10000/000000_3]
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:296)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:254)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:157)
at
org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1458)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:731)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:755)
at
org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.close(MapRecordProcessor.java:482)
... 17 more
{code}
Steps to reproduce
{code:java}
ozone volume create /vol1
ozone sh bucket create /vol1/obs-bucket --layout OBJECT_STORE
ozone sh bucket link /vol1/obs-bucket /s3v/obs-bucket-link
beeline -u "jdbc:
[hive2://schal-bc15-2.schal-bc15.root.hwx.site:10000/default;principal=hive/[email protected];ssl=true;sslTrustStore=/var/lib/cloudera-scm-agent/agent-cert/cm-auto-global_truststore.jks;sslTrustStorePassword=QxEbA7iW4almtMtkwrDBn8m3BB28Uh4xGDHrIDmjuFi]
"
> create external table mytable1(key string, value int) location '
[s3a://obs-bucket-link/mytable1]
';
> insert into mytable1 values("cldr",1);
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
