liuzx8888 opened a new issue, #7232:
URL: https://github.com/apache/iceberg/issues/7232
### Apache Iceberg version
1.2.0 (latest release)
### Query engine
Hive
### Please describe the bug 🐞
iceberg table schema：
`create TABLE hz_jzjbxx
(
bxh bigint,
yljgdm string,
yljgmc string,
jzxh string,
jzlb string,
hzid string,
blh string,
hzxm string,
jsm string,
hzxbdm string,
hzxbmc string,
hzcsrq date,
hzsfzh string,
hyzkdm string,
hyzkmc string,
mzdm string,
mzmc string,
gjdm string,
gjmc string,
zydm string,
zymc string,
whcddm string,
whcdmc string,
hzgzdwmc string,
hzgddh string,
hzyddh string,
hzemail string,
ynkh string,
ybkh string,
djsj timestamp,
djczydm string,
djczymc string,
jlzt string,
termflag string,
termfailedcolumn string,
termfailedmessage string,
termsuccesscolumn string,
source string,
source_tablename string,
source_key string,
source_keyvalue string,
isdelete string,
source_lastupdate timestamp,
destination_lastupdate timestamp,
timestp string,
pch string,
nl string,
lxrdh string
)
partitioned by (partitionvalue int)
STORED BY 'org.apache.iceberg.mr.hive.HiveIcebergStorageHandler'
LOCATION 'alluxio://192.168.2.182:19998/mnt/ramdisk/hz_jzjbxx';`
hive version：3.1.1
when i execute script :
`SELECT * FROM hz_jzjbxx a
where a.hzid='6900718986'`
error log：
`iceberg.BaseTableScan: Scanning table
default_iceberg.iceberg_test.hz_jzjbxx snapshot 1732163159105224184 created at
2023-03-29T02:17:54.276+00:00 with filter hzid = (hash-3fc42bc8)
2023-03-29T11:37:59,270 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
metrics.LoggingMetricsReporter: Received metrics report:
ScanReport{tableName=default_iceberg.iceberg_test.hz_jzjbxx,
snapshotId=1732163159105224184, filter=ref(name="hzid") == "(hash-3fc42bc8)",
schemaId=0, projectedFieldIds=[1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14,
15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34,
35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49],
projectedFieldNames=[bxh, yljgdm, yljgmc, jzxh, jzlb, hzid, blh, hzxm, jsm,
hzxbdm, hzxbmc, hzcsrq, hzsfzh, hyzkdm, hyzkmc, mzdm, mzmc, gjdm, gjmc, zydm,
zymc, whcddm, whcdmc, hzgzdwmc, hzgddh, hzyddh, hzemail, ynkh, ybkh, djsj,
djczydm, djczymc, jlzt, termflag, termfailedcolumn, termfailedmessage,
termsuccesscolumn, source, source_tablename, source_key, source_keyvalue,
isdelete, source_lastupdate, destination_lastupdate, timestp, pch, nl, lxrdh,
partitionvalue], scanMetrics=ScanMetricsResult{totalPl
anningDuration=TimerResult{timeUnit=NANOSECONDS, totalDuration=PT0.18447376S,
count=1}, resultDataFiles=CounterResult{unit=COUNT, value=12},
resultDeleteFiles=CounterResult{unit=COUNT, value=0},
totalDataManifests=CounterResult{unit=COUNT, value=1},
totalDeleteManifests=CounterResult{unit=COUNT, value=0},
scannedDataManifests=CounterResult{unit=COUNT, value=1},
skippedDataManifests=CounterResult{unit=COUNT, value=0},
totalFileSizeInBytes=CounterResult{unit=BYTES, value=197220128},
totalDeleteFileSizeInBytes=CounterResult{unit=BYTES, value=0},
skippedDataFiles=CounterResult{unit=COUNT, value=5},
skippedDeleteFiles=CounterResult{unit=COUNT, value=0},
scannedDeleteManifests=CounterResult{unit=COUNT, value=0},
skippedDeleteManifests=CounterResult{unit=COUNT, value=0},
indexedDeleteFiles=CounterResult{unit=COUNT, value=0},
equalityDeleteFiles=CounterResult{unit=COUNT, value=0},
positionalDeleteFiles=CounterResult{unit=COUNT, value=0}}, metadata={}}
2023-03-29T11:37:59,271 ERROR [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
CliDriver: Failed with exception
java.io.IOException:org.apache.iceberg.exceptions.RuntimeIOException: Failed to
decode value as UTF-8: java.nio.HeapByteBuffer[pos=0 lim=16 cap=16]
java.io.IOException: org.apache.iceberg.exceptions.RuntimeIOException:
Failed to decode value as UTF-8: java.nio.HeapByteBuffer[pos=0 lim=16 cap=16]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:602)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:509)
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146)
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2692)
at
org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229)
at
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:259)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:188)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:402)
at
org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:821)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:759)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:683)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:323)
at org.apache.hadoop.util.RunJar.main(RunJar.java:236)
Caused by: org.apache.iceberg.exceptions.RuntimeIOException: Failed to
decode value as UTF-8: java.nio.HeapByteBuffer[pos=0 lim=16 cap=16]
at
org.apache.iceberg.types.Conversions.internalFromByteBuffer(Conversions.java:166)
at
org.apache.iceberg.types.Conversions.fromByteBuffer(Conversions.java:126)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.eq(InclusiveMetricsEvaluator.java:315)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.eq(InclusiveMetricsEvaluator.java:82)
at
org.apache.iceberg.expressions.ExpressionVisitors$BoundExpressionVisitor.predicate(ExpressionVisitors.java:162)
at
org.apache.iceberg.expressions.ExpressionVisitors.visitEvaluator(ExpressionVisitors.java:390)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.eval(InclusiveMetricsEvaluator.java:107)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.access$100(InclusiveMetricsEvaluator.java:82)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator.eval(InclusiveMetricsEvaluator.java:76)
at
org.apache.iceberg.ManifestReader.lambda$entries$0(ManifestReader.java:257)
at
org.apache.iceberg.io.CloseableIterable$5.shouldKeep(CloseableIterable.java:139)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:66)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:49)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:64)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:49)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:64)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:49)
at
org.apache.iceberg.io.CloseableIterable$7$1.hasNext(CloseableIterable.java:197)
at
org.apache.iceberg.io.CloseableIterable$ConcatCloseableIterable$ConcatCloseableIterator.hasNext(CloseableIterable.java:243)
at
org.apache.iceberg.relocated.com.google.common.collect.TransformedIterator.hasNext(TransformedIterator.java:46)
at
org.apache.iceberg.relocated.com.google.common.collect.TransformedIterator.hasNext(TransformedIterator.java:46)
at
org.apache.iceberg.relocated.com.google.common.collect.Iterators$ConcatenatedIterator.getTopMetaIterator(Iterators.java:1379)
at
org.apache.iceberg.relocated.com.google.common.collect.Iterators$ConcatenatedIterator.hasNext(Iterators.java:1395)
at
org.apache.iceberg.io.CloseableIterator$1.hasNext(CloseableIterator.java:50)
at
org.apache.iceberg.util.BinPacking$PackingIterator.next(BinPacking.java:123)
at
org.apache.iceberg.util.BinPacking$PackingIterator.next(BinPacking.java:95)
at
org.apache.iceberg.io.CloseableIterator$1.next(CloseableIterator.java:55)
at
org.apache.iceberg.io.CloseableIterable$7$1.next(CloseableIterable.java:202)
at java.lang.Iterable.forEach(Iterable.java:74)
at
org.apache.iceberg.mr.mapreduce.IcebergInputFormat.getSplits(IcebergInputFormat.java:149)
at
org.apache.iceberg.mr.mapred.MapredIcebergInputFormat.getSplits(MapredIcebergInputFormat.java:68)
at
org.apache.iceberg.mr.hive.HiveIcebergInputFormat.getSplits(HiveIcebergInputFormat.java:103)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.generateWrappedSplits(FetchOperator.java:425)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:395)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:314)
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:540)
... 16 more
Caused by: java.nio.charset.MalformedInputException: Input length = 1
at java.nio.charset.CoderResult.throwException(CoderResult.java:281)
at java.nio.charset.CharsetDecoder.decode(CharsetDecoder.java:816)
at
org.apache.iceberg.types.Conversions.internalFromByteBuffer(Conversions.java:164)
... 51 more
2023-03-29T11:37:59,277 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
exec.TableScanOperator: RECORDS_OUT_INTERMEDIATE:0,
RECORDS_OUT_OPERATOR_TS_0:0,
2023-03-29T11:37:59,277 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
exec.FilterOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_FIL_5:0,
2023-03-29T11:37:59,277 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
exec.SelectOperator: RECORDS_OUT_OPERATOR_SEL_2:0, RECORDS_OUT_INTERMEDIATE:0,
2023-03-29T11:37:59,277 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
exec.LimitOperator: RECORDS_OUT_INTERMEDIATE:0, RECORDS_OUT_OPERATOR_LIM_3:0,
2023-03-29T11:37:59,277 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
exec.ListSinkOperator: RECORDS_OUT_OPERATOR_LIST_SINK_6:0,
RECORDS_OUT_INTERMEDIATE:0,
2023-03-29T11:37:59,282 INFO [c4223431-1b8d-4565-b6e8-8a59648e3ced main]
CliDriver: Time taken: 2.192 seconds`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
