changquanyou opened a new issue #2065:
URL: https://github.com/apache/iceberg/issues/2065
Env:
- spark3.0
- Iceberg0.10.0
- `./bin/spark-sql --packages
org.apache.iceberg:iceberg-spark3-runtime:0.10.0 \
--conf spark.sql.catalog.hadoop_prod=org.apache.iceberg.spark.SparkCatalog \
--conf spark.sql.catalog.hadoop_prod.type=hadoop \
--conf
spark.sql.catalog.hadoop_prod.warehouse=hdfs://bfd-wfj-67p121:8020/iceberg/warehouse
\
--master spark://bfd-wfj-67p123:7077`
Issue: Using Spark Sql: select title from mf_data where pubDayStr =
'2021-01-09' and **title like 'apple%'** limit 1;
Here is the Exception:
21/01/11 18:02:43 ERROR SparkSQLDriver: Failed in [select title from
mf_data where pubDayStr = '2021-01-09' and title like 'apple%' limit 1]
java.lang.IllegalArgumentException: Truncate length should be positive
at
org.apache.iceberg.relocated.com.google.common.base.Preconditions.checkArgument(Preconditions.java:142)
at org.apache.iceberg.util.BinaryUtil.truncateBinary(BinaryUtil.java:35)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.startsWith(InclusiveMetricsEvaluator.java:326)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.startsWith(InclusiveMetricsEvaluator.java:76)
at
org.apache.iceberg.expressions.ExpressionVisitors$BoundExpressionVisitor.predicate(ExpressionVisitors.java:135)
at
org.apache.iceberg.expressions.ExpressionVisitors.visitEvaluator(ExpressionVisitors.java:322)
at
org.apache.iceberg.expressions.ExpressionVisitors.visitEvaluator(ExpressionVisitors.java:341)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.eval(InclusiveMetricsEvaluator.java:99)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.access$100(InclusiveMetricsEvaluator.java:76)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator.eval(InclusiveMetricsEvaluator.java:70)
at
org.apache.iceberg.ManifestReader.lambda$entries$0(ManifestReader.java:182)
at
org.apache.iceberg.io.CloseableIterable$3.shouldKeep(CloseableIterable.java:82)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:67)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:65)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:65)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at
org.apache.iceberg.io.CloseableIterable$4$1.hasNext(CloseableIterable.java:108)
at
org.apache.iceberg.util.ParallelIterable$ParallelIterator.lambda$new$1(ParallelIterable.java:67)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
java.lang.IllegalArgumentException: Truncate length should be positive
at
org.apache.iceberg.relocated.com.google.common.base.Preconditions.checkArgument(Preconditions.java:142)
at org.apache.iceberg.util.BinaryUtil.truncateBinary(BinaryUtil.java:35)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.startsWith(InclusiveMetricsEvaluator.java:326)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.startsWith(InclusiveMetricsEvaluator.java:76)
at
org.apache.iceberg.expressions.ExpressionVisitors$BoundExpressionVisitor.predicate(ExpressionVisitors.java:135)
at
org.apache.iceberg.expressions.ExpressionVisitors.visitEvaluator(ExpressionVisitors.java:322)
at
org.apache.iceberg.expressions.ExpressionVisitors.visitEvaluator(ExpressionVisitors.java:341)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.eval(InclusiveMetricsEvaluator.java:99)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator$MetricsEvalVisitor.access$100(InclusiveMetricsEvaluator.java:76)
at
org.apache.iceberg.expressions.InclusiveMetricsEvaluator.eval(InclusiveMetricsEvaluator.java:70)
at
org.apache.iceberg.ManifestReader.lambda$entries$0(ManifestReader.java:182)
at
org.apache.iceberg.io.CloseableIterable$3.shouldKeep(CloseableIterable.java:82)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:67)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:65)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at org.apache.iceberg.io.FilterIterator.advance(FilterIterator.java:65)
at org.apache.iceberg.io.FilterIterator.hasNext(FilterIterator.java:50)
at
org.apache.iceberg.io.CloseableIterable$4$1.hasNext(CloseableIterable.java:108)
at
org.apache.iceberg.util.ParallelIterable$ParallelIterator.lambda$new$1(ParallelIterable.java:67)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
