ammarchalifah commented on issue #15349:
URL: https://github.com/apache/iceberg/issues/15349#issuecomment-4562617418
Full `stdout` from the repro on EMR
```
Spark version: 4.0.2-amzn-0
Using database: spj_repro_fb869b11
[OK] spark.sql.iceberg.planning.preserve-data-grouping = true
[OK] spark.sql.sources.v2.bucketing.enabled = true
[OK] spark.sql.sources.v2.bucketing.pushPartValues.enabled = true
[OK] spark.sql.sources.v2.bucketing.partiallyClusteredDistribution.enabled
= false
[OK] spark.sql.requireAllClusterKeysForCoPartition = false
[OK]
spark.sql.sources.v2.bucketing.allowJoinKeysSubsetOfPartitionKeys.enabled = true
[OK] spark.sql.sources.v2.bucketing.allowCompatibleTransforms.enabled =
true
[OK] spark.sql.sources.v2.bucketing.partition.filter.enabled = true
[OK] spark.sql.sources.v2.bucketing.shuffle.enabled = true
[OK] spark.sql.sources.v2.bucketing.sorting.enabled = true
[OK] spark.sql.adaptive.enabled = true
[OK] spark.sql.adaptive.coalescePartitions.enabled = true
[OK] spark.sql.adaptive.skewJoin.enabled = true
[OK] spark.sql.autoBroadcastJoinThreshold = -1
[OK] spark.sql.sources.partitionOverwriteMode = dynamic
Inserting data in multiple batches ...
Target: 450 rows, Source: 510 rows
=== EXPLAIN SELECT JOIN ===
Error occurred during query planning:
=== END EXPLAIN SELECT JOIN ===
>>> 'KeyGroupedPartitioning' count in join plan: 0
>>> 'Exchange hashpartitioning' count in join plan: 0
=== EXPLAIN MERGE INTO ===
Error occurred during query planning:
=== END EXPLAIN MERGE INTO ===
>>> 'KeyGroupedPartitioning' count in merge plan: 0
>>> 'Exchange hashpartitioning' count in merge plan: 0
Running MERGE INTO ...
FAILED: Wrong class, expected java.lang.CharSequence, but was
java.lang.Integer, for object: 14
Traceback (most recent call last):
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/repro-spj-bucket-string.py",
line 182, in main
spark.sql(merge_sql)
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/pyspark.zip/pyspark/sql/session.py",
line 1810, in sql
return DataFrame(self._jsparkSession.sql(sqlQuery, litArgs), self)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/py4j-0.10.9.9-src.zip/py4j/java_gateway.py",
line 1362, in __call__
return_value = get_return_value(
^^^^^^^^^^^^^^^^^
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/pyspark.zip/pyspark/errors/exceptions/captured.py",
line 288, in deco
raise converted from None
pyspark.errors.exceptions.captured.IllegalArgumentException: Wrong class,
expected java.lang.CharSequence, but was java.lang.Integer, for object: 14
Cleanup complete.
Traceback (most recent call last):
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/repro-spj-bucket-string.py",
line 200, in <module>
main()
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/repro-spj-bucket-string.py",
line 182, in main
spark.sql(merge_sql)
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/pyspark.zip/pyspark/sql/session.py",
line 1810, in sql
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/py4j-0.10.9.9-src.zip/py4j/java_gateway.py",
line 1362, in __call__
File
"/mnt1/yarn/usercache/hadoop/appcache/application_1779959607612_0001/container_1779959607612_0001_01_000001/pyspark.zip/pyspark/errors/exceptions/captured.py",
line 288, in deco
pyspark.errors.exceptions.captured.IllegalArgumentException: Wrong class,
expected java.lang.CharSequence, but was java.lang.Integer, for object: 14
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
