RussellSpitzer commented on issue #15058:
URL: https://github.com/apache/iceberg/issues/15058#issuecomment-3755730359
The dependencies are all included within the jar, except for those Spark
provides at runtime. The error does make it seem like you have a Scala 2.13
artifact ? maybe?
For reference I just tested the following as a sanity check
```
~/SparkInstalls/spark-3.5.4-bin-hadoop3/bin/spark-shell \
--packages org.apache.iceberg:iceberg-spark-runtime-3.5_2.12:1.10.0 \
--conf
spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
\
--conf
spark.sql.catalog.spark_catalog=org.apache.iceberg.spark.SparkSessionCatalog \
--conf spark.sql.catalog.spark_catalog.type=hive \
--conf spark.sql.catalog.local=org.apache.iceberg.spark.SparkCatalog \
--conf spark.sql.catalog.local.type=hadoop \
--conf spark.sql.catalog.local.warehouse=/tmp/iceberg-warehouse
spark.sql("CREATE TABLE local.db.my_table (id bigint, data string) USING
iceberg;")
scala> spark.sql("""CALL
local.system.rewrite_data_files('db.my_table')""").show
+--------------------------+----------------------+---------------------+-----------------------+--------------------------+
|rewritten_data_files_count|added_data_files_count|rewritten_bytes_count|failed_data_files_count|removed_delete_files_count|
+--------------------------+----------------------+---------------------+-----------------------+--------------------------+
| 0| 0| 0|
0| 0|
+--------------------------+----------------------+---------------------+-----------------------+--------------------------+
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
