MariusCostin opened a new issue #2593:
URL: https://github.com/apache/iceberg/issues/2593
Hello,
So, i'm trying to execute a Merge operation between 2 iceberg tables and it
seems i get the following error:
**java.lang.UnsupportedOperationException: MERGE INTO TABLE is not supported
temporarily.**
The setup is the following:
- **Amazon EMR** with **Spark 3.1.0** and also tried it on **EMR** with
**Spark 3.0.1**
- Launching the shell with: **spark-shell --packages
org.apache.iceberg:iceberg-spark3-runtime:0.11.1,software.amazon.awssdk:bundle:2.15.40,software.amazon.awssdk:url-connection-client:2.15.40**
- Creating the session as follows:
val spark = SparkSession.builder.appName("MyApp")
.config("spark.jars.packages",
"org.apache.iceberg:iceberg-spark3-runtime:0.11.0,software.amazon.awssdk:bundle:2.15.40,software.amazon.awssdk:url-connection-client:2.15.40")
.config("spark.sql.extensions",
"org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions").config("spark.sql.catalog.spark_catalog",
"org.apache.iceberg.spark.SparkSessionCatalog")
.config("spark.sql.catalog.spark_catalog.type", "hive")
.config("spark.sql.catalog.local",
"org.apache.iceberg.spark.SparkCatalog")
.config("spark.sql.catalog.local.type", "hadoop")
.config("spark.sql.catalog.local.warehouse", "s3://random_bucket")
.getOrCreate()
Do you have any idea why it's acting like this? We recently started to
research the implementation of iceberg for our data lake and hit this brick
wall.
Thanks in advance.
Marius Costin
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
