liuzx8888 opened a new issue #2604:
URL: https://github.com/apache/iceberg/issues/2604


   i'm trying to execute a Merge operation between 2 iceberg tables and it 
seems i get the following error:
   
![image](https://user-images.githubusercontent.com/10862577/118638326-50845b80-b809-11eb-9fb4-c4fa76cba820.png)
   
   The setup is the following:
   ```
           <scala.version>2.12.0</scala.version>
           <spark.version>3.0.2</spark.version>
           <iceberg.version>0.11.1</iceberg.version>
           <hadoop.version>3.1.1</hadoop.version>
           <druid.version>1.1.21</druid.version>
           <kafka.version>2.0.0</kafka.version>
           <hive.version>3.1.1</hive.version>
   ```
   
   ```
       val spark = SparkSession
         .builder()
         .master("local[2]")
         .appName("IcebergAPI")
         .config("spark.sql.extensions", 
"org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions")
         .config("spark.sql.catalog.spark_catalog", 
"org.apache.iceberg.spark.SparkSessionCatalog")
         .config("spark.sql.catalog.spark_catalog.type", "hive")
         .config("spark.sql.catalog.hive_prod", 
"org.apache.iceberg.spark.SparkCatalog")
         .config("spark.sql.catalog.hive_prod.type", "hive")
         .config("spark.sql.catalog.hive_prod.warehouse", 
"hdfs://ambari5:8020/warehouse/tablespace/managed/hive")
         .config("spark.sql.catalog.hive_prod.uri", "thrift://ambari6:9083")
         .config("iceberg.engine.hive.enabled", "true")
         .enableHiveSupport()
         .getOrCreate()
   ```
   
   now  i can   execute following sql susseccful 
   
       spark.sql("create database if not exists hive_prod.ods2")
       spark.sql("CREATE TABLE IF NOT EXISTS hive_prod.ods.table4 (id bigint, 
data string) USING iceberg")
       spark.sql("INSERT INTO hive_prod.ods.table4 VALUES (1, 'aa'), (2, 'bb'), 
(3, 'cc')")
       spark.sql("select * from  hive_prod.ods.table4").show()
   
   Do you have any idea why it's acting like this? 
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to