[GitHub] [iceberg] 221770490011111 opened a new issue #2533: spark sql MERGE INTO There is an error Error: Error running query: java.lang.IllegalArgumentException: Can't zip RDDs with unequal numbers of partitions: List(1, 0) (state=,code=0)

Tue, 27 Apr 2021 18:53:37 -0700 


221770490011111 opened a new issue #2533:
URL: https://github.com/apache/iceberg/issues/2533


   ```
   CREATE TABLE IF NOT EXISTS cdp.test_merge_001(offline_channel STRING COMMENT 
'_pk',unique_key STRING COMMENT '_ck',open_id STRING COMMENT '',mobile string 
COMMENT '_ck',hobby STRING COMMENT '',activity_time STRING COMMENT '' )
    USING iceberg;
   
   CREATE TABLE IF NOT EXISTS cdp.test_merge_002(offline_channel STRING COMMENT 
'_pk',unique_key STRING COMMENT '_ck',open_id STRING COMMENT '',mobile string 
COMMENT '_ck',hobby STRING COMMENT '',activity_time STRING COMMENT '' )
    USING iceberg；
   ```
   
   this is table test_merge_002:
   
![image](https://user-images.githubusercontent.com/39689341/116333155-969b6000-a805-11eb-8c5a-7dca05b4e4b8.png)
   
   
   this is table test_merge_001:
   
![image](https://user-images.githubusercontent.com/39689341/116333259-baf73c80-a805-11eb-9b17-f3fe96bb7dbd.png)
   
   
   but  run this sql，appear error
   
![image](https://user-images.githubusercontent.com/39689341/116334288-84babc80-a807-11eb-926b-7a81059f55d6.png)
   
   ```
   MERGE INTO cdp.test_merge_002
    tt1  USING 
   (SELECT * FROM cdp.test_merge_001) tt2 ON (  tt1.unique_key = tt2.unique_key 
AND tt1.mobile = tt2.mobile) WHEN MATCHED THEN UPDATE SET tt1.offline_channel = 
tt2.offline_channel,
   tt1.unique_key = tt2.unique_key,
   tt1.open_id = tt2.open_id,
   tt1.mobile = tt2.mobile,
   tt1.hobby = tt2.hobby,
   tt1.activity_time = tt2.activity_time  WHEN NOT MATCHED THEN INSERT *
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to