painterg opened a new issue, #5979:
URL: https://github.com/apache/hudi/issues/5979

   **Environment Description**
   
   * Hudi version : 0.10.1
   * Hadoop version : 2.7.3
   * Storage : HDFS
   * Flink version : 1.13.6
   * Flink-cdc version : 2.2.1
   * Oracle version : 19c
   
   I test the following case : (I use the flink sql way to code)
   step 1 : I have two tables in the oracle,A and B.Then I create two hudi's 
tables,hudi_A(MOR) and hudi_B(MOR).
   
![image](https://user-images.githubusercontent.com/81795585/175817779-3b0a407c-c29a-4404-83c8-b5b14fa3d920.png)
   
   step 2 : I ingest data into hudi through Flinkcdc,use the SQL : "insert into 
hudi_A select fields.... from A",and "insert into hudi_B select fields... from 
B". A-->hudi_A, B-->hudi_B.
                 
   step 3 : I create the hudi table,hudi_C(MOR),to receive the result of 
join.Then I use the sql "insert into hudi_C select fields... from hudi_A left 
join hudi_B on ....". hudi_A left hudi_B -->hudi_C.
   
   The problem :
   I add one record into the A of oracle,and hudi_A can receive the '+I' 
operation,and hudi_C can receive the '+I' operation.This is OK.
   I update one record in the A of oracle,and hudi_A can receive the '+U' 
operation,and hudi_C can receive the '+U' operation.This is OK. 
   I delete one record in the A of oracle,and hudi_A can receive the '-D' 
operation,but hudi_C can not receive the '-D' operation.This is failure.The 
program is running,without errors.The hudi_C data is not reduced.
   
   To figure out why, I do another test : 
   I add table hudi_A' without join operation.The pipeline is  
A-->hudi_A-->Hudi_A', use two sql "insert into ....".
   hudi_A and hudi_A' are both ok in CRUD operations,can receive "+I,+U,-D".The 
data are correct in the hudi_A and hudi_A'.
   
   I don't understand why this happens. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to