[GitHub] [hudi] fengjian428 opened a new issue #3755: [Delta Streamer] file name mismatch with meta when compaction running

Tue, 05 Oct 2021 23:48:23 -0700 


fengjian428 opened a new issue #3755:
URL: https://github.com/apache/hudi/issues/3755


   Environment： Hudi 0.9  ，Hbase 1.4.12
   
   when I run delta streamer(version 0.9) to ingest data from kafka to a Hbase 
indexed mor table ,  after few commits, met this error when compaction running
   
![image](https://user-images.githubusercontent.com/4403474/136153476-785f7e62-4b26-4f0a-9b16-1ec7010da6b4.png)
   
    In hdfs there is a file has same fileId and commit instant but different in 
the middle: 
hdfs://tl5/projects/data_vite/mysql_ingestion/rti_vite/shopee_item_v4_db__item_v4_tab_newHbase/BR/2021-10/813800cd-1aaf-43ea-829f-4feef4a51cb3-0_19-2672-4427765_20211006051032.parquet
   below is 20211006051032.commit's content,  
   
   
![image](https://user-images.githubusercontent.com/4403474/136153507-ebc87179-d4fd-4737-9b07-2218f35667bb.png)
   
   What does 2672-4427765 and 2657-4368242 mean?  why they are mismatch and how 
can I fix this error?
   I tried recreate table , it happens again


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to