[GitHub] [hudi] ssomuah commented on issue #1852: [SUPPORT]

[GitBox]

ssomuah commented on issue #1852:
URL: https://github.com/apache/hudi/issues/1852#issuecomment-663000848


   I updated to master @ 743ef322b88d90be9775b889f6381925cdda5f35 and then 
applied the patch you linked above. 
   
   The first batch that ran had several "RunCompactionActionExecutor" 
   
    I'm still consistently seeing long batches 
   
   <img width="1592" alt="Screen Shot 2020-07-23 at 8 45 49 AM" 
src="https://user-images.githubusercontent.com/2061955/88288372-b07da480-ccc1-11ea-9dc6-4e0a0675244a.png";>
   
   
   <img width="1151" alt="Screen Shot 2020-07-23 at 8 46 07 AM" 
src="https://user-images.githubusercontent.com/2061955/88288414-b96e7600-ccc1-11ea-92f8-ba1671466164.png";>
   
   
   <img width="1581" alt="Screen Shot 2020-07-23 at 8 46 17 AM" 
src="https://user-images.githubusercontent.com/2061955/88288429-c0958400-ccc1-11ea-9617-81bffd01a8af.png";>
   
   
   <img width="1583" alt="Screen Shot 2020-07-23 at 8 46 33 AM" 
src="https://user-images.githubusercontent.com/2061955/88288446-c5f2ce80-ccc1-11ea-9032-0c251d2f94d9.png";>
   
   
   The contents of the  timeline folder are now. 
   
   
[dot_hoodie_folder_v2.txt](https://github.com/apache/hudi/files/4966070/dot_hoodie_folder_v2.txt)
   
   
   I think the root of my issue is that I have tons of log files which don't 
seem to get compacted. 
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org