[GitHub] [hudi] spyzzz commented on issue #2193: [SUPPORT] Optimise MOR file size and upsert

[GitBox]

spyzzz commented on issue #2193:
URL: https://github.com/apache/hudi/issues/2193#issuecomment-714356313


   I tried with hoodie.copyonwrite.record.size.estimate=100. 
   
   And its a little bit better, file size are now close de 60Mo instead of 5Mo
   
   And batch are faster : 
   
   1 -> 10min (same)
   2 -> 11 min 
   3 -> 17min 
   
   <img width="1414" alt="Capture d’écran 2020-10-22 à 11 17 46" 
src="https://user-images.githubusercontent.com/5584892/96851511-66d75e00-1458-11eb-85e5-157cb40f6fad.png";>
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org