nbalajee commented on pull request #2607:
URL: https://github.com/apache/hudi/pull/2607#issuecomment-818882851


   > 1. Logical vs Physical Space
          - With RFC-15 this information can be reported from metdata.  (before 
RFC-15, may take additional listing)
   > 2. CPU used per record (CPU usage of this job ?)
          - cumulative sum of time taken translates to vcore seconds.
   > 3. Mem used per record (Mem usage of this job ?)
          - cumulative sum of time taken translates to memory seconds 
(timetaken * {mem allocated per executor} by default.  Can be refined with 
actual mem usage stats).
   > 4. Time taken per record
           - write stage time
           - bloom index stage time 
           are collected per executor.  
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to