[
https://issues.apache.org/jira/browse/TEZ-3216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15329080#comment-15329080
]
Siddharth Seth commented on TEZ-3216:
-------------------------------------
We could get rid of the new config altogether.
Instead repurpose TEZ_RUNTIME_REPORT_PARTITION_STATS to handle both cases.
(Change away from boolean to a string). So
false | none -> no stats
true | lossy -> current stats
lossless -> precise stats
Maybe an auto in the future.
(true,false) for backward compatibility.
> Support for more precise partition stats in VertexManagerEvent
> --------------------------------------------------------------
>
> Key: TEZ-3216
> URL: https://issues.apache.org/jira/browse/TEZ-3216
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ming Ma
> Assignee: Ming Ma
> Attachments: TEZ-3216.patch
>
>
> Follow up on TEZ-3206 discussion, at least for some use cases, more accurate
> partition stats will be useful for DataMovementEvent routing. Maybe we can
> provide a config option to allow apps to choose the more accurate partition
> stats over RoaringBitmap.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
