[
https://issues.apache.org/jira/browse/HUDI-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Danny Chen reassigned HUDI-5487:
--------------------------------
Assignee: Danny Chen
> Reduce duplicate Logs in ExternalSpillableMap
> ---------------------------------------------
>
> Key: HUDI-5487
> URL: https://issues.apache.org/jira/browse/HUDI-5487
> Project: Apache Hudi
> Issue Type: Improvement
> Reporter: dzcxzl
> Assignee: Danny Chen
> Priority: Minor
> Labels: pull-request-available
> Fix For: 0.13.1
>
>
> We see hundreds of thousands of duplicate logs in the executor log.
> {code:java}
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567
> 22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage
> 480.0 (TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size
> to => 4567 {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
