dzcxzl created HUDI-5487:
----------------------------
Summary: Reduce duplicate Logs in ExternalSpillableMap
Key: HUDI-5487
URL: https://issues.apache.org/jira/browse/HUDI-5487
Project: Apache Hudi
Issue Type: Improvement
Reporter: dzcxzl
We see hundreds of thousands of duplicate logs in the executor log.
{code:java}
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567
22/12/26 21:13:40,864 [Executor task launch worker for task 0.0 in stage 480.0
(TID 211376)] INFO ExternalSpillableMap: Update Estimated Payload size to =>
4567 {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
