[
https://issues.apache.org/jira/browse/TEZ-4393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4393:
------------------------------
Description:
https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/ShuffleScheduler.java#L920
logs this:
{code}
2022-02-10 10:06:49,537 [INFO] [Fetcher_O {Reducer_3} #18]
|orderedgrouped.ShuffleScheduler|: srcAttempt=InputAttemptIdentifier
[inputIdentifier=2268, attemptNumber=0,
pathComponent=attempt_1642579940152_2265110_1_04_000567_0_10002, spillType=0,
spillId=-1], numUniqueHosts=677, hostFailureThreshold=136, hostFailuresCount=0,
hosts crossing threshold=0, reducerFetchIssues=false
{code}
the message doesn't contain anything about the purpose of this log line, it
only puts reducerFetchIssues=failedAcrossNodes to the end
> ShuffleScheduler.hasFailedAcrossNodes log message to have more context
> ----------------------------------------------------------------------
>
> Key: TEZ-4393
> URL: https://issues.apache.org/jira/browse/TEZ-4393
> Project: Apache Tez
> Issue Type: Wish
> Reporter: László Bodor
> Priority: Major
>
> https://github.com/apache/tez/blob/master/tez-runtime-library/src/main/java/org/apache/tez/runtime/library/common/shuffle/orderedgrouped/ShuffleScheduler.java#L920
> logs this:
> {code}
> 2022-02-10 10:06:49,537 [INFO] [Fetcher_O {Reducer_3} #18]
> |orderedgrouped.ShuffleScheduler|: srcAttempt=InputAttemptIdentifier
> [inputIdentifier=2268, attemptNumber=0,
> pathComponent=attempt_1642579940152_2265110_1_04_000567_0_10002, spillType=0,
> spillId=-1], numUniqueHosts=677, hostFailureThreshold=136,
> hostFailuresCount=0, hosts crossing threshold=0, reducerFetchIssues=false
> {code}
> the message doesn't contain anything about the purpose of this log line, it
> only puts reducerFetchIssues=failedAcrossNodes to the end
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
