[
https://issues.apache.org/jira/browse/SPARK-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tathagata Das updated SPARK-4601:
---------------------------------
Description: When running the NetworkWordCount, the description of the word
count jobs are set as "getCallsite at DStream:xxx" . This should be set to the
line number of the streaming application that has the output operation that led
to the job being created. This is because the callsite is incorrectly set in
the thread launching the jobs. (was: When running the NetworkWordCount, the
description of the word count jobs are set as "getCallsite at DStream:xxx" .
This should be set to the line number of the streaming application that has the
output operation that led to the job being created.)
> Call site of jobs generated by streaming incorrect in Spark UI
> --------------------------------------------------------------
>
> Key: SPARK-4601
> URL: https://issues.apache.org/jira/browse/SPARK-4601
> Project: Spark
> Issue Type: Bug
> Components: Streaming
> Reporter: Tathagata Das
> Assignee: Tathagata Das
>
> When running the NetworkWordCount, the description of the word count jobs are
> set as "getCallsite at DStream:xxx" . This should be set to the line number
> of the streaming application that has the output operation that led to the
> job being created. This is because the callsite is incorrectly set in the
> thread launching the jobs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
