[
https://issues.apache.org/jira/browse/SPARK-34580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17293476#comment-17293476
]
Hyukjin Kwon commented on SPARK-34580:
--------------------------------------
Thanks [~gsomogyi]!
> Provide the relationship between batch ID and SQL executions (and/or Jobs) in
> SS UI page
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-34580
> URL: https://issues.apache.org/jira/browse/SPARK-34580
> Project: Spark
> Issue Type: Improvement
> Components: Structured Streaming
> Affects Versions: 3.1.1
> Reporter: Gabor Somogyi
> Priority: Major
>
> The current SS UI page focuses to show the trends among the batches, which is
> great to figure out whether the streaming query is running healthy or not,
> and the oddness of specific batch.
> One thing still bugging you is that what you can get from here is the batch
> ID (number), which means you have to find out related SQL executions and Jobs
> manually with the batch ID. It's high likely bound to the recent runs of SQL
> executions/Jobs so you may not need to find it with searching on lots of
> pages, but the fact you need to find it by yourself manually is still
> annoying.
> It would be nice if we can provide the relationship between batch ID and SQL
> executions (probably Jobs as well if the space is enough) and links to these
> pages, like we see job page links from SQL execution page.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
