Gabor Somogyi created SPARK-34580:
-------------------------------------
Summary: Provide the relationship between batch ID and SQL
executions (and/or Jobs) in SS UI page
Key: SPARK-34580
URL: https://issues.apache.org/jira/browse/SPARK-34580
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.1.1
Reporter: Gabor Somogyi
The current SS UI page focuses to show the trends among the batches, which is
great to figure out whether the streaming query is running healthy or not, and
the oddness of specific batch.
One thing still bugging you is that what you can get from here is the batch ID
(number), which means you have to find out related SQL executions and Jobs
manually with the batch ID. It's high likely bound to the recent runs of SQL
executions/Jobs so you may not need to find it with searching on lots of pages,
but the fact you need to find it by yourself manually is still annoying.
It would be nice if we can provide the relationship between batch ID and SQL
executions (probably Jobs as well if the space is enough) and links to these
pages, like we see job page links from SQL execution page.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
