[
https://issues.apache.org/jira/browse/SPARK-27142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16791728#comment-16791728
]
Ajith S commented on SPARK-27142:
---------------------------------
Ok apologies for being abstract about this requirement. Let me explain. A
single SQL query can result into multiple jobs. So for end user who is using
STS or spark-sql, the intended highest level of probe is the SQL which he has
executed. This information can be seen from SQL tab. Attaching a sample.
!image-2019-03-13-19-29-26-896.png!
But same information he cannot access using the REST API exposed by spark and
he always have to rely on jobs API which may be difficult. So i intend to
expose the information seen in SQL tab in UI via REST API
Mainly:
# executionId : long
# status : string - possible values COMPLETED/RUNNING/FAILED
# description : string - executed SQL string
# submissionTime : formatted time of SQL submission
# duration : string - total run time
# runningJobIds : Seq[Int] - sequence of running job ids
# failedJobIds : Seq[Int] - sequence of failed job ids
# successJobIds : Seq[Int] - sequence of success job ids
> Provide REST API for SQL level information
> ------------------------------------------
>
> Key: SPARK-27142
> URL: https://issues.apache.org/jira/browse/SPARK-27142
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Ajith S
> Priority: Minor
> Attachments: image-2019-03-13-19-29-26-896.png
>
>
> Currently for Monitoring Spark application SQL information is not available
> from REST but only via UI. REST provides only
> applications,jobs,stages,environment. This Jira is targeted to provide a REST
> API so that SQL level information can be found
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
