Ed Elliott created SPARK-46884:
----------------------------------
Summary: Spark Connect add property in ExecutePlanRequest for job
description
Key: SPARK-46884
URL: https://issues.apache.org/jira/browse/SPARK-46884
Project: Spark
Issue Type: Improvement
Components: Connect
Affects Versions: 3.5.0
Reporter: Ed Elliott
A representation of the execution request is added as the job description when
using Spark Connect.
I would like to add a property to the ExecutePlanRequest that allows client
applications to set the string instead of the description being generated by
the Spark Connect server.
Having the new property means that we can get things like the client app's
stack trace in the job description, which would match the point of the client
application.
I have created a small wip PR (I need to figure out how to test it).
The new property could be optional to be backwards compatible and not a
breaking change.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
