[
https://issues.apache.org/jira/browse/SPARK-54314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-54314.
----------------------------------
Resolution: Fixed
Resolving as Fixed: this change was merged to master. Implementing commit:
01a79c857639 [SPARK-54314][PYTHON][CONNECT] Improve Server-Side debuggability
in Spark Connect by capturing client appli. (Triaged as a stranded ticket — the
fix landed but the JIRA was left unresolved. Verified present on current master
and not reverted.)
> Improve Server-Side debuggability in Spark Connect by capturing client
> application's file name and line numbers in PySpark
> --------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-54314
> URL: https://issues.apache.org/jira/browse/SPARK-54314
> Project: Spark
> Issue Type: Improvement
> Components: PySpark
> Affects Versions: 3.5.4, 3.5.5, 3.5.6, 4.0.0, 4.0.1, 3.5.7
> Reporter: Susheel Aroskar
> Assignee: Susheel Aroskar
> Priority: Major
> Labels: pull-request-available
> Original Estimate: 672h
> Remaining Estimate: 672h
>
> Make Spark Connect server logs and observability tooling more useful by
> transmitting client-side code location details (function name, file name and
> line number) along with actions in PySpark. This will help developers debug
> errors in production pipelines and improve observability integrations (e.g.,
> OpenTelemetry).
> SPIP:
> [https://docs.google.com/document/d/1Sqa2QtY4tTVEwy-Tuh42gzL5RyuENmcPhPqETkpZgk0/edit?tab=t.0]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
