Hi all,

I opened SPARK-59395 to propose exposing deterministic attribution between 
individual SDP flow executions and the Spark SQL executions/jobs they produce. 
The OSS SDP runtime knows the active flow internally, but that identity 
currently isn’t exposed through the public observability boundary.
I’d appreciate any feedback on whether this is something SDP should expose and 
what the appropriate abstraction might be.
JIRA: https://issues.apache.org/jira/browse/SPARK-59395
Thanks,
Paul

Reply via email to