[
https://issues.apache.org/jira/browse/SPARK-54019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18038578#comment-18038578
]
Sanford Ryza commented on SPARK-54019:
--------------------------------------
This is actually incidentally fixed as a consequence of this fix for
SPARK-54020. Not sure the preferred way to track this, but we can either
resolve it as Fixed or Duplicate.
> Prevent spark.sql session state mutation within Python pipeline files
> ---------------------------------------------------------------------
>
> Key: SPARK-54019
> URL: https://issues.apache.org/jira/browse/SPARK-54019
> Project: Spark
> Issue Type: Sub-task
> Components: Declarative Pipelines
> Affects Versions: 4.1.0
> Reporter: Sanford Ryza
> Priority: Major
>
> We should ban all uses of spark.sql except for select statements.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
