[ https://issues.apache.org/jira/browse/SPARK-52451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18011919#comment-18011919 ]
Yihong He commented on SPARK-52451: ----------------------------------- The task is not finished yet, and it may require multiple pull requests to make the SparkConnectPlanner side-effect free. I will create some follow-up tickets to track the work. > The SparkConnectPlanner should side effect free > ------------------------------------------------ > > Key: SPARK-52451 > URL: https://issues.apache.org/jira/browse/SPARK-52451 > Project: Spark > Issue Type: Task > Components: Connect, SQL > Affects Versions: 4.1.0 > Reporter: Herman van Hövell > Assignee: Yihong He > Priority: Major > Labels: pull-request-available > Fix For: 4.1.0 > > > The current SparkConnectPlanner allows commands and side effects to be > materialized inside the planner. This leads to code duplication, it is > somewhat hard to follow, and it is hard to observe properly (Nothing shows up > in the UI for example). -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org