Sandy Ryza created SPARK-52375:
----------------------------------

             Summary: [SDP] Parsing and registration for SQL graph elements
                 Key: SPARK-52375
                 URL: https://issues.apache.org/jira/browse/SPARK-52375
             Project: Spark
          Issue Type: Sub-task
          Components: Declarative Pipelines, SQL
    Affects Versions: 4.1.0
            Reporter: Sandy Ryza
            Assignee: Anish Mahto


SQL definitions of elements in a Declarative Pipeline are sent to the backend 
as strings, with multiple statements. We need to split these strings, parse 
each statement, and register the relevant datasets and flows described in them 
with the dataflow graph.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to