Sanford Ryza created SPARK-53772:
------------------------------------
Summary: Refactor PythonPipelineSuite on top of APITest
Key: SPARK-53772
URL: https://issues.apache.org/jira/browse/SPARK-53772
Project: Spark
Issue Type: Improvement
Components: Declarative Pipelines
Affects Versions: 4.1.0
Reporter: Sanford Ryza
The tests in PythonPipelineSuite are essentially API tests, meaning that they
could be written to extend the APITest class. That would allow them to rely on
the APITest infrastructure and be tested in a higher fidelity way.
Doing this will Spark Connect protocol additions to allow the client to access
metadata about the dataflow graph.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
