Anish Mahto created SPARK-53498:
-----------------------------------
Summary: [SDP] Add `pyspark.pipelines` to `classic/setup.py`
Key: SPARK-53498
URL: https://issues.apache.org/jira/browse/SPARK-53498
Project: Spark
Issue Type: Sub-task
Components: Declarative Pipelines
Affects Versions: 4.1.0
Reporter: Anish Mahto
SDP is only supported in spark connect, and we want the SDP client to be
distributed as part of the`pyspark-connect` PyPi package.
In order for the `pyspark/pipelines` module to be distributed as part of
`pyspark-connect`, we need to explicitly list the module in the
`python/packaging/client/setup.py`, in addition to already listing it in
`python/packaging/connect/setup.py`.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
