[
https://issues.apache.org/jira/browse/SPARK-61240?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-61240:
---------------------------------
Fix Version/s: connect-rust-4.3.0
> Run the official Spark Connect test suites against the drop-in in CI
> --------------------------------------------------------------------
>
> Key: SPARK-61240
> URL: https://issues.apache.org/jira/browse/SPARK-61240
> Project: Spark
> Issue Type: Test
> Components: Connect
> Affects Versions: connect-rust-4.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
> Fix For: connect-rust-4.3.0
>
>
> CI runs the official 4.3.0 Connect test files only through the Rust
> transport, with official PySpark building the plans. The drop-in's own
> Rust-backed classes (DataFrame, Column, functions, readers) are therefore
> never run under the official suite in CI. Running the files against the
> drop-in directly already works locally (119 files, sql, ml, errors and logger
> Connect suites), but nothing gates it. This adds a drop-in mode to
> run_official_tests.py, a manifest of by-design and environmental failures,
> and a parallel CI job.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]