Hyukjin Kwon created SPARK-61240:
------------------------------------
Summary: Run the official Spark Connect test suites against the
drop-in in CI
Key: SPARK-61240
URL: https://issues.apache.org/jira/browse/SPARK-61240
Project: Spark
Issue Type: Test
Components: Connect
Affects Versions: connect-rust-4.3.0
Reporter: Hyukjin Kwon
CI runs the official 4.3.0 Connect test files only through the Rust transport,
with official PySpark building the plans. The drop-in's own Rust-backed classes
(DataFrame, Column, functions, readers) are therefore never run under the
official suite in CI. Running the files against the drop-in directly already
works locally (119 files, sql, ml, errors and logger Connect suites), but
nothing gates it. This adds a drop-in mode to run_official_tests.py, a manifest
of by-design and environmental failures, and a parallel CI job.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
