Hyukjin Kwon created SPARK-61587:
------------------------------------

             Summary: Find the WASM UDF proc macro and the doc snippets' 
dependencies in the build directory layout of Rust 1.100
                 Key: SPARK-61587
                 URL: https://issues.apache.org/jira/browse/SPARK-61587
             Project: Spark
          Issue Type: Bug
          Components: Connect
    Affects Versions: connect-rust-4.3.0
            Reporter: Hyukjin Kwon


Rust 1.100.0 (2026-11-09) changed the layout of cargo's build directory: there 
is no target/<profile>/deps any more, and the artifacts of each unit are in a 
directory of its own, target/<profile>/build/<package>/<hash>/out, which is 
also the OUT_DIR of a build script.

Two places of spark-connect-rust assumed the old layout, and CI, which installs 
the stable toolchain, fails since it got 1.100:
- crates/spark-connect-build (apache-spark-connect-build, the build.rs helper 
of WASM UDFs) looked for the spark_connect_macros proc-macro dylib in 
OUT_DIR/../../../deps, and panics with "could not find the spark_connect_macros 
proc-macro dylib in .../target/debug/build/deps". This breaks the build of any 
crate that calls embed_wasm_udf with Rust 1.100 (the WASM UDF feature and Rust 
behavioral e2e jobs).
- scripts/check_doc_snippets.py compiled the doc snippets with -L 
dependency=target/debug/deps, and every snippet fails with "can't find crate 
for `spark_connect_core`" (the docs job).




--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to