awhyte opened a new issue, #1193:
URL: https://github.com/apache/datafusion-python/issues/1193

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   I maintain a Rust library that uses Datafusion internally for certain 
calculations. The remainder of this library can be operated from Python via 
pyo3. 
   
   In order to control the behvariour of some of the internal Datafusion 
calculations, I would like to be able to pass `datafusion-python` Python 
objects like `[Py]Expr` and `[Py]SortExpr` into Rust as arguments.
   
   I can include the `datafusion_python` crate with its incredibly helpful 
wrappers, structs and conversions. However, regular `datafusion-python` Python 
objects cannot be passed in because the `datafusion` Python package links to 
its own private Rust library rather than my independent Rust library.
   
   pyo3 complains with:
   ```
   TypeError: argument 'example_custom_expr': 'Expr' cannot be converted to 
'Expr'.
   ```
   
   This seems to be because the two Rust backends are not binary compatible.
   
   **Describe the solution you'd like**
   I would like to be able to point the `datafusion-python` Python frontend at 
a different Rust backend in order to make use of its great feature coverage and 
overall capability.
   
   Would it be possible to override the default linking location?
   
   **Describe alternatives you've considered**
   The only way I can think to make this work would be to copy relevant chunks 
of Python code from `datafusion-python` package into my own Python code, and 
try to keep it synchronised. 
   
   **Additional context**


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org

Reply via email to