[
https://issues.apache.org/jira/browse/ARROW-9453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157419#comment-17157419
]
Andy Grove commented on ARROW-9453:
-----------------------------------
This sounds really interesting. I have been thinking about supporting WASM UDFs
for a while now but more from the point of view of DataFusion being able to
invoke UDFs developed in languages other than Rust. Unfortunately, I don't know
much about WASM yet.
With your proposal, would the WASM code be running in the same process as
Spark, or would Spark be calling another process? Why would you want to invoke
Arrow from your WASM code versus having Arrow invoke your WASM code? Most of
these questions are just my curiosity about the use case.
> [Rust] Compiling Rust libary against WASM32 library
> ---------------------------------------------------
>
> Key: ARROW-9453
> URL: https://issues.apache.org/jira/browse/ARROW-9453
> Project: Apache Arrow
> Issue Type: New Feature
> Components: Rust, Rust - DataFusion
> Affects Versions: 1.0.0
> Reporter: RJ Atwal
> Priority: Major
>
> I am hoping to support arch_target=Wasm32 as a compilation target for the
> rust arrow & datafusion packages.
> My plan is to add compiler conditionals around any I/O features and libc
> dependent features of these two libraries.
> My intent is to be able to use the apache arrow libraries in UDF style WASM
> functions which pass arrow memory references between the host (spark
> environment) and the WASM code
--
This message was sent by Atlassian Jira
(v8.3.4#803005)