alamb commented on issue #87: URL: https://github.com/apache/arrow-rs/issues/87#issuecomment-826797808
Comment from Andy Grove(andygrove) @ 2020-07-14T14:25:52.335+0000: <pre>This sounds really interesting. I have been thinking about supporting WASM UDFs for a while now but more from the point of view of DataFusion being able to invoke UDFs developed in languages other than Rust. Unfortunately, I don't know much about WASM yet. With your proposal, would the WASM code be running in the same process as Spark, or would Spark be calling another process? Why would you want to invoke Arrow from your WASM code versus having Arrow invoke your WASM code? Most of these questions are just my curiosity about the use case.</pre> Comment from RJ Atwal(Rj-atwal) @ 2020-07-14T14:53:22.829+0000: <pre>[~andygrove] To answer your questions: 1. Wasm code would be running in the same process as Spark (unfortunately their will be a JNI wall between the two execution areas though). 2. I want to use arrow as the format to pass data (references) between Java land and the WASM (native) execution. So, I need libraries to handle arrow on both environments.</pre> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
