seddonm1 commented on issue #177: URL: https://github.com/apache/arrow-datafusion/issues/177#issuecomment-905062937
@alamb @Dandandan @jorgecarleitao I have done some digging into this. There are two blockers: 1. dirs-rs **problem** `dirs-rs` is pulled in due to `prettyprint-r` pulled in due to pretty printing dataframes https://github.com/apache/arrow-datafusion/blob/master/datafusion/src/execution/dataframe_impl.rs#L34. `dirs` does not have a `wasm32-unknown` implementation and the owner seems reluctant to add it: https://github.com/dirs-dev/dirs-rs/issues/17. **solution** The arrow crate has a feature flag which enables pretty printing. If we agree we can add this to the datafusion (default enabled) to prevent this first problem. 2. lz4 **problem** the `parquet` crate depends on `lz4` which is generated by `lz4-sys` (not native rust) and does not compile to `wasm32-unknown-unknown`. I have done a test of ripping parquet out of datafusion and everything compiles. **solution** we could either put anything `parquet` behind another feature flag or swap out the `lz4` for a pure rust implementation like the redox: https://lib.rs/crates/lz4-compress. It would be relatively easy for me to do the two feature flags unless someone has an objection? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
