kflansburg commented on pull request #8968:
URL: https://github.com/apache/arrow/pull/8968#issuecomment-748502283


   > Our JSON reader already has the building blocks needed to trivially do 
this, and after #8938, you should be able to read all nested JSON types.
   
   Great, thanks for the tip!
   
   > There is a slight downside to having the `arrow-kafka` live in this 
repository, which is that `librdkafka` isn't trivial to install in Windows (I 
use it in WSL instead). So from a development perspective, it might impose some 
load on developers (esp drive-by contributions).
   
   Thanks for the heads up, this seems to be the main issue with CI right now. 
I would switch to dynamic-linking, however Cargo will still not build without 
the correct libraries present. 
   
   I figured that this would be a controversial thing to include in-tree for 
the reasons you mentioned. I don't really want to re-implement all of 
`librdkafka` in Rust (as was done with `parquet`), but I think there should be 
a way for `arrow` to provide `arrow`-specific functionality in-tree for 
external IO crates. 
   
   I will leave this discussion for the core maintainers though. 
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to