hi Cindy,

Could you clarify which PL you are working in (though assuming Scala /
Java judging by your e-mail address)?

In C++ we have reasonably mature Parquet->Arrow reading but not yet
conversion from Arrow to Avro. In Java, I am not sure what is the
state of the art for getting Parquet into Arrow but this code does not
live in Apache Arrow -- I know that Apache Iceberg has done some work
around this but I'm not sure how consumable it is as a library.
Java-Arrow does have some preliminary support for converting Arrow to
Avro, I believe. So there's some engineering here to do in any case.

best,
Wes

On Mon, Jun 29, 2020 at 2:45 PM Cindy McMullen <[email protected]> wrote:
>
> Can I use Arrow to stream data from a Parquet file source and consume it via 
> Avro?

Reply via email to