Sure, if you need an Arrow writer and want to work on it, we would be happy to include it in Iceberg.
What is your use case? The main reason why we don't have one is that neither Presto nor Spark uses Arrow for writing. On Mon, Jul 6, 2020 at 9:04 AM Chen Song <chen.song...@gmail.com> wrote: > I looked at the Iceberg Data API > <https://github.com/apache/iceberg/tree/master/data/src/main/java/org/apache/iceberg/data> > and found that the write is row based. If I want to use a columnar data > file format like Parquet and efficiently sink columnar data in memory (like > Arrow). I assume it is not currently implemented but OK to enhance the data > API to support this? > > -- > Chen Song > > -- Ryan Blue Software Engineer Netflix
