[GitHub] [arrow] emkornfield commented on pull request #7319: ARROW-8289: [Rust] Parquet Arrow writer with nested support

2020-08-08 Thread GitBox
emkornfield commented on pull request #7319: URL: https://github.com/apache/arrow/pull/7319#issuecomment-670968900 > I'm also unsure of how to test deeply nested arrays directly in the code (I had to use Spark because Arrow reader doesn't yet support that). In C++ I covered at least

[GitHub] [arrow] emkornfield commented on pull request #7319: ARROW-8289: [Rust] Parquet Arrow writer with nested support

2020-08-08 Thread GitBox
emkornfield commented on pull request #7319: URL: https://github.com/apache/arrow/pull/7319#issuecomment-670968236 > @emkornfield not sure if I understand this part, I'll try create a nested batch with a few levels, and have one record have the top level be nested. There are two

[GitHub] [arrow] emkornfield commented on pull request #7319: ARROW-8289: [Rust] Parquet Arrow writer with nested support

2020-08-01 Thread GitBox
emkornfield commented on pull request #7319: URL: https://github.com/apache/arrow/pull/7319#issuecomment-667618090 > IMO we can solve this in two steps: 1) have a top-level method to compute def/rep levels for all leaf arrays of a given an arrow array, and then 2) use column writer to