nevi-me commented on pull request #7319: URL: https://github.com/apache/arrow/pull/7319#issuecomment-670899165
@sunchao @andygrove (CC @wesm @kszucs @emkornfield) in the past few months we haven't had enough review bandwidth on Rust's Parquet implementation (mostly relying on Chao for non-trivial reviews), and given the amount of work needed for an Arrow writer + the interest so far (I think few people already using this fork), I'd like to propose: * We create a temporary branch in the apache/arrow repo, where the arrow writer can temporarily live * We can merge changes into the branch, esp if there aren't enough reviewers at the time * When we're close to a release, we merge what's on the temp branch into the branch that's currently called `master` but will be renamed soon 😉 ITO this PR, I think I've gotten arbitrary nesting covered, but there's a lot more work that we can now divide more easily so others can contribute better. I'm also unsure of how to test deeply nested arrays directly in the code (I had to use Spark because Arrow reader doesn't yet support that). I'll also bring this up in the mailing list for wider visibility ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
