Xiening, and Gang, Thank you for your contributions to the much desired C++ Writer! Owen did mention about a release with the ORC C++ writer soon. We will keep you posted.
On Tue, Jan 16, 2018 at 1:22 AM, Xiening Dai <[email protected]> wrote: > > Hi all, > > In the last couple of months, Gang and I had been working on adding support > for ORC C++ writer. With the commit from Gang last week, we now have a fully > functioning ORC writer in C++. Here's a quick summary of what have been done > - > > Basic output stream and buffering support > Type writer that supports all ORC types including composite types > Index and statistics > RLEv1 support > Zlib compression support > UTs and the new CSVFileImport tool to create ORC file using C++ writer > > The C++ writer is not yet at feature parity with the Java writer, and we > plan to continue improving it going forward - > > More efficient memory management for the writer > Better encoding support (RLEv2 and double encoding in the future) > More compression codec support, especially zStd > Async prefetch support for the reader > Predicate pushdown > > We'd like to invite people in this mail group to try out the new C++ writer > and report any issues/bugs. > > Owen/Deepak, > > Thanks for your helps on code reviews and design reviews in the past. If you > need help on shipping the writer in next ORC release, feel free to let us > know. Thanks! -- regards, Deepak Majeti
