Attendees: - Aliaksei, Deepak: developers at Vertica, working on C++ api for Parquet (reader) - Wes: Cloudera, working on parquet C++, exposing read/write api to python. will collaborate with A and D - Jason: Dremio, Drill dev, contributed ByteBuffer apis in Parquet, looking in S3 perf - Liwei: from China, 10cent social network, sparkSQL + parquet. Several patches up for review - Parth: Drill dev at MapR. Interested in the vectorized read work by Nong and Steven - Ryan, Taras: dev at Cloudera. interested in 1.9 release. - Julien: Dremio, moderator - Cheng: databricks dev, usually in China, visiting in SF. - Dan: Netflix. Pig predicate push down and filter. release 1.9. and S3 perf issue. Vectorized java discussion.
Actions: - Julien to send introductory email about Vectorized java API: Steven, Nong, Daniel, Ryan, Nezih Agenda: - C++ work: - Aleksei+Deepak and Wes will review each other’s code and committers will commit when consensus is reached. - S3 perf issue after byte buffer: PARQUET-400 - seek operations on s3 are expensive. - some more discussion will happen offline - blacklist some filesystems based on the URI could be a workaround - Liwei’s patches - PARQUET-427 - to review: https://issues.apache.org/jira/secure/attachment/12782011/Parquet-427%20v0.1.pdf Daniel, Julien - 1.9 release - Dan’s patches. => Ryan and Julien to review. - Dictionary level filtering PARQUET-384 - Pig integration with filter api in predicate push down. PARQUET-397 - reviewed outstanding bugs: - most have a patch and are ready to merge. - some may be taken out of the release as they are low priority and don’t have a patch yet. Parquet sync up time: - We had two people joining that would prefer a Chinese friendly time (4pm PT). - The morning time is supposed to be Europe friendly. Today we did not have anyone from Europe though. - Julien to send email to gauge people’s preference. If both have supporter we’ll do a rotation. - next sync up will be at 4pm to start. On Wed, Jan 27, 2016 at 10:03 AM, Julien Le Dem <[email protected]> wrote: > > > https://plus.google.com/hangouts/_/event/cvgi67jmoptmgb1i488re8scbuo?hl=en&authuser=1 > -- > Julien > -- Julien
