Re: Parquet Sync meeting notes - April 23 2024

2024-04-25 Thread Steve Loughran
In my vector  IO PR it was raising false positives about a new class.

Maybe the process should be something like "submitter needs approval for
extra exclusions"

more troublesome: once a release has shipped, those exclusions should be
stripped from the master branch,
as then a regression is a genuine failure

On Thu, 25 Apr 2024 at 16:06, Gang Wu  wrote:

> Let me take a look at the exclusions of japicmp. Will try to remove
> them as much as possible.
>
> Best,
> Gang
>
> On Thu, Apr 25, 2024 at 10:01 PM Gábor Szádovszky 
> wrote:
>
> > Sorry, I was not able to attend the meeting. Let me put some notes here:
> >
> > 2. We have been fighting with compatibility issues for a while now.
> That's
> > why we introduced japicmp. I can see many exclusions in the master pom. I
> > think we should investigate if these exclusions cause any issues before
> the
> > next release. We should avoid excluding code from the compatibility
> checker
> > even if it seems reasonable because they tend to be kept there from
> release
> > to release.
> >
> > 3. Let's call it parquet-mr 2.0. "Parquet" might be confusing since this
> > mailing list is used for both parquet-mr and parquet-format.
> > I think the main requirement for parquet-mr 2.0 would be to have it
> > "standalone". The core should contain an API that is able read/write
> > parquet files at different levels. It should be released in a way that it
> > does not bring any dependencies. (What is required should be shaded.) We
> > can even start developing the new API in a separate module under
> parquet-mr
> > 1.x, so our clients can play with it and give feedback.
> >
> > Xinli shang  ezt írta (időpont: 2024. ápr. 23.,
> > K,
> > 16:31):
> >
> > > 4/23/2024
> > >
> > > Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
> > >
> > >
> > > Parquet-mr 1.14 release:
> > >
> > > 1. Fokko and Gang will discuss starting the release soon
> > >
> > > 2. There are a few breaking changes we need to make to ensure backward
> > > compatibility and do proper testing
> > >
> > > 2. Vinoo will shadow and do some testing
> > >
> > > 3. Ideas on the release of Parquet 2.0. We start collecting thoughts
> and
> > > welcome everybody to share opinions.
> > > --
> > > Xinli Shang
> > >
> >
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-25 Thread Gang Wu
Let me take a look at the exclusions of japicmp. Will try to remove
them as much as possible.

Best,
Gang

On Thu, Apr 25, 2024 at 10:01 PM Gábor Szádovszky  wrote:

> Sorry, I was not able to attend the meeting. Let me put some notes here:
>
> 2. We have been fighting with compatibility issues for a while now. That's
> why we introduced japicmp. I can see many exclusions in the master pom. I
> think we should investigate if these exclusions cause any issues before the
> next release. We should avoid excluding code from the compatibility checker
> even if it seems reasonable because they tend to be kept there from release
> to release.
>
> 3. Let's call it parquet-mr 2.0. "Parquet" might be confusing since this
> mailing list is used for both parquet-mr and parquet-format.
> I think the main requirement for parquet-mr 2.0 would be to have it
> "standalone". The core should contain an API that is able read/write
> parquet files at different levels. It should be released in a way that it
> does not bring any dependencies. (What is required should be shaded.) We
> can even start developing the new API in a separate module under parquet-mr
> 1.x, so our clients can play with it and give feedback.
>
> Xinli shang  ezt írta (időpont: 2024. ápr. 23.,
> K,
> 16:31):
>
> > 4/23/2024
> >
> > Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
> >
> >
> > Parquet-mr 1.14 release:
> >
> > 1. Fokko and Gang will discuss starting the release soon
> >
> > 2. There are a few breaking changes we need to make to ensure backward
> > compatibility and do proper testing
> >
> > 2. Vinoo will shadow and do some testing
> >
> > 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> > welcome everybody to share opinions.
> > --
> > Xinli Shang
> >
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-25 Thread Gábor Szádovszky
Sorry, I was not able to attend the meeting. Let me put some notes here:

2. We have been fighting with compatibility issues for a while now. That's
why we introduced japicmp. I can see many exclusions in the master pom. I
think we should investigate if these exclusions cause any issues before the
next release. We should avoid excluding code from the compatibility checker
even if it seems reasonable because they tend to be kept there from release
to release.

3. Let's call it parquet-mr 2.0. "Parquet" might be confusing since this
mailing list is used for both parquet-mr and parquet-format.
I think the main requirement for parquet-mr 2.0 would be to have it
"standalone". The core should contain an API that is able read/write
parquet files at different levels. It should be released in a way that it
does not bring any dependencies. (What is required should be shaded.) We
can even start developing the new API in a separate module under parquet-mr
1.x, so our clients can play with it and give feedback.

Xinli shang  ezt írta (időpont: 2024. ápr. 23., K,
16:31):

> 4/23/2024
>
> Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
>
>
> Parquet-mr 1.14 release:
>
> 1. Fokko and Gang will discuss starting the release soon
>
> 2. There are a few breaking changes we need to make to ensure backward
> compatibility and do proper testing
>
> 2. Vinoo will shadow and do some testing
>
> 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> welcome everybody to share opinions.
> --
> Xinli Shang
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-24 Thread Claire McGinty
Great news on 1.14 getting ready for release! It's a little last minute,
but I cleaned up a draft I've been working on for supporting an
Array#Contains predicate and opened a PR
. It is a lot of code to
review, but surprisingly didn't require any breaking changes. I'm wondering
if it's feasible whether this feature could make it into 1.14.0 :)

Best,
Claire

On Wed, Apr 24, 2024 at 5:30 AM Steve Loughran 
wrote:

> where is the timetable for these calls? I think I'd like to join in if the
> timing works for me (UK)
>
> On Tue, 23 Apr 2024 at 15:31, Xinli shang  wrote:
>
> > 4/23/2024
> >
> > Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
> >
> >
> > Parquet-mr 1.14 release:
> >
> > 1. Fokko and Gang will discuss starting the release soon
> >
> > 2. There are a few breaking changes we need to make to ensure backward
> > compatibility and do proper testing
> >
> > 2. Vinoo will shadow and do some testing
> >
> > 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> > welcome everybody to share opinions.
> > --
> > Xinli Shang
> >
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-24 Thread Steve Loughran
where is the timetable for these calls? I think I'd like to join in if the
timing works for me (UK)

On Tue, 23 Apr 2024 at 15:31, Xinli shang  wrote:

> 4/23/2024
>
> Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
>
>
> Parquet-mr 1.14 release:
>
> 1. Fokko and Gang will discuss starting the release soon
>
> 2. There are a few breaking changes we need to make to ensure backward
> compatibility and do proper testing
>
> 2. Vinoo will shadow and do some testing
>
> 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> welcome everybody to share opinions.
> --
> Xinli Shang
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-23 Thread Prem Sahoo
I will defer here as per Parquet community Parquet V2 encoding is not final yet 
so they haven’t make it official. I have no clue how pyarrow is supporting it ?
I thought  parquet used by pyarrow and Spark should have same flavor but 
unfortunately it is not which is very concerning. Spark doesn’t support write 
in Parquet V2 and pyarrow do support in V2.
Sent from my iPhone

> On Apr 23, 2024, at 11:23 AM, Gang Wu  wrote:
> 
> I would expect so. parquet-mr has a complete implementation of all v2
> encodings
> and some other Parquet implementations (e.g. Apache Arrow C++ and arrow-rs)
> have already supported most (if not all) v2 encodings for a long time.
> 
> Best,
> Gang
> 
>> On Tue, Apr 23, 2024 at 11:02 PM Prem Sahoo  wrote:
>> 
>> Are we planning to put Parquet V2 encoding in 2.0 ?
>> Sent from my iPhone
>> 
>>> On Apr 23, 2024, at 10:31 AM, Xinli shang 
>> wrote:
>>> 
>>> 4/23/2024
>>> 
>>> Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
>>> 
>>> 
>>> Parquet-mr 1.14 release:
>>> 
>>> 1. Fokko and Gang will discuss starting the release soon
>>> 
>>> 2. There are a few breaking changes we need to make to ensure backward
>>> compatibility and do proper testing
>>> 
>>> 2. Vinoo will shadow and do some testing
>>> 
>>> 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
>>> welcome everybody to share opinions.
>>> --
>>> Xinli Shang
>> 


Re: Parquet Sync meeting notes - April 23 2024

2024-04-23 Thread Gang Wu
I would expect so. parquet-mr has a complete implementation of all v2
encodings
and some other Parquet implementations (e.g. Apache Arrow C++ and arrow-rs)
have already supported most (if not all) v2 encodings for a long time.

Best,
Gang

On Tue, Apr 23, 2024 at 11:02 PM Prem Sahoo  wrote:

> Are we planning to put Parquet V2 encoding in 2.0 ?
> Sent from my iPhone
>
> > On Apr 23, 2024, at 10:31 AM, Xinli shang 
> wrote:
> >
> > 4/23/2024
> >
> > Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
> >
> >
> > Parquet-mr 1.14 release:
> >
> > 1. Fokko and Gang will discuss starting the release soon
> >
> > 2. There are a few breaking changes we need to make to ensure backward
> > compatibility and do proper testing
> >
> > 2. Vinoo will shadow and do some testing
> >
> > 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> > welcome everybody to share opinions.
> > --
> > Xinli Shang
>


Re: Parquet Sync meeting notes - April 23 2024

2024-04-23 Thread Prem Sahoo
Are we planning to put Parquet V2 encoding in 2.0 ?
Sent from my iPhone

> On Apr 23, 2024, at 10:31 AM, Xinli shang  wrote:
> 
> 4/23/2024
> 
> Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang
> 
> 
> Parquet-mr 1.14 release:
> 
> 1. Fokko and Gang will discuss starting the release soon
> 
> 2. There are a few breaking changes we need to make to ensure backward
> compatibility and do proper testing
> 
> 2. Vinoo will shadow and do some testing
> 
> 3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
> welcome everybody to share opinions.
> --
> Xinli Shang


Parquet Sync meeting notes - April 23 2024

2024-04-23 Thread Xinli shang
4/23/2024

Attendee  Fokko Driesprong, Vinoo Ganesh, Xinli Shang


Parquet-mr 1.14 release:

1. Fokko and Gang will discuss starting the release soon

2. There are a few breaking changes we need to make to ensure backward
compatibility and do proper testing

2. Vinoo will shadow and do some testing

3. Ideas on the release of Parquet 2.0. We start collecting thoughts and
welcome everybody to share opinions.
-- 
Xinli Shang


Parquet sync meeting notes - March 26 2024

2024-03-26 Thread Xinli shang
Hi all,

These are the meeting notes of today's sync meeting.

3/26/2024

Attendees: Gábor Szádovszky, Vinoo Ganesh, Xinli Shang

   1.

   Parquet-mr 1.14 release - target for mid of 2024
   2.

   Vulnerabilities findings - done.
   3.

   Java and scala files in format repo removal - start an email to discuss
   with the community

-- 
Xinli Shang


Updated invitation: Parquet Sync @ Monthly from 7am to 8am on the fourth Tuesday (PST) (dev@parquet.apache.org)

2024-02-20 Thread Xinli shang
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20240227T07
DTEND;TZID=America/Los_Angeles:20240227T08
RRULE:FREQ=MONTHLY;BYDAY=4TU
DTSTAMP:20240219T153858Z
ORGANIZER;CN=Xinli shang:mailto:sha...@uber.com
UID:6vgu231jai324kjt1041divb7b_r20240227t150...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Xinli shang;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=matthew.m.tur...@outlook.com;X-NUM-GUESTS=0:mailto:matthew.m.turner
 @outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszk
 y...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=arl...@pitt.edu;X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=i...@isolineltd.com;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=brian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=robe...@palantir.com;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=theo...@amazon.com;X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=shengxuan@bytedance.com;X-NUM-GUESTS=0:mailto:shengxuan.liu@bytedan
 ce.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=collimarc...@gmail.com;X-NUM-GUESTS=0:mailto:collimarc...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=yi.he.ust...@gmail.com;X-NUM-GUESTS=0:mailto:yi.he.ust...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 

Updated invitation: Parquet Sync @ Monthly from 7am to 8am on the fourth Tuesday from Tue Jul 25, 2023 to Mon Feb 26 (PDT) (dev@parquet.apache.org)

2024-02-20 Thread Xinli shang
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20230725T07
DTEND;TZID=America/Los_Angeles:20230725T08
RRULE:FREQ=MONTHLY;UNTIL=20240227T075959Z;BYDAY=4TU
DTSTAMP:20240219T153858Z
ORGANIZER;CN=Xinli shang:mailto:sha...@uber.com
UID:6vgu231jai324kjt1041divb7b_r20230725t140...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Xinli shang;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=matthew.m.tur...@outlook.com;X-NUM-GUESTS=0:mailto:matthew.m.turner
 @outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszk
 y...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=arl...@pitt.edu;X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=i...@isolineltd.com;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=brian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=robe...@palantir.com;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=theo...@amazon.com;X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=shengxuan@bytedance.com;X-NUM-GUESTS=0:mailto:shengxuan.liu@bytedan
 ce.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=collimarc...@gmail.com;X-NUM-GUESTS=0:mailto:collimarc...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=yi.he.ust...@gmail.com;X-NUM-GUESTS=0:mailto:yi.he.ust...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 

Canceled event: Parquet Sync @ Tue Dec 26, 2023 7am - 8am (PST) (dev@parquet.apache.org)

2023-12-13 Thread Xinli shang
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20231226T07
DTEND;TZID=America/Los_Angeles:20231226T08
DTSTAMP:20231212T224002Z
ORGANIZER;CN=Xinli shang:mailto:sha...@uber.com
UID:6vgu231jai324kjt1041divb7b_r20230725t140...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=Xinli 
 shang;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ma
 tthew.m.tur...@outlook.com;X-NUM-GUESTS=0:mailto:matthew.m.turner@outlook.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ar
 l...@pitt.edu;X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=yu
 mw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=iv
 a...@isolineltd.com;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=br
 ian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ji
 ashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=vi
 noo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ha
 drien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=py
 a...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=jo
 rgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=hu
 axin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ro
 be...@palantir.com;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=th
 eo...@amazon.com;X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=sh
 engxuan@bytedance.com;X-NUM-GUESTS=0:mailto:shengxuan@bytedance.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=co
 llimarc...@gmail.com;X-NUM-GUESTS=0:mailto:collimarc...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=yi
 .he.ust...@gmail.com;X-NUM-GUESTS=0:mailto:yi.he.ust...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=vc
 @onehouse.ai;X-NUM-GUESTS=0:mailto:v...@onehouse.ai
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin 

Parquet Sync meeting notes - July 2023

2023-07-25 Thread Xinli shang
7/25/2023

Attendees (Gidon Gershinsky , Gang Wu, Chao Sun, Xinli
Shang, Jiashen Zhang)

Review data masking

   1.

   The current design is to implement on the reader side and it is
   lightweight
   2.

   When KMS returned access denied and the session-based flag is enabled, a
   null value is returned instead of the original value.
   3.

   Relying on the KMS access denied has a few issues
   1.

  Expense because it is RPC calls
  2.

  There are different KMS and the retuning error might be different

Add a column-wise key/nullify flag just like we did in the column encryption
.
By doing this, we don’t need to contact KMS

-- 
Xinli Shang


Parquet sync meeting notes - April 2023

2023-04-28 Thread Xinli shang
Hi all,

Here is the meeting notes for today's Parquet sync meeting.


4/28/2023

Attendee  (Shenxuan Liu, Fokko Driesprong, Gang Wu, Jiashen Zhang, Xinli
Shang )

   1.

   Post-release 1.13.0
   1.

  Iceberg upgraded to 1.13.0 bumped the Hadoop support to Hadoop 3 but
  we didn’t notice since we don’t run CI against hadoop 2. This has been
  fixed in #2290 <https://github.com/apache/parquet-mr/pull/1083>.
  2.

  Some small changes (#1073
  <https://github.com/apache/parquet-mr/pull/1073> and #1074
  <https://github.com/apache/parquet-mr/pull/1074>) to make Flink use
  the ParquetMR without having Hadoop on the classpath.
  2.

   In Velox, we store/cache files locally, then we could see a bottleneck
   in the parquet itself.
   1.

  Use SSD to store the local file 3G bytes/sec, For decompression, it
  is 200M/Sec.
  2.

  The current Parquet reader is designed for remote reading.
  3.

  There is a trans-compression
  
<https://github.com/apache/parquet-mr/blob/master/parquet-cli/src/main/java/org/apache/parquet/cli/commands/TransCompressionCommand.java>
  API you can use to speed up,  about 20x faster
  4.

  ZSTD is recommended
  3.

   Data masking Parquet-2223
   <https://github.com/apache/parquet-mr/pull/1016>
   1.

  The code is incomplete. It is needed to hide the columns in the
  schema when it is hidden. And we also need to mark it as hidden.


-- 
Xinli Shang


Canceled event: Parquet Sync @ Tue Feb 28, 2023 8:30am - 9:30am (PST) (dev@parquet.apache.org)

2023-02-24 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20230228T083000
DTEND;TZID=America/Los_Angeles:20230228T093000
DTSTAMP:20230223T215055Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:jmumoits31chu3tdvrp4lsf...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ji
 ashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=vi
 noo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ha
 drien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=py
 a...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=jo
 rgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=hu
 axin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="M
 iller, Tim";X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="H
 ailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.com
RECURRENCE-ID;TZID=America/Los_Angeles:20230228T083000
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Parquet sync meeting notes 1/24/2023

2023-01-24 Thread Xinli shang
Attendees:( Gidon Gershinsky, Xinli Shang, Tim Miller, Vinoo)

   1.

   Release new version
   1.

  ZSTD stream closure bug fixes and a few other fixes are blocking
  issues.
  2.

   PRs:
   1.

  Parquet-2069 : Fix
  some Avro schema issues, we have new comments. Miller will work
on it soon.
  2.

  Parquet-2126 :
  thread-safe compressor/decompressor. We have new comments.
Miller will work
  on it soon.
  3.

  PARQUET-2103 : Bug
  fix for prettyJOSN. Looks good. Will merge after addressing the comments.
  4.

  Consolidate rewriter - Most of the comments are addressed. Xinli will
  have another look


-- 
Xinli Shang


Canceled event: Parquet Sync @ Tue Dec 27, 2022 8:30am - 9:30am (PST) (dev@parquet.apache.org)

2022-12-14 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20221227T083000
DTEND;TZID=America/Los_Angeles:20221227T093000
DTSTAMP:20221214T162419Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:jmumoits31chu3tdvrp4lsf...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ji
 ashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=vi
 noo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ha
 drien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=py
 a...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=jo
 rgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=hu
 axin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="M
 iller, Tim";X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="H
 ailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.com
RECURRENCE-ID;TZID=America/Los_Angeles:20221227T083000
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Canceled event: Parquet Sync @ Tue Oct 25, 2022 8:30am - 9:30am (PDT) (dev@parquet.apache.org)

2022-10-24 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20221025T083000
DTEND;TZID=America/Los_Angeles:20221025T093000
DTSTAMP:20221024T124951Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:jmumoits31chu3tdvrp4lsf...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ji
 ashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=vi
 noo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ha
 drien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=py
 a...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=jo
 rgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=hu
 axin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="M
 iller, Tim";X-NUM-GUESTS=0:mailto:theo...@amazon.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="H
 ailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.com
RECURRENCE-ID;TZID=America/Los_Angeles:20221025T083000
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Parquet Sync meeting - July 26 2022

2022-07-26 Thread Xinli shang
Attendees ( Gidon Gershinsky, Xinli Shang, Tim Miller)

   1.

   Release 1.12.3
   1.

  Post release - no issue reported.
  2.

   Parquet Cell-level encryption

  a. What if the user only partially has the keys but
not all the hidden columns? Should we throw an exception or filled out with
'null'?
  b. It needs more discussion and we can continue in
the design doc.

   1.

   Parquet-2069 : Fix some
   avro schema issue. Generally, Avro schema conversion is a problematic
   area and we need some risk control.
   2.

   Parquet-2126 :
   thread-safe compressor/decompressor. Close to merge but need some more
   thinking on the thread exit scenario.


-- 
Xinli Shang


Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Oct 27, 2021 to Tue May 24 (PDT) (dev@parquet.apache.org)

2022-04-27 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20211027T09
DTEND;TZID=America/Los_Angeles:20211027T10
RRULE:FREQ=MONTHLY;UNTIL=20220126T075959Z;BYDAY=4WE
DTSTAMP:20220427T171354Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvh...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
X-MICROSOFT-CDO-OWNERAPPTID:1838706738
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~
 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Oct 27, 2021 to Tue May 24 (PDT) (dev@parquet.apache.org)

2022-04-27 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20211027T09
DTEND;TZID=America/Los_Angeles:20211027T10
RRULE:FREQ=MONTHLY;UNTIL=20220126T075959Z;BYDAY=4WE
DTSTAMP:20220427T171347Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvh...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
X-MICROSOFT-CDO-OWNERAPPTID:1838706738
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~
 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Mar 23 to Tue May 24 (PDT) (dev@parquet.apache.org)

2022-04-27 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220323T09
DTEND;TZID=America/Los_Angeles:20220323T10
RRULE:FREQ=MONTHLY;UNTIL=20220525T065959Z;BYDAY=4WE
DTSTAMP:20220427T171347Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220323t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN="Hailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.com
X-MICROSOFT-CDO-OWNERAPPTID:-1064352485
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet

Updated invitation: Parquet Sync @ Monthly from 8:30am to 9:30am on the fourth Tuesday (PDT) (dev@parquet.apache.org)

2022-04-27 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220524T083000
DTEND;TZID=America/Los_Angeles:20220524T093000
RRULE:FREQ=MONTHLY;BYDAY=4TU
DTSTAMP:20220427T171346Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:jmumoits31chu3tdvrp4lsf...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TR
 UE;CN=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.
 com_53454131313931326e6441766530387468426c616b656c793756432d343836313237@re
 source.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszk
 y...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarleitao@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Hailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.co
 m
X-MICROSOFT-CDO-OWNERAPPTID:1954369700
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Mar 23 to Tue May 24 (PDT) (dev@parquet.apache.org)

2022-04-27 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220323T09
DTEND;TZID=America/Los_Angeles:20220323T10
RRULE:FREQ=MONTHLY;UNTIL=20220525T065959Z;BYDAY=4WE
DTSTAMP:20220427T171355Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220323t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN="Hailu, Andreas";X-NUM-GUESTS=0:mailto:andreas.ha...@ny.email.gs.com
X-MICROSOFT-CDO-OWNERAPPTID:-1064352485
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet

Parquet sync meeting notes 3/23/2022

2022-03-23 Thread Xinli shang
Attendee (Jorge from Munin Data),   Gidon, Huaxin, Vinoo, Xinli



   1.

   Cell level encryption
   1.

  Formal design
  

  is sent out
  2.

  We choose the 2nd option - splitting columns because it doesn’t need
  specification change
  3.

  Implementation is going on
  4.

  Create a feature branch for review
  2.

   Column resolution by ID (pr
   )
   1.

  The ‘field_id’ in the schema is used.
  2.

  Uniqueness might not guarantee to be used by column resolution with
  ID. We might need a place to remember a flag that this Parquet file is
  column id resolvable
  3.

  Concat tool might be a problem
  4.

  Need some help from Iceberg
  3.

   Parquet writer for Iceberg (Adding a new constructor)
   1.

  A diff will be sent out soon
  4.

   New website (link )
   1.

  Looks good, will make it formal


-- 
Xinli Shang
VP Apache Parquet PMC Chair, Tech Lead Manager at Uber Data Infra


Updated invitation: Parquet Sync @ Wed Apr 27, 2022 9am - 10am (PDT) (dev@parquet.apache.org)

2022-03-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220427T09
DTEND;TZID=America/Los_Angeles:20220427T10
DTSTAMP:20220322T224635Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220323t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
X-MICROSOFT-CDO-OWNERAPPTID:531906069
RECURRENCE-ID;TZID=America/Los_Angeles:20220427T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Feb 23 to Tue Mar 22 (PST) (dev@parquet.apache.org)

2022-03-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220223T09
DTEND;TZID=America/Los_Angeles:20220223T10
RRULE:FREQ=MONTHLY;UNTIL=20220323T065959Z;BYDAY=4WE
DTSTAMP:20220322T224636Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220223t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
X-MICROSOFT-CDO-OWNERAPPTID:-167094961
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by 

Updated invitation: Parquet Sync @ Wed Mar 23, 2022 9am - 10am (PDT) (dev@parquet.apache.org)

2022-03-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220323T09
DTEND;TZID=America/Los_Angeles:20220323T10
DTSTAMP:20220322T224635Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220323t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
X-MICROSOFT-CDO-OWNERAPPTID:1653225653
RECURRENCE-ID;TZID=America/Los_Angeles:20220323T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday (PDT) (dev@parquet.apache.org)

2022-03-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220323T09
DTEND;TZID=America/Los_Angeles:20220323T10
RRULE:FREQ=MONTHLY;BYDAY=4WE
DTSTAMP:20220322T224635Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220323t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.co
 m
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarlei...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=huaxin.ga...@gmail.com;X-NUM-GUESTS=0:mailto:huaxin.ga...@gmail.com
X-MICROSOFT-CDO-OWNERAPPTID:-1064352485
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975" id="ow12490" __is_owner="true">https://uber.zoom.u
 

Re: Meeting notes for Parquet sync meeting - March 1st. 2022

2022-03-11 Thread Xinli shang
We don't have a detailed plan/timeline yet but we are looking for it in the
next one or two months.

On Thu, Mar 10, 2022 at 4:36 PM Prakhar Jain 
wrote:

> Hi All
>   Thanks for sharing the meeting notes. Do we have a tentative timeline in
> mind for the new version of Parquet-MR? Also will it be a major/minor/or a
> patch release.
>
> Thanks and Regards
> Prakhar Jain
>
>
> On Tue, Mar 1, 2022 at 9:34 AM Xinli shang 
> wrote:
>
> > 3/1/2022
> >
> > Attendees: Xinli Shang, Gidon Gershinsky, Vinoo Ganesh
> >
> >1.
> >
> >The new website of Apache Parquet is to be launched
> >1.
> >
> >   https://www.vinoo.io/
> >   2.
> >
> >   Vinoo to  send out an email to dev@ for a preview
> >   2.
> >
> >Cell level encryption
> >1.
> >
> >   Objective/Goals need to be clear
> >   2.
> >
> >   Performance
> >   3.
> >
> >   Avoid changing specification
> >   3.
> >
> >Data masking
> >1.
> >
> >   The PR is to be ready to review soon.
> >   4.
> >
> >Release new version of Parquet
> >1.
> >
> >   Blocked on ID resolution change. Need to ping.
> >
> > --
> > Xinli Shang
> >
>


-- 
Xinli Shang


Re: Meeting notes for Parquet sync meeting - March 1st. 2022

2022-03-10 Thread Prakhar Jain
Hi All
  Thanks for sharing the meeting notes. Do we have a tentative timeline in
mind for the new version of Parquet-MR? Also will it be a major/minor/or a
patch release.

Thanks and Regards
Prakhar Jain


On Tue, Mar 1, 2022 at 9:34 AM Xinli shang  wrote:

> 3/1/2022
>
> Attendees: Xinli Shang, Gidon Gershinsky, Vinoo Ganesh
>
>1.
>
>The new website of Apache Parquet is to be launched
>1.
>
>   https://www.vinoo.io/
>   2.
>
>   Vinoo to  send out an email to dev@ for a preview
>   2.
>
>Cell level encryption
>1.
>
>   Objective/Goals need to be clear
>   2.
>
>   Performance
>   3.
>
>   Avoid changing specification
>   3.
>
>Data masking
>1.
>
>   The PR is to be ready to review soon.
>   4.
>
>Release new version of Parquet
>1.
>
>   Blocked on ID resolution change. Need to ping.
>
> --
> Xinli Shang
>


Meeting notes for Parquet sync meeting - March 1st. 2022

2022-03-01 Thread Xinli shang
3/1/2022

Attendees: Xinli Shang, Gidon Gershinsky, Vinoo Ganesh

   1.

   The new website of Apache Parquet is to be launched
   1.

  https://www.vinoo.io/
  2.

  Vinoo to  send out an email to dev@ for a preview
  2.

   Cell level encryption
   1.

  Objective/Goals need to be clear
  2.

  Performance
  3.

  Avoid changing specification
  3.

   Data masking
   1.

  The PR is to be ready to review soon.
  4.

   Release new version of Parquet
   1.

  Blocked on ID resolution change. Need to ping.

-- 
Xinli Shang


Updated invitation: Parquet Sync @ Tue Mar 1, 2022 9am - 10am (PST) (dev@parquet.apache.org)

2022-02-15 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220301T09
DTEND;TZID=America/Los_Angeles:20220301T10
DTSTAMP:20220215T210217Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220223t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TR
 UE;CN=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.
 com_53454131313931326e6441766530387468426c616b656c793756432d343836313237@re
 source.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszk
 y...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=hadrien.k...@sonat.no;X-NUM-GUESTS=0:mailto:hadrien.k...@sonat.no
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=py...@pinterest.com;X-NUM-GUESTS=0:mailto:py...@pinterest.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jorgecarlei...@gmail.com;X-NUM-GUESTS=0:mailto:jorgecarleitao@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
X-MICROSOFT-CDO-OWNERAPPTID:-606989481
RECURRENCE-ID;TZID=America/Los_Angeles:20220223T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meet
 ing.Join Zoom Meeting - password is requiredhttps://ub
 er.zoom.us/j/3523778975">https://uber.zoom.us/j/3523778975?pwd=anhscnBNbFpD
 aUprQkZ1T3RLRzBPQT09Meeting ID: 352 377 8975Password: 03011
 5One tap mobile+16699006833\,\,3523778975# US (San 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday from Wed Jan 26 to Tue Feb 22 (PST) (dev@parquet.apache.org)

2022-01-28 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220126T09
DTEND;TZID=America/Los_Angeles:20220126T10
RRULE:FREQ=MONTHLY;UNTIL=20220223T075959Z;BYDAY=4WE
DTSTAMP:20220128T221645Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220126t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
X-MICROSOFT-CDO-OWNERAPPTID:-1803251231
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 

Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Wednesday (PST) (dev@parquet.apache.org)

2022-01-28 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20220223T09
DTEND;TZID=America/Los_Angeles:20220223T10
RRULE:FREQ=MONTHLY;BYDAY=4WE
DTSTAMP:20220128T221645Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvhc9n_r20220223t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=chao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Wang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fo...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedossett@etsy
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Revin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=jiashenzz...@gmail.com;X-NUM-GUESTS=0:mailto:jiashenzz...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=vinoo.gan...@gmail.com;X-NUM-GUESTS=0:mailto:vinoo.gan...@gmail.com
X-MICROSOFT-CDO-OWNERAPPTID:-167094961
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India 

Re: Parquet sync meeting notes - 1/26/2022

2022-01-27 Thread Xinli shang
Here

is the link for the Cell-Level encryption pre-design. Feel free to share
the feedback in the file directly by adding comments.

On Wed, Jan 26, 2022 at 9:51 AM Xinli shang  wrote:

> 1/26/2022
>
> Attendees: Xinli Shang, Gidon Gershinsky, Pavi Subenderan, Jason Zhang
>
>1.
>
>Data masking
>1.
>
>   Pavi: Will create a PR by next week
>   2.
>
>   PARQUET-2062 
>   3.
>
>   Will have a high-level design sent out soon
>   2.
>
>Cell level encryption
>1.
>
>   Xinli: Will send out the draft design soon
>   2.
>
>   Key questions: Should we have the same key for all the cells in the
>   same column? It could generate millions of keys if we do it.
>   3.
>
>   There are two options explored: 1)Use FPE to encrypt in place, 2)
>   add extra columns to utilize existing modular encryption. Will have 
> them in
>   the design.
>   3.
>
>Release of 1.13.0
>1.
>
>   Data masking(null)
>   1.
>
>  PARQUET-2062 
>  will be done in a few weeks.
>  2.
>
>   ID resolution instead of name
>   1.
>
>  PARQUET-2006 ,
>  need to see if it needs specification change and the scope of the 
> change
>  and ETA. We will decide should we include it in 1.13.0.
>
>
>
> Xinli Shang
> Apache Parquet PMC Chair
> Teach Lead Manager at Uber Data Infra
>
>
>

-- 
Xinli Shang


Parquet sync meeting notes - 1/26/2022

2022-01-26 Thread Xinli shang
1/26/2022

Attendees: Xinli Shang, Gidon Gershinsky, Pavi Subenderan, Jason Zhang

   1.

   Data masking
   1.

  Pavi: Will create a PR by next week
  2.

  PARQUET-2062 
  3.

  Will have a high-level design sent out soon
  2.

   Cell level encryption
   1.

  Xinli: Will send out the draft design soon
  2.

  Key questions: Should we have the same key for all the cells in the
  same column? It could generate millions of keys if we do it.
  3.

  There are two options explored: 1)Use FPE to encrypt in place, 2) add
  extra columns to utilize existing modular encryption. Will have
them in the
  design.
  3.

   Release of 1.13.0
   1.

  Data masking(null)
  1.

 PARQUET-2062 
 will be done in a few weeks.
 2.

  ID resolution instead of name
  1.

 PARQUET-2006 ,
 need to see if it needs specification change and the scope of
the change
 and ETA. We will decide should we include it in 1.13.0.



Xinli Shang
Apache Parquet PMC Chair
Teach Lead Manager at Uber Data Infra


Canceled event: Parquet Sync @ Wed Dec 22, 2021 9am - 10am (PST) (dev@parquet.apache.org)

2021-12-17 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20211222T09
DTEND;TZID=America/Los_Angeles:20211222T10
DTSTAMP:20211216T173314Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvh...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
RECURRENCE-ID;TZID=America/Los_Angeles:20211222T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975
LAST-MODIFIED:20211216T173313Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:3
STATUS:CANCELLED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Reminder of tomorrow's Parquet sync meeting

2021-11-23 Thread Xinli shang
Hi Everybody,

Just a kind reminder of tomorrow's Parquet sync meeting at 9:00am PST. The
meeting ID & password are as below.

https://uber.zoom.us/j/3523778975
<https://www.google.com/url?q=https://uber.zoom.us/j/3523778975=D=calendar=1638125393411984=AOvVaw1ZF0a6aN7FaY8VyDvI_GmU>

Meeting ID: 352 377 8975
Password: 030115

-- 
Xinli Shang


Canceled event with note: Parquet Sync @ Wed Oct 27, 2021 9am - 10am (PDT) (dev@parquet.apache.org)

2021-10-25 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20211027T09
DTEND;TZID=America/Los_Angeles:20211027T10
DTSTAMP:20211023T133627Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:tvfaq819qc81p0ljk2jkpvh...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
RECURRENCE-ID;TZID=America/Los_Angeles:20211027T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975
LAST-MODIFIED:20211023T133626Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:3
STATUS:CANCELLED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Meeting notes of parquet-sync 9/28/2021

2021-09-28 Thread Xinli shang
9/27/2021

Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky

   1.

   1.12.1 release
   1.

  Done
  2.

   PARQUET-2094
   1.

  Done
  3.

   FilterAPI
   1.

  Will be done soon.
  4.

   High throughput column encryption rewriter
   1.

  The review is almost done
  5.

   1.13.0 tasks
   1.

  ID resolution instead of name
  1.

 PARQUET-2006 ,
 will ping
 2.

  FilterAPI (PR in review)
  1.

 Review is in progress
 3.

  Data masking(null)
  1.

 PARQUET-2062 
 will be done by Pavi from Uber
 4.

  Uniform file encryption
  1.

 Gidon will send out PR
 5.

  Column Encryption rewriter
  1.

 The review is almost done
 6.

  Rewriter versions
  1.

 Xinli will work on this


--
Xinli Shang | Tech Leam Manager @ Uber Data Infra


Parquet sync meeting notes - Aug 2021

2021-08-24 Thread Xinli shang
8/24/2021


Attendees: Xinli Shang, Gábor Szádovszky, Huaxin Gao


   1.

   FilterAPI PR
   1.

  Will be reviewed soon.
  2.

  It will be in a minor release
  2.

   High throughput column encryption rewriter
   1.

  PR to be created  (tests are done and look promising - 20x faster)
  3.

   Old PRs
   1.

  If opened in 1 year, work with the author to rebase and merge if
  possible.
  2.

  If opened 1 year earlier, simply close and notify the author to
  reopen if needed.
  4.

   1.12.1 release
   1.

  We should plan to release 1.13.0 soon. Hence Parquet 1.12.1 might not
  be needed.
  5.

   1.13.0 planning
   1.

  ID resolution instead of name
  2.

  FilterAPI (PR in review)
  3.

  Data masking(null)
  4.

  Unified file encryption
  5.

  Column Encryption rewriter


-- 
Xinli Shang, Tech Lead Manager @ Uber Data Infra


Reminder for Parquet sync meeting tomorrow

2021-08-23 Thread Xinli shang
Hi all,

This is a kindly reminder for the Parquet sync meeting tomorrow. The zoom
link and password are as below.

Join Zoom Meeting - password is required
https://uber.zoom.us/j/3523778975
<https://www.google.com/url?q=https://uber.zoom.us/j/3523778975=D=calendar=1629992100686277=AOvVaw0yiaKJK3mhLz4zsbOmvfrQ>

Meeting ID: 352 377 8975
Password: 030115

-- 
Xinli Shang


Canceled event with note: Parquet Sync @ Tue Jun 22, 2021 9am - 10am (PDT) (dev@parquet.apache.org)

2021-06-15 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20210622T09
DTEND;TZID=America/Los_Angeles:20210622T10
DTSTAMP:20210615T180135Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20210223t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=al
 tekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ch
 ao.apa...@gmail.com;X-NUM-GUESTS=0:mailto:chao.apa...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="W
 ang, Yuming";X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=fo
 k...@driesprongen.nl;X-NUM-GUESTS=0:mailto:fo...@driesprongen.nl
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 iskodedoss...@etsy.com;X-NUM-GUESTS=0:mailto:aniskodedoss...@etsy.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Br
 ian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Re
 vin Chalil;X-NUM-GUESTS=0:mailto:revin.cha...@microsoft.com
RECURRENCE-ID;TZID=America/Los_Angeles:20210622T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975
LAST-MODIFIED:20210615T180133Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:2
STATUS:CANCELLED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Re: Parquet sync meeting May 2021

2021-05-25 Thread Micah Kornfield
>
>  Iceberg filtering / V2 api
>   3.
>   Adopt Arrow as data model


Curious if more notes, or discussion around the two points above will
happen on the mailing list?  Or are there relevant JIRAs?

Thanks,
Micah



On Tue, May 25, 2021 at 9:45 AM Xinli shang  wrote:

> 5/25/2021
>
> Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky
>
>1.
>
>Parquet 1.12.0 post release issues:
>1.
>
>   Release 1.12.1? Let's wait a bit since the testing and integration is
>   still going on. Better to have more fixes for the release.
>   2.
>
>   Two integer overflow issues are being reviewed.
>   2.
>
>INT96 issue (Parquet-2037) - fixed and merged
>3.
>
>1.13.0 planning ideas brainstorming
>1.
>
>   ID resolution instead of name
>   2.
>
>   Iceberg filtering / V2 api
>   3.
>
>   Adopt Arrow as data model
>   4.
>
>   Vectorization API
>   5.
>
>   Unified file encryption
>   6.
>
>   Data masking(null)
>
>
> --
> Xinli Shang, Tech Lead Manager at Uber Data Infra
>


Parquet sync meeting May 2021

2021-05-25 Thread Xinli shang
5/25/2021

Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky

   1.

   Parquet 1.12.0 post release issues:
   1.

  Release 1.12.1? Let's wait a bit since the testing and integration is
  still going on. Better to have more fixes for the release.
  2.

  Two integer overflow issues are being reviewed.
  2.

   INT96 issue (Parquet-2037) - fixed and merged
   3.

   1.13.0 planning ideas brainstorming
   1.

  ID resolution instead of name
  2.

  Iceberg filtering / V2 api
  3.

  Adopt Arrow as data model
  4.

  Vectorization API
  5.

  Unified file encryption
  6.

  Data masking(null)


-- 
Xinli Shang, Tech Lead Manager at Uber Data Infra


Parquet Sync

2021-05-24 Thread shangx
This is a reminder for tomorrow's Parquet sync meeting at 9:00 am PDT. The  
Zoom meeting information is as below. Join Zoom Meeting - password is  
required https://uber.zoom.us/j/3523778975 Meeting ID: 352 377 8975  
Password: 030115


Title: Parquet Sync
Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting -  
password is requiredhttps://uber.zoom.us/j/3523778975Meeting ID: 352 377  
8975Password: 030115One tap mobile+16699006833,,3523778975# US (San  
Jose)+16468769923,,3523778975# US (New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)877 369 0926  
US Toll-free855 880 1246 US  
Toll-freeMeeting ID: 352 377 8975Find your local number:  
https://uber.zoom.us/u/aZKZunOZ9Join by SIP3523778975@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India Mumbai)115.114.115.7 (India  
Hyderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110  
(Hong Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)207.226.132.110  
(Japan)Meeting ID: 352 377 8975

When: Tue May 25, 2021 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/3523778975
Who:
* sha...@uber.com - organizer
* Matthew Turner
* wesmck...@gmail.com
* gabor.szadovs...@cloudera.com
* gg5...@gmail.com
* gwali...@gmail.com
* emkornfi...@gmail.com
* Lekshmi Narayanan, Arun Balajiee
* altekruseja...@gmail.com
* Ryan Blue
* chao.apa...@gmail.com
* Wang, Yuming
* Fokko Driesprong
* aniskodedoss...@etsy.com
* dev@parquet.apache.org
* Robert Kruszewski
* Ivan Gavryliuk
* Revin Chalil


Parquet sync meeting notes - April 2021

2021-04-27 Thread Xinli shang
4/27/2021

Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky, Xin Dong, Ryan
Blue, Q. Xie

   1.

   Parquet 1.12.0 post release issues:
   1.

  Parquet-2027 - Page offset issue. Fixed.
  2.

  Parquet-2026 - Not allowing empty file anymore
  1.

 What are the data of empty file looks like?
 1.

They are 0 rows files.
2.

 What are they used?
 1.

 In some cases, they could be used as a placeholder.
3.

 The previous release didn’t make it clear as a supported feature.
 If we allow this in the future, we should document this.
Gabor will chat
 with the owner if they can fix and contribute.
 2.

   INT-96 issue: Is it possible to fix it? For the read path, we already
   have a configuration. So far it seems not easy for us to fix as it could
   introduce several issues.
   1.

  Gabor will open a Jira ticket and investigate a little more to get a
  sense of how complex and how risky it is. Once we have that
information, we
  can discuss it next time.
  3.

   Provider-aware compression codec - PARQUET-1886
   1.

  If we can make it independent of Hadoop API, it could be better.
  Let’s have a design for that. Make it configurable instead of implicitly
  looking up because that could introduce runtime error.
  4.

   Iceberg related discussion
   1.

  Testing is going on with Iceberg for Parquet 1.12.0.
  5.

   Null data masking
   1.

  Null masking implemented in Parquet and it doesn't need to re-write
  the data. It can be contributed to open source.


---
Xinli Shang | Tech Lead Manager in Uber Data Infra


Parquet Sync

2021-04-26 Thread shangx
This is a quick reminder for tomorrow's Parquet Sync meeting 9:00AM-10:00AM  
PDT. Join Zoom Meeting - password is required  
https://uber.zoom.us/j/3523778975 Meeting ID: 352 377 8975 Password: 030115  
One tap mobile +16699006833,,3523778975# US (San Jose)  
+16468769923,,3523778975# US (New York) Dial by your location +1 669 900  
6833 US (San Jose) +1 646 876 9923 US (New York) 877 369 0926 US Toll-free  
855 880 1246 US Toll-free Meeting ID: 352 377 8975 Find your local number:  
https://uber.zoom.us/u/aZKZunOZ9 Join by SIP 3523778...@zoomcrc.com Join by  
H.323 162.255.37.11 (US West) 162.255.36.11 (US East) 221.122.88.195  
(China) 115.114.131.7 (India Mumbai) 115.114.115.7 (India Hyderabad)  
213.19.144.110 (EMEA) 103.122.166.55 (Australia) 209.9.211.110 (Hong Kong)  
64.211.144.160 (Brazil) 69.174.57.160 (Canada) 207.226.132.110 (Japan)  
Meeting ID: 352 377 8975


Title: Parquet Sync
Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting -  
password is requiredhttps://uber.zoom.us/j/3523778975Meeting ID: 352 377  
8975Password: 030115One tap mobile+16699006833,,3523778975# US (San  
Jose)+16468769923,,3523778975# US (New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)877 369 0926  
US Toll-free855 880 1246 US  
Toll-freeMeeting ID: 352 377 8975Find your local number:  
https://uber.zoom.us/u/aZKZunOZ9Join by SIP3523778975@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India Mumbai)115.114.115.7 (India  
Hyderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110  
(Hong Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)207.226.132.110  
(Japan)Meeting ID: 352 377 8975

When: Tue Apr 27, 2021 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/3523778975, SEA | 1191 2nd Ave-8th-Blakely  
(7) [Zoom]

Who:
* sha...@uber.com - organizer
* Matthew Turner
* wesmck...@gmail.com
* gabor.szadovs...@cloudera.com
* gg5...@gmail.com
* gwali...@gmail.com
* emkornfi...@gmail.com
* Lekshmi Narayanan, Arun Balajiee
* altekruseja...@gmail.com
* Ryan Blue
* chao.apa...@gmail.com
* Wang, Yuming
* Fokko Driesprong
* aniskodedoss...@etsy.com
* dev@parquet.apache.org
* Robert Kruszewski
* Ivan Gavryliuk
* Revin Chalil


Reminder for today's Parquet sync meeting 9:00am PDT

2021-03-23 Thread Xinli shang
Hi all,

This is the meeting information below.

https://uber.zoom.us/j/3523778975 password is required

Meeting ID: 352 377 8975

Password: 030115

-- 
Xinli Shang


Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Tuesday (PST) (dev@parquet.apache.org)

2021-02-01 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20210223T09
DTEND;TZID=America/Los_Angeles:20210223T10
RRULE:FREQ=MONTHLY;BYDAY=4TU
DTSTAMP:20210201T174437Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20210223t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.ed
 u
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
X-MICROSOFT-CDO-OWNERAPPTID:-488130593
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~
 :~:~:~:~:~:~:~::~:~::-\nPlease do not edit this section of the description.
 \n\nView your event at https://calendar.google.com/calendar/event?action=VI
 EW=MW1zbGlka2g4ZWR0aW9ydmhlbHZ0dXNscDhfUjIwMjEwMjIzVDE3MDAwMCBkZXZAcGFy
 cXVldC5hcGFjaGUub3Jn=MTUjc2hhbmd4QHViZXIuY29tNWViMDc4NTgwNDE2YTViYzkzOG
 U0NzVhMmJiZjgzZjU4ZDBhYjc4NA=America%2FLos_Angeles=en=0.\n-::~:~:
 :~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~
 :~::-
LAST-MODIFIED:20210201T174435Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:1
STATUS:CONFIRMED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Updated invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Tuesday from Tue Jan 26 to Mon Feb 22 (PST) (dev@parquet.apache.org)

2021-02-01 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20210126T09
DTEND;TZID=America/Los_Angeles:20210126T10
RRULE:FREQ=MONTHLY;UNTIL=20210223T075959Z;BYDAY=4TU
DTSTAMP:20210201T174437Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20210126t170...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.ed
 u
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekruseja...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
X-MICROSOFT-CDO-OWNERAPPTID:-432234048
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~
 :~:~:~:~:~:~:~::~:~::-\nPlease do not edit this section of the description.
 \n\nView your event at https://calendar.google.com/calendar/event?action=VI
 EW=MW1zbGlka2g4ZWR0aW9ydmhlbHZ0dXNscDhfUjIwMjEwMTI2VDE3MDAwMCBkZXZAcGFy
 cXVldC5hcGFjaGUub3Jn=MTUjc2hhbmd4QHViZXIuY29tZGZmZTZlYTJlMGNkOTY5NDc1ND
 g4NjBlYmM2NTg5ZTJiNGI2YWRhYQ=America%2FLos_Angeles=en=0.\n-::~:~:
 :~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~
 :~::-
LAST-MODIFIED:20210201T174435Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:1
STATUS:CONFIRMED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Parquet sync meeting notes Jan 26, 2021

2021-01-26 Thread Xinli shang
Hi all,

Attendees: Xinli Shang, Gábor Szádovszky, Gidon Gershinsky, Jason
Alterkruse


Topics:

   1.

   Parquet column encryption
   1.

  The ported code in Presto will be open-sourced soon.
  2.

  Crypto factory could be changed when new use cases come in(Gidon).
  2.

   Parquet-mr 1.12.0 release
   1.

  The higher version of Avro only has unit test diff. We should go
  ahead to release.
  2.

  Check with Spark community for the Spark Avro issue - Xinli
  3.

  There are still a lot of open PRs. We want owners to indicate should
  those PRs be included in 1.12.0.
  4.

  Will issue an RC0 release soon - Gabor
  3.

   Core features definition
   1.

  Send emails to all PMCs - Gabor
  4.

   Deprecation of summary files
   1.

  There is a discussion in the Iceberg community for summary files.
  Those files could be still useful in some cases (Jason).
  2.

  At least in Parquet 1.12.0, we will leave it as is while the
  discussion is still going on. Maybe we can add a switch to turn
it on/off.


Please let me know if you have any questions.

Xinli Shang | Tech Lead Manager @ Uber Data Infra


Re: Parquet sync meeting 11/24/2020

2020-11-24 Thread Gidon Gershinsky
Thanks Xinli,

A slight correction re 2.1: The recent improvements / pull requests are in
the Java version, parquet-mr. But the ideas for some of them indeed came
from our work with the Arrow teams, that develop a C++ version of parquet
modular encryption.

Cheers, Gidon


On Tue, Nov 24, 2020 at 8:46 PM Xinli shang  wrote:

> 11/24/2020
>
> Hi all,
>
> Attendees:
>
>1.
>
>To solve Parquet upgrading with Avro version issue, should we release
>Parquet Avro with a separate release?
>1.
>
>   For uprading Avro from1.8 to 1.9, Parquet only have unit test change
>   and parquet-cli and user can excluce avro from Parquet
>   2.
>
>   The long-term still benefits if we can separate but it is not easy,
>   for now, it is not required.
>   2.
>
>Column Encryption
>1.
>
>   C++ version has several PRs (improvements) recently.
>   3.
>
>Data masking
>
>
>1.
>
>Some upper layer can develop their own data masking easily.
>2.
>
>We might think about some simple tools other than executing them in
>Parquet.
>3.
>
>Developed null data masking in Parquet and it works now. Open a Google
>doc and we can discuss from there.
>
>
>1.
>
>Parquet 1.11.x adoption to Presto
>1.
>
>   PR  is created but it
>   has a unit test failure.
>   2.
>
>Parquet 1.11.x feature adoption to Iceberg
>1.
>
>   Iceberg meeting notes
>   <
> https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit#
> >
>   for discussing this issue.
>   2.
>
>   Issue summary and proposals
>   <
> https://docs.google.com/document/d/1f8erGSnhVcdD0UokGx2opjmGvCU69g7fsiPXCJhP3MA/edit#
> >
>
>   3.
>
>   For having Parquet V2 API to support Iceberg, if we do that, then
>   makes sense to have vectorized API with Parquet V2 API. Let’s bring
> other
>   PMS/commuters to discuss for the next community meeting.
>   3.
>
>Parquet 1.12.0
>
> a. Will cut RC release soon
>
> Please let me know if you have any questions.
>
> Xinli Shang | Tech Lead Manager @ Uber Data Infra
>
>
> --
> Xinli Shang
>


Re: Parquet sync meeting 11/24/2020

2020-11-24 Thread Ryan Blue
Sorry I wasn't able to make it to the sync today. I should be able to make
it to the next one and we can talk about getting some of Iceberg's changes
upstream.

On Tue, Nov 24, 2020 at 10:46 AM Xinli shang 
wrote:

> 11/24/2020
>
> Hi all,
>
> Attendees:
>
>1.
>
>To solve Parquet upgrading with Avro version issue, should we release
>Parquet Avro with a separate release?
>1.
>
>   For uprading Avro from1.8 to 1.9, Parquet only have unit test change
>   and parquet-cli and user can excluce avro from Parquet
>   2.
>
>   The long-term still benefits if we can separate but it is not easy,
>   for now, it is not required.
>   2.
>
>Column Encryption
>1.
>
>   C++ version has several PRs (improvements) recently.
>   3.
>
>Data masking
>
>
>1.
>
>Some upper layer can develop their own data masking easily.
>2.
>
>We might think about some simple tools other than executing them in
>Parquet.
>3.
>
>Developed null data masking in Parquet and it works now. Open a Google
>doc and we can discuss from there.
>
>
>1.
>
>Parquet 1.11.x adoption to Presto
>1.
>
>   PR  is created but it
>   has a unit test failure.
>   2.
>
>Parquet 1.11.x feature adoption to Iceberg
>1.
>
>   Iceberg meeting notes
>   <
> https://docs.google.com/document/d/1YuGhUdukLP5gGiqCbk0A5_Wifqe2CZWgOd3TbhY3UQg/edit#
> >
>   for discussing this issue.
>   2.
>
>   Issue summary and proposals
>   <
> https://docs.google.com/document/d/1f8erGSnhVcdD0UokGx2opjmGvCU69g7fsiPXCJhP3MA/edit#
> >
>
>   3.
>
>   For having Parquet V2 API to support Iceberg, if we do that, then
>   makes sense to have vectorized API with Parquet V2 API. Let’s bring
> other
>   PMS/commuters to discuss for the next community meeting.
>   3.
>
>Parquet 1.12.0
>
> a. Will cut RC release soon
>
> Please let me know if you have any questions.
>
> Xinli Shang | Tech Lead Manager @ Uber Data Infra
>
>
> --
> Xinli Shang
>


-- 
Ryan Blue
Software Engineer
Netflix


Parquet sync meeting 11/24/2020

2020-11-24 Thread Xinli shang
11/24/2020

Hi all,

Attendees:

   1.

   To solve Parquet upgrading with Avro version issue, should we release
   Parquet Avro with a separate release?
   1.

  For uprading Avro from1.8 to 1.9, Parquet only have unit test change
  and parquet-cli and user can excluce avro from Parquet
  2.

  The long-term still benefits if we can separate but it is not easy,
  for now, it is not required.
  2.

   Column Encryption
   1.

  C++ version has several PRs (improvements) recently.
  3.

   Data masking


   1.

   Some upper layer can develop their own data masking easily.
   2.

   We might think about some simple tools other than executing them in
   Parquet.
   3.

   Developed null data masking in Parquet and it works now. Open a Google
   doc and we can discuss from there.


   1.

   Parquet 1.11.x adoption to Presto
   1.

  PR  is created but it
  has a unit test failure.
  2.

   Parquet 1.11.x feature adoption to Iceberg
   1.

  Iceberg meeting notes
  

  for discussing this issue.
  2.

  Issue summary and proposals
  


  3.

  For having Parquet V2 API to support Iceberg, if we do that, then
  makes sense to have vectorized API with Parquet V2 API. Let’s bring other
  PMS/commuters to discuss for the next community meeting.
  3.

   Parquet 1.12.0

a. Will cut RC release soon

Please let me know if you have any questions.

Xinli Shang | Tech Lead Manager @ Uber Data Infra


-- 
Xinli Shang


Parquet sync meeting notes - Oct 2020

2020-10-27 Thread Xinli shang
10/27/2020


Hi all,


Attendees:  Michael, Gidon, Gabor, Xinli, Cao Sun

   1.

   Column Encryption
   1.

  Parquet-1396 is approved and will be merged.
  2.

  So far, all the planned changes around column encryption are done!
  3.

  Data masking
  1.

 Set up a call with Sri and Gidon for it.
 2.

 PR  for replacing
 the column with null is in the review.
 2.

   Questions around Parquet v1 and v2
   1.

  Encoding is not bounded to v1 or v2
  2.

  Not clear on v2 roadmap
  3.

  Documentation of v1 and v2 - Owner: Michael
  4.

  Discussion for retiring of V2
  3.

   Parquet 1.11.x adoption to Presto
   1.

  PR  is created but it
  has a unit test failure
  4.

   Parquet 1.11.x adoption to Iceberg
   1.

  Upgraded to 1.11.1 now
  2.

  Integrating the Column Index feature to it. See some issues and Xinli
  is working on it.
  5.

   Parquet 1.11.x adoption to Spark
   1.

  Parquet 1.11.x introduced a new version(1.9) of Avro which removed
  some APIs. It breaks the upgrading.
  2.

  Solutions - Fix Avro in Hive
  1.

 Upgrade to 1.9, attempted but introduced a lot of issues.
 2.

 Replace deprecated API call in Hive with a new API. Hive remains
 1.8 of Avro. This has to be in Hive 2.3 and upgrade Avro from
1.7 to 1.8 of
 Avro.
 3.

  Tracking ticket
  1.

 https://issues.apache.org/jira/browse/SPARK-27733
 2.

 https://issues.apache.org/jira/browse/SPARK-26346
 6.

   Parquet 1.12.0
   1.

  Some companies want to adopt column encryption which is only
  available in Parquet 12.
  2.

  Parquet 1.12.0 will be on Avro 1.10. Need to know if this is a
  problem. Chao will try it out.


Please let me know if you have any questions.


Xinli Shang | Tech Lead Manager @ Uber Data Infra


Parquet sync meeting notes - 9/22/2020

2020-09-22 Thread Xinli shang
9/22/2020

Hi all,

Attendees:  Ashish Singh, Julien, Gidon, Gabor, Xinli

   1.

   Column Encryption
   1.

  PRs are all merged.
  2.

  Data masking
  1.

 This feature should have top-down approach starting from service.
 Maybe we can start with parquet-tool.
 2.

 Reducing the storage overhead for data masking - There are some
 thinkings about different compressions and tools.
 3.

 Testing: Write more tests and test with real data usually are good
 approaches. Maybe we can ask some 3rd parties that don’t know
this feature
 to have test by looking at the specification. Another way is to have
 interoperability tests between C++ and Java implementation.
Gidon has done
 some in his work. It would be great if we have automation for
it to test
 more.
 2.

   Parquet 12 release
   1.

  Created Jira ticket to release.
  2.

  Concern for the adoption of Parquet 1.11.0 because of Avro
version. Action
  Item(Owner: Xinli) - Bring in people dealing with this upgrade effort
  to the next meeting to discuss the next step.
  3.

   Parquet-313: Implement 3 level ist.
   1.

  This is a good initiative. It is a little hard for current committers
  to review because we don’t use that or don’t have knowledge of
that. Check
  if somebody from Twitter can help with the review & verification. Action
  Item(Owner: Julie) Julie will try to find someone.
  2.

  Use a flag in the code to make it optional to reduce the risk.


Please let me know if you have any questions.

Xinli Shang | Tech Lead Manager @ Uber Data Infra


-- 
Xinli Shang


Updated invitation with note: Parquet Sync @ Tue Sep 22, 2020 9:30am - 10:30am (PDT) (dev@parquet.apache.org)

2020-09-14 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20200922T093000
DTEND;TZID=America/Los_Angeles:20200922T103000
DTSTAMP:20200914T223130Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20200526t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TR
 UE;CN=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.
 com_53454131313931326e6441766530387468426c616b656c793756432d343836313237@re
 source.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszk
 y...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl122@pit
 t.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ivan Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
X-MICROSOFT-CDO-OWNERAPPTID:-149198596
RECURRENCE-ID;TZID=America/Los_Angeles:20200922T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975">https://uber.zoom.us/j/3523778975Meeting ID: 352 
 377 8975Password: 030115One tap mobile+16699006833\,\,35237
 78975# US (San Jose)+16468769923\,\,3523778975# US (New York)Di
 al by your location\;\;\;\;\;\;\;
 sp\;+1 669 900 6833 US (San Jose)\;\;\;\;\;
 sp\;\;\;+1 646 876 9923 US (New York)\;\;\;
 sp\;\;\;\;\;877 369 0926 US Toll-free\;\;
 \;\;\;\;\;\;855 880 1246 US Toll-freeMeet
 ing ID: 352 377 8975Find your local number: https://uber.zoom.
 us/u/aZKZunOZ9">https://uber.zoom.us/u/aZKZunOZ9Join by SIP
 3523778...@zoomcrc.comJ
 oin by H.323162.255.37.11 (US West)162.255.36.11 (US East)221.1
 22.88.195 (China)115.114.131.7 (India Mumbai)115.114.115.7 (India H
 yderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.2
 11.110 (Hong Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)
 207.226.132.110 (Japan)Meeting ID: 352 377 8975\n\n-::~:~::~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-\nPlease
  do not edit this section of the description.\n\nView your event at https:/
 /www.google.com/calendar/event?action=VIEW=MW1zbGlka2g4ZWR0aW9ydmhlbHZ0
 dXNscDhfMjAyMDA5MjJUMTYwMDAwWiBkZXZAcGFycXVldC5hcGFjaGUub3Jn=MTUjc2hhbm
 d4QHViZXIuY29tZWYyZmMzOGQ5MGNiNDYxNGFkZTlkNzk5NjRhOWM3YjI5YTk2OTFkMA=Am
 erica%2FLos_Angeles=en=0.\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-
LAST-MODIFIED:20200914T223127Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:2
STATUS:CONFIRMED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Canceled event: Parquet Sync @ Tue Aug 25, 2020 9am - 10am (PDT) (dev@parquet.apache.org)

2020-08-18 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20200825T09
DTEND;TZID=America/Los_Angeles:20200825T10
DTSTAMP:20200818T140318Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20200526t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=SEA 
 | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_534541
 31313931326e6441766530387468426c616b656c793756432d343836313...@resource.cal
 endar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;CN=shangx
 @uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ma
 tthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ga
 bor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gw
 ali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=em
 kornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="L
 ekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ro
 bert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Iv
 an Gavryliuk;X-NUM-GUESTS=0:mailto:i...@isolineltd.com
RECURRENCE-ID;TZID=America/Los_Angeles:20200825T09
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting - password is requiredhttps://uber.zoom.us/
 j/3523778975" id="ow4314" __is_owner="true">https://uber.zoom.us/j/35237789
 75Meeting ID: 352 377 8975Password: 030115One tap m
 obile+16699006833\,\,3523778975# US (San Jose)+16468769923\,\,35237
 78975# US (New York)Dial by your location\;\;\;&
 nbsp\;\;\;\;\;+1 669 900 6833 US (San Jose)\;&
 nbsp\;\;\;\;\;\;\;+1 646 876 9923 US (New Yor
 k)\;\;\;\;\;\;\;\;877 369 0926 
 US Toll-free\;\;\;\;\;\;\;\;855
  880 1246 US Toll-freeMeeting ID: 352 377 8975Find your local numbe
 r: https://uber.zoom.us/u/aZKZunOZ9;>https://uber.zoom.us/u/aZKZun
 OZ9Join by SIP35237
 78...@zoomcrc.comJoin by H.323162.255.37.11 (US West)16
 2.255.36.11 (US East)221.122.88.195 (China)115.114.131.7 (India Mum
 bai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122
 .166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)
 69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID: 352 37
 7 8975
LAST-MODIFIED:20200818T140315Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:2
STATUS:CANCELLED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Parquet Sync

2020-08-15 Thread shangx
I will be OOO on Aug 25. If somebody can host it this time, please let me  
know. Otherwise, we can skip it.


Title: Parquet Sync
Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting -  
password is requiredhttps://uber.zoom.us/j/3523778975Meeting ID: 352 377  
8975Password: 030115One tap mobile+16699006833,,3523778975# US (San  
Jose)+16468769923,,3523778975# US (New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)877 369 0926  
US Toll-free855 880 1246 US  
Toll-freeMeeting ID: 352 377 8975Find your local number:  
https://uber.zoom.us/u/aZKZunOZ9Join by SIP3523778975@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India Mumbai)115.114.115.7 (India  
Hyderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110  
(Hong Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)207.226.132.110  
(Japan)Meeting ID: 352 377 8975

When: Tue Aug 25, 2020 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/3523778975, SEA | 1191 2nd Ave-8th-Blakely  
(7) [Zoom]

Who:
* sha...@uber.com - organizer
* Matthew Turner
* wesmck...@gmail.com
* gabor.szadovs...@cloudera.com
* gg5...@gmail.com
* gwali...@gmail.com
* emkornfi...@gmail.com
* dev@parquet.apache.org
* Lekshmi Narayanan, Arun Balajiee
* Robert Kruszewski
* Ivan Gavryliuk


Meeting notes for Parquet sync (July 2020)

2020-07-28 Thread Xinli shang
Attendees: Gidon, Gabor, Fokko, Xu, Sri, Xinli



   1.

   Column Encryption
   1.

  PR 800  - This is to
  merge to master and it is being reviewed.
  1.

 One comment is about CRC. Since the encryption algorithm AES-GCM
 already has an integration check, doing CRC is redundant.
 2.

 The behavior “CRC is enabled by default in writing path” will not
 be changed even when AES-GCM is used. This is because CRC calculation
 overhead is very small according to our earlier tests, and changing
 behavior may break something.
 2.

  The PR  for
  Parquet-1396 will be moved to the master branch after PR 800
   is done.
  2.

   Parquet 1.11.1 release.
   1.

  Additional fix(Parquet-1684
  ) to be added?
  The conclusion is no after the discussion. This is not a regression in
  Parquet11 and the change itself is not low risk.
  2.

  Rolling out the Spark is still blocked. But downgrading the Avro
  version in Parquet is not an option.
  3.

   Parquet 12 release
   1.

  After encryption is done, Gabor will create a Jira to start the
  process.
  4.

   Proposal for CompressionCodec Provider-aware Compression Codec (doc
   

   )
   1.

  PR-803  need to be
  reviewed
  5.

   Data masking
   1.

  After column encryption is done in master, we(Xinli, Gidon, and Sri)
  will start the conversation.


Please let me know if you have any questions.

---

Xinli | Uber Data Infra Team


Parquet Sync

2020-07-27 Thread shangx
This is a kindly reminder of tomorrow's meeting and that the meeting ID and  
password can be found below. Join Zoom Meeting - password is required  
https://uber.zoom.us/j/3523778975 Meeting ID: 352 377 8975 Password: 030115  
Xinli Shang | Uber Data Infra Team


Title: Parquet Sync
Xinli shang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting -  
password is requiredhttps://uber.zoom.us/j/3523778975Meeting ID: 352 377  
8975Password: 030115One tap mobile+16699006833,,3523778975# US (San  
Jose)+16468769923,,3523778975# US (New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)877 369 0926  
US Toll-free855 880 1246 US  
Toll-freeMeeting ID: 352 377 8975Find your local number:  
https://uber.zoom.us/u/aZKZunOZ9Join by SIP3523778975@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India Mumbai)115.114.115.7 (India  
Hyderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110  
(Hong Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)207.226.132.110  
(Japan)Meeting ID: 352 377 8975

When: Tue Jul 28, 2020 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/3523778975, SEA | 1191 2nd Ave-8th-Blakely  
(7) [Zoom]

Who:
* sha...@uber.com - organizer
* Matthew Turner
* wesmck...@gmail.com
* gabor.szadovs...@cloudera.com
* gg5...@gmail.com
* gwali...@gmail.com
* emkornfi...@gmail.com
* dev@parquet.apache.org
* Lekshmi Narayanan, Arun Balajiee
* Robert Kruszewski
* Ivan Gavryliuk


Parquet sync meeting notes

2020-06-23 Thread Xinli shang
Hi all,

Attendees: Gidon, Gabor, Julien, Xu, Xinli


Topics:


   1.

   Proposal for CompressionCodec Provider-aware Compression Codec (doc
   

   )
   1.

  Concern: open the door for compatibility issue
  2.

  Mitigation: We need to think about how to test it, fall back to
  standard implementation, provide enough information in metadata
like vendor
  name, version etc.


   1.

   Column Encryption
   1.

  782  is merged
  2.

  615  will be done soo
  2.

   Unifying Vectorization API


   1.

   Discussed 2-3 years ago. There will be a lot of work. But somebody can
   drive it, we still encourage it.


   1.

   Parquet 1.11.1 release.

a. Regression is found and the PR is 798
. We need people who are
familiar with avro to have a look.

-- 
Xinli Shang


Updated invitation: Parquet Sync @ Tue Jun 23, 2020 9am - 10am (PDT) (dev@parquet.apache.org)

2020-06-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20200623T09
DTEND;TZID=America/Los_Angeles:20200623T10
DTSTAMP:20200622T230138Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtuslp8_r20200526t160...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Matthew Turner;X-NUM-GUESTS=0:mailto:matthew.m.tur...@outlook.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gabor.szadovs...@cloudera.com;X-NUM-GUESTS=0:mailto:gabor.szadovszky@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gwali...@gmail.com;X-NUM-GUESTS=0:mailto:gwali...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=emkornfi...@gmail.com;X-NUM-GUESTS=0:mailto:emkornfi...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN="Lekshmi Narayanan, Arun Balajiee";X-NUM-GUESTS=0:mailto:arl...@pitt.ed
 u
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=Robert Kruszewski;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=Brian Bowman;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
X-MICROSOFT-CDO-OWNERAPPTID:1172221350
RECURRENCE-ID;TZID=America/Los_Angeles:20200623T09
CREATED:20200210T155820Z
DESCRIPTION:This is a reminder that the ZOOM link has a password added 
 below.\;--
 -Xinli shang is inviting you to
  a scheduled Zoom meeting.Join Zoom Meeting - password is required<
 br>https://uber.zoom.us/j/3523778975; id="ow1110" __is_owner="true
 ">https://uber.zoom.us/j/3523778975Meeting ID: 352 377 8975
 Password: 030115One tap mobile+16699006833\,\,3523778975# US (S
 an Jose)+16468769923\,\,3523778975# US (New York)Dial by your l
 ocation\;\;\;\;\;\;\;\;+1 669 9
 00 6833 US (San Jose)\;\;\;\;\;\;\;&
 nbsp\;+1 646 876 9923 US (New York)\;\;\;\;\;&
 nbsp\;\;\;877 369 0926 US Toll-free\;\;\;
 \;\;\;\;\;855 880 1246 US Toll-freeMeeting ID: 352 
 377 8975Find your local number: https://uber.zoom.us/u/aZKZunO
 Z9">https://uber.zoom.us/u/aZKZunOZ9Join by SIP3523778...@zoomcrc.comJoin by H.323
 162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195 (C
 hina)115.114.131.7 (India Mumbai)115.114.115.7 (India Hyderabad)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110 (Hong
  Kong)64.211.144.160 (Brazil)69.174.57.160 (Canada)207.226.132.
 110 (Japan)Meeting ID: 352 377 8975\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-\nPlease do not edit
  this section of the description.\n\nView your event at https://www.google.
 com/calendar/event?action=VIEW=MW1zbGlka2g4ZWR0aW9ydmhlbHZ0dXNscDhfMjAy
 MDA2MjNUMTYwMDAwWiBkZXZAcGFycXVldC5hcGFjaGUub3Jn=MTUjc2hhbmd4QHViZXIuY2
 9tNGJlMDM4YjBmMWJlM2RjMzc0ZDcxNzA1MDEzOWEzMWVlNTZlYjZiZg=America%2FLos_
 Angeles=en=0.\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-
LAST-MODIFIED:20200622T230136Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:1
STATUS:CONFIRMED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Today's Parquet sync Zoom meeting

2020-05-26 Thread Xinli shang
Hi all,

In the meeting invitation, you should have received the password. For your
convenience, I paste it below. See you in 30 minutes!

https://uber.zoom.us/j/3523778975


Meeting ID: 352 377 8975
Password: 030115

-- 
Xinli Shang


Parquet sync meeting notes - 4/28/2020

2020-04-28 Thread Xinli shang
Hi all,


Please find the meeting notes below. I apologize for sending the meeting
password late and that caused some people cannot join the meeting. I wasn't
aware of the Zoom's change that forces everybody except for the meeting
owner to input the password. I have updated the meeting invitation and
included the password.


4/28/2020

Attendee:  Xinli, Gabor

Topics:

Column Encryption

   -

   In the basic parquet encryption layer, two pull requests are left: PR-776
    (ready for review), and
   PR-782 (focused on testing interop with parquet-cpp, can be reviewed after
   initial round of 776 reviews).
   -

   The next step is to work on key management tools and Parquet-1396
   (schema controlled encryption).

Parquet-11 Release

   -

   Spark-26346 /
   PARQUET-1774 : There
   is a finding in Spark. Gabor is waiting for the Spark community to verify
   the fix of Parquet-1174. No response from Spark yet.


Xinli Shang


-- 
Xinli Shang


Parquet Sync

2020-04-28 Thread shangx
Please use the password 030115 to join. I will update the meeting  
invitation later.


Title: Parquet Sync
Xinli shang is inviting you to a scheduled Zoom meeting.

Join Zoom Meeting
https://uber.zoom.us/j/3523778975

Meeting ID: 352 377 8975

One tap mobile
+16699006833,,3523778975# US (San Jose)
+16468769923,,3523778975# US (New York)

Dial by your location
+1 669 900 6833 US (San Jose)
+1 646 876 9923 US (New York)
877 369 0926 US Toll-free
855 880 1246 US Toll-free
Meeting ID: 352 377 8975
Find your local number: https://uber.zoom.us/u/aZKZunOZ9

Join by SIP
3523778...@zoomcrc.com

Join by H.323
162.255.37.11 (US West)
162.255.36.11 (US East)
221.122.88.195 (China)
115.114.131.7 (India Mumbai)
115.114.115.7 (India Hyderabad)
213.19.144.110 (EMEA)
103.122.166.55 (Australia)
209.9.211.110 (Hong Kong)
64.211.144.160 (Brazil)
69.174.57.160 (Canada)
207.226.132.110 (Japan)
Meeting ID: 352 377 8975

When: Tue Apr 28, 2020 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/3523778975, SEA | 1191 2nd Ave-8th-Blakely  
(7) [Zoom]

Who:
* sha...@uber.com - organizer
* dev@parquet.apache.org
* Lekshmi Narayanan, Arun Balajiee
* Matthew Turner
* wesmck...@gmail.com
* gabor.szadovs...@cloudera.com
* gg5...@gmail.com
* gwali...@gmail.com
* emkornfi...@gmail.com
* Robert Kruszewski


Parquet sync meeting notes

2020-03-24 Thread Xinli shang
3/24/2020

Attendee:  Walid, Gabor, Xindong, Gidon, Shrikumar, Xinli

Topics:

Column Encryption

   -

   PR-769  is being
   reviewed. Gidon/Xinli just addressed the feedback this morning and Gabor is
   going to have another look.
   -

   Gidon has the code that encrypted column indexes, waiting for PR-769
    to be merged and then
   create PR.

Parquet-11 Release

   -

   Spark-26346 /
   PARQUET-1774 : There
   is a finding in Spark. Gabor is waiting for the Spark community to verify
   the fix of Parquet-1174. No response from Spark yet.

Bloom Filter:

   -

   Walid created the PRs for Union/Intersection APIs
   -

  Gabor: We would like to see use cases of them before we can add them.
  -

   Bloom Filter configuration
   -

  Comments: Have a page to discuss the configuration

Parquet-1804:

   -

   Xindong: Some performant compression methods utilizing hardware can
   accelerate compression. We want the parquet-mr to support a customized
   compression method.
   -

   Concern from the community: We already have some issues between
   parquet-mr and parquet-cpp as an example. If we open the door for users to
   customize their own compression, then more compatibility issues could
   happen.

-- 
Xinli Shang


Parquet sync meeting notes

2020-02-25 Thread Xinli shang
*Date*: 2/25/2020


Attendee:  Xinli, Gabor, Gidon, Shrikumar

Topics:

Column Configuration

   -

   The PR  needs a committer
   or PMC to review and approve. Xinli/Junjie/Walid have reviewed the code but
   they don’t have permission to merge.

Column Encryption

   -

   PR-614  needs to be
   merged; Wait for bloom filter’s PR merging.

Parquet-11 Release

   -

   There is a finding in Spark. Gabor is waiting for the spark community.

Parquet-1791: Add ‘prune’ command to parquet-tools

   -

   PR  is merged.

Parquet-1792: Add ‘mask’ command to parquet-tools/cli

   -

   In progress

Bloom Filter:

   -

   PR  is reviewed. One last
   comment is under discussion.


Xinli Shang


Invitation: Parquet Sync @ Monthly from 9am to 10am on the fourth Tuesday (PST) (dev@parquet.apache.org)

2020-02-12 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20200225T09
DTEND;TZID=America/Los_Angeles:20200225T10
RRULE:FREQ=MONTHLY;BYDAY=4TU
DTSTAMP:20200212T233922Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:1mslidkh8edtiorvhelvtus...@google.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE;C
 N=SEA | 1191 2nd Ave-8th-Blakely (7) [Zoom];X-NUM-GUESTS=0:mailto:uber.com_
 53454131313931326e6441766530387468426c616b656c793756432d343836313237@resour
 ce.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
X-MICROSOFT-CDO-OWNERAPPTID:-599962246
CREATED:20200210T155820Z
DESCRIPTION:Xinli shang is inviting you to a scheduled Zoom meeting.\n\nJoi
 n Zoom Meeting\nhttps://uber.zoom.us/j/3523778975\n\nMeeting ID: 352 377 89
 75\n\nOne tap mobile\n+16699006833\,\,3523778975# US (San Jose)\n+164687699
 23\,\,3523778975# US (New York)\n\nDial by your location\n+1 669 90
 0 6833 US (San Jose)\n+1 646 876 9923 US (New York)\n877 36
 9 0926 US Toll-free\n855 880 1246 US Toll-free\nMeeting ID: 352 377
  8975\nFind your local number: https://uber.zoom.us/u/aZKZunOZ9\n\nJoin by 
 SIP\n3523778...@zoomcrc.com\n\nJoin by H.323\n162.255.37.11 (US West)\n162.
 255.36.11 (US East)\n221.122.88.195 (China)\n115.114.131.7 (India Mumbai)\n
 115.114.115.7 (India Hyderabad)\n213.19.144.110 (EMEA)\n103.122.166.55 (Aus
 tralia)\n209.9.211.110 (Hong Kong)\n64.211.144.160 (Brazil)\n69.174.57.160 
 (Canada)\n207.226.132.110 (Japan)\nMeeting ID: 352 377 8975\n\n\n-::~:~::~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~:
 :-\nPlease do not edit this section of the description.\n\nView your event 
 at https://www.google.com/calendar/event?action=VIEW=MW1zbGlka2g4ZWR0aW
 9ydmhlbHZ0dXNscDggZGV2QHBhcnF1ZXQuYXBhY2hlLm9yZw=MTUjc2hhbmd4QHViZXIuY2
 9tMDI5NDdkYmQwMmI4YjVkZGVkNWE2NTQyNTI5NjU5OTZiN2EyYWJiOA=America%2FLos_
 Angeles=en=1.\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-
LAST-MODIFIED:20200212T233921Z
LOCATION:https://uber.zoom.us/j/3523778975\, SEA | 1191 2nd Ave-8th-Blakely
  (7) [Zoom]
SEQUENCE:1
STATUS:CONFIRMED
SUMMARY:Parquet Sync 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Parquet Sync Meeting Notes

2020-01-29 Thread Xinli shang
Hi all,

These are the meeting notes for today's Parquet community sync.

1/29/2020

Attendee:  Brian, Xinli, Gabor, Gidon, Walid


Topics:

Column Encryption

   -

   https://github.com/apache/parquet-mr/pull/614 need to be merged.
   -

   Still waiting for Parquet 11 release.


Parquet-11 Release

   -

   There is a finding in Spark and working on it.


PARQUET-1681 


   -

   This is a severe issue. Some types of Avro schemas(like this
   
)
   are not compatible with themselves after converting to Parquet. This causes
   the data cannot be read. The fix is ready and a PR will be created for
   review.


-- 
Xinli Shang


Canceled event: Parquet Sync - Monthly(every 3rd thursday) @ Thu Dec 19, 2019 9am - 10am (PST) (dev@parquet.apache.org)

2019-12-11 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:CANCEL
BEGIN:VEVENT
DTSTART:20191219T17Z
DTEND:20191219T18Z
DTSTAMP:20191210T170611Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:3f2npc97o5cj0qnqnrlfjld...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=an
 dy.gr...@rms.com;X-NUM-GUESTS=0:mailto:andy.gr...@rms.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=La
 rs Volker;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN="X
 u, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ma
 rc...@gmail.com;X-NUM-GUESTS=0:mailto:marc...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ro
 be...@palantir.com;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=no
 n...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=da
 niels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ba
 l...@uber.com;X-NUM-GUESTS=0:mailto:bal...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=m.
 lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=lu
 kas.naleze...@gmail.com;X-NUM-GUESTS=0:mailto:lukas.naleze...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=su
 nc...@apache.org;X-NUM-GUESTS=0:mailto:sunc...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ip
 pokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=de
 v...@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=sz
 o...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=we
 smck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=b.
 hano...@criteo.com;X-NUM-GUESTS=0:mailto:b.hano...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=st
 ak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Da
 niel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ya
 lia...@twitter.com;X-NUM-GUESTS=0:mailto:yalia...@twitter.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Mo
 hit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=gg
 5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Pa
 vi Subenderan;X-NUM-GUESTS=0:mailto:p...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ju
 lien Le Dem;X-NUM-GUESTS=0:mailto:julien.le...@wework.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=q.
 x...@criteo.com;X-NUM-GUESTS=0:mailto:q...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=br
 ian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ma
 rk.ma...@kognitio.com;X-NUM-GUESTS=0:mailto:mark.ma...@kognitio.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=cs
 ringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringho...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Ry
 an Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ji
 mmyjc...@tencent.com;X-NUM-GUESTS=0:mailto:jimmyjc...@tencent.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=sz
 onyi.a...@gmail.com;X-NUM-GUESTS=0:mailto:szonyi.a...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=xh
 o...@gmail.com;X-NUM-GUESTS=0:mailto:xho...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=rz
 am...@nvidia.com;X-NUM-GUESTS=0:mailto:rzam...@nvidia.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=ju
 lien.le...@gmail.com;X-NUM-GUESTS=0:mailto:julien.le...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=Mo
 hammad Islam;X-NUM-GUESTS=0:mailto:misla...@yahoo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;CN=bi
 

Updated invitation with note: Parquet Sync - Monthly(every 3rd thursday) @ Monthly from 9am to 10am on the third Thursday from Thu Nov 21 to Wed Dec 18 (PST) (dev@parquet.apache.org)

2019-12-11 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20191121T09
DTEND;TZID=America/Los_Angeles:20191121T10
RRULE:FREQ=MONTHLY;UNTIL=20191219T075959Z;BYDAY=3TH
DTSTAMP:20191210T170611Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:3f2npc97o5cj0qnqnrlfjldv1g_r20191121t170...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=shri.hariharasubrahman...@oracle.com;X-NUM-GUESTS=0:mailto:shri.har
 iharasubrahman...@oracle.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.li...@criteo.com;X-NUM-GUESTS=0:mailto:m.li...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Parth Chandra;X-NUM-GUESTS=0:mailto:pchan...@maprtech.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=robe...@palantir.com;X-NUM-GUESTS=0:mailto:robe...@palantir.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=xho...@gmail.com;X-NUM-GUESTS=0:mailto:xho...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Sergio Pena;X-NUM-GUESTS=0:mailto:sergio.p...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=DECLINED;RSVP=TRUE
 ;CN=Reynold Xin;X-NUM-GUESTS=0:mailto:r...@databricks.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jimmyjc...@tencent.com;X-NUM-GUESTS=0:mailto:jimmyjc...@tencent.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=dam6...@gmail.com;X-NUM-GUESTS=0:mailto:dam6...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=marc...@gmail.com;X-NUM-GUESTS=0:mailto:marc...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=apha...@cloudera.com;X-NUM-GUESTS=0:mailto:apha...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=Pavi Subenderan;X-NUM-GUESTS=0:mailto:p...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=brian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Xu, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=b.hano...@criteo.com;X-NUM-GUESTS=0:mailto:b.hano...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jbap...@cloudera.com;X-NUM-GUESTS=0:mailto:jbap...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.dee...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=alexleven...@twitter.com;X-NUM-GUESTS=0:mailto:alexlevenson@twitter
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 

Updated invitation with note: Parquet Sync - Monthly(every 3rd thursday) @ Monthly from 9am to 10am on the third Thursday from Thu Oct 17 to Wed Dec 18 (PDT) (dev@parquet.apache.org)

2019-12-11 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20191017T09
DTEND;TZID=America/Los_Angeles:20191017T10
RRULE:FREQ=MONTHLY;UNTIL=20191121T075959Z;BYDAY=3TH
DTSTAMP:20191210T170611Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:3f2npc97o5cj0qnqnrlfjld...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Daniel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniket...@gmail.com;X-NUM-GUESTS=0:mailto:aniket...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=daniels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ippokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Lars Volker;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Mohit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=smanik...@gmail.com;X-NUM-GUESTS=0:mailto:smanik...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Julien Le Dem;X-NUM-GUESTS=0:mailto:julien.le...@wework.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=TENTATIVE;RSVP=TRU
 E;CN=j.cof...@criteo.com;X-NUM-GUESTS=0:mailto:j.cof...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jacq...@apache.org;X-NUM-GUESTS=0:mailto:jacq...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ven...@uber.com;X-NUM-GUESTS=0:mailto:ven...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=borokna...@cloudera.com;X-NUM-GUESTS=0:mailto:boroknagyz@cloudera.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Xu, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.dee...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=csringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringhofer@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=stak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=bikramjeet@cloudera.com;X-NUM-GUESTS=0:mailto:bikramjeet.vig@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 

Parquet Sync Meeting Notes

2019-12-04 Thread Xinli shang
Hi all,

These are the meeting notes for today's Parquet community sync.

*12/04/201*

Attendee: Gidon, Gabor, Jim, Ryan, Xinli


Topics:

Column Encryption

   1.

   C++ version is fully merged.
   2.

   Java version is waiting for the Parquet-11 release.


Bloom Filter

   1.

   Opened a PR in parquet-mr repo to change the implementation and the
   spec.
   2.

   These will be in C++ version also. Jim will take the ownership of it.


Parquet-11 Release


   1.

   Closed all the open discussions in email.
   2.

   Xinli will take the ownership to verify CRC enabled by default by using
   production data. This is not a blocker.
   3.

   PMC to validate the release - Gabor will send out email to ask PMCs.

-- 
Xinli Shang


Invitation: Parquet Sync - Makeup @ Wed Dec 4, 2019 9am - 10am (PST) (dev@parquet.apache.org)

2019-11-21 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VEVENT
DTSTART:20191204T17Z
DTEND:20191204T18Z
DTSTAMP:20191121T174406Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:a3doa966suvqpc7pp29g6e8...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
X-MICROSOFT-CDO-OWNERAPPTID:573227090
CREATED:20191121T174024Z
DESCRIPTION:This is a makeup meeting for the Nov.\;Xinli s
 hang is inviting you to a scheduled Zoom meeting.Join Zoom Meeting<
 br>https://uber.zoom.us/j/693354394;>https://uber.zoom.us/j/693354
 394Meeting ID: 693 354 394One tap mobile+1669900683
 3\,\,693354394# US (San Jose)+16468769923\,\,693354394# US (New York)Dial by your location\;\;\;\;\;\;
 bsp\;\;+1 669 900 6833 US (San Jose)\;\;\;\;
 bsp\;\;\;\;+1 646 876 9923 US (New York)\;\;
 bsp\;\;\;\;\;\;855 880 1246 US Toll-free\
 ;\;\;\;\;\;\;\;877 369 0926 US Toll-free
 Meeting ID: 693 354 394Find your local number: https://ube
 r.zoom.us/u/aZKZunOZ9">https://uber.zoom.us/u/aZKZunOZ9Join by 
 SIP693354...@zoomcrc.com
 Join by H.323162.255.37.11 (US West)162.255.36.11 (US East)
 221.122.88.195 (China)115.114.131.7 (India)213.19.144.110 (EMEA)103.122.166.55 (Australia)209.9.211.110 (Hong Kong)64.211.144.160 
 (Brazil)69.174.57.160 (Canada)207.226.132.110 (Japan)Meeting ID
 : 693 354 394\n\n-::~:~::~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:
 ~:~:~:~:~:~:~:~:~:~:~::~:~::-\nPlease do not edit this section of the descr
 iption.\n\nView your event at https://www.google.com/calendar/event?action=
 VIEW=YTNkb2E5NjZzdXZxcGM3cHAyOWc2ZThhbjAgZGV2QHBhcnF1ZXQuYXBhY2hlLm9yZw
 =MTUjc2hhbmd4QHViZXIuY29tYmZhMTRhMTJkODk3ZjA0ZjE5NzViNzcwYzc2Y2E1YjkzZD
 YzMDA2ZA=America%2FLos_Angeles=en=1.\n-::~:~::~:~:~:~:~:~:~:~:~:~
 :~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~:~::~:~::-
LAST-MODIFIED:20191121T174406Z
LOCATION:https://uber.zoom.us/j/693354394
SEQUENCE:0
STATUS:CONFIRMED
SUMMARY:Parquet Sync - Makeup 
TRANSP:OPAQUE
END:VEVENT
END:VCALENDAR


invite.ics
Description: application/ics


Re: Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Xinli shang
Sorry for the meeting ID issue. I don't know why this same ID worked for
the last two meetings but not today. I will send out another invitation
soon targetting for early December as a makeup.

Just Julien and me in the meeting today and we briefly talked about the
current outstanding tasks. We can talk them in more detail in the makeup
meeting.

On Thu, Nov 21, 2019 at 9:15 AM Julien Le Dem
 wrote:

> that worked, thanks!
>
> On Thu, Nov 21, 2019 at 9:11 AM Xinli shang 
> wrote:
>
> > Can you try
> https://urldefense.proofpoint.com/v2/url?u=https-3A__uber.zoom.us_j_142456544-3F=DwIBaQ=r2dcLCtU9q6n0vrtnDw9vg=FQ88AmOZ4TMjDdqNBGu-ag=rEenljUvElhCIaOfXaXmXIuncTrfrY-1gbayEFNgIUc=0vb3nSDmJ03zJCKipI4E5vd2KB22TyqmUyeWc0g8hU4=
> >
> > On Thu, Nov 21, 2019 at 9:07 AM Gabor Szadovszky 
> wrote:
> >
> > > Hi,
> > >
> > > Is it just me who cannot join to the meeting? It says "Invalid meeting
> > > ID"...
> > >
> > > Cheers,
> > > Gabor
> > >
> >
> >
> > --
> > Xinli Shang
> >
>


-- 
Xinli Shang


Re: Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Julien Le Dem
that worked, thanks!

On Thu, Nov 21, 2019 at 9:11 AM Xinli shang  wrote:

> Can you try https://uber.zoom.us/j/142456544?
>
> On Thu, Nov 21, 2019 at 9:07 AM Gabor Szadovszky  wrote:
>
> > Hi,
> >
> > Is it just me who cannot join to the meeting? It says "Invalid meeting
> > ID"...
> >
> > Cheers,
> > Gabor
> >
>
>
> --
> Xinli Shang
>


Re: Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Xinli shang
Can you try https://uber.zoom.us/j/142456544?

On Thu, Nov 21, 2019 at 9:07 AM Gabor Szadovszky  wrote:

> Hi,
>
> Is it just me who cannot join to the meeting? It says "Invalid meeting
> ID"...
>
> Cheers,
> Gabor
>


-- 
Xinli Shang


Re: Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Julien Le Dem
same for me. can someone send a new link?

On Thu, Nov 21, 2019 at 9:08 AM Jim Apple  wrote:

> The same is happening to me. Additionally, one of the toll-free phone
> numbers did not pick up.
>
> No outages I see: https://statusgator.com/services/zoom,
> https://status.zoom.us/
>
> On 2019/11/21 17:06:56, Gabor Szadovszky  wrote:
> > Hi,
> >
> > Is it just me who cannot join to the meeting? It says "Invalid meeting
> > ID"...
> >
> > Cheers,
> > Gabor
> >
>


Re: Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Jim Apple
The same is happening to me. Additionally, one of the toll-free phone numbers 
did not pick up.

No outages I see: https://statusgator.com/services/zoom, https://status.zoom.us/

On 2019/11/21 17:06:56, Gabor Szadovszky  wrote: 
> Hi,
> 
> Is it just me who cannot join to the meeting? It says "Invalid meeting
> ID"...
> 
> Cheers,
> Gabor
> 


Parquet sync zoom - invalid meeting ID

2019-11-21 Thread Gabor Szadovszky
Hi,

Is it just me who cannot join to the meeting? It says "Invalid meeting
ID"...

Cheers,
Gabor


Re: Parquet Sync - 10/17/2019 - Meeting Notes

2019-10-17 Thread Julien Le Dem
Thanks for the notes. Sorry I missed the sync because of a conflict.

On Thu, Oct 17, 2019 at 10:00 AM Gidon Gershinsky  wrote:

> A slight correction re C++. I said the following
> C++ work is near completion/merge. Deepark has reviewed it and made
> additional changes / refactoring.
>
> On Thu, Oct 17, 2019 at 7:33 PM  wrote:
>
>> 10/17/2019
>>
>> Attendee:
>> Gidon
>> Gabor
>> Ryan
>> Karfiol
>> Xinli
>>
>> Topics:
>>
>> Column Encryption
>> For C++ version, Gidon worked with Deepak to have reviews going on.
>> For Java, we are blocked on the Parquet-11 release. Gabor proposed to
>> have branch the Parquet-11 and then merge later. But we would need to be in
>> master as the final step.
>>
>> Bloom Filter
>> Next step is to wait for the Parquet-11 release
>>
>> Parquet-11 Validation
>> Ryan - the release can go ahead without me if there are enough PMCs
>> Gabor - I will try to push this effort in a couple of weeks
>>
>> Ongoing Parquet Work
>> There is some work to create PR shortly to optimize Parquet usage of byte
>> buffer, ParallelIzation, S3 reading, etc.
>>
>> Xinli Shang (Uber)
>>
>> Parquet Sync - Monthly(every 3rd thursday)
>> Hi all,
>>
>> This is an invitation for the next occasion of the regular sync meeting
>> of the Parquet community.
>>
>> Xinli Shang
>>
>> Join Zoom Meeting
>> https://uber.zoom.us/j/112318682
>> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682=D=157176203650=AFQjCNFLMC07ke-eJw4pjYYwN8FsCtnzMA>
>>
>> One tap mobile
>> +16699006833,,112318682# US (San Jose)
>> +16468769923,,112318682# US (New York)
>>
>> Dial by your location
>> +1 669 900 6833 US (San Jose)
>> +1 646 876 9923 US (New York)
>> 855 880 1246 US Toll-free
>> 877 369 0926 US Toll-free
>> Meeting ID: 112 318 682
>> Find your local number: https://zoom.us/u/aZKZunOZ9
>> <https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fu%2FaZKZunOZ9=D=1571762036501000=AFQjCNH-GaE-r1Fxk3iTw0cJgIRhbUP1JA>
>>
>> Join by SIP
>> 112318...@zoomcrc.com
>>
>> Join by H.323
>> 162.255.37.11 (US West)
>> 162.255.36.11 (US East)
>> 221.122.88.195 (China)
>> 115.114.131.7 (India)
>> 213.19.144.110 (EMEA)
>> 103.122.166.55 (Australia)
>> 209.9.211.110 (Hong Kong)
>> 64.211.144.160 (Brazil)
>> 69.174.57.160 (Canada)
>> 207.226.132.110 (Japan)
>> Meeting ID: 112 318 682
>> *When*
>> Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
>>
>> *Where*
>> https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)
>> [Zoom] (map
>> <https://www.google.com/maps/search/https:%2F%2Fuber.zoom.us%2Fj%2F112318682,+SEA+%7C+1191+2nd+Ave-8th-Whidbey+%287%29+%5BZoom%5D?hl=en>
>> )
>>
>> *Who*
>> •
>> sha...@uber.com - organizer
>> •
>> shri.hariharasubrahman...@oracle.com
>> •
>> non...@gmail.com
>> •
>> robe...@palantir.com
>> •
>> szonyi.a...@gmail.com
>> •
>> szo...@cloudera.com
>> •
>> m.lac...@criteo.com
>> •
>> csringho...@cloudera.com
>> •
>> rzam...@nvidia.com
>> •
>> borokna...@cloudera.com
>> •
>> bikramjeet@cloudera.com
>> •
>> dev@parquet.apache.org
>> •
>> daniels...@gmail.com
>> •
>> smanik...@gmail.com
>> •
>> nkol...@cloudera.com
>> •
>> ven...@uber.com
>> •
>> q...@criteo.com
>> •
>> jimmyjc...@tencent.com
>> •
>> vercego...@cloudera.com
>> •
>> Xu, Cheng A
>> •
>> aniket...@gmail.com
>> •
>> jbap...@cloudera.com
>> •
>> Julien Le Dem
>> •
>> apha...@cloudera.com
>> •
>> yalia...@twitter.com
>> •
>> marc...@gmail.com
>> •
>> mark.ma...@kognitio.com
>> •
>> santlal.gu...@bitwiseglobal.com
>> •
>> Daniel Weeks
>> •
>> wesmck...@gmail.com
>> •
>> sunc...@apache.org
>> •
>> j.cof...@criteo.com
>> •
>> Reynold Xin
>> •
>> Ryan Blue
>> •
>> Lars Volker
>> •
>> alexleven...@twitter.com
>> •
>> jacq...@apache.org
>> •
>> Sergio Pena
>> •
>> gg5...@gmail.com
>> •
>> fnoth...@berkeley.edu
>> •
>> lukas.naleze...@gmail.com
>> •
>> m.li...@criteo.com
>> •
>> stak...@cloudera.com
>> •
>> s...@yelp.com
>> •
>> o.kaidan...@criteo.com
>> •
>> altekruseja...@gmail.com
>> •
>> brian.bow...@sas.com
>> •
>> julien.le...@gmail.com
>> •
>> Mohammad Islam
>> •
>> gabor.szadovs...@cloudera.com
>> •
>> andy.gr...@rms.com
>> •
>> Wei Han
>> •
>> yumw...@ebay.com
>> •
>> bal...@uber.com
>> •
>> ippokra...@gmail.com
>> •
>> Pavi Subenderan
>> •
>> Zoltan Ivanfi
>> •
>> b.hano...@criteo.com
>> •
>> dam6...@gmail.com
>> •
>> majeti.dee...@gmail.com
>> •
>> Parth Chandra
>> •
>> Mohit Sabharwal
>> •
>> nilangekar.po...@gmail.com
>> •
>> xho...@gmail.com
>> •
>> gorec...@amazon.com
>>
>


Re: Parquet Sync - 10/17/2019 - Meeting Notes

2019-10-17 Thread Gidon Gershinsky
A slight correction re C++. I said the following
C++ work is near completion/merge. Deepark has reviewed it and made
additional changes / refactoring.

On Thu, Oct 17, 2019 at 7:33 PM  wrote:

> 10/17/2019
>
> Attendee:
> Gidon
> Gabor
> Ryan
> Karfiol
> Xinli
>
> Topics:
>
> Column Encryption
> For C++ version, Gidon worked with Deepak to have reviews going on.
> For Java, we are blocked on the Parquet-11 release. Gabor proposed to have
> branch the Parquet-11 and then merge later. But we would need to be in
> master as the final step.
>
> Bloom Filter
> Next step is to wait for the Parquet-11 release
>
> Parquet-11 Validation
> Ryan - the release can go ahead without me if there are enough PMCs
> Gabor - I will try to push this effort in a couple of weeks
>
> Ongoing Parquet Work
> There is some work to create PR shortly to optimize Parquet usage of byte
> buffer, ParallelIzation, S3 reading, etc.
>
> Xinli Shang (Uber)
>
> Parquet Sync - Monthly(every 3rd thursday)
> Hi all,
>
> This is an invitation for the next occasion of the regular sync meeting of
> the Parquet community.
>
> Xinli Shang
>
> Join Zoom Meeting
> https://uber.zoom.us/j/112318682
> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682=D=157176203650=AFQjCNFLMC07ke-eJw4pjYYwN8FsCtnzMA>
>
> One tap mobile
> +16699006833,,112318682# US (San Jose)
> +16468769923,,112318682# US (New York)
>
> Dial by your location
> +1 669 900 6833 US (San Jose)
> +1 646 876 9923 US (New York)
> 855 880 1246 US Toll-free
> 877 369 0926 US Toll-free
> Meeting ID: 112 318 682
> Find your local number: https://zoom.us/u/aZKZunOZ9
> <https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fu%2FaZKZunOZ9=D=1571762036501000=AFQjCNH-GaE-r1Fxk3iTw0cJgIRhbUP1JA>
>
> Join by SIP
> 112318...@zoomcrc.com
>
> Join by H.323
> 162.255.37.11 (US West)
> 162.255.36.11 (US East)
> 221.122.88.195 (China)
> 115.114.131.7 (India)
> 213.19.144.110 (EMEA)
> 103.122.166.55 (Australia)
> 209.9.211.110 (Hong Kong)
> 64.211.144.160 (Brazil)
> 69.174.57.160 (Canada)
> 207.226.132.110 (Japan)
> Meeting ID: 112 318 682
> *When*
> Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
>
> *Where*
> https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)
> [Zoom] (map
> <https://www.google.com/maps/search/https:%2F%2Fuber.zoom.us%2Fj%2F112318682,+SEA+%7C+1191+2nd+Ave-8th-Whidbey+%287%29+%5BZoom%5D?hl=en>
> )
>
> *Who*
> •
> sha...@uber.com - organizer
> •
> shri.hariharasubrahman...@oracle.com
> •
> non...@gmail.com
> •
> robe...@palantir.com
> •
> szonyi.a...@gmail.com
> •
> szo...@cloudera.com
> •
> m.lac...@criteo.com
> •
> csringho...@cloudera.com
> •
> rzam...@nvidia.com
> •
> borokna...@cloudera.com
> •
> bikramjeet@cloudera.com
> •
> dev@parquet.apache.org
> •
> daniels...@gmail.com
> •
> smanik...@gmail.com
> •
> nkol...@cloudera.com
> •
> ven...@uber.com
> •
> q...@criteo.com
> •
> jimmyjc...@tencent.com
> •
> vercego...@cloudera.com
> •
> Xu, Cheng A
> •
> aniket...@gmail.com
> •
> jbap...@cloudera.com
> •
> Julien Le Dem
> •
> apha...@cloudera.com
> •
> yalia...@twitter.com
> •
> marc...@gmail.com
> •
> mark.ma...@kognitio.com
> •
> santlal.gu...@bitwiseglobal.com
> •
> Daniel Weeks
> •
> wesmck...@gmail.com
> •
> sunc...@apache.org
> •
> j.cof...@criteo.com
> •
> Reynold Xin
> •
> Ryan Blue
> •
> Lars Volker
> •
> alexleven...@twitter.com
> •
> jacq...@apache.org
> •
> Sergio Pena
> •
> gg5...@gmail.com
> •
> fnoth...@berkeley.edu
> •
> lukas.naleze...@gmail.com
> •
> m.li...@criteo.com
> •
> stak...@cloudera.com
> •
> s...@yelp.com
> •
> o.kaidan...@criteo.com
> •
> altekruseja...@gmail.com
> •
> brian.bow...@sas.com
> •
> julien.le...@gmail.com
> •
> Mohammad Islam
> •
> gabor.szadovs...@cloudera.com
> •
> andy.gr...@rms.com
> •
> Wei Han
> •
> yumw...@ebay.com
> •
> bal...@uber.com
> •
> ippokra...@gmail.com
> •
> Pavi Subenderan
> •
> Zoltan Ivanfi
> •
> b.hano...@criteo.com
> •
> dam6...@gmail.com
> •
> majeti.dee...@gmail.com
> •
> Parth Chandra
> •
> Mohit Sabharwal
> •
> nilangekar.po...@gmail.com
> •
> xho...@gmail.com
> •
> gorec...@amazon.com
>


Parquet Sync - 10/17/2019 - Meeting Notes

2019-10-17 Thread shangx

10/17/2019

Attendee:
Gidon
Gabor
Ryan
Karfiol
Xinli

Topics:

Column Encryption
For C++ version, Gidon worked with Deepak to have reviews going on.
For Java, we are blocked on the Parquet-11 release. Gabor proposed to have  
branch the Parquet-11 and then merge later. But we would need to be in  
master as the final step.


Bloom Filter
Next step is to wait for the Parquet-11 release

Parquet-11 Validation
Ryan - the release can go ahead without me if there are enough PMCs
Gabor - I will try to push this effort in a couple of weeks

Ongoing Parquet Work
There is some work to create PR shortly to optimize Parquet usage of byte  
buffer, ParallelIzation, S3 reading, etc.


Xinli Shang (Uber)


Title: Parquet Sync - Monthly(every 3rd thursday)
Hi all,This is an invitation for the next occasion of the regular sync  
meeting of the Parquet community.Xinli ShangJoin Zoom  
Meetinghttps://uber.zoom.us/j/112318682One tap  
mobile+16699006833,,112318682# US (San Jose)+16468769923,,112318682# US  
(New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)855 880 1246  
US Toll-free877 369 0926 US  
Toll-freeMeeting ID: 112 318 682Find your local number:  
https://zoom.us/u/aZKZunOZ9Join by SIP112318682@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India)213.19.144.110 (EMEA)103.122.166.55  
(Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)69.174.57.160  
(Canada)207.226.132.110 (Japan)Meeting ID: 112 318 682

When: Thu Oct 17, 2019 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/112318682, SEA | 1191 2nd Ave-8th-Whidbey (7)  
[Zoom]

Who:
* sha...@uber.com - organizer
* shri.hariharasubrahman...@oracle.com
* non...@gmail.com
* robe...@palantir.com
* szonyi.a...@gmail.com
* szo...@cloudera.com
* m.lac...@criteo.com
* csringho...@cloudera.com
* rzam...@nvidia.com
* borokna...@cloudera.com
* bikramjeet@cloudera.com
* dev@parquet.apache.org
* daniels...@gmail.com
* smanik...@gmail.com
* nkol...@cloudera.com
* ven...@uber.com
* q...@criteo.com
* jimmyjc...@tencent.com
* vercego...@cloudera.com
* Xu, Cheng A
* aniket...@gmail.com
* jbap...@cloudera.com
* Julien Le Dem
* apha...@cloudera.com
* yalia...@twitter.com
* marc...@gmail.com
* mark.ma...@kognitio.com
* santlal.gu...@bitwiseglobal.com
* Daniel Weeks
* wesmck...@gmail.com
* sunc...@apache.org
* j.cof...@criteo.com
* Reynold Xin
* Ryan Blue
* Lars Volker
* alexleven...@twitter.com
* jacq...@apache.org
* Sergio Pena
* gg5...@gmail.com
* fnoth...@berkeley.edu
* lukas.naleze...@gmail.com
* m.li...@criteo.com
* stak...@cloudera.com
* s...@yelp.com
* o.kaidan...@criteo.com
* altekruseja...@gmail.com
* brian.bow...@sas.com
* julien.le...@gmail.com
* Mohammad Islam
* gabor.szadovs...@cloudera.com
* andy.gr...@rms.com
* Wei Han
* yumw...@ebay.com
* bal...@uber.com
* ippokra...@gmail.com
* Pavi Subenderan
* Zoltan Ivanfi
* b.hano...@criteo.com
* dam6...@gmail.com
* majeti.dee...@gmail.com
* Parth Chandra
* Mohit Sabharwal
* nilangekar.po...@gmail.com
* xho...@gmail.com
* gorec...@amazon.com


Updated invitation with note: Parquet Sync - Monthly(every 3rd thursday) @ Monthly from 9am to 10am on the third Thursday (PDT) (dev@parquet.apache.org)

2019-09-19 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
X-LIC-LOCATION:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:19700308T02
RRULE:FREQ=YEARLY;BYMONTH=3;BYDAY=2SU
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:19701101T02
RRULE:FREQ=YEARLY;BYMONTH=11;BYDAY=1SU
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20191017T09
DTEND;TZID=America/Los_Angeles:20191017T10
RRULE:FREQ=MONTHLY;BYDAY=3TH
DTSTAMP:20190919T174328Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:3f2npc97o5cj0qnqnrlfjld...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Daniel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniket...@gmail.com;X-NUM-GUESTS=0:mailto:aniket...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=daniels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ippokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Lars Volker;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Mohit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=smanik...@gmail.com;X-NUM-GUESTS=0:mailto:smanik...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Julien Le Dem;X-NUM-GUESTS=0:mailto:julien.le...@wework.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=j.cof...@criteo.com;X-NUM-GUESTS=0:mailto:j.cof...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jacq...@apache.org;X-NUM-GUESTS=0:mailto:jacq...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ven...@uber.com;X-NUM-GUESTS=0:mailto:ven...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=borokna...@cloudera.com;X-NUM-GUESTS=0:mailto:boroknagyz@cloudera.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Xu, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.deepak@gmail.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=csringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringhofer@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=stak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=bikramjeet@cloudera.com;X-NUM-GUESTS=0:mailto:bikramjeet.vig@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 

Re: Parquet Sync - Meeting Notes

2019-09-19 Thread Gidon Gershinsky
Hi Xinli,

Regarding the parquet-cpp encryption - there are no integration errors. A
number of pull requests are merged by now; the remaining code has been
reviewed and updated; the only outstanding question (how/when to turn off
OpenSSL getting included in Arrow) had been addressed by the Cpp leads and
will be resolved soon.

Cheers, Gidon.

On Thu, Sep 19, 2019 at 8:37 PM  wrote:

> Hi all,
>
> This is the meeting notes that I took. Feel free to add or correct it if
> something is missed or wrong.
>
> 9/19/2019
>
> Attendee:
> Xinli Shang(Uber)
> Gidon Gershinsky(IBM)
> Jim Apple (Netflix)
> Nandor Kollar, Gabor, and several other Cloudera folks
> Julien Le Dem (WeWork)
> Deepak (Vertica)
> Please add if you are missed.
> Topics:
> Column Encryption
> Parquet-format has the specification merged.
> One PR is merged into parquet-mr, the second is being reviewed.
> For parquet-cpp, we still have some integration errors.
> Xinli backported the encryption code to parquet 1.10.1 to mitigate the
> risk. We can wait for 1.11.0 release before deciding should public
> community should do that.
>
> Bloom filter
> The spec has been checked in to parquet-format.
> Will continue the validation of the correctness on parquet-mr(feature
> branch) and parquet-cpp(master branch? some code like reader/writer not in
> master branch yet).
> Netflix has done enough testing on performance. The remaining tests are
> mainly for correctness.
> There are unit tests and integration tests that cover.
>
> Parquet-format 2.7.0
> Releasing of parquet-format is slow now. We need the release before
> checking into parquet-mr master.
> There are several options. We prefer option 3 that is to release bloom
> filter and parquet encryption together in 2.7.0.
> 3 PMC voted in this meeting +1 for the option 3.
> Ryan can help on the release, signing keys etc.
>
> Remove old Parquet modules
> Hive modules - sounds good
> Scooge - Julien will reach out to twitter
> Tools - undecided - Cloudera may still use the parquet-tools according to
> Gabor.
> Cascading - undecided
> We can change the module as deprecated as description.
>
> 1.11.0 Release
> Column index validation - Need Ryan to review it.
>
> Someone is proposing byte_stream_split encoding in the mailing list
> Ryan made a proposal and the owner just replied to try the proposal and
> get back.
>
> 7. Merge Parquet and ORC
> Ryan and Owen had a talk in ApacheCon regarding merging ORC and Parquet.
> There are a lot of benefits to doing that but also a lot of work. Overall,
> people in this meeting support this effort.
> Ryan can start socializing this effort.
>
> Xinli Shang (Uber)
>
>
>
> Parquet Sync
> Hi all,
>
> This is an invitation for the next occasion of the regular sync meeting of
> the Parquet community.
>
> Xinli Shang
>
> Join Zoom Meeting
> https://uber.zoom.us/j/112318682
> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682=D=1569346673766000=AFQjCNHq8oiMu0Nmrd08gPaB-b628c7g0g>
>
> One tap mobile
> +16699006833,,112318682# US (San Jose)
> +16468769923,,112318682# US (New York)
>
> Dial by your location
> +1 669 900 6833 US (San Jose)
> +1 646 876 9923 US (New York)
> 855 880 1246 US Toll-free
> 877 369 0926 US Toll-free
> Meeting ID: 112 318 682
> Find your local number: https://zoom.us/u/aZKZunOZ9
> <https://www.google.com/url?q=https%3A%2F%2Fzoom.us%2Fu%2FaZKZunOZ9=D=1569346673767000=AFQjCNETnBw2FHwysQKOvs9iV8And4RGaQ>
>
> Join by SIP
> 112318...@zoomcrc.com
>
> Join by H.323
> 162.255.37.11 (US West)
> 162.255.36.11 (US East)
> 221.122.88.195 (China)
> 115.114.131.7 (India)
> 213.19.144.110 (EMEA)
> 103.122.166.55 (Australia)
> 209.9.211.110 (Hong Kong)
> 64.211.144.160 (Brazil)
> 69.174.57.160 (Canada)
> 207.226.132.110 (Japan)
> Meeting ID: 112 318 682
> *When*
> Thu Sep 19, 2019 9am – 10am Pacific Time - Los Angeles
>
> *Where*
> https://uber.zoom.us/j/112318682 (map
> <https://www.google.com/url?q=https%3A%2F%2Fuber.zoom.us%2Fj%2F112318682=D=1569346673769000=AFQjCNHxn_23fnnu4UhPHNAm2VP5bk4BUg>
> )
>
> *Who*
> •
> sha...@uber.com - organizer
> •
> gg5...@gmail.com
> •
> Daniel Weeks
> •
> aniket...@gmail.com
> •
> daniels...@gmail.com
> •
> altekruseja...@gmail.com
> •
> ippokra...@gmail.com
> •
> Lars Volker
> •
> Mohit Sabharwal
> •
> santlal.gu...@bitwiseglobal.com
> •
> yumw...@ebay.com
> •
> smanik...@gmail.com
> •
> szo...@cloudera.com
> •
> Julien Le Dem
> •
> j.cof...@criteo.com
> •
> dev@parquet.apache.org
> •
> m.lac...@criteo.com
> •
> non

Parquet Sync - Meeting Notes

2019-09-19 Thread shangx

Hi all,

This is the meeting notes that I took. Feel free to add or correct it if  
something is missed or wrong.


9/19/2019

Attendee:
Xinli Shang(Uber)
Gidon Gershinsky(IBM)
Jim Apple (Netflix)
Nandor Kollar, Gabor, and several other Cloudera folks
Julien Le Dem (WeWork)
Deepak (Vertica)
   Please add if you are missed.
Topics:
Column Encryption
   Parquet-format has the specification merged.
   One PR is merged into parquet-mr, the second is being reviewed.
   For parquet-cpp, we still have some integration errors.
   Xinli backported the encryption code to parquet 1.10.1 to mitigate the  
risk. We can wait for 1.11.0 release before deciding should public  
community should do that.


Bloom filter
The spec has been checked in to parquet-format.
Will continue the validation of the correctness on parquet-mr(feature  
branch) and parquet-cpp(master branch? some code like reader/writer not in  
master branch yet).
Netflix has done enough testing on performance. The remaining tests are  
mainly for correctness.

There are unit tests and integration tests that cover.

Parquet-format 2.7.0
Releasing of parquet-format is slow now. We need the release before  
checking into parquet-mr master.
There are several options. We prefer option 3 that is to release bloom  
filter and parquet encryption together in 2.7.0.

3 PMC voted in this meeting +1 for the option 3.
Ryan can help on the release, signing keys etc.

Remove old Parquet modules
Hive modules  - sounds good
Scooge  - Julien will reach out to twitter
Tools - undecided - Cloudera may still use the parquet-tools according to  
Gabor.

Cascading - undecided
We can change the module as deprecated as description.

1.11.0 Release
Column index validation -   Need Ryan to review it.

Someone is proposing byte_stream_split encoding in the mailing list
Ryan made a proposal and the owner just replied to try the proposal and get  
back.


  7. Merge Parquet and ORC
Ryan and Owen had a talk in ApacheCon regarding merging ORC and Parquet.
There are a lot of benefits to doing that but also a lot of work. Overall,  
people in this meeting support this effort.

Ryan can start socializing this effort.

Xinli Shang (Uber)





Title: Parquet Sync
Hi all,This is an invitation for the next occasion of the regular sync  
meeting of the Parquet community.Xinli ShangJoin Zoom  
Meetinghttps://uber.zoom.us/j/112318682One tap  
mobile+16699006833,,112318682# US (San Jose)+16468769923,,112318682# US  
(New York)Dial by your  
location+1 669 900 6833 US  
(San Jose)+1 646 876 9923  
US (New York)855 880 1246  
US Toll-free877 369 0926 US  
Toll-freeMeeting ID: 112 318 682Find your local number:  
https://zoom.us/u/aZKZunOZ9Join by SIP112318682@zoomcrc.comJoin by  
H.323162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  
(China)115.114.131.7 (India)213.19.144.110 (EMEA)103.122.166.55  
(Australia)209.9.211.110 (Hong Kong)64.211.144.160 (Brazil)69.174.57.160  
(Canada)207.226.132.110 (Japan)Meeting ID: 112 318 682

When: Thu Sep 19, 2019 9am – 10am Pacific Time - Los Angeles
Where: https://uber.zoom.us/j/112318682
Who:
* sha...@uber.com - organizer
* gg5...@gmail.com
* Daniel Weeks
* aniket...@gmail.com
* daniels...@gmail.com
* altekruseja...@gmail.com
* ippokra...@gmail.com
* Lars Volker
* Mohit Sabharwal
* santlal.gu...@bitwiseglobal.com
* yumw...@ebay.com
* smanik...@gmail.com
* szo...@cloudera.com
* Julien Le Dem
* j.cof...@criteo.com
* dev@parquet.apache.org
* m.lac...@criteo.com
* non...@gmail.com
* jacq...@apache.org
* fnoth...@berkeley.edu
* ven...@uber.com
* borokna...@cloudera.com
* Xu, Cheng A
* majeti.dee...@gmail.com
* csringho...@cloudera.com
* stak...@cloudera.com
* o.kaidan...@criteo.com
* bikramjeet@cloudera.com
* brian.bow...@sas.com
* apha...@cloudera.com
* nkol...@cloudera.com
* wesmck...@gmail.com
* Ryan Blue
* Wei Han
* robe...@palantir.com
* Zoltan Ivanfi
* s...@yelp.com
* xho...@gmail.com
* gabor.szadovs...@cloudera.com
* m.li...@criteo.com
* bal...@uber.com
* jimmyjc...@tencent.com
* Pavi Subenderan
* Reynold Xin
* b.hano...@criteo.com
* sunc...@apache.org
* q...@criteo.com
* mark.ma...@kognitio.com
* yalia...@twitter.com
* alexleven...@twitter.com
* marc...@gmail.com
* Parth Chandra
* jbap...@cloudera.com
* nilangekar.po...@gmail.com
* Mohammad Islam
* julien.le...@gmail.com
* Sergio Pena
* rzam...@nvidia.com
* vercego...@cloudera.com
* szonyi.a...@gmail.com
* dam6...@gmail.com
* shri.hariharasubrahman...@oracle.com


Invitation: Parquet Sync @ Thu Sep 19, 2019 9am - 10am (PDT) (dev@parquet.apache.org)

2019-09-06 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VEVENT
DTSTART:20190919T16Z
DTEND:20190919T17Z
DTSTAMP:20190906T225855Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:3f2npc97o5cj0qnqnrlfjld...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Daniel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniket...@gmail.com;X-NUM-GUESTS=0:mailto:aniket...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=daniels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ippokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Lars Volker;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Mohit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=smanik...@gmail.com;X-NUM-GUESTS=0:mailto:smanik...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Julien Le Dem;X-NUM-GUESTS=0:mailto:julien.le...@wework.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=j.cof...@criteo.com;X-NUM-GUESTS=0:mailto:j.cof...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jacq...@apache.org;X-NUM-GUESTS=0:mailto:jacq...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ven...@uber.com;X-NUM-GUESTS=0:mailto:ven...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=borokna...@cloudera.com;X-NUM-GUESTS=0:mailto:boroknagyz@cloudera.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Xu, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.deepak@gmail.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=csringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringhofer@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=stak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=bikramjeet@cloudera.com;X-NUM-GUESTS=0:mailto:bikramjeet.vig@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=brian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=apha...@cloudera.com;X-NUM-GUESTS=0:mailto:apha...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=nkol...@cloudera.com;X-NUM-GUESTS=0:mailto:nkol...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 

Re: Parquet Sync Meeting Notes

2019-07-19 Thread Jim Apple
I believe this has now been both voted on a few months ago and approved by 
Zoltan last week.

If someone could merge it, that would get us one step closer to a 
parquet-format release.

On 2019/07/17 17:59:06, Xinli shang  wrote: 
> Gidon pointed out that the encryption parquet-format PR is the one below
> only. Sorry for the confusion.
> https://github.com/apache/parquet-format/pull/142



Re: Parquet Sync Meeting Notes

2019-07-17 Thread Xinli shang
Gidon pointed out that the encryption parquet-format PR is the one below
only. Sorry for the confusion.
https://github.com/apache/parquet-format/pull/142

On Wed, Jul 17, 2019 at 10:57 AM Xinli shang  wrote:

> 7/17/2019
>
> Attendee:
>
> Ryan Blue(Netflix)
>
> Jame(Netflix)
>
> Gidon Gershinsky(IBM)
>
> Steven(Yelp)
>
> Deepak and several other folks (Vertica)
>
> Xinli Shang(Uber)
>
> Junjie Chen
>
> Topics:
>
>1.
>
>Column Encryption
>1.
>
>   Gidon:
>   1.
>
>  C++ version code review: Have addressed all feedbacks. The last
>  step is testing. Hopefully tomorrow the testing can be done.
>  2.
>
>  Reviewed bloom filter design from Parquet encryption
>  perspective. It is straightforward.
>  3.
>
>  Not much done on Java version Parquet side. Worked with Xinli to
>  fix several issues.
>  4.
>
>  Found throughput issues in Java and fixed it.
>  2.
>
>   Xinli:
>   1.
>
>  Gidon sent out a design which consolidates different ways of
>  deploying parquet encryption, but not much attention is gained from 
> the
>  community. Please have a look if you are interested in.
>  2.
>
>  There is a discussion about unifying table properties in
>  HMS(HIVE-21848) for both ORC and Parquet column encryption. Please 
> chime in
>  if you have a concern.
>  3.
>
>  Java version parquet-mr PR review is being slow. How do we move
>  faster? We need more people to review it.
>  1.
>
> https://github.com/apache/parquet-mr/pull/613
> 2.
>
> https://github.com/apache/parquet-mr/pull/614
> 3.
>
> https://github.com/apache/parquet-mr/pull/643
> 3.
>
>   Jim
>   1.
>
>  What is blocked on the parquet-mr review? We need more people to
>  review it. There is a lot of PR now.
>  4.
>
>   Deepak
>   1.
>
>  Does the parquet encryption work with Hive?
>  1.
>
> Yes, we have tested it(xinli).
> 2.
>
>  Also have questions about table properties definition.
>  1.
>
> HIVE-21848(xinli)
> 2. Bloom filter
>   1.
>
>   Junjie Chen
>   1.
>
>  We need one more PMC vote
>  2.
>
>   Ryan
>   1.
>
>  I will have a look next week. Were the issues raised earlier
>  addressed?
>  1.
>
> Yes(Junjie)
> 2.
>
>  Parquet-format should be considered as upstream for parquet-cpp
>  and parquet-mr that are implementation.
>  3.
>
>  We need Encryption specification merge to parquet-format ASAP,
>  then bloom filter. Otherwise, parquet-format will depend parquet-cpp 
> and
>  parquet-mr, which is not right.
>
>https://github.com/apache/parquet-format/pull/68
>
>https://github.com/apache/parquet-format/pull/142
>1.
>
>   Xinli
>   1.
>
>  Is parquet-format 2.6 + encryption compatible with parquet
>  2.7(encryption + bloom filter)?
>  1.
>
> By design, yes(Gidon)
> 2.
>
>  Please add Xinli for testing if we have a prototype for bloom
>  filter to make sure they are compatible.
>
>
>
>1.
>
>Parquet-1.11.0 Release Validation
>1.
>
>   Ryan
>   1.
>
>  Both Ryan and Zalton are very busy. No progress so far.
>  2.
>
>  We need to write a test to make sure the data write/read are
>  correct.
>
>
>
>1.
>
>Remove old Parquet modules
>
>
>1.
>
>Ryan
>1.
>
>   No time. If somebody has time to do it, go for it.
>
>
> --
> Xinli Shang
>


-- 
Xinli Shang


Parquet Sync Meeting Notes

2019-07-17 Thread Xinli shang
7/17/2019

Attendee:

Ryan Blue(Netflix)

Jame(Netflix)

Gidon Gershinsky(IBM)

Steven(Yelp)

Deepak and several other folks (Vertica)

Xinli Shang(Uber)

Junjie Chen

Topics:

   1.

   Column Encryption
   1.

  Gidon:
  1.

 C++ version code review: Have addressed all feedbacks. The last
 step is testing. Hopefully tomorrow the testing can be done.
 2.

 Reviewed bloom filter design from Parquet encryption perspective.
 It is straightforward.
 3.

 Not much done on Java version Parquet side. Worked with Xinli to
 fix several issues.
 4.

 Found throughput issues in Java and fixed it.
 2.

  Xinli:
  1.

 Gidon sent out a design which consolidates different ways of
 deploying parquet encryption, but not much attention is
gained from the
 community. Please have a look if you are interested in.
 2.

 There is a discussion about unifying table properties in
 HMS(HIVE-21848) for both ORC and Parquet column encryption.
Please chime in
 if you have a concern.
 3.

 Java version parquet-mr PR review is being slow. How do we move
 faster? We need more people to review it.
 1.

https://github.com/apache/parquet-mr/pull/613
2.

https://github.com/apache/parquet-mr/pull/614
3.

https://github.com/apache/parquet-mr/pull/643
3.

  Jim
  1.

 What is blocked on the parquet-mr review? We need more people to
 review it. There is a lot of PR now.
 4.

  Deepak
  1.

 Does the parquet encryption work with Hive?
 1.

Yes, we have tested it(xinli).
2.

 Also have questions about table properties definition.
 1.

HIVE-21848(xinli)
2. Bloom filter
  1.

  Junjie Chen
  1.

 We need one more PMC vote
 2.

  Ryan
  1.

 I will have a look next week. Were the issues raised earlier
 addressed?
 1.

Yes(Junjie)
2.

 Parquet-format should be considered as upstream for parquet-cpp
 and parquet-mr that are implementation.
 3.

 We need Encryption specification merge to parquet-format ASAP,
 then bloom filter. Otherwise, parquet-format will depend
parquet-cpp and
 parquet-mr, which is not right.

   https://github.com/apache/parquet-format/pull/68

   https://github.com/apache/parquet-format/pull/142
   1.

  Xinli
  1.

 Is parquet-format 2.6 + encryption compatible with parquet
 2.7(encryption + bloom filter)?
 1.

By design, yes(Gidon)
2.

 Please add Xinli for testing if we have a prototype for bloom
 filter to make sure they are compatible.



   1.

   Parquet-1.11.0 Release Validation
   1.

  Ryan
  1.

 Both Ryan and Zalton are very busy. No progress so far.
 2.

 We need to write a test to make sure the data write/read are
 correct.



   1.

   Remove old Parquet modules


   1.

   Ryan
   1.

  No time. If somebody has time to do it, go for it.


-- 
Xinli Shang


接受:Invitation: Parquet Sync @ Wed Jul 17, 2019 9am - 10am (PDT) (dev@parquet.apache.org)

2019-07-08 Thread surpass...@aliyun.com.INVALID
BEGIN:VCALENDAR
METHOD:Reply
PRODID:-//Tencent Corporation//Foxmail
VERSION:2.0
CALSCALE:GREGORIAN
BEGIN:VEVENT
UID:le8g4gu941dtghlqne2hbr2...@google.com
CLASS:PUBLIC
DTEND:20190717T17Z
CREATED:20190709T011620Z
DTSTAMP:20190708T165313Z
DTSTART:20190717T16Z
SUMMARY:Parquet Sync 
ATTENDEE;CN=surpass...@aliyun.com;RSVP=TRUE;PARTSTAT=ACCEPTED:MAILTO:surpa
 ss...@aliyun.com
LOCATION:https://uber.zoom.us/j/741353276, SEA | 1191 2nd Ave - 08th Fox (
 3 • VC)
ORGANIZER:MAILTO:dev@parquet.apache.org
DESCRIPTION:You have been invited to the following event.\n\nTitle: Parque
 t Sync\nHi all,This is an invitation for the next occasion of the regular 
 sync  \nmeeting of the Parquet community.Xinli ShangJoin Zoom  \nMee
 tinghttps://uber.zoom.us/j/741353276One tap  \nmobile+16699006833,,7413532
 76# US (San Jose)+16468769923,,741353276# US  \n(New York)Dial by your  \n
 location+1 669 900 6833 US
   \n(San Jose)+1 646 876 9
 923  \nUS (New York)855 88
 0 1246  \nUS Toll-free877 
 369 0926 US  \nToll-freeMeeting ID: 741 353 276Find your local number:  \n
 https://zoom.us/u/aZKZunOZ9Join by SIP741353276@zoomcrc.comJoin by  \nH.32
 3162.255.37.11 (US West)162.255.36.11 (US East)221.122.88.195  \n(China)11
 5.114.131.7 (India)213.19.144.110 (EMEA)103.122.166.55  \n(Australia)209.9
 .211.110 (Hong Kong)64.211.144.160 (Brazil)69.174.57.160  \n(Canada)207.22
 6.132.110 (Japan)Meeting ID: 741 353 276\nWhen: Wed Jul 17, 2019 9am – 10a
 m Pacific Time - Los Angeles\nWhere: https://uber.zoom.us/j/741353276, SEA
  | 1191 2nd Ave - 08th Fox (3 •  \nVC)\nCalendar: dev@parquet.apache.org\n
 Who:\n * sha...@uber.com - organizer\n * gg5...@gmail.com\n * 
 Daniel Weeks\n * aniket...@gmail.com\n * daniels...@gmail.com\n   
   * altekruseja...@gmail.com\n * ippokra...@gmail.com\n * Lars Vol
 ker\n * Mohit Sabharwal\n * santlal.gu...@bitwiseglobal.com\n 
 * yumw...@ebay.com\n * szo...@cloudera.com\n * Julien Le Dem\n
  * j.cof...@criteo.com\n * dev@parquet.apache.org\n * m.lacour@cri
 teo.com\n * non...@gmail.com\n * jacq...@apache.org\n * fnotha
 f...@berkeley.edu\n * borokna...@cloudera.com\n * Xu, Cheng A\n 
 * majeti.dee...@gmail.com\n * csringho...@cloudera.com\n * stakiar
 @cloudera.com\n * o.kaidan...@criteo.com\n * bikramjeet.vig@cloude
 ra.com\n * brian.bow...@sas.com\n * apha...@cloudera.com\n * n
 kol...@cloudera.com\n * wesmck...@gmail.com\n * Ryan Blue\n * 
 Wei Han\n * robe...@palantir.com\n * Zoltan Ivanfi\n * smoy@ye
 lp.com\n * xho...@gmail.com\n * gabor.szadovs...@cloudera.com\n   
   * m.li...@criteo.com\n * jimmyjc...@tencent.com\n * Pavi Subende
 ran\n * Reynold Xin\n * b.hano...@criteo.com\n * sunchao@apach
 e.org\n * q...@criteo.com\n * mark.ma...@kognitio.com\n * yali
 a...@twitter.com\n * alexleven...@twitter.com\n * marc...@gmail.co
 m\n * Parth Chandra\n * jbap...@cloudera.com\n * nilangekar.po
 o...@gmail.com\n * Mohammad Islam\n * julien.le...@gmail.com\n 
 * Sergio Pena\n * vercego...@cloudera.com\n\nEvent details:  \nhttps:/
 /www.google.com/calendar/event?action=VIEW=bGU4ZzRndTk0MWR0Z2hscW5lMmh
 icjIzY3MgZGV2QHBhcnF1ZXQuYXBhY2hlLm9yZw=MTUjc2hhbmd4QHViZXIuY29tNDc1NW
 E2NDMxZjcxM2NjNTE0MmUwM2FlMjQyZjA5NDBkZTA0ZTIxOA=America%2FLos_Angeles
 =en=0\n\nInvitation from Google Calendar: https://www.google.com/cal
 endar/\n\nYou are receiving this courtesy email at the account dev@parquet
 .apache.org  \nbecause you are an attendee of this event.\n\nTo stop recei
 ving future updates for this event, decline this event.  \nAlternatively y
 ou can sign up for a Google account at  \nhttps://www.google.com/calendar/
  and control your notification settings for  \nyour entire calendar.\n\nFo
 rwarding this invitation could allow any recipient to send a response to  
 \nthe organizer and be added to the guest list, or invite others regardles
 s  \nof their own invitation status, or to modify your RSVP. Learn more at
   \nhttps://support.google.com/calendar/answer/37135#forwarding\n
LAST-MODIFIED:20190709T011620Z
END:VEVENT
END:VCALENDAR


Invitation: Parquet Sync @ Wed Jul 17, 2019 9am - 10am (PDT) (dev@parquet.apache.org)

2019-07-08 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VEVENT
DTSTART:20190717T16Z
DTEND:20190717T17Z
DTSTAMP:20190708T165313Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:le8g4gu941dtghlqne2hbr2...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Daniel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=RESOURCE;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=TR
 UE;X-NUM-GUESTS=0:mailto:uber.com_53454131313931326e6441766530387468466f783
 356432d393339393...@resource.calendar.google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniket...@gmail.com;X-NUM-GUESTS=0:mailto:aniket...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=daniels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ippokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Lars Volker;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Mohit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=yumw...@ebay.com;X-NUM-GUESTS=0:mailto:yumw...@ebay.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Julien Le Dem;X-NUM-GUESTS=0:mailto:julien.le...@wework.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=j.cof...@criteo.com;X-NUM-GUESTS=0:mailto:j.cof...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jacq...@apache.org;X-NUM-GUESTS=0:mailto:jacq...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=borokna...@cloudera.com;X-NUM-GUESTS=0:mailto:boroknagyz@cloudera.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN="Xu, Cheng A";X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.deepak@gmail.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=csringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringhofer@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=stak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=bikramjeet@cloudera.com;X-NUM-GUESTS=0:mailto:bikramjeet.vig@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=brian.bow...@sas.com;X-NUM-GUESTS=0:mailto:brian.bow...@sas.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=apha...@cloudera.com;X-NUM-GUESTS=0:mailto:apha...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=nkol...@cloudera.com;X-NUM-GUESTS=0:mailto:nkol...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com

Re: Parquet Sync - Meeting notes

2019-05-02 Thread Zoltan Ivanfi
Hi,

I would like to add the following to the notes for topic "1. key signing":
- Zoltan brought up the question of whether and how PMC-s from the US
could remotely sign the keys of committers/PMC-s located in Europe.
- Julien and Ryan commented that for the purpose of signing releases
it is not really necessary for the signer's key to be in the web of
trust as long as it is in the central KEYS file (especially if the
signers participate in Parquet Syncs discussing the RC, thereby
implicitly confirming their ownership of that signature).

Br,

Zoltan

On Tue, Apr 30, 2019 at 10:25 PM Xinli shang  wrote:
>
> Hi all,
>
> This is to follow up of the meeting notes below. I created Jira ticket 
> PARQUET-1396 and the design can be found here.  The recorded video in Hadoop 
> Contributor Meetup can also help reading the design. Please share your 
> feedback by commenting on the design doc.
>
> On top of Gidon’s change, we introduced a plugin/interface to Parquet to 
> activate encryption and build up encryption properties. Currently, we 
> implement its schema driven implementation, but it can be implemented in 
> another way too. I will send out the design soon.
>
>
> Xinli
>
> On Tue, Apr 30, 2019 at 12:30 PM Xinli shang  wrote:
>>
>> 4/30/2019
>>
>>
>> Attendee:
>>
>> Zoltan and Several other folks(Cloudera)
>>
>> Brian (SaS?)
>>
>> Ryan Blue(Netflix)
>>
>> Julien(WeWorks)
>>
>> Wes McKinney(Ursa Labs)
>>
>> Gidon Gershinsky(IBM)
>>
>> Steven(?)
>>
>> Anikt(?)
>>
>> Deepak(?)
>>
>> Xinli Shang(Uber)
>>
>>
>> Topics:
>>
>> Key signing issue
>>
>> Zoltan/Julien/Ryan:
>>
>> We already have email exchange of this issue.
>>
>> In the past, it is done in person. But it is OK to sign each other via video 
>> conference. We can do a video session of signing keys.
>>
>> It is painful to do this every release
>>
>>
>> Column Encryption
>>
>> Gidon:
>>
>> C++ version progress well. It is pretty much done.
>>
>> Wait for Parquet-1.11.0 release to send out code review
>>
>> Found issues in Java. Worked around it. Will talk to Java community.
>>
>> Xinli:
>>
>> On top of Gidon’s change, we introduced a plugin/interface to Parquet to 
>> activate encryption and build up encryption properties. Currently, we 
>> implement its schema driven implementation, but it can be implemented in 
>> another way too. I will send out the design soon.
>>
>> Gidon:
>>
>> Overall we took a bottom-up approach. We might need another layer on top of 
>> these to make the adoption easier.
>>
>> Ryan:
>>
>> Different companies can have a different implementation. It is good to have 
>> a plugin mode.
>>
>> Brian: Question of the key metadata, KMS.
>>
>> Currently, Parquet designs it as a byte array. Depending on the 
>> implementation, it can be used to record the KMS/Key Metadata.
>>
>> Parquet-1.11.0 Release Validation
>>
>> Ryan
>>
>> Validate the write path of column index - We need to test the calculation is 
>> correct; Validation is independent. Ryan will take this task.
>>
>> Brian:
>>
>> Can help some testing in Summer if needed.
>>
>> Steven:
>>
>> What is the test strategy, any fuzzing test?
>>
>> Ryan:
>>
>> We have some random test but not reliable. Inside Netflix, we have stable 
>> fuzzing test. May need to port some to Parquet.
>>
>> Xinli:
>>
>> We have run a lot of regression test on Parquet-1.11.0. We add encryption 
>> code on top of 1.11.0 and run a lot of tests. No new feature test of 1.110 
>> but existing features tests are so far so good. Let us know if you want us 
>> to add some more tests into our test suite.
>>
>>
>> Remove old Parquet modules
>>
>> Ryan
>>
>> We should remove those old modules if they are not needed
>>
>> Hive module - Seems not used
>>
>> Scrooge module - if it is only used by one company, we might not want to 
>> maintain it
>>
>> Does anybody still use parquet-tools instead of parquet-cli? Maybe we can 
>> mark it as deprecated.
>>
>> Open a Jira ticket for it.
>>
>> Julien
>>
>> Twitter may use it. Julien will check with Twitter.
>>
>> We should communicate widely.
>>
>>
>> --
>> Xinli Shang (Uber)
>
>
>
> --
> Xinli Shang


Re: Parquet Sync - Meeting notes

2019-04-30 Thread Xinli shang
Hi all,

This is to follow up of the meeting notes below. I created Jira ticket
PARQUET-1396  and the
design can be found here
.
The recorded video  in Hadoop
Contributor Meetup can also help reading the design. Please share your
feedback by commenting on the design doc.


   1. On top of Gidon’s change, we introduced a plugin/interface to Parquet
   to activate encryption and build up encryption properties. Currently, we
   implement its schema driven implementation, but it can be implemented in
   another way too. I will send out the design soon.


Xinli

On Tue, Apr 30, 2019 at 12:30 PM Xinli shang  wrote:

> 4/30/2019
>
> Attendee:
>
> Zoltan and Several other folks(Cloudera)
>
> Brian (SaS?)
>
> Ryan Blue(Netflix)
>
> Julien(WeWorks)
>
> Wes McKinney(Ursa Labs)
>
> Gidon Gershinsky(IBM)
>
> Steven(?)
>
> Anikt(?)
>
> Deepak(?)
>
> Xinli Shang(Uber)
>
>
> Topics:
>
>1.
>
>Key signing issue
>1.
>
>   Zoltan/Julien/Ryan:
>   1.
>
>  We already have email exchange of this issue.
>  2.
>
>  In the past, it is done in person. But it is OK to sign each
>  other via video conference. We can do a video session of signing 
> keys.
>  3.
>
>  It is painful to do this every release
>
>
>
>1.
>
>Column Encryption
>1.
>
>   Gidon:
>   1.
>
>  C++ version progress well. It is pretty much done.
>  2.
>
>  Wait for Parquet-1.11.0 release to send out code review
>  3.
>
>  Found issues in Java. Worked around it. Will talk to Java
>  community.
>  2.
>
>   Xinli:
>   1.
>
>  On top of Gidon’s change, we introduced a plugin/interface to
>  Parquet to activate encryption and build up encryption properties.
>  Currently, we implement its schema driven implementation, but it can 
> be
>  implemented in another way too. I will send out the design soon.
>  3.
>
>   Gidon:
>   1.
>
>  Overall we took a bottom-up approach. We might need another
>  layer on top of these to make the adoption easier.
>  4.
>
>   Ryan:
>   1.
>
>  Different companies can have a different implementation. It is
>  good to have a plugin mode.
>  5.
>
>   Brian: Question of the key metadata, KMS.
>   1.
>
>  Currently, Parquet designs it as a byte array. Depending on the
>  implementation, it can be used to record the KMS/Key Metadata.
>  2.
>
>Parquet-1.11.0 Release Validation
>1.
>
>   Ryan
>   1.
>
>  Validate the write path of column index - We need to test the
>  calculation is correct; Validation is independent. Ryan will take 
> this task.
>  2.
>
>   Brian:
>   1.
>
>  Can help some testing in Summer if needed.
>  3.
>
>   Steven:
>   1.
>
>  What is the test strategy, any fuzzing test?
>  4.
>
>   Ryan:
>   1.
>
>  We have some random test but not reliable. Inside Netflix, we
>  have stable fuzzing test. May need to port some to Parquet.
>  5.
>
>   Xinli:
>   1.
>
>  We have run a lot of regression test on Parquet-1.11.0. We add
>  encryption code on top of 1.11.0 and run a lot of tests. No new 
> feature
>  test of 1.110 but existing features tests are so far so good. Let us 
> know
>  if you want us to add some more tests into our test suite.
>
>
>
>1.
>
>Remove old Parquet modules
>
>
>1.
>
>Ryan
>1.
>
>   We should remove those old modules if they are not needed
>   2.
>
>   Hive module - Seems not used
>   3.
>
>   Scrooge module - if it is only used by one company, we might not
>   want to maintain it
>   4.
>
>   Does anybody still use parquet-tools instead of parquet-cli? Maybe
>   we can mark it as deprecated.
>   5.
>
>   Open a Jira ticket for it.
>   2.
>
>Julien
>1.
>
>   Twitter may use it. Julien will check with Twitter.
>   2.
>
>   We should communicate widely.
>
>
> --
> Xinli Shang (Uber)
>


-- 
Xinli Shang


Parquet Sync - Meeting notes

2019-04-30 Thread Xinli shang
4/30/2019

Attendee:

Zoltan and Several other folks(Cloudera)

Brian (SaS?)

Ryan Blue(Netflix)

Julien(WeWorks)

Wes McKinney(Ursa Labs)

Gidon Gershinsky(IBM)

Steven(?)

Anikt(?)

Deepak(?)

Xinli Shang(Uber)


Topics:

   1.

   Key signing issue
   1.

  Zoltan/Julien/Ryan:
  1.

 We already have email exchange of this issue.
 2.

 In the past, it is done in person. But it is OK to sign each other
 via video conference. We can do a video session of signing keys.
 3.

 It is painful to do this every release



   1.

   Column Encryption
   1.

  Gidon:
  1.

 C++ version progress well. It is pretty much done.
 2.

 Wait for Parquet-1.11.0 release to send out code review
 3.

 Found issues in Java. Worked around it. Will talk to Java
 community.
 2.

  Xinli:
  1.

 On top of Gidon’s change, we introduced a plugin/interface to
 Parquet to activate encryption and build up encryption properties.
 Currently, we implement its schema driven implementation, but
it can be
 implemented in another way too. I will send out the design soon.
 3.

  Gidon:
  1.

 Overall we took a bottom-up approach. We might need another layer
 on top of these to make the adoption easier.
 4.

  Ryan:
  1.

 Different companies can have a different implementation. It is
 good to have a plugin mode.
 5.

  Brian: Question of the key metadata, KMS.
  1.

 Currently, Parquet designs it as a byte array. Depending on the
 implementation, it can be used to record the KMS/Key Metadata.
 2.

   Parquet-1.11.0 Release Validation
   1.

  Ryan
  1.

 Validate the write path of column index - We need to test the
 calculation is correct; Validation is independent. Ryan will
take this task.
 2.

  Brian:
  1.

 Can help some testing in Summer if needed.
 3.

  Steven:
  1.

 What is the test strategy, any fuzzing test?
 4.

  Ryan:
  1.

 We have some random test but not reliable. Inside Netflix, we have
 stable fuzzing test. May need to port some to Parquet.
 5.

  Xinli:
  1.

 We have run a lot of regression test on Parquet-1.11.0. We add
 encryption code on top of 1.11.0 and run a lot of tests. No
new feature
 test of 1.110 but existing features tests are so far so good.
Let us know
 if you want us to add some more tests into our test suite.



   1.

   Remove old Parquet modules


   1.

   Ryan
   1.

  We should remove those old modules if they are not needed
  2.

  Hive module - Seems not used
  3.

  Scrooge module - if it is only used by one company, we might not want
  to maintain it
  4.

  Does anybody still use parquet-tools instead of parquet-cli? Maybe we
  can mark it as deprecated.
  5.

  Open a Jira ticket for it.
  2.

   Julien
   1.

  Twitter may use it. Julien will check with Twitter.
  2.

  We should communicate widely.


-- 
Xinli Shang (Uber)


Invitation: Parquet Sync @ Tue Apr 30, 2019 9am - 10am (PDT) (dev@parquet.apache.org)

2019-04-22 Thread shangx
BEGIN:VCALENDAR
PRODID:-//Google Inc//Google Calendar 70.9054//EN
VERSION:2.0
CALSCALE:GREGORIAN
METHOD:REQUEST
BEGIN:VEVENT
DTSTART:20190430T16Z
DTEND:20190430T17Z
DTSTAMP:20190422T145846Z
ORGANIZER;CN=sha...@uber.com:mailto:sha...@uber.com
UID:neek24e0s0ipb1jvapvfk3e...@google.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=ACCEPTED;RSVP=TRUE
 ;CN=sha...@uber.com;X-NUM-GUESTS=0:mailto:sha...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Daniel Weeks;X-NUM-GUESTS=0:mailto:dwe...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=aniket...@gmail.com;X-NUM-GUESTS=0:mailto:aniket...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=daniels...@gmail.com;X-NUM-GUESTS=0:mailto:daniels...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=altekruseja...@gmail.com;X-NUM-GUESTS=0:mailto:altekrusejason@gmail
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=ippokra...@gmail.com;X-NUM-GUESTS=0:mailto:ippokra...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=l...@cloudera.com;X-NUM-GUESTS=0:mailto:l...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Mohit Sabharwal;X-NUM-GUESTS=0:mailto:mo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=santlal.gu...@bitwiseglobal.com;X-NUM-GUESTS=0:mailto:santlal.gupta
 @bitwiseglobal.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=szo...@cloudera.com;X-NUM-GUESTS=0:mailto:szo...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=julien.le...@wework.com;X-NUM-GUESTS=0:mailto:julien.ledem@wework.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=j.cof...@criteo.com;X-NUM-GUESTS=0:mailto:j.cof...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=dev@parquet.apache.org;X-NUM-GUESTS=0:mailto:dev@parquet.apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=m.lac...@criteo.com;X-NUM-GUESTS=0:mailto:m.lac...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=non...@gmail.com;X-NUM-GUESTS=0:mailto:non...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=jacq...@apache.org;X-NUM-GUESTS=0:mailto:jacq...@apache.org
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=fnoth...@berkeley.edu;X-NUM-GUESTS=0:mailto:fnoth...@berkeley.edu
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=borokna...@cloudera.com;X-NUM-GUESTS=0:mailto:boroknagyz@cloudera.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=cheng.a...@intel.com;X-NUM-GUESTS=0:mailto:cheng.a...@intel.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=gg5...@gmail.com;X-NUM-GUESTS=0:mailto:gg5...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=majeti.dee...@gmail.com;X-NUM-GUESTS=0:mailto:majeti.deepak@gmail.c
 om
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=csringho...@cloudera.com;X-NUM-GUESTS=0:mailto:csringhofer@cloudera
 .com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=stak...@cloudera.com;X-NUM-GUESTS=0:mailto:stak...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=o.kaidan...@criteo.com;X-NUM-GUESTS=0:mailto:o.kaidan...@criteo.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=bikramjeet@cloudera.com;X-NUM-GUESTS=0:mailto:bikramjeet.vig@cl
 oudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=apha...@cloudera.com;X-NUM-GUESTS=0:mailto:apha...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=nkol...@cloudera.com;X-NUM-GUESTS=0:mailto:nkol...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wesmck...@gmail.com;X-NUM-GUESTS=0:mailto:wesmck...@gmail.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=Ryan Blue;X-NUM-GUESTS=0:mailto:rb...@netflix.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=wei...@uber.com;X-NUM-GUESTS=0:mailto:wei...@uber.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 TRUE;CN=z...@cloudera.com;X-NUM-GUESTS=0:mailto:z...@cloudera.com
ATTENDEE;CUTYPE=INDIVIDUAL;ROLE=REQ-PARTICIPANT;PARTSTAT=NEEDS-ACTION;RSVP=
 

  1   2   3   4   >