Re: Welcome new committers and PMC!

2023-05-03 Thread Gidon Gershinsky
Congratulations Amogh, Eduard, Szehon! Cheers, Gidon On Thu, May 4, 2023 at 7:59 AM Péter Váry wrote: > Congratulations everyone! > Well deserved! > > On Thu, May 4, 2023, 03:42 Steve Zhang > wrote: > >> Congrats everyone! Well deserved and great job! >> >> Thanks, >> Steve Zhang >> >> >> >>

Re: Welcome new PMC members!

2023-04-12 Thread Gidon Gershinsky
Congrats Fokko, Steven, Yufei! Cheers, Gidon On Wed, Apr 12, 2023 at 7:14 AM Ajantha Bhat wrote: > Congratulations to all. > > On Wed, Apr 12, 2023 at 8:51 AM OpenInx wrote: > >> Congrats ! >> >> On Wed, Apr 12, 2023 at 10:25 AM Junjie Chen >> wrote: >> >>> Congratulations to all of you!

Re: Welcome Yufei Gu as a committer

2022-08-26 Thread Gidon Gershinsky
Congratulations, Yufei! Cheers, Gidon On Fri, Aug 26, 2022 at 7:30 AM Christiano Anderson wrote: > Congrats, Yufei! > > > > > --- Original Message --- > On Friday, August 26th, 2022 at 01:20, Anton Okolnychyi > wrote: > > > > > > > > I’d like to welcome Yufei Gu as a committer to the

Re: Welcome new PMC members!

2021-11-17 Thread Gidon Gershinsky
Congratulations guys!! Cheers, Gidon On Thu, Nov 18, 2021 at 2:12 AM Ryan Blue wrote: > Hi everyone, I want to welcome Jack Ye and Russell Spitzer to the Iceberg > PMC. They've both been amazing at reviewing and helping people in the > community and the PMC has decided to invite them to join.

Fwd: Data encryption in Iceberg

2021-09-28 Thread Gidon Gershinsky
Hi all, The encryption sync is set for next Tue, October 5, at 9am PDT. Additional folks interested to join - let me know in a direct message. Cheers, Gidon -- Forwarded message - From: Gidon Gershinsky Date: Wed, Sep 1, 2021 at 9:10 PM Subject: Fwd: Data encryption in Iceberg

Re: [DISCUSS] Iceberg roadmap

2021-09-13 Thread Gidon Gershinsky
Hi Ryan, I just wonder if the encryption should be a Spec v3 category. We have the key_metadata fields in both data_file and manifest_file structs, which might be sufficient for a reasonable basic encryption support. But I certainly agree this is an L-sized project. Cheers, Gidon On Sat, Sep

Fwd: Data encryption in Iceberg

2021-09-01 Thread Gidon Gershinsky
- From: Gidon Gershinsky Date: Mon, Aug 30, 2021 at 5:57 PM Subject: Re: Data encryption in Iceberg To: Hi Jack, Thank you. We've been indeed busy with building the Iceberg data encryption code, since we have quite a demand for this functionality (with timeline requirements..). I've

Re: Data encryption in Iceberg

2021-08-30 Thread Gidon Gershinsky
this is a long-running distributed procedure, my > feeling is that the community will lean towards a procedure call. > > We can continue with the discussion around this while first doing the > detailed implementation. Let's set up a discussion around this so that we > can align the efforts.

Data encryption in Iceberg

2021-08-25 Thread Gidon Gershinsky
Hi all, We have briefly discussed this subject in a June sync, with a decision to continue via the mailing list. There are a number of pull requests from Jack and myself that implement a set of disjoint elements from the high-level design

Re: Welcoming Russell Spitzer as a new committer

2021-03-29 Thread Gidon Gershinsky
Congratulations Russell!! On Mon, Mar 29, 2021, 19:21 Chao Sun wrote: > Congrats Russell! > > On Mon, Mar 29, 2021 at 9:15 AM Xinli shang > wrote: > >> Congratulations Russell! >> >> On Mon, Mar 29, 2021 at 9:13 AM Miao Wang >> wrote: >> >>> Congratulations Russell! >>> >>> >>> >>> Miao >>>

Re: Key rotation in Iceberg data encryption

2021-03-25 Thread Gidon Gershinsky
gh is we basically lose the > history of the table when we do this process. > > I'm not as big a fan of the new external file approach, mainly because I > think we have a new object to keep track of and unlike bloom filters, this > is extremely sensitive information. I think we

Key rotation in Iceberg data encryption

2021-03-25 Thread Gidon Gershinsky
Hi all, We're working with Jack on a design for encryption of Iceberg data tables, and got a question / decision point we'd like to bring to the community's attention. Might be a bit exotic, but is important, so we have to try this. Any input on this subject, or pointers to relevant contacts /

Re: Extending Apache Iceberg Encryption Module

2021-03-25 Thread Gidon Gershinsky
“(1) is a direct DEK passing; we've considered it for Parquet, but decided > against it, because it can lead to unsafe situations” > > > > Nice, I think I also mentioned in the doc that I am against using this > scheme, so we can focus more on supporting the single and double wrapping

Re: Extending Apache Iceberg Encryption Module

2021-03-24 Thread Gidon Gershinsky
east the location and structure of AAD prefix > should be discussed, so hopefully we can reach some general consensus for > integrity support for Iceberg tables and make sure the right information is > in place or can be added later. > > > > I am also working on a POC to flush

Re: Extending Apache Iceberg Encryption Module

2021-03-23 Thread Gidon Gershinsky
Hi Jack, We're working on Parquet encryption, which is about to be released in the upcoming parquet-mr-1.12 version. Recently, we've started to look into its integration in Iceberg. It became immediately clear we need to take a wider view that covers other types of encryption in Iceberg (file