Re: [DISCUSS] Write-audit-publish support

From a timeline perspective, we can’t work on implementing this feature in next a couple of months. For short term workaround, we choose a lock mechanism at application level. @Anton Okolnychyi If you can pick up this feature, it will be great! Thanks!

Re: [ANNOUNCE] Apache Iceberg release 0.7.0-incubating

Congratulations! Miao From: Xabriel Collazo Mojica Reply-To: "dev@iceberg.apache.org" Date: Monday, October 28, 2019 at 9:08 AM To: "dev@iceberg.apache.org" Subject: Re: [ANNOUNCE] Apache Iceberg release 0.7.0-incubating This is great news! Thanks to all involved in development as well as

Re: Iceberg tombstone?

existing filter code and our Table interface to wrap existing readers. On the other hand, if that's not what you want then I'm not sure how it differs from the existing plan to add row-level deletes. Can you clarify? rb On Wed, Jan 15, 2020 at 11:04 AM Miao Wang wrote: Hi Filip, I

Re: Welcome new committer and PPMC member Ratandeep Ratti

Congratulations! Sent from my iPhone On Feb 17, 2020, at 3:38 PM, Gara Walid wrote:  Congratulations! Cheers, Walid On Mon, Feb 17, 2020, 10:04 PM John Zhuge mailto:jzh...@apache.org>> wrote: Congratulations ! On Mon, Feb 17, 2020 at 12:47 PM Rohan Agarwal

Re: Iceberg tombstone?

Hi Filip, I vote for this feature because it is extensible for [1]. Besides Openlnx’s comments, can you provide a high level description on how tombstone aligns with milestone [1]? [1]. https://github.com/apache/incubator-iceberg/milestone/4 Thanks! Miao From: OpenInx Reply-To:

Re: Open a new branch for row-delete feature ?

+1 on not creating a branch now. Rebasing and maintenance are too expensive, comparing of fast development. Some additional thoughts below. Row-delete feature should be behind a feature flag, which implies that it should have minimum impact on Master branch if it is turned off. Working on

Re: Timestamp Based Incremental Reading in Iceberg ...

+1 Openlnx’s comment on implementation. Only if we have an external timing synchronization service and enforce all clients using the service, timestamps of different clients are not comparable. So, there are two asks: 1). Whether to have a timestamp based API for delta reading; 2). How to

Re: New committer: Shardul Mahadik

Congratulations! Miao Sent from my iPhone > On Jul 22, 2020, at 8:08 PM, 俊杰陈 wrote: > > Congrats! Good job! > >> On Thu, Jul 23, 2020 at 11:01 AM Saisai Shao wrote: >> >> Congrats! >> >> Thanks >> Saisai >> >> OpenInx 于2020年7月23日周四 上午10:06写道： >>> >>> Congratulations ! >>> >>> On Thu,

Iceberg At Adobe

Hi, Our team post 1 blog about Iceberg use case at Adobe. https://medium.com/adobetech/iceberg-at-adobe-88cf1950e866 There will be a series of blogs to show more details. Miao

Secondary Index Support Draft

Hi, As we discussed in the sync up meeting, I come up with a draft for secondary index support. Draft. It is WIP. Detailed API design is not included in this version. Thanks! Miao

Re: Sync to discuss secondary index proposal

major reasons that I put my thoughts on building data format and compute engine agnostic into the draft. Miao From: OpenInx Date: Thursday, January 28, 2021 at 6:31 PM To: Iceberg Dev List , Miao Wang Cc: Ryan Blue Subject: Re: Sync to discuss secondary index proposal Sorry I sent the wron

Re: Welcoming OpenInx as a new PMC member!

Congratulations! Sent from my iPhone On Jun 29, 2021, at 4:57 PM, Steven Wu wrote:  Congrats! On Tue, Jun 29, 2021 at 2:12 PM Huadong Liu mailto:huadong...@gmail.com>> wrote: Congrats Zheng! On Tue, Jun 29, 2021 at 1:52 PM Ryan Blue mailto:b...@apache.org>> wrote: Hi everyone, I'd like

Re: Welcoming Jack Ye as a new committer!

Congratulations! Miao Sent from my iPhone On Jul 5, 2021, at 4:14 PM, Daniel Weeks wrote:  Great work Jack, Congratulations! On Mon, Jul 5, 2021 at 1:21 PM karuppayya mailto:karuppayya1...@gmail.com>> wrote: Congratulations Jack! On Mon, Jul 5, 2021 at 1:14 PM Yufei Gu

Re: Welcoming Russell Spitzer as a new committer

Congratulations Russell! Miao From: Szehon Ho Reply-To: "dev@iceberg.apache.org" Date: Monday, March 29, 2021 at 9:12 AM To: "dev@iceberg.apache.org" Subject: Re: Welcoming Russell Spitzer as a new committer Awesome, well-deserved, Russell! Szehon On 29 Mar 2021, at 18:10, Holden Karau

Re: Welcoming Yan Yan as a new committer!

Congrats @Yan Yan! Miao From: Ryan Blue Reply-To: "dev@iceberg.apache.org" Date: Tuesday, March 23, 2021 at 3:43 PM To: Iceberg Dev List Subject: Welcoming Yan Yan as a new committer! Hi everyone, I'd like to welcome Yan Yan as a new Iceberg committer. Thanks for

Re: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

It works for me. With a quick thought, there may be a few concerns about consolidated fashion storage. 1). Maintaining the consolidated storage may be a bit more complex; 2). It may make collecting index while writing data file (i.e., online index building) more complex (e.g., we need to

Re: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

looking forward thanks! Paula Paula Ta-Shma, Ph.D. Cloud Storage and Analytics IBM Research - Haifa Phone:+972.74.7929402 Email: pa...@il.ibm.com<mailto:pa...@il.ibm.com> From:Miao Wang To:"dev@iceberg.apache.org<mailto:dev@iceberg.apache.org>" ma

Re: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

Hi Guy, I will read the doc in the weekend. Thanks! Miao From: Guy Khazma Reply-To: "dev@iceberg.apache.org" Date: Friday, February 19, 2021 at 8:49 AM To: "dev@iceberg.apache.org" Subject: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg Hi All, Following up on our

Re: Continuing the Secondary Index Discussion

would like to restart the thread to continue the discussion. So far most people refer to the document authored by Miao Wang<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdocs.google.com%2Fdocument%2Fd%2F1E1ofBQoKRnX04bWT3utgyHQGaHZoelgXosk_UNsTUuQ%2Fedit=04%7

Re: [VOTE] Adopt Puffin format as a file format for statistics and indexes

+1 on the format! It looks great! Thanks for materializing the initial design idea. Miao From: Kyle Bendickson Date: Sunday, June 12, 2022 at 1:55 PM To: dev@iceberg.apache.org Subject: Re: [VOTE] Adopt Puffin format as a file format for statistics and indexes EXTERNAL: Use caution when