Thanks, Jack and Ryan, for closing out these issues. Since there are no more blockers, I will start preparing a release candidate.
- Carl On Tue, Aug 3, 2021 at 3:29 PM Ryan Blue <b...@tabular.io> wrote: > I just merged the PR. Thanks for making it possible to create v2 tables > easily, Jack! > > On Tue, Aug 3, 2021 at 1:02 PM Jack Ye <yezhao...@gmail.com> wrote: > >> Thanks! The PR is mostly ready and just got approved by Anton. As soon as >> it is merged we can start the branch cut. >> -Jack >> >> On Mon, Aug 2, 2021 at 11:39 PM Carl Steinbach <cwsteinb...@gmail.com> >> wrote: >> >>> Hi Jack, >>> >>> I added #2887 to the 0.12.0 release project board >>> <https://github.com/apache/iceberg/projects/1>. When do you think this >>> patch will be committed? >>> >>> - Carl >>> >>> On Mon, Aug 2, 2021 at 4:28 PM Ryan Blue <b...@tabular.io> wrote: >>> >>>> Jack, I've been reviewing that one so that we can get it in. Thanks for >>>> fixing it! >>>> >>>> On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <yezhao...@gmail.com> wrote: >>>> >>>>> Thanks for the update Carl! >>>>> >>>>> Given that we have voted for the adoption of format v2, can we also >>>>> get this change in, so that people can start to use v2 tables? >>>>> https://github.com/apache/iceberg/pull/2887 >>>>> >>>>> -Jack >>>>> >>>>> On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <c...@apache.org> wrote: >>>>> >>>>>> I want to provide everyone with a quick update on the 0.12.0 release >>>>>> process. At this point, #2906 Fix Partition field IDs in table >>>>>> replacement <https://github.com/apache/iceberg/pull/2906> is the >>>>>> only remaining blocker. Ryan is working on a fix and predicts that we'll >>>>>> be >>>>>> ready to cut the first release candidate by the end of this week. >>>>>> >>>>>> - Carl >>>>>> >>>>>> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> Hi Carl, >>>>>>> >>>>>>> For the Issue: https://github.com/apache/iceberg/issues/2783 >>>>>>> >>>>>>> The status is: I gave a bit of a try but couldn’t find an easy fix, >>>>>>> so hoping someone more knowledgable about this code has cycle to take a >>>>>>> look at it. >>>>>>> >>>>>>> It would be great to fix it for 0.12 as it seems to block more >>>>>>> metadata queries than before, but for timing purpose I’m not sure if its >>>>>>> feasible. >>>>>>> >>>>>>> Thanks >>>>>>> Szehon >>>>>>> >>>>>>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> >>>>>>> wrote: >>>>>>> >>>>>>>> Hi Everyone, >>>>>>>> >>>>>>>> Currently, there are three issues blocking the release of 0.12.0: >>>>>>>> >>>>>>>> >>>>>>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit >>>>>>>> the transaction at the same time >>>>>>>> <https://github.com/apache/iceberg/issues/2308> >>>>>>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int >>>>>>>> field. Type name: java.lang.string >>>>>>>> <https://github.com/apache/iceberg/issues/2783> >>>>>>>> 3. #2284 Core: reassign the partition field IDs and reuse any >>>>>>>> existing ID <https://github.com/apache/iceberg/pull/2284>s >>>>>>>> >>>>>>>> #2284 is in review. >>>>>>>> >>>>>>>> Ryan said he would take a look at #2308. >>>>>>>> >>>>>>>> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether >>>>>>>> or not you're working on #2783? >>>>>>>> >>>>>>>> Thanks. >>>>>>>> >>>>>>>> - Carl >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> I haven't heard any news for the 0.12.0 release since then, are we >>>>>>>>> still planning for the release? >>>>>>>>> >>>>>>>>> Please let me know if there is anything we can do to help speed up >>>>>>>>> the process. (I just saw the release board, will try to at least >>>>>>>>> review >>>>>>>>> those PRs) >>>>>>>>> >>>>>>>>> Best, >>>>>>>>> Jack Ye >>>>>>>>> >>>>>>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>>> >>>>>>>>>> Great, thanks Ryan. >>>>>>>>>> >>>>>>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just >>>>>>>>>>> merged it. >>>>>>>>>>> >>>>>>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>>>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>>>>>> >>>>>>>>>>>> Hi Carl, >>>>>>>>>>>> >>>>>>>>>>>> Thanks a lot for managing 0.12.0 release. >>>>>>>>>>>> >>>>>>>>>>>> Can you also pl. add this PR: >>>>>>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the >>>>>>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 >>>>>>>>>>>> micro_batch reader. Without this, streaming reads will fail if a >>>>>>>>>>>> snapshot >>>>>>>>>>>> of type delete or replace is encountered, & is pretty much >>>>>>>>>>>> unusable. This >>>>>>>>>>>> PR is already approved by multiple Committers - Ryan and Russell. >>>>>>>>>>>> >>>>>>>>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>>>>>>>> proposed on the project board - into the *0.12.0* release, and >>>>>>>>>>>> hence, proposing this. If this PR will be merged - no action is >>>>>>>>>>>> needed. pl. >>>>>>>>>>>> pardon my ignorance. >>>>>>>>>>>> >>>>>>>>>>>> Best regards, >>>>>>>>>>>> Sreeram >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <c...@tabular.io> >>>>>>>>>>>> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi Grant, >>>>>>>>>>>>> >>>>>>>>>>>>> Good catch! I added PR-1648 >>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 >>>>>>>>>>>>> project board. >>>>>>>>>>>>> >>>>>>>>>>>>> - Carl >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas < >>>>>>>>>>>>> gr...@spothero.com> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades >>>>>>>>>>>>>> the avro version used in iceberg? I do not see it in the "To-Do" >>>>>>>>>>>>>> section >>>>>>>>>>>>>> linked above, but the older avro version has caused major >>>>>>>>>>>>>> problems >>>>>>>>>>>>>> described in this issue and it would be nice to get in 0.12.0. >>>>>>>>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach < >>>>>>>>>>>>>> c...@apache.org> wrote: >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Hi Everyone, >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 >>>>>>>>>>>>>>> release. My goal is to start cutting release candidates this >>>>>>>>>>>>>>> Friday, 7/17 >>>>>>>>>>>>>>> at 24:00 PST. I am tracking progress on this release on the >>>>>>>>>>>>>>> Release >>>>>>>>>>>>>>> 0.12.0 Project Board >>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that >>>>>>>>>>>>>>> this board only tracks issues that BLOCK the release. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release >>>>>>>>>>>>>>> tomorrow, >>>>>>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>>>>>>>> information: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> If you have any questions or concerns, please get in touch >>>>>>>>>>>>>>> with me over email or slack. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> - Carl >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> >>>>>>>>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>>>>>>>> gr...@spothero.com >>>>>>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Ryan Blue >>>>>>>>>>> Tabular >>>>>>>>>>> >>>>>>>>>> >>>> >>>> -- >>>> Ryan Blue >>>> Tabular >>>> >>> > > -- > Ryan Blue > Tabular >