Jack, I've been reviewing that one so that we can get it in. Thanks for fixing it!
On Mon, Aug 2, 2021 at 3:12 PM Jack Ye <yezhao...@gmail.com> wrote: > Thanks for the update Carl! > > Given that we have voted for the adoption of format v2, can we also get > this change in, so that people can start to use v2 tables? > https://github.com/apache/iceberg/pull/2887 > > -Jack > > On Mon, Aug 2, 2021 at 3:08 PM Carl Steinbach <c...@apache.org> wrote: > >> I want to provide everyone with a quick update on the 0.12.0 release >> process. At this point, #2906 Fix Partition field IDs in table >> replacement <https://github.com/apache/iceberg/pull/2906> is the only >> remaining blocker. Ryan is working on a fix and predicts that we'll be >> ready to cut the first release candidate by the end of this week. >> >> - Carl >> >> On Mon, Jul 19, 2021 at 2:58 PM Szehon Ho <szehon.apa...@gmail.com> >> wrote: >> >>> Hi Carl, >>> >>> For the Issue: https://github.com/apache/iceberg/issues/2783 >>> >>> The status is: I gave a bit of a try but couldn’t find an easy fix, so >>> hoping someone more knowledgable about this code has cycle to take a look >>> at it. >>> >>> It would be great to fix it for 0.12 as it seems to block more metadata >>> queries than before, but for timing purpose I’m not sure if its feasible. >>> >>> Thanks >>> Szehon >>> >>> On Mon, Jul 19, 2021 at 2:19 PM Carl Steinbach <c...@apache.org> wrote: >>> >>>> Hi Everyone, >>>> >>>> Currently, there are three issues blocking the release of 0.12.0: >>>> >>>> >>>> 1. #2308 Handle the case that RewriteFiles and RowDelta commit the >>>> transaction at the same time >>>> <https://github.com/apache/iceberg/issues/2308> >>>> 2. #2783 Metadata Table Empty Projection - Unknown type for int >>>> field. Type name: java.lang.string >>>> <https://github.com/apache/iceberg/issues/2783> >>>> 3. #2284 Core: reassign the partition field IDs and reuse any >>>> existing ID <https://github.com/apache/iceberg/pull/2284>s >>>> >>>> #2284 is in review. >>>> >>>> Ryan said he would take a look at #2308. >>>> >>>> @Szehon Ho <sze...@cloudera.com>, can you please confirm whether or >>>> not you're working on #2783? >>>> >>>> Thanks. >>>> >>>> - Carl >>>> >>>> >>>> >>>> On Mon, Jul 19, 2021 at 12:31 PM Jack Ye <yezhao...@gmail.com> wrote: >>>> >>>>> I haven't heard any news for the 0.12.0 release since then, are we >>>>> still planning for the release? >>>>> >>>>> Please let me know if there is anything we can do to help speed up the >>>>> process. (I just saw the release board, will try to at least review those >>>>> PRs) >>>>> >>>>> Best, >>>>> Jack Ye >>>>> >>>>> On Mon, Jul 12, 2021 at 5:41 PM Sreeram Garlapati < >>>>> gsreeramku...@gmail.com> wrote: >>>>> >>>>>> Great, thanks Ryan. >>>>>> >>>>>> On Mon, Jul 12, 2021 at 5:17 PM Ryan Blue <b...@tabular.io> wrote: >>>>>> >>>>>>> Sreeram, I was just waiting for tests to pass on that PR. I just >>>>>>> merged it. >>>>>>> >>>>>>> On Mon, Jul 12, 2021 at 4:41 PM Sreeram Garlapati < >>>>>>> gsreeramku...@gmail.com> wrote: >>>>>>> >>>>>>>> Hi Carl, >>>>>>>> >>>>>>>> Thanks a lot for managing 0.12.0 release. >>>>>>>> >>>>>>>> Can you also pl. add this PR: >>>>>>>> https://github.com/apache/iceberg/pull/2752 - which adds the >>>>>>>> option "streaming-skip-delete-snapshots" - to Spark3 micro_batch >>>>>>>> reader. Without this, streaming reads will fail if a snapshot of type >>>>>>>> delete or replace is encountered, & is pretty much unusable. This PR is >>>>>>>> already approved by multiple Committers - Ryan and Russell. >>>>>>>> >>>>>>>> PS: I am unsure if new PRs will be merged apart from the list >>>>>>>> proposed on the project board - into the *0.12.0* release, and >>>>>>>> hence, proposing this. If this PR will be merged - no action is >>>>>>>> needed. pl. >>>>>>>> pardon my ignorance. >>>>>>>> >>>>>>>> Best regards, >>>>>>>> Sreeram >>>>>>>> >>>>>>>> On Mon, Jul 12, 2021 at 4:14 PM Carl Steinbach <c...@tabular.io> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Hi Grant, >>>>>>>>> >>>>>>>>> Good catch! I added PR-1648 >>>>>>>>> <https://github.com/apache/iceberg/pull/1648> to the 0.12.0 >>>>>>>>> project board. >>>>>>>>> >>>>>>>>> - Carl >>>>>>>>> >>>>>>>>> On Mon, Jul 12, 2021 at 1:16 PM Grant Nicholas <gr...@spothero.com> >>>>>>>>> wrote: >>>>>>>>> >>>>>>>>>> Howdy! Any updates on PR-1648 >>>>>>>>>> <https://github.com/apache/iceberg/pull/1648> which upgrades the >>>>>>>>>> avro version used in iceberg? I do not see it in the "To-Do" section >>>>>>>>>> linked >>>>>>>>>> above, but the older avro version has caused major problems >>>>>>>>>> described in >>>>>>>>>> this issue and it would be nice to get in 0.12.0. >>>>>>>>>> https://github.com/apache/iceberg/issues/1654 >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, Jul 12, 2021 at 2:39 PM Carl Steinbach <c...@apache.org> >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> Hi Everyone, >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> I volunteered to be the release manager for the 0.12.0 release. >>>>>>>>>>> My goal is to start cutting release candidates this Friday, 7/17 at >>>>>>>>>>> 24:00 >>>>>>>>>>> PST. I am tracking progress on this release on the Release >>>>>>>>>>> 0.12.0 Project Board >>>>>>>>>>> <https://github.com/apache/iceberg/projects/1>. Note that this >>>>>>>>>>> board only tracks issues that BLOCK the release. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> There are currently 7 PRs listed in the To-Do >>>>>>>>>>> <https://github.com/apache/iceberg/projects/1#column-14786627> >>>>>>>>>>> column. I am going to remove these PRs from the 0.12.0 release >>>>>>>>>>> tomorrow, >>>>>>>>>>> 7/13 at 24:00 PST, unless they are updated with the following >>>>>>>>>>> information: >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> 1) Why does the PR need to be included in the 0.12.0 release? >>>>>>>>>>> >>>>>>>>>>> 2) When will the PR will be ready for review? >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> If you have any questions or concerns, please get in touch with >>>>>>>>>>> me over email or slack. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Thanks. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> - Carl >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> >>>>>>>>>> [image: SpotHero] <http://spothero.com/> >>>>>>>>>> >>>>>>>>>> Grant Nicholas / Senior Data Engineer II >>>>>>>>>> Pronouns <https://lgbt.ucsf.edu/pronounsmatter>: he/his >>>>>>>>>> gr...@spothero.com >>>>>>>>>> spothero.com <http://www.spothero.com/> | LinkedIn >>>>>>>>>> <https://www.linkedin.com/in/grantanicholas> >>>>>>>>>> *Your perfect spot is waiting for you! Learn more >>>>>>>>>> at spothero.com/careers <http://spothero.com/careers>* >>>>>>>>>> >>>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Ryan Blue >>>>>>> Tabular >>>>>>> >>>>>> -- Ryan Blue Tabular