Hi Russel, Spark 3.5: Fix NotSerializableException when migrating Spark tables > <https://github.com/apache/iceberg/pull/11157>
Given this can't make it in time, I submitted a PR[1] to add a warning in the doc that "parallelism > 1" doesn't work for migration procedures. Please help review it. [1] https://github.com/apache/iceberg/pull/11417 Thanks, Manu On Tue, Oct 29, 2024 at 2:17 AM Russell Spitzer <russell.spit...@gmail.com> wrote: > We currently have the following PR's still in the 1.7.0 Milestone. I want > to remove any that aren't ready to go by the end of the day so if you have > strong feelings about some of these please coordinate with committers to > review and get this code in. > > *Please do not tag any additional PR's as 1.7.0 unless they are a clear > bug and regression*. I expect the PR's below to either get reviewed or I > can just move them out to the next release. > > > https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22 > > AWS: Refresh vended credentials > <https://github.com/apache/iceberg/pull/11389> AWS > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3AAWS> > 22 <https://github.com/apache/iceberg/pull/11389> > Flink 1.20: Update Flink to use planned Avro reads > <https://github.com/apache/iceberg/pull/11386> flink > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Aflink> > 10 <https://github.com/apache/iceberg/pull/11386> > GCS: Refresh vended credentials > <https://github.com/apache/iceberg/pull/11282> build > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Abuild> > core > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Acore> > GCP > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3AGCP> > 5 <https://github.com/apache/iceberg/pull/11282> > Data: Add partition stats writer and reader > <https://github.com/apache/iceberg/pull/11216> core > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Acore> > data > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Adata> > 22 <https://github.com/apache/iceberg/pull/11216> > Spark 3.5: Fix NotSerializableException when migrating Spark tables > <https://github.com/apache/iceberg/pull/11157> API > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3AAPI> > data > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Adata> > spar > <https://github.com/apache/iceberg/pulls?q=is%3Aopen+is%3Apr+milestone%3A%22Iceberg+1.7.0%22+label%3Aspark> > 1 > <https://github.com/apache/iceberg/issues/11157/linked_closing_reference?reference_location=REPO_ISSUES_INDEX> > 17 <https://github.com/apache/iceberg/pull/11157> >
