Python 3.11 support in Apache Beam

2023-02-07 Thread Anand Inguva via dev
Hi all, We are planning to work on adding support for Python 3.11[1] to Apache Beam Python SDK. As part of this effort, we are going to update the python build dependencies defined at [2]. Right now, there is an error with the newer version of protobuf(4.21.11). It is not generating _urn files.

Re: Python 3.11 support in Apache Beam

2023-02-07 Thread Valentyn Tymofieiev via dev
Hi Anand, On Tue, Feb 7, 2023 at 1:35 PM Anand Inguva via dev wrote: > Hi all, > > We are planning to work on adding support for Python 3.11[1] to Apache > Beam Python SDK. > > As part of this effort, we are going to update the python build > dependencies defined at [2]. > > Right now, there is

Re: OpenJDK8 / OpenJDK11 container deprecation

2023-02-07 Thread Robert Bradshaw via dev
Seams reasonable to me. On Tue, Feb 7, 2023 at 4:19 PM Luke Cwik via user wrote: > > As per [1], the JDK8 and JDK11 containers that Apache Beam uses have stopped > being built and supported since July 2022. I have filed [2] to track the > resolution of this issue. > > Based upon [1], almost

Re: Python 3.11 support in Apache Beam

2023-02-07 Thread Valentyn Tymofieiev via dev
On Tue, Feb 7, 2023 at 2:35 PM Anand Inguva wrote: > Yes, it is related to protobuf only. But I think the update of these > dependencies are required for Python 3.11 since the newer versions have > support for Python 3.11 wheels. > Assuming you refer to protobuf. Yes, there are no wheels for

OpenJDK8 / OpenJDK11 container deprecation

2023-02-07 Thread Luke Cwik via dev
As per [1], the JDK8 and JDK11 containers that Apache Beam uses have stopped being built and supported since July 2022. I have filed [2] to track the resolution of this issue. Based upon [1], almost everyone is swapping to the eclipse-temurin container[3] as their base based upon the linked

Re: OpenJDK8 / OpenJDK11 container deprecation

2023-02-07 Thread Andrew Pilloud via dev
This sounds reasonable to me as well. I've made swaps like this in the past, the base image of each is probably a bigger factor than the JDK. The openjdk images were based on Debian 11. The default eclipse-temurin images are based on Ubuntu 22.04 with an alpine option. Ubuntu is a Debian

Re: Python 3.11 support in Apache Beam

2023-02-07 Thread Anand Inguva via dev
Yes, it is related to protobuf only. But I think the update of these dependencies are required for Python 3.11 since the newer versions have support for Python 3.11 wheels. If we use older versions of these packages, then we have to depend on installing those packages on Python 3.11 from source

Beam High Priority Issue Report (40)

2023-02-07 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/25140 [Bug]: