Re: [Go SDK] Direct Runner Replacement: Prism

2023-02-14 Thread Robert Burke via dev
Here are the next two chunks! https://github.com/apache/beam/pull/25476 - Coder / element / bytes handling internally for prism. https://github.com/apache/beam/pull/25478 - Worker fnAPI handling. Took a bit to get a baseline of unit testing in for these, since they were covered by whole pipeline

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Ashok KS
Hi Shivam, Thanks a lot for your response. I did check the http request. But I wanted to see if I can use the Google API client Library. The docs show a Python example for it shown below. I wanted to know if there is something similar with Go. from googleapiclient.discovery import build #

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Shivam Singhal
There shouldn’t be much change in the API request irrespective of the SDK language On Wed, 15 Feb 2023 at 10:50, Shivam Singhal wrote: > Hey Ashok, > > If you already have a flex template file and the docker image built, you > can use the Dataflow API to run the template. > >

Re: Launch Dataflow Flex Templates from Go

2023-02-14 Thread Shivam Singhal
Hey Ashok, If you already have a flex template file and the docker image built, you can use the Dataflow API to run the template. https://cloud.google.com/dataflow/docs/reference/rest On Wed, 15 Feb 2023 at 04:49, Ashok KS wrote: > Hello Beam Community, > > I have written a Dataflow pipeline

Launch Dataflow Flex Templates from Go

2023-02-14 Thread Ashok KS
Hello Beam Community, I have written a Dataflow pipeline using Python SDK and I would be creating a Flex template with it. My task is to launch this Flex Template from Cloud Functions which would be in Go. I found the package below but couldn't find any sample.

Re: OpenJDK8 / OpenJDK11 container deprecation

2023-02-14 Thread Kenneth Knowles
SGTM. I asked on the PR if this could impact users, but having read the docker release calendar I am not concerned. The last update to the old version was in 2019, and the introduction of compatible versions was 2020. On Tue, Feb 14, 2023 at 3:01 PM Byron Ellis via user wrote: > FWIW I am Team

Re: OpenJDK8 / OpenJDK11 container deprecation

2023-02-14 Thread Byron Ellis via dev
FWIW I am Team Upgrade Docker :-) On Tue, Feb 14, 2023 at 2:53 PM Luke Cwik via user wrote: > I made some progress in testing the container and did hit an issue where > Ubuntu 22.04 "Jammy" is dependent on the version of Docker installed. It > turns out that our boot.go crashes with

Re: OpenJDK8 / OpenJDK11 container deprecation

2023-02-14 Thread Luke Cwik via dev
I made some progress in testing the container and did hit an issue where Ubuntu 22.04 "Jammy" is dependent on the version of Docker installed. It turns out that our boot.go crashes with "runtime/cgo: pthread_create failed: Operation not permitted" because the Ubuntu 22.04 is using new syscalls

Re: Beam Release 2.46

2023-02-14 Thread Damon Douglas via dev
Hello Danny, Do you mind if I shadow you while you do this? Best, Damon On Thu, Feb 9, 2023 at 3:17 PM Kenneth Knowles wrote: > Excellent! Keep that release train rolling. > > On Thu, Feb 9, 2023 at 9:28 AM Ahmet Altay via dev > wrote: > >> Thank you Danny! >> >> On Wed, Feb 8, 2023 at 6:46