Re: Potential bug with Kafka (or other external) IO in Python Portable Runner

/core/construction/Environments.java#L134 > > I don't think we support running Java cross-language transforms in other > environments yet. > > Thanks, > Cham > > On Tue, May 4, 2021 at 12:30 PM Nir Gazit wrote: > >> But looking at the code of the exception >> &l

Re: Potential bug with Kafka (or other external) IO in Python Portable Runner

environment (agree that the terminology is > confusing). > > On Tue, May 4, 2021 at 11:04 AM Nir Gazit wrote: > >> Yes that’s on purpose. I’m running in Kubernetes which makes it hard to >> install docker on the pods so I don’t want to use the docker environment. >

Re: Potential bug with Kafka (or other external) IO in Python Portable Runner

Jayalath wrote: > Is it possible that you don't have the "docker" command available in your > system ? > > On Tue, May 4, 2021 at 10:28 AM Nir Gazit wrote: > >> Hey, >> I'm trying to run a pipeline with a Kafka Source, using an EXTERNAL >> env

Potential bug with Kafka (or other external) IO in Python Portable Runner

Hey, I'm trying to run a pipeline with a Kafka Source, using an EXTERNAL environment. However, when the pipeline is run, the error below is thrown, which implies that for some reason the external environment pipeline options didn't get in. When replacing the Kafka Source with an S3 source (for

Re: [PROPOSAL] Preparing for Beam 2.28.0 release

Thanks, > Cham > > On Thu, Feb 11, 2021 at 9:40 AM Nir Gazit wrote: > >> Hey, >> I hope it's not too late but is it possible to Cherry-pick this PR as >> well: >> https://github.com/apache/beam/pull/13723 >> >> It fixes a critical bug >> <http

Re: [PROPOSAL] Preparing for Beam 2.28.0 release

Hey, I hope it's not too late but is it possible to Cherry-pick this PR as well: https://github.com/apache/beam/pull/13723 It fixes a critical bug that currently prevents the use of S3IO (and probably other IOs) on the Python SDK. Thanks Nir On

Re: Error when trying to read from S3

wonder what is the reason this assertion was added as it seems that it hasn't been there in the past. Any assistance would be appreciated! Nir On Wed, Feb 10, 2021 at 6:49 PM Nir Gazit wrote: > Hey, > I'm getting this error: > apache_beam.io.filesystem.BeamIOError: Match operati

Contributor permission for Beam Jira tickets

Hey, I'm Nir, platform architect from Fiverr, working on integrating Beam into our streaming pipelines at the company. I have several features in mind that might be useful for us (specifically BEAM-11525 for supporting MemSQL I/O