[Question] DebeziumIO ReadFromDebezium getting stuck

Hi everyone. I'm having trouble making a performance test work for the Debezium connector. This test reads the events from a PostgreSQL database produced by a number of operations (inserts, deletes, updates) done for ~20 min. When running in DirectRunner the pipeline reads the messages, stops, and

[Question] Spanner ServiceCallMetrics on Dataflow runner

Hi team, I've been working on BEAM-11986[1] and opened this PR[2]. In a nutshell, it counts write/read requests made to the Spanner API from the WriteToSpanner transform with a ServiceCallMetric[3]. The issue here is that when running the integration tests[4] on DirectRunner the metrics from

Re: [Question] Bug in SdkHarness

onnect? > > On Thu, Jul 15, 2021 at 11:00 AM Miguel Hernández Sandoval < > rogelio.hernan...@wizeline.com> wrote: > >> Yes, I was able to reproduce the error locally and debugged it, but >> haven't found anything. >> >> On Wed, Jul 14, 2021 at 4:38 PM Luke Cwik w

Re: [Question] Bug in SdkHarness

Yes, I was able to reproduce the error locally and debugged it, but haven't found anything. On Wed, Jul 14, 2021 at 4:38 PM Luke Cwik wrote: > Repro locally and run with a Python debugger? > > On Wed, Jul 14, 2021 at 1:46 PM Miguel Hernández Sandoval < > rogelio.hernan...@wize

Re: [Question] Bug in SdkHarness

ady to accept a client? > > On Wed, Jul 14, 2021 at 1:27 PM Miguel Hernández Sandoval < > rogelio.hernan...@wizeline.com> wrote: > >> Hi team, >> I am currently working on solving this bug [1]. The ticket describes a >> grpc.FutureTimeoutError in the SdkHarness.__in

[Question] Bug in SdkHarness

Hi team, I am currently working on solving this bug [1]. The ticket describes a grpc.FutureTimeoutError in the SdkHarness.__init__ and it seems that it gets stuck in this line [2] causing the timeout and making some tests fail. Here [3] how the tests were run and the results. I was wondering if

Re: GCS API call testing

Sorry, forgot to include the ticket [1] https://issues.apache.org/jira/browse/BEAM-11984 On Mon, May 24, 2021 at 7:54 AM Miguel Hernández Sandoval < rogelio.hernan...@wizeline.com> wrote: > Hi team, > I've been working on this ticket[1] where some API requests to GCS are > c

GCS API call testing

Hi team, I've been working on this ticket[1] where some API requests to GCS are counted and kept as process-wide metrics. I was hoping you could give me some advice on how to test this kind of feature to test it using a real response from GCS instead of mocked responses and how to test it using a

Re: pb2 file generation

es. Just > let this command above generate the _pb2.py files, which occurs as part of > building the protos > > > > > > On Mon, May 17, 2021 at 12:29 PM Tyson Hamilton > wrote: > >> +Alex Amato may be able to help with this. >> >> On Mon, May 17, 2021

pb2 file generation

Hi team, I am working on BEAM-11984[1]. I want to add some labels to metrics_pb2_urns.py. However, I don't know the process to generate/update those files. I was hoping you could give me some guidance on this. Thank you all! -Mike [1] https://issues.apache.org/jira/browse/BEAM-11984 -- *This

BEAM - 12016

Hi team, I'm new to the project and I wanted to start by taking the task BEAM-12016 . Do you have any info or suggestions for its implementation/analysis? Thank you -- Mike -- *This email and its contents (including any attachments) are being

Re: JIRA Beam Issue Tracker permissions

Sorry, I forgot to mention my JIRA username. This is it: *Mike Hernandez* Thank you. On Wed, Apr 14, 2021 at 9:28 AM Rogelio Miguel Hernández Sandoval < rogelio.hernan...@wizeline.com> wrote: > Hi Beam team, > My name is Miguel Hernandez, I work for Wizeline and I'm

JIRA Beam Issue Tracker permissions

Hi Beam team, My name is Miguel Hernandez, I work for Wizeline and I'm a new member of the maintenance team for Apache Beam. I'm writing to get permission for the JIRA Beam issue tracker so I can get started with my onboarding process. Thank you very much. Regards, -- Miguel Hernández