Re: Question about SplittableDoFn

t files or query databases in order to >> determine the initial restrictions and partitions of the data. >> >> >> On Tue, May 18, 2021, 3:21 PM Miguel Anzo Palomo < >> miguel.a...@wizeline.com> wrote: >> >>> Hi, I’m looking at how to implement a

Question about SplittableDoFn

Hi, I’m looking at how to implement a reader as a SplittableDoFn and I'm having some problems with the initial restriction, specifically, how do you set the initial restriction if you don’t know the size of the data? The DoFn that I'm working on takes a PCollection of Spanner *ReadOperations *and

[Apace BEAM Go improvements] Lazy map side inputs

Hi, I was checking out this task BEAM-3293 and I'm having some issues fully understanding the idea of how side inputs work internally. Is there any resource or specific example that can help to better understand how they work and why/where the lazy

Re: [Apace BEAM Go improvements] Lazy map side inputs

exec/input.go#L36 > [22] > https://github.com/apache/beam/blob/7c43ab6a8df9b23caa7321fddff9a032a71908f6/sdks/go/pkg/beam/core/runtime/exec/sideinput.go#L59 > [23] > https://github.com/apache/beam/blob/243128a8fc52798e1b58b0cf1a271d95ee7aa241/sdks/go/pkg/beam/core/runtime/harness/state

Add to JIRA contributor list

Hi, I'm Miguel from Wizeline, I would like to be added to the contributor list to be able to start assigning me some tickets and start working in them. Thanks -- Miguel Angel Anzo Palomo | WIZELINE Software Engineer miguel.a...@wizeline.com Remote Office -- *This email and its contents

Re: Command line to run DatstoreIO integration tests for java

/provider/datastore/DataStoreReadWriteIT.java#L105 [2] https://github.com/apache/beam/blob/089ca7a62be86ad7865308f2cbd676bb18d7d648/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore/DatastoreV1.java#L927 On Tue, Aug 10, 2021 at 3:25 PM Miguel Anzo Palomo wrote: >

Re: Command line to run DatstoreIO integration tests for java

eport/org.apache.beam.sdk.io.gcp.datastore/ >>> >>> Thanks, >>> Cham >>> >>> On Tue, Aug 17, 2021 at 5:33 PM Alex Amato wrote: >>> >>>> +Chamikara, +Heejong, >>>> >>>> Do you have any ideas here? I want to verify t

Re: Command line to run DatstoreIO integration tests for java

Hi Alex, My problem trying to locally run that test was that, since I don't have access to the apache-beam-testing GCP project I was having problems getting a datastore instance to read/write from. On Tue, Aug 10, 2021 at 1:08 PM Alex Amato wrote: > Miguel, I believe you were having trouble

Codecov reports question

Hi, I’m working on adding codecov coverage for go tests on PR's, currently I have generated the report for the coverage but I have some questions about how to upload it to codecov [1]. Looking at the current python actions I see that the coverage report is generated via tox.ini, and I can see that

Re: Flaky test in JmsIO help

, it may cause some race conditions there but seems > it happens quite rarely. > > — > Alexey > > > > On 5 Oct 2021, at 21:24, JB Onofré wrote: > > Hi > > I will take a look. That’s probably a race condition with the broker > service. > > Regards >

Flaky test in JmsIO help

Hi, I've been working on checking out why is this issue happening (flaky test in JmsIO). The logs in this example