RE: NanosInstant not being recognised by BigQueryIO.Write

2020-08-05 Thread Robert.Butcher
Hi Cham, I’m not registered as a BEAM committer so I don’t believe I have access rights to raise JIRAs. Would you be kind enough to file a bug report on my behalf? I would suggest creating a simple end-to-end test that takes a protobuf-generated domain object and writes to BigQuery making use

RE: NanosInstant not being recognised by BigQueryIO.Write

2020-07-15 Thread Robert.Butcher
Hi Cham, Yes, I’m happy to when I get a moment. Kind regards, Rob From: Chamikara Jayalath [mailto:chamik...@google.com] Sent: 15 July 2020 16:36 To: dev Subject: Re: NanosInstant not being recognised by BigQueryIO.Write * "This is an external

NanosInstant not being recognised by BigQueryIO.Write

2020-07-08 Thread Robert.Butcher
Hi All, I am posting this to the dev (as opposed to user channel) as I believe it will be of interest to the those working on either Schemas or BigQuery I have a pipeline based on BEAM 2.22 that is ingesting data into BigQuery. Internally I am using protobuf for my domain model and the

RE: Unit-testing BEAM pipelines with PROCESSING_TIME timers

2020-05-11 Thread Robert.Butcher
Many thanks, Darshan! I’ve made equivalent changes to my test case and it’s working fine. Kind regards, Rob From: Darshan Jani [mailto:darshanjani...@gmail.com] Sent: 11 May 2020 15:08 To: dev@beam.apache.org Subject: Re: Unit-testing BEAM pipelines with PROCESSING_TIME timers

Unit-testing BEAM pipelines with PROCESSING_TIME timers

2020-05-11 Thread Robert.Butcher
I have a BEAM DoFn that I'm attempting to unit test. It involves using a timer based on processing time and I've not managed to get it to fire. The relevant code excerpts are as follows: @TimerId("timer") private final TimerSpec timer = TimerSpecs.timer(TimeDomain.PROCESSING_TIME);