Understood,
Let me make the changes and I will get back on this thread
On Sat, Oct 26, 2024 at 9:19 PM Reuven Lax wrote:
> One more thing - in addition to a deterministic coder, DestinationInfo
> needs to have a proper equals and hashTo method defined.
>
> On Fri, Oct 25, 2024 at 10:30 PM Reuve
One more thing - in addition to a deterministic coder, DestinationInfo
needs to have a proper equals and hashTo method defined.
On Fri, Oct 25, 2024 at 10:30 PM Reuven Lax wrote:
> Ah, I suspect I know what's going on. What you're doing won't work unless
> the DestinationInfoCoder is a determini
Ah, I suspect I know what's going on. What you're doing won't work unless
the DestinationInfoCoder is a deterministic coder (i.e. two equivalent
objects map to the same encoded representation). A json encoding often
isn't deterministic (for one reason, it's legal to encode the json fields
in any or
Hi Kenneth / Reuven,
Actually I did a little more observation on the root cause on what might be
the actual problem here,
Here's what I found:
409s on Bigquery duplicate jobs might be the side effect of something else
related to schema,
What I have came to observe is that when I am giving Dynam
This is running in batch mode though? In that case I would expect the pane
to always be 0.
On Fri, Oct 25, 2024 at 9:46 AM Priyans Desai via dev
wrote:
> From the issue report, it looks like it is happening for both with and
> without runner V2:
> https://github.com/apache/beam/issues/28219#issu
>From the issue report, it looks like it is happening for both with and
without runner V2:
https://github.com/apache/beam/issues/28219#issuecomment-2423624052
On Fri, Oct 25, 2024 at 12:21 PM Reuven Lax via dev
wrote:
> Are you using runner v2? The issue you linked to implies that this only
> ha
Are you using runner v2? The issue you linked to implies that this only
happened on runner v2.
On Fri, Oct 25, 2024 at 8:26 AM Kenneth Knowles wrote:
> Hi Pranjal,
>
> If there is a bug in Beam, this is a good list to contact. If there is a
> problem with a GCP service, then GCP support is bette
Hi Pranjal,
If there is a bug in Beam, this is a good list to contact. If there is a
problem with a GCP service, then GCP support is better.
I see the code you shared, but what error or difficulty are you
encountering?
Kenn
On Mon, Oct 21, 2024 at 2:33 PM Pranjal Pandit wrote:
> Hi Kenneth /
