[
https://issues.apache.org/jira/browse/BEAM-12949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Daniel Thevessen updated BEAM-12949:
------------------------------------
Description:
Datastore has a few classic Dataflow templates that rely on being able to
provide all parameters at runtime.
The newly introduced `hintNumWorkers` parameter needs to be switched to a
`ValueProvider` to make that compatible for adjusting parameters. In addition,
the `firstInstant` object should not be serialized into the template itself, as
that freezes the start point for weeks at a time.
was:
Datastore has a few classic Dataflow templates that rely on being able to
provide all parameters at runtime.
The newly introduced `hintNumWorkers` & parameter needs to be switched to a
`ValueProvider` to make that compatible for adjusting parameters. In addition,
the `firstInstant` object should not be serialized into the template itself, as
that freezes the start point for weeks at a time.
> DatastoreIO: Fix template compatibility
> ---------------------------------------
>
> Key: BEAM-12949
> URL: https://issues.apache.org/jira/browse/BEAM-12949
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Daniel Thevessen
> Assignee: Daniel Thevessen
> Priority: P2
> Time Spent: 0.5h
> Remaining Estimate: 0h
>
> Datastore has a few classic Dataflow templates that rely on being able to
> provide all parameters at runtime.
> The newly introduced `hintNumWorkers` parameter needs to be switched to a
> `ValueProvider` to make that compatible for adjusting parameters. In
> addition, the `firstInstant` object should not be serialized into the
> template itself, as that freezes the start point for weeks at a time.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
