[ https://issues.apache.org/jira/browse/BEAM-384 ]


    Danny McCormick deleted comment on BEAM-384:
    --------------------------------------

was (Author: JIRAUSER282469):
This issue has been migrated to [https://github.com/apache/beam/issues/17881]

> Streaming BigQueryIO should support user-provided IDs
> -----------------------------------------------------
>
>                 Key: BEAM-384
>                 URL: https://issues.apache.org/jira/browse/BEAM-384
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>    Affects Versions: 0.1.0-incubating, 0.2.0-incubating
>            Reporter: Daniel Mills
>            Priority: P3
>
> Currently, BigQueryIO always assigns IDs and does a shuffle to ensure that 
> they are atomic.  This incurs a noticeable cost and is unnecessary if the 
> user already has deterministic IDs that they can use.  The sink should be 
> able to use these IDs to skip the shuffle.



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

Reply via email to