[
https://issues.apache.org/jira/browse/BEAM-8960?focusedWorklogId=361165&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-361165
]
ASF GitHub Bot logged work on BEAM-8960:
----------------------------------------
Author: ASF GitHub Bot
Created on: 17/Dec/19 22:42
Start Date: 17/Dec/19 22:42
Worklog Time Spent: 10m
Work Description: yirutang commented on pull request #10408: [BEAM-8960]:
Add an option for user to opt out of using insert id for…
URL: https://github.com/apache/beam/pull/10408
Expose an option so that user can opt out of using insert id while streaming
into BigQuery. Insert id only guarantees best effort insert rows deduplication,
without it, user will be able to opt into using new streaming backend with
higher quotas and reliabilities.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 361165)
Remaining Estimate: 23h 50m (was: 24h)
Time Spent: 10m
> Add an option for user to be able to opt out of using insert id for BigQuery
> streaming insert.
> ----------------------------------------------------------------------------------------------
>
> Key: BEAM-8960
> URL: https://issues.apache.org/jira/browse/BEAM-8960
> Project: Beam
> Issue Type: New Feature
> Components: io-java-gcp
> Reporter: Yiru Tang
> Priority: Minor
> Original Estimate: 24h
> Time Spent: 10m
> Remaining Estimate: 23h 50m
>
> BigQuery streaming insert id offers best effort insert deduplication. If user
> choose to opt out of using insert ids, they could potentially to be opt into
> using our current new streaming backend which gives higher speed and more
> quota. Insert id deduplication is best effort and doesn't have ultimate just
> once guarantees.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
