[
https://issues.apache.org/jira/browse/BEAM-4824?focusedWorklogId=153199&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-153199
]
ASF GitHub Bot logged work on BEAM-4824:
----------------------------------------
Author: ASF GitHub Bot
Created on: 10/Oct/18 16:36
Start Date: 10/Oct/18 16:36
Worklog Time Spent: 10m
Work Description: calonso commented on issue #6055: [BEAM-4824] Batch
BigQueryIO returns job results
URL: https://github.com/apache/beam/pull/6055#issuecomment-428642597
Hi @reuvenlax , thanks for your comments.
I think I've got an idea on how to approach this. Let me know what do you
think:
1. Return the job result information as a side output from the `WriteTables`
transform
1. Only make it available downstream if the user requests so by adding a new
`withLoadJobsStatus` method to the builder
I'll write an end to end solution but only covering the untriggered single
partition codepath to get your input on it before investing more time, does it
make sense?
Another question, just out of curiosity, how will the next BQ connector work
with inserts?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 153199)
Time Spent: 1h 50m (was: 1h 40m)
> Get BigQueryIO batch loads to return something actionable
> ---------------------------------------------------------
>
> Key: BEAM-4824
> URL: https://issues.apache.org/jira/browse/BEAM-4824
> Project: Beam
> Issue Type: Improvement
> Components: io-java-gcp
> Reporter: Carlos Alonso
> Assignee: Carlos Alonso
> Priority: Minor
> Time Spent: 1h 50m
> Remaining Estimate: 0h
>
> ATM BigQueryIO batchloads returns an empty collection that has no information
> related to how the load job finished. It is even returned before the job
> finishes.
>
> Change it so that:
> # The returning PCollection only appers when the job has actually finished
> # The returning PCollection contains information about the job result
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
