[ 
https://issues.apache.org/jira/browse/BEAM-2879?focusedWorklogId=340752&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-340752
 ]

ASF GitHub Bot logged work on BEAM-2879:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 08/Nov/19 21:19
            Start Date: 08/Nov/19 21:19
    Worklog Time Spent: 10m 
      Work Description: chamikaramj commented on issue #9665: [BEAM-2879] 
Support writing data to BigQuery via avro
URL: https://github.com/apache/beam/pull/9665#issuecomment-551993467
 
 
   Unfortunately, looks like BigQueryIOIT is a recently added test that is 
currently not captured by any of the test suites.
   
   @steveniemitz Will you be able to add a test that writes to BQ using Avro to 
the BigQueryTornadoesIT that is captured by the Beam Java PostCommit test suite 
?
   
https://github.com/apache/beam/blob/master/examples/java/src/test/java/org/apache/beam/examples/cookbook/BigQueryTornadoesIT.java
   
https://builds.apache.org/view/A-D/view/Beam/view/PostCommit/job/beam_PostCommit_Java/lastCompletedBuild/testReport/org.apache.beam.examples.cookbook/BigQueryTornadoesIT/
   
   @mwalenia can you comment on the status of BigQueryIOIT ?
   
   cc: @pabloem 
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 340752)
    Time Spent: 5h  (was: 4h 50m)

> Implement and use an Avro coder rather than the JSON one for intermediary 
> files to be loaded in BigQuery
> --------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-2879
>                 URL: https://issues.apache.org/jira/browse/BEAM-2879
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-gcp
>            Reporter: Black Phoenix
>            Assignee: Steve Niemitz
>            Priority: Minor
>              Labels: starter
>          Time Spent: 5h
>  Remaining Estimate: 0h
>
> Before being loaded in BigQuery, temporary files are created and encoded in 
> JSON. Which is a costly solution compared to an Avro alternative 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to