Chamikara Jayalath created BEAM-5517:
----------------------------------------
Summary: Update Python BigQuery source to use fastavro module to
read exported data
Key: BEAM-5517
URL: https://issues.apache.org/jira/browse/BEAM-5517
Project: Beam
Issue Type: Improvement
Components: sdk-py-core
Reporter: Chamikara Jayalath
Assignee: Chamikara Jayalath
Currently we use avro module for reading data exported by BigQuery. Moving to
fastavro should result in a significant performance boost.
Creating this Jira for tracking but most of the changes should be in the runner
(DataflowRunner) since we current BigQuery source is a native source.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
