Yueyang Qiu created BEAM-8098:
---------------------------------
Summary: BigQueryIO needs documentation on how data types in
BigQuery and in Beam SDK correspond
Key: BEAM-8098
URL: https://issues.apache.org/jira/browse/BEAM-8098
Project: Beam
Issue Type: Improvement
Components: io-java-gcp
Reporter: Yueyang Qiu
Assignee: Yueyang Qiu
While working on [https://github.com/apache/beam/pull/9144], I realized there
is a gap in BigQueryIO documentation on mapping between data types defined in
BigQuery and in Beam SDK.
For example, if a user reads a BYTES field from BigQuery into Beam, it will be
represented as java.nio.ByteBuffer type in Beam Java SDK. The user will need to
do an explicit type cast to ByteBuffer in order to use the data, but there is
no easy way the user can know which type they should cast to, unless digging
into BigQueryIO's implementation (Java - Avro - BigQuery).
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
