kmjung commented on pull request #13058: URL: https://github.com/apache/beam/pull/13058#issuecomment-706236204
The purpose of the convertGenericRecordToTableRow class is to provide compatibility with BigQuery's legacy JSON TableRow type. I can't find any documentation here, but my understanding is that -- regrettably -- INTEGER values are sent as strings in the original JSON, and so this is done here for compatibility reasons. I don't think we can change this at this point, anyways, as existing pipelines rely on this behavior. If you're looking to optimize your storage API pipelines, I would encourage you to look at consuming the GenericRecords produced by the stream source directly, rather than converting them to TableRow. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
