ding-qin commented on issue #24726: URL: https://github.com/apache/beam/issues/24726#issuecomment-1894980729
I used apache_beam 2.53.0 and this bug still exists. It's a common use case that metada of a BigQuery table is required in the query. Not only INFORMATION_SCHEMA but also _partitiondate is required in the many cases. For example, `select _partitiondate, * from xxxx` The same query can be executed successfully using bigquery client library. The reason I want to do it using apache beam is because I want to convert to complex SQL joins to PTransform so that it can be executed in parallel to improve the performance. However, I have to work around it for now. Hopefully it can be fixed as soon as possible. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
