xushiyan commented on PR #5201: URL: https://github.com/apache/hudi/pull/5201#issuecomment-1098347742
> Shouldn’t the BigQuery inputformat adapter the dataset with partition columns? And why bring in the complexities to the writer/reader of spark based on little gains. Hey @danny0405 BQ does not support inputformat as such. Some previous discussion in the RFC https://github.com/apache/hudi/pull/4503#discussion_r786981999. There are big companies who rely heavily on BQ so it's worth the efforts. Besides, this is an existing config default to false, so people don't need it don't use. Hope this helps clarify the context. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
