steve-xi-awx opened a new issue, #10829: URL: https://github.com/apache/hudi/issues/10829
**To Reproduce** Steps to reproduce the behavior: 1. use BigQuerySyncTool to sync hudi table into BQ as a external table with connection id 2. update the hudi table schema, then when we try to sync the hudi table metadata to BigQuery table, the error is occurred. **Additional context** Add any other context about the problem here. **Stacktrace** ```Add the stacktrace of the error.``` error when sync to BigQuery, will ignore this error and continue to process next batch, error is An error occurred while calling o2983.syncHoodieTable. : com.google.cloud.bigquery.BigQueryException: Schema can be specified only on the Table.Schema field for external tables with an associated connection_id but schema was provided on Table.Externaldataconfig.Schema. at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.translate(HttpBigQueryRpc.java:115) at com.google.cloud.bigquery.spi.v2.HttpBigQueryRpc.patch(HttpBigQueryRpc.java:271) at com.google.cloud.bigquery.BigQueryImpl$15.call(BigQueryImpl.java:673) at com.google.cloud.bigquery.BigQueryImpl$15.call(BigQueryImpl.java:670) at com.google.api.gax.retrying.DirectRetryingExecutor.submit(DirectRetryingExecutor.java:103) at com.google.cloud.RetryHelper.run(RetryHelper.java:76) at com.google.cloud.RetryHelper.runWithRetries(RetryHelper.java:50) at com.google.cloud.bigquery.BigQueryImpl.update(BigQueryImpl.java:669) at org.apache.hudi.gcp.bigquery.HoodieBigQuerySyncClient.updateTableSchema(HoodieBigQuerySyncClient.java:206) at org.apache.hudi.gcp.bigquery.BigQuerySyncTool.syncTable(BigQuerySyncTool.java:147) at org.apache.hudi.gcp.bigquery.BigQuerySyncTool.syncHoodieTable(BigQuerySyncTool.java:111) at sun.reflect.GeneratedMethodAccessor817.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244) at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:374) at py4j.Gateway.invoke(Gateway.java:282) at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132) at py4j.commands.CallCommand.execute(CallCommand.java:79) at py4j.ClientServerConnection.sendCommand(ClientServerConnection.java:244) at py4j.CallbackClient.sendCommand(CallbackClient.java:384) at py4j.CallbackClient.sendCommand(CallbackClient.java:356) at py4j.reflection.PythonProxyHandler.invoke(PythonProxyHandler.java:106) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
