nsivabalan commented on issue #7049: URL: https://github.com/apache/hudi/issues/7049#issuecomment-1295692772
issue could be that, schema provider could be returning original schema w/o the `test_field" that you are adding as part of the transformer. If you are can't match the output schema after transformation, then better not set any schema provider. And hudi will infer based on Dataset<Row>'s schema(after transformation). I tried locally and this query worked out for me. ``` --transformer-class org.apache.hudi.utilities.transform.SqlQueryBasedTransformer --hoodie-conf "\"hoodie.deltastreamer.transformer.sql=SELECT *, '1' AS test_field FROM <SRC> a \"" ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
