jarredhj0214 commented on PR #13548: URL: https://github.com/apache/gravitino/pull/13548#issuecomment-6072479012
Thanks for flagging downstream compatibility. I checked the current PR commit: SparkJdbcTypeConverter already handles ExternalType by mapping it to StringType (see https://github.com/apache/gravitino/blob/53e809c4a/spark-connector/spark-common/src/main/java/org/apache/gravitino/spark/connector/jdbc/SparkJdbcTypeConverter.java). Thus the Spark JDBC type-conversion layer has a string fallback for these columns. This does not provide native high-precision decimal arithmetic, and end-to-end Spark reads have not been validated in this PR. The scope here remains preserving MySQL metadata and allowing table loading. The requested comments and MySQL load IT have been added in 53e809c4a. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
