dejankrak-db commented on PR #59305: URL: https://github.com/apache/spark/pull/59305#issuecomment-6126981900
Thanks for the review. On the gating question: the SQL surface is now behind the internal conf `spark.sql.fileType.enabled` (default `Utils.isTesting`, so on in tests and off otherwise). When it is disabled the parser does not recognize `FILE`, and `TypeUtils.failUnsupportedDataType` rejects the type with a new `UNSUPPORTED_FILE_TYPE` error, which covers `CAST`, `CREATE TABLE` on v2 catalogs, `ALTER TABLE` and the other callers of that check. JSON schema parsing stays ungated so persisted schemas remain readable, as with the nanosecond timestamp types. The description is updated to match. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
