[jira] [Commented] (SPARK-26310) Verification of JSON options
[ https://issues.apache.org/jira/browse/SPARK-26310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713285#comment-16713285 ] Apache Spark commented on SPARK-26310: -- User 'MaxGekk' has created a pull request for this issue: https://github.com/apache/spark/pull/23257 > Verification of JSON options > > > Key: SPARK-26310 > URL: https://issues.apache.org/jira/browse/SPARK-26310 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Maxim Gekk >Priority: Major > > For JSON options used only in write, the following exception should be raised > if those options are used in read. The same exception should be raised in the > opposite case when read option is used in write: > {code} > java.lang.IllegalArgumentException: The JSON option "dropFieldIfAllNull" is > not applicable in write. > {code} > The verification can be disabled via the SQL config: > {code} > spark.sql.verifyDataSourceOptions > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-26310) Verification of JSON options
[ https://issues.apache.org/jira/browse/SPARK-26310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713283#comment-16713283 ] Apache Spark commented on SPARK-26310: -- User 'MaxGekk' has created a pull request for this issue: https://github.com/apache/spark/pull/23257 > Verification of JSON options > > > Key: SPARK-26310 > URL: https://issues.apache.org/jira/browse/SPARK-26310 > Project: Spark > Issue Type: Sub-task > Components: SQL >Affects Versions: 2.4.0 >Reporter: Maxim Gekk >Priority: Major > > For JSON options used only in write, the following exception should be raised > if those options are used in read. The same exception should be raised in the > opposite case when read option is used in write: > {code} > java.lang.IllegalArgumentException: The JSON option "dropFieldIfAllNull" is > not applicable in write. > {code} > The verification can be disabled via the SQL config: > {code} > spark.sql.verifyDataSourceOptions > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org