[jira] [Commented] (SPARK-26310) Verification of JSON options

2018-12-07 Thread Apache Spark (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-26310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713285#comment-16713285
 ] 

Apache Spark commented on SPARK-26310:
--

User 'MaxGekk' has created a pull request for this issue:
https://github.com/apache/spark/pull/23257

> Verification of JSON options
> 
>
> Key: SPARK-26310
> URL: https://issues.apache.org/jira/browse/SPARK-26310
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 2.4.0
>Reporter: Maxim Gekk
>Priority: Major
>
> For JSON options used only in write, the following exception should be raised 
> if those options are used in read. The same exception should be raised in the 
> opposite case when read option is used in write:
> {code}
> java.lang.IllegalArgumentException: The JSON option "dropFieldIfAllNull" is 
> not applicable in write.
> {code}
> The verification can be disabled via the SQL config: 
> {code}
> spark.sql.verifyDataSourceOptions
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Commented] (SPARK-26310) Verification of JSON options

2018-12-07 Thread Apache Spark (JIRA)


[ 
https://issues.apache.org/jira/browse/SPARK-26310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16713283#comment-16713283
 ] 

Apache Spark commented on SPARK-26310:
--

User 'MaxGekk' has created a pull request for this issue:
https://github.com/apache/spark/pull/23257

> Verification of JSON options
> 
>
> Key: SPARK-26310
> URL: https://issues.apache.org/jira/browse/SPARK-26310
> Project: Spark
>  Issue Type: Sub-task
>  Components: SQL
>Affects Versions: 2.4.0
>Reporter: Maxim Gekk
>Priority: Major
>
> For JSON options used only in write, the following exception should be raised 
> if those options are used in read. The same exception should be raised in the 
> opposite case when read option is used in write:
> {code}
> java.lang.IllegalArgumentException: The JSON option "dropFieldIfAllNull" is 
> not applicable in write.
> {code}
> The verification can be disabled via the SQL config: 
> {code}
> spark.sql.verifyDataSourceOptions
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org