[ https://issues.apache.org/jira/browse/SPARK-19918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-19918: ------------------------------------ Assignee: Apache Spark > Use TextFileFormat in implementation of JsonFileFormat > ------------------------------------------------------ > > Key: SPARK-19918 > URL: https://issues.apache.org/jira/browse/SPARK-19918 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.2.0 > Reporter: Hyukjin Kwon > Assignee: Apache Spark > > If we use Dataset for initial loading when inferring the schema, there are > advantages. Please refer SPARK-18362 > It seems JSON one was supposed to be fixed together but missed according to > https://github.com/apache/spark/pull/15813 > {quote} > A similar problem also affects the JSON file format and this patch originally > fixed that as well, but I've decided to split that change into a separate > patch so as not to conflict with changes in another JSON PR. > {quote} > Also, this affects some functionalities because it does not use > {{FileScanRDD}}. This problem is described in SPARK-19885 (but it was CSV's > case). -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org