[ https://issues.apache.org/jira/browse/SPARK-15463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon reopened SPARK-15463: ---------------------------------- I am reopening this as I feel we need this per the issues https://github.com/databricks/spark-csv/issues/62 https://github.com/databricks/spark-csv/issues/264 https://github.com/databricks/spark-csv/issues/329 https://github.com/databricks/spark-csv/issues/245 https://github.com/databricks/spark-csv/issues/295 https://github.com/databricks/spark-csv/issues/321 https://github.com/databricks/spark-csv/issues/399 which are loosely or tightly related with this feature in spark-csv. There are loosely or tightly related and similar questions/issues in spark-xml too for example as below: https://github.com/databricks/spark-xml/issues/114 https://github.com/databricks/spark-xml/issues/131 https://github.com/databricks/spark-xml/issues/127 https://github.com/databricks/spark-xml/issues/162 https://github.com/databricks/spark-xml/issues/213 > Support for creating a dataframe from CSV in Dataset[String] > ------------------------------------------------------------ > > Key: SPARK-15463 > URL: https://issues.apache.org/jira/browse/SPARK-15463 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 2.0.0 > Reporter: PJ Fanning > > I currently use Databrick's spark-csv lib but some features don't work with > Apache Spark 2.0.0-SNAPSHOT. I understand that with the addition of CSV > support into spark-sql directly, that spark-csv won't be modified. > I currently read some CSV data that has been pre-processed and is in > RDD[String] format. > There is sqlContext.read.json(rdd: RDD[String]) but other formats don't > appear to support the creation of DataFrames based on loading from > RDD[String]. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org