Reynold Xin created SPARK-6591:
----------------------------------
Summary: Python data source load options should auto convert
common types into strings
Key: SPARK-6591
URL: https://issues.apache.org/jira/browse/SPARK-6591
Project: Spark
Issue Type: Improvement
Components: PySpark, SQL
Reporter: Reynold Xin
Assignee: Davies Liu
See the discussion at : https://github.com/databricks/spark-csv/pull/39
If the caller invokes
{code}
sqlContext.load("com.databricks.spark.csv", path = "cars.csv", header = True)
{code}
We should automatically turn header into "true" in string form.
We should do this for booleans and numeric values.
cc [~yhuai]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
