Samuel Alexander created SPARK-10219:
----------------------------------------
Summary: Error when additional options provided as variable in
write.df
Key: SPARK-10219
URL: https://issues.apache.org/jira/browse/SPARK-10219
Project: Spark
Issue Type: Bug
Components: R
Affects Versions: 1.4.0
Environment: SparkR shell
Reporter: Samuel Alexander
Opened a SparkR shell
Created a df using
> df <- jsonFile(sqlContext, "examples/src/main/resources/people.json")
Assigned a variable like below
> mode <- "append"
When write.df called using below statement got the mentioned error
> write.df(df, source="org.apache.spark.sql.parquet", path=par_path,
> option=mode)
Error in writeType(con, type) : Unsupported type for serialization name
Whereas mode is passed as "append" itself, i.e. not via mode variable as below
everything works fine
> write.df(df, source="org.apache.spark.sql.parquet", path=par_path,
> option="append")
Note: For parquet it is not needed to hanve option. But we are using Spark
Salesforce package
(http://spark-packages.org/package/springml/spark-salesforce) which require
additional options to be passed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
