RE: SparkR read.df Option type doesn't match

2015-11-27 Thread liushiqi9
There is a bug at this page in the examples I have file it in the JIRA It's SPARK-12019. I don't know how to change the page. But I think an example that shows how to write options would be great. Like sc <- sparkR.init(master="yarn-client",appName= "SparkR", sparkHome = "/home/spark",

SparkR read.df Option type doesn't match

2015-11-26 Thread liushiqi9
I try to write a third party datasource plugin for spark. It works perfect fine in scala, but in R because I need to pass the options, which is a map[string,string] in scala, and nothing in R works, I failed. I tried use named list in R, it cannot get the value since I use get in my plugin to get

Re: SparkR read.df Option type doesn't match

2015-11-26 Thread liushiqi9
I found the answer myself. options should be added like: read.df(sqlContext,path=NULL,source="***",option1="",option2="" ) -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/SparkR-read-df-Option-type-doesn-t-match-tp15365p15370.html Sent from the