Spark to R to process by your UDF
could have significant overhead. Could you provide more information on your
case?
_
From: Xiao Liu1 <liux...@us.ibm.com<mailto:liux...@us.ibm.com>>
Sent: Wednesday, January 18, 2017 11:30 AM
Subject: what does dapply
Hi,
I'm really new and trying to learn sparkR. I have defined a relatively
complicated user-defined function, and use dapply() to apply the function
on a SparkDataFrame. It was very fast. But I am not sure what has actually
been done by dapply(). Because when I used collect() to see the output,
