[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16494708#comment-16494708
]
Felix Cheung commented on SPARK-23650:
--
sorry, I really don't have time/resource to investigate
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421933#comment-16421933
]
Deepansh commented on SPARK-23650:
--
@[~felixcheung] following up on above discussion.
> Slow SparkR udf
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411246#comment-16411246
]
Deepansh commented on SPARK-23650:
--
R environment inside the thread for applying UDF is not getting
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16410856#comment-16410856
]
Felix Cheung commented on SPARK-23650:
--
can you clarify where you see "R environment inside the
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404213#comment-16404213
]
Deepansh commented on SPARK-23650:
--
I tried reading the model in UDF, but for every new stream, the
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404198#comment-16404198
]
Felix Cheung commented on SPARK-23650:
--
Is there a reason for the broadcast?
Could you instead
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16404183#comment-16404183
]
Deepansh commented on SPARK-23650:
--
Is there any other way to implement my use case with minimum(ms)
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16401525#comment-16401525
]
Felix Cheung commented on SPARK-23650:
--
do you mean this?
RRunner: Times: boot = 0.010 s, init =
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398237#comment-16398237
]
Deepansh commented on SPARK-23650:
--
attaching more of logs.
> Slow SparkR udf (dapply)
>
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16398174#comment-16398174
]
Felix Cheung commented on SPARK-23650:
--
I see one RRunner - do you have more of the log?
> Slow
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396834#comment-16396834
]
Deepansh commented on SPARK-23650:
--
I tried on local as well as yarn cluster, the result is more or less
[
https://issues.apache.org/jira/browse/SPARK-23650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16396607#comment-16396607
]
Felix Cheung commented on SPARK-23650:
--
which system/platform are you running on?
> Slow SparkR udf
12 matches
Mail list logo