GitHub user sun-rui opened a pull request:
https://github.com/apache/spark/pull/12024
[SPARK-12792][SPARKR] Refactor RRDD to support R UDF.
## What changes were proposed in this pull request?
Refactor RRDD by separating the common logic interacting with the R worker
to a new class RRunner, which can be used to evaluate R UDFs.
Now RRDD relies on RRuner for RDD computation and RRDD could be reomved if
we want to remove RDD API in SparkR later.
## How was this patch tested?
dev/lint-r
SparkR unit tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/sun-rui/spark SPARK-12792_new
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12024.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12024
----
commit e86f720b83540ba649565473b759268e69122878
Author: Sun Rui <[email protected]>
Date: 2016-01-27T12:37:08Z
[SPARK-12792][SPARKR] Refactor RRDD to support R UDF.
commit 0244e0eda066a434dbfc7d8e5b8f3a74bc139f80
Author: Sun Rui <[email protected]>
Date: 2016-01-27T12:40:21Z
Add the missing file.
commit f25e1565d23addc07d229bfade93927be60350b3
Author: Sun Rui <[email protected]>
Date: 2016-01-28T04:52:12Z
Fix scala style.
commit 1a992e0ed2193c3c6818d8cac9407f53c3c4c84b
Author: Sun Rui <[email protected]>
Date: 2016-02-06T08:09:45Z
Add a test case for concurrent computation of an RRDD.
commit 1eda42c4e54208d71838dde55adee4ce888bba90
Author: Sun Rui <[email protected]>
Date: 2016-03-29T02:27:00Z
Fix logging import.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
