GitHub user adrian555 reopened a pull request:
https://github.com/apache/spark/pull/22455
[SPARK-24572][SPARKR] "eager execution" for R shell, IDE
## What changes were proposed in this pull request?
Check the `spark.sql.repl.eagerEval.enabled` configuration property in
SparkDataFrame `show()` method. If the `SparkSession` has eager execution
enabled, the data will be returned to the R client when the data frame is
created. So instead of seeing this
```
> df <- createDataFrame(faithful)
> df
SparkDataFrame[eruptions:double, waiting:double]
```
you will see
```
> df <- createDataFrame(faithful)
> df
+---------+-------+
|eruptions|waiting|
+---------+-------+
| 3.6| 79.0|
| 1.8| 54.0|
| 3.333| 74.0|
| 2.283| 62.0|
| 4.533| 85.0|
| 2.883| 55.0|
| 4.7| 88.0|
| 3.6| 85.0|
| 1.95| 51.0|
| 4.35| 85.0|
| 1.833| 54.0|
| 3.917| 84.0|
| 4.2| 78.0|
| 1.75| 47.0|
| 4.7| 83.0|
| 2.167| 52.0|
| 1.75| 62.0|
| 4.8| 84.0|
| 1.6| 52.0|
| 4.25| 79.0|
+---------+-------+
only showing top 20 rows
```
## How was this patch tested?
Manual tests as well as unit tests (one new test case is added).
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/adrian555/spark eager_execution
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/22455.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #22455
----
commit b3e014c4e8050e8a0b3da190bb327347f9136b7e
Author: adrian555 <v2ave10p>
Date: 2018-09-18T20:48:56Z
support eager execution
commit d0be3a8582de548862a78cfa5ffb58df933efa8d
Author: adrian555 <v2ave10p>
Date: 2018-09-18T20:51:43Z
Merge remote-tracking branch 'remotes/upstream/master' into eager_execution
commit cd8a7041c6eecc59d22db72f4f2065ed9f06640a
Author: adrian555 <v2ave10p>
Date: 2018-09-18T21:09:48Z
add newline
commit a89bf37e7fbfa089a39e0fb91cdd4a1bdd409b9f
Author: adrian555 <v2ave10p>
Date: 2018-09-20T20:58:02Z
address review comment
commit a083d64ea3210c367cc4d63ad51a1c6beab129e7
Author: adrian555 <v2ave10p>
Date: 2018-09-20T22:03:30Z
address review comment
commit 7b121e65b99e177d8870b4e098797f1f1e86ce65
Author: adrian555 <v2ave10p>
Date: 2018-09-21T00:02:31Z
address review comment
commit 4492b278ba5a4721d6a5dc836436191ad155dfc6
Author: adrian555 <v2ave10p>
Date: 2018-09-21T17:36:33Z
address review comment
commit 100bac715ee3fc6baee960dfa7c9466baa032bcb
Author: adrian555 <v2ave10p>
Date: 2018-09-24T18:16:41Z
address review comment
commit 57eb00824b072b2a326810ff42edef2ca2626eb6
Author: adrian555 <v2ave10p>
Date: 2018-09-25T17:51:34Z
address review comment
commit df582fc8d31c4e993a6e215fa0901a4728affc0e
Author: adrian555 <v2ave10p>
Date: 2018-09-26T23:06:03Z
add sparkr.SparkDataFrame.base_show_func option
commit d1562777924fd84f14655df9c7418575aeae7fbe
Author: adrian555 <v2ave10p>
Date: 2018-09-26T23:11:41Z
Merge remote-tracking branch 'remotes/upstream/master' into eager_execution
commit 44df922fb347211c9a962bf1771e2e0005634305
Author: adrian555 <v2ave10p>
Date: 2018-10-03T20:27:05Z
address review comment
commit 7ce8f9454d222b42dc3969894147461eaa850b46
Author: adrian555 <v2ave10p>
Date: 2018-10-18T17:13:32Z
Merge remote-tracking branch 'remotes/upstream/master' into eager_execution
commit 76767f9e5288d593efedda000c7fc01799d43085
Author: adrian555 <v2ave10p>
Date: 2018-10-18T18:05:47Z
address review comment
commit b5e463f8babe75463054fe1224348bb707afc195
Author: adrian555 <v2ave10p>
Date: 2018-10-23T17:52:17Z
address review comment
commit 5b39d737aea4b4a680e63e25f5df81993ced1c70
Author: adrian555 <v2ave10p>
Date: 2018-10-23T17:53:17Z
Merge remote-tracking branch 'remotes/upstream/master' into eager_execution
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
