GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/16310
[SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table
## What changes were proposed in this pull request?
SparkR tests, `R/run-tests.sh`, succeeds only once because
`test_sparkSQL.R` does not clean up the test table, `people`.
As a result, the rows in `people` table are accumulated at every run and
the test cases fail.
The following is the failure result for the second run.
```r
Failed
-------------------------------------------------------------------------
1. Failure: create DataFrame from RDD (@test_sparkSQL.R#204)
-------------------
collect(sql("SELECT age from people WHERE name = 'Bob'"))$age not equal to
c(16).
Lengths differ: 2 vs 1
2. Failure: create DataFrame from RDD (@test_sparkSQL.R#206)
-------------------
collect(sql("SELECT height from people WHERE name ='Bob'"))$height not
equal to c(176.5).
Lengths differ: 2 vs 1
```
## How was this patch tested?
Manual. Run `run-tests.sh` twice and pass without failures.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-18897
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/16310.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #16310
----
commit e4f5e38bbd59736e8d186fa8971673287a1717e5
Author: Dongjoon Hyun <[email protected]>
Date: 2016-12-16T13:37:18Z
[SPARK-18897][SPARKR] Fix SparkR SQL Test to drop test table
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
