GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/8464
[SPARK-9986][SPARK-9991][SPARK-9993][SQL]Create a simple test framework for
local operators
This PR includes the following changes:
1. Before adding a test framework, I added `OpenCloseIterator` and refactor
`LocalNode` to make it reusable.
2. Add `LocalNodeTest` for local operator tests and add unit tests for
FilterNode and ProjectNode.
3. Add `LimitNode` and `UnionNode` and their unit tests to show how to use
`LocalNodeTest`. (SPARK-9991, SPARK-9993)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark local-execution
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/8464.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #8464
----
commit 4dc2583bbbbc22ed4751a1e89cfa4521d19f2fa2
Author: zsxwing <[email protected]>
Date: 2015-08-26T15:39:48Z
Add OpenCloseIterator and refactor LocalNode to make it reusable
commit 99433c17c2f2db0ec0d4eb51bf96ca2774eee9a4
Author: zsxwing <[email protected]>
Date: 2015-08-26T15:41:55Z
Add LocalNodeTest for local operator tests and add unit tests for
FilterNode and ProjectNode
commit 4e101eecf65e630aa3450bf0a2fe130845ce318e
Author: zsxwing <[email protected]>
Date: 2015-08-26T15:42:11Z
Add LimitNode and UnionNode
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
