GitHub user JoshRosen opened a pull request:
https://github.com/apache/spark/pull/7625
[WIP][CI-SKIP] Expression fuzz testing in Spark SQL
This is a WIP pull request for some expression fuzz testing code that I'm
working on as part of a side-project, hackathon. I'm creating this pull
request now in order to share the code and to have a pull request that I can
reference from my other pull requests for fixing bugs that were found using
this tester.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JoshRosen/spark fuzz-test
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/7625.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #7625
----
commit 8b22358b3f4e1664bf243d74833ffac1489ff2a0
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T02:14:43Z
Initial commit for SQL expression fuzzing harness
commit b1cb62bc4e1fc7f688b4588bfb0bfe202a80b981
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T03:03:46Z
Apply implicit casts (in a hacky way for now)
commit d72853b30bcd14c70465911219f5e3b0b0a9ec78
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T22:40:21Z
More messy WIP prototyping on expression fuzzing
commit a22a1e0b04387eb1dbd3b4f9347565dd92f4c7ea
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T23:02:00Z
Add some comments; speed up classpath search
commit a3239af76b237a526aea737ea79bfb9b95dfd371
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T23:07:37Z
Move dummy type coercion to a helper method
commit c494687fedb133d06d95c628caef3f004b84526e
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T23:30:59Z
More code cleanup and comments
commit 45bbed008f9f42dd3fd49e54e50e30b40323c3d6
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T23:39:53Z
Use non-mutable interpreted projection.
commit aa89baac776ff3144138bc307523309b3f560120
Author: Josh Rosen <[email protected]>
Date: 2015-07-11T23:44:26Z
Log expression after coercion
commit 92ea6f6436eb6a2eca798dabef5d4af88cb53fa1
Author: Josh Rosen <[email protected]>
Date: 2015-07-13T00:50:07Z
Run tests in deterministic order
commit 4c5dc9cd9e3b04a267e27bb739cd78a11b0147b0
Author: Josh Rosen <[email protected]>
Date: 2015-07-23T20:31:06Z
Test with random inputs of all types
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]