GitHub user jose-torres opened a pull request:
https://github.com/apache/spark/pull/20922
Ratefix
## What changes were proposed in this pull request?
Roll forward c68ec4e (#20688).
There are two minor test changes required:
* An error which used to be TreeNodeException[ArithmeticException] is no
longer wrapped and is now just ArithmeticException.
* The test framework simply does not set the active Spark session. (Or
rather, it doesn't do so early enough - I think it only happens when a query is
analyzed.) I've added the required logic to SQLTestUtils.
## How was this patch tested?
existing tests
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/jose-torres/spark ratefix
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/20922.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #20922
----
commit ab838aa5cdb0e6b0b5840dafc456e1c5249c9a3f
Author: jerryshao <sshao@...>
Date: 2018-03-27T21:39:05Z
[SPARK-23096][SS] Migrate rate source to V2
## What changes were proposed in this pull request?
This PR migrate micro batch rate source to V2 API and rewrite UTs to suite
V2 test.
## How was this patch tested?
UTs.
Author: jerryshao <[email protected]>
Closes #20688 from jerryshao/SPARK-23096.
commit 8e191250864e9a6fe36b5f705f2aedfb366b0afb
Author: Jose Torres <torres.joseph.f+github@...>
Date: 2018-03-28T17:56:03Z
test fixes
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
