GitHub user aviv-ebates opened a pull request:
https://github.com/apache/spark/pull/21057
2 Improvements to Pyspark docs
Each of these 2 items has cost me a few hours of debugging. Hopefully, this
will stop others from having to debug the same thing.
1. Describe the expected type of `fromOffsets` param.
2. Add missing method to `StreamingListener`, which is invoked by proxy
from the Java/Scala side, and throws a strange exception when not found.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/aviv-ebates/spark improve-docs
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21057.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21057
----
commit 4b67ecd0a5e835c35083fe9a1b069f240e8062e1
Author: Aviv <37817804+aviv-ebates@...>
Date: 2018-04-10T17:53:42Z
improve doc1
commit e040a68151c308a1e46cda6723fed2b7023a7331
Author: Aviv <37817804+aviv-ebates@...>
Date: 2018-04-10T17:55:02Z
missing, undocumented, method.
Since this method is missing here, trying to use a Listener throws an
expection. Since it's not documented, it's hard to handle.
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]