GitHub user aviv-ebates opened a pull request:

    https://github.com/apache/spark/pull/21057

    2 Improvements to Pyspark docs

    Each of these 2 items has cost me a few hours of debugging. Hopefully, this 
will stop others from having to debug the same thing.
    
    1. Describe the expected type of `fromOffsets` param.
    2. Add missing method to `StreamingListener`, which is invoked by proxy 
from the Java/Scala side, and throws a strange exception when not found.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/aviv-ebates/spark improve-docs

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/21057.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #21057
    
----
commit 4b67ecd0a5e835c35083fe9a1b069f240e8062e1
Author: Aviv <37817804+aviv-ebates@...>
Date:   2018-04-10T17:53:42Z

    improve doc1

commit e040a68151c308a1e46cda6723fed2b7023a7331
Author: Aviv <37817804+aviv-ebates@...>
Date:   2018-04-10T17:55:02Z

    missing, undocumented, method.
    
    Since this method is missing here, trying to use a Listener throws an 
expection. Since it's not documented, it's hard to handle.

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to