GitHub user gabrielenizzoli opened a pull request:
https://github.com/apache/spark/pull/11028
[SPARK-13121] [Streaming] java mapWithState mishandles scala Optionjava
mapwithstate broken java mapping
Already merged into 1.6 branch, this PR is to commit to master the same
change
Github user gabrielenizzoli closed the pull request at:
https://github.com/apache/spark/pull/11007
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Github user gabrielenizzoli commented on the pull request:
https://github.com/apache/spark/pull/11007#issuecomment-178772851
@zsxwing yes, I will close this PR and create a new one for master. Should
I assign the same jira issue number to the PR for master?
---
If your project is
GitHub user gabrielenizzoli opened a pull request:
https://github.com/apache/spark/pull/11007
java mapwithstate, broken java mapping
java mapwithstate with Function3 has wrong conversion of java Optional to
scala Option, now code uses same conversion used in the mapwithstate call
Github user gabrielenizzoli commented on the pull request:
https://github.com/apache/spark/pull/1077#issuecomment-48005418
@tdas done
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this
GitHub user gabrielenizzoli opened a pull request:
https://github.com/apache/spark/pull/1077
Fix for newFilesOnly logic in file DStream
The newFilesOnly logic should be inverted: if newFilesOnly==true then only
start reading files older than current time. As the code is now if
