GitHub user tdas opened a pull request:
https://github.com/apache/spark/pull/6625
[SPARK-7180][SPARK-8090][SPARK-8191]
This PR solves three SerializationDebugger issues.
* SPARK-7180 - SerializationDebugger fails with ArrayOutOfBoundsException
* SPARK-8090 - SerializationDebugger does not handle classes with
writeReplace correctly
* SPARK-8191 - SerializableDebugger does not handle classes with
writeObject method
The solutions for each are explained as follows
* SPARK-7180 - The wrong slot desc was used for getting the value of the
fields in the object being tested.
* SPARK-8090 - Test the type of the replaced object.
* SPARK-8191 - Use a dummy ObjectOutputStream to collect all the objects
written by the writeObject() method, and then test those objects as usual.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tdas/spark SPARK-7180
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6625.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6625
----
commit 790b617ff34848183054c5eb83d016217a25ada8
Author: Tathagata Das <[email protected]>
Date: 2015-06-01T20:31:20Z
Handled exception in StreamingContext.start()
commit 20b2ec1f4a452aba718219741958a8eb8c47aa89
Author: Tathagata Das <[email protected]>
Date: 2015-06-02T00:01:14Z
Added synchronized
commit a24535b8174b143251a85ed4eafad02f6bf6c763
Author: Tathagata Das <[email protected]>
Date: 2015-06-03T21:43:04Z
Fixed bugs and added support for writeObject
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
