[
https://issues.apache.org/jira/browse/PIRK-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15556158#comment-15556158
]
ASF GitHub Bot commented on PIRK-45:
------------------------------------
GitHub user wraydulany opened a pull request:
https://github.com/apache/incubator-pirk/pull/107
[WIP] PIRK-45 Remove dependency on Java serialization
This is a WIP (do not merge) for adding in JSON serialization. I can't get
this WIP to pass the elasticsearch spark streaming tests on my cluster.
I'm fairly sure that this is a configuration problem on my end (the errors
I get appear to be such), but I'm having little luck resolving them, and would
love it if some of the community could give it a test.
I've left in Java Serialization for now, but I've made JSON serialization
the default.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/wraydulany/incubator-pirk PIRK-45
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-pirk/pull/107.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #107
----
commit c2c6af2465e21cd706c8cfd0dc4f95f7746d86f0
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-09-28T15:13:12Z
Initial start on moving away from Java object serialization.
commit 66235a9c6ac07e3cec6a94c0874b40bf6624192e
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-09-29T17:02:17Z
Initial work.
commit 03b4964c2b25538aaecfdcd56a408bcba8154688
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-01T17:20:09Z
Merge branch 'master' of https://github.com/wraydulany/incubator-pirk into
PIRK-45
commit de01c5ad1e670200cefa6c7dfc2b678cb245eaf6
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-01T17:21:27Z
Merge branch 'master' of https://github.com/wraydulany/incubator-pirk into
PIRK-45
commit 7b221de870f7efc8b41ec52fd5d05af06360c405
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-04T18:24:18Z
Added deserializer for query; I think I should delete the serializer for
QueryInfo.
commit fdeb7d77117691f7dda63a2a180d805861216893
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-04T19:21:22Z
Query serialization seems to be working now; at least it doesn't fail to
get recalled.
commit b31afcfe7f01ebda6a19e27b5e651f8dc8763f16
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-04T19:42:20Z
Response deserializer compiles.
commit 42e2bb6082a601e5e503e76170499baff37fc478
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-05T12:31:51Z
Custom deserializers complete, as are class amendments to make them work.
commit 603fcaa777f754dbf60836a8a81b7239b39ae494
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-05T14:29:21Z
Merge remote-tracking branch 'upstream/master' into PIRK-45
commit fbebc4adafefa640e5b0339d2423abdabed9b0b3
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-05T15:59:55Z
Needed to add a new constructor for QueryInfo so as to not depend on the
existence of a populated QuerySchemaRegistry.
commit b9caf260f14405705864ba200d993057a7040416
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-06T12:16:34Z
Move to gson breaks hdfs?
commit dc9fcfd848c89bf59310c0c12284b5bbb72caec4
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-06T12:49:45Z
Working with Gson on two tests; time for distributed tests.
commit 99cddd1981f76569d63add70a6351ba744ca13c9
Author: Walter Ray-Dulany <[email protected]>
Date: 2016-10-07T20:19:48Z
Merge remote-tracking branch 'upstream/master' into PIRK-45
----
> Remove dependency on Java serialization
> ---------------------------------------
>
> Key: PIRK-45
> URL: https://issues.apache.org/jira/browse/PIRK-45
> Project: PIRK
> Issue Type: Improvement
> Reporter: Tim Ellison
> Assignee: Walter Ray-Dulany
>
> Pirk should not depend upon Java serialization as a persistent object format.
> Maintaining support for a variety of versions of Java serialized form can be
> difficult, this includes both the querier and responder sides of a PIR.
> Alternative formats such as XML and JSON are more forgiving/extensible.
> Furthermore, and despite Pirk's trust between querier and responder, there
> are potential implications for loading the binary representation of Java's
> serialized instances as a vector for security vulnerabilities.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
