[
https://issues.apache.org/jira/browse/HADOOP-13519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-13519:
------------------------------------
Attachment: HADOOP-13519-branch-2-001.patch
patch 001; declares the path implements serializable, made up a serialization
version number and a round trip test.
Also tested in spark, without it you see a stack trace starting
{code}
Cause: java.io.NotSerializableException: org.apache.hadoop.fs.Path
Serialization stack:
- object not serializable (class: org.apache.hadoop.fs.Path, value:
/test/filegenerator)
{code}
> Make Path serializable
> ----------------------
>
> Key: HADOOP-13519
> URL: https://issues.apache.org/jira/browse/HADOOP-13519
> Project: Hadoop Common
> Issue Type: Improvement
> Components: io
> Affects Versions: 2.7.2
> Reporter: Steve Loughran
> Assignee: Steve Loughran
> Priority: Minor
> Attachments: HADOOP-13519-branch-2-001.patch
>
>
> If you could make Hadoop Paths serializable, you can use them in Spark
> operations without having to convert them to and from URIs.
> It's trivial for paths to support this; as well as the OS code we need to add
> a check that there's no null URI coming in over the wire, and test to
> validate round tripping
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
