[
https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010296#comment-14010296
]
Colin Patrick McCabe commented on SPARK-1518:
---------------------------------------------
I wonder if we should have a discussion on the mailing list about the oldest
version of Hadoop we should support. I would argue that it should be 0.23.
Yahoo! is still using that version. Perhaps other people have more information
than I do, though.
If we decide to support 0.20, I will create a patch that does this using
reflection. But I'd rather get your guys' opinion on whether that make sense
first.
> Spark master doesn't compile against hadoop-common trunk
> --------------------------------------------------------
>
> Key: SPARK-1518
> URL: https://issues.apache.org/jira/browse/SPARK-1518
> Project: Spark
> Issue Type: Bug
> Reporter: Marcelo Vanzin
> Assignee: Colin Patrick McCabe
> Priority: Critical
>
> FSDataOutputStream::sync() has disappeared from trunk in Hadoop;
> FileLogger.scala is calling it.
> I've changed it locally to hsync() so I can compile the code, but haven't
> checked yet whether those are equivalent. hsync() seems to have been there
> forever, so it hopefully works with all versions Spark cares about.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
