[
https://issues.apache.org/jira/browse/SPARK-1518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14010284#comment-14010284
]
Colin Patrick McCabe commented on SPARK-1518:
---------------------------------------------
I think it's very, very, very unlikely that anyone will want to run Hadoop 0.20
against Spark. Why don't we:
* fix the compile against Hadoop trunk
* wait for someone to show up who wants compatibility with hadoop 0.20 before
we work on it?
It seems like if there is interest in Spark on Hadoop 0.20, there will quickly
be a patch submitted to get it compiling there. If there is no such interest,
then we'll be done here without doing a lot of work up front.
If you agree then I'll create a pull req. I have verified that fixing the
flush thing un-breaks the compile on master.
> Spark master doesn't compile against hadoop-common trunk
> --------------------------------------------------------
>
> Key: SPARK-1518
> URL: https://issues.apache.org/jira/browse/SPARK-1518
> Project: Spark
> Issue Type: Bug
> Reporter: Marcelo Vanzin
> Assignee: Colin Patrick McCabe
> Priority: Critical
>
> FSDataOutputStream::sync() has disappeared from trunk in Hadoop;
> FileLogger.scala is calling it.
> I've changed it locally to hsync() so I can compile the code, but haven't
> checked yet whether those are equivalent. hsync() seems to have been there
> forever, so it hopefully works with all versions Spark cares about.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
