[
https://issues.apache.org/jira/browse/SPARK-1306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-1306.
------------------------------
Resolution: Fixed
I think this was obviated by subsequent changes to this documentation. SBT is
no longer the focus, but, building-spark.md now has more comprehensive
documentation on building with YARN, including these recent versions.
> no instructions provided for sbt assembly with Hadoop 2.2
> ---------------------------------------------------------
>
> Key: SPARK-1306
> URL: https://issues.apache.org/jira/browse/SPARK-1306
> Project: Spark
> Issue Type: Bug
> Components: Documentation
> Affects Versions: 0.9.0
> Reporter: Diana Carroll
>
> on the running-on-yarn.html page, in the section "Building a YARN-Enabled
> Assembly JAR", only the instructions for building for "old" Hadoop (2.0.5)
> are provided. There's a comment that "The build process now also supports
> new YARN versions (2.2.x). See below."
> However, the only mention below is a single sentence which says "See Building
> Spark with Maven for instructions on how to build Spark using the Maven
> process." There are no instructions for building with sbt. This is different
> than in prior versions of the docs, in which a whole paragraph was provided.
> I'd like to see the command line to build for Hadoop 2.2 included right at
> the top of the page. Also remove the bit about how it is "now" supported.
> Hadoop 2.2 is now the "norm", no longer an exception, as I see it.
> Unfortunately I'm not sure exactly what the command should be. I tried this,
> but got errors:
> SPARK_HADOOP_VERSION=2.2.0 SPARK_YARN=true sbt/sbt assembly
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
