[
https://issues.apache.org/jira/browse/SPARK-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115942#comment-14115942
]
Apache Spark commented on SPARK-3234:
-------------------------------------
User 'liancheng' has created a pull request for this issue:
https://github.com/apache/spark/pull/2208
> SPARK_HADOOP_VERSION and SPARK_HIVE depend on deprecated make-distribution.sh
> command line options
> --------------------------------------------------------------------------------------------------
>
> Key: SPARK-3234
> URL: https://issues.apache.org/jira/browse/SPARK-3234
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 1.0.2
> Reporter: Cheng Lian
> Assignee: Cheng Lian
> Priority: Minor
>
> In {{make-distribution.sh}}, {{SPARK_HADOOP_VERSION}} is determined by
> {{\-\-hadoop}}, and {{SPARK_HIVE}} is determined by {{\-\-with-hive}}, but
> these two command line options are deprecated by
> `-Dhadoop.version`/`-Phadoop-??` and `-Phive` respectively. The result is
> that:
> # we may end up with something like {{spark-1.1.0-SNAPSHOT-bin-.tgz}} unless
> {{\-\-name}} is specified explicitly
> # Datanucleus jars will not be included in the distribution folder/tarball
> unless we set {{SPARK_HIVE=true}} explicitly
> A possible fix is to check {{hadoop.version}} and {{project.activeProfiles}}
> with {{mvn help:evaluate}}, similar to what we do now to determine
> {{VERSION}}.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
