[
https://issues.apache.org/jira/browse/SPARK-3787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kousuke Saruta updated SPARK-3787:
----------------------------------
Description:
When we build with sbt with profile for hadoop and without property for hadoop
version like:
{code}
sbt/sbt -Phadoop-2.2 assembly
{code}
jar name is always used default version (1.0.4).
When we build with maven with same condition for sbt, default version for each
profile is used.
For instance, if we build like:
{code}
mvn -Phadoop-2.2 package
{code}
jar name is used hadoop2.2.0 as a default version of hadoop-2.2.
was:
When we build with sbt with profile for hadoop and without property for hadoop
version like:
{code}
sbt/sbt -Phadoop-2.2 assembly
{code}
jar name is always used default version (1.0.4).
When we build with maven with same condition for sbt, default version for each
profile.
For instance, if we build like:
{code}
mvn -Phadoop-2.2 package
{code}
jar name is used hadoop2.2.0 as a default version of hadoop-2.2.
> Assembly jar name is wrong when we build with sbt omitting -Dhadoop.version
> ---------------------------------------------------------------------------
>
> Key: SPARK-3787
> URL: https://issues.apache.org/jira/browse/SPARK-3787
> Project: Spark
> Issue Type: Bug
> Components: Build
> Affects Versions: 1.2.0
> Reporter: Kousuke Saruta
>
> When we build with sbt with profile for hadoop and without property for
> hadoop version like:
> {code}
> sbt/sbt -Phadoop-2.2 assembly
> {code}
> jar name is always used default version (1.0.4).
> When we build with maven with same condition for sbt, default version for
> each profile is used.
> For instance, if we build like:
> {code}
> mvn -Phadoop-2.2 package
> {code}
> jar name is used hadoop2.2.0 as a default version of hadoop-2.2.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
