[
https://issues.apache.org/jira/browse/SEDONA-277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17716937#comment-17716937
]
Kristin Cowalcijk commented on SEDONA-277:
------------------------------------------
This problem cannot be solved by simply enabling {{resolved-pom-maven-plugin}}
when building spark-shaded, there are some other problems with other scala 2.13
artifacts.
For example,
[sedona-core-3.0_2.13:1.4.0|https://mvnrepository.com/artifact/org.apache.sedona/sedona-core-3.0_2.13/1.4.0]
declares spark-core and spark-sql as compile dependency instead of provided
dependency, and the version of scala-library dependency is 2.12 instead of
2.13. This is because the POM for sedona-core-3.0_2.13 relies on the
sedona-parent POM to define dependency versions, while sedona-parent POM only
works for scala 2.12 artifacts.
> Sedona spark artifacts for scala 2.13 do not have proper POMs
> -------------------------------------------------------------
>
> Key: SEDONA-277
> URL: https://issues.apache.org/jira/browse/SEDONA-277
> Project: Apache Sedona
> Issue Type: Bug
> Affects Versions: 1.4.0
> Reporter: Kristin Cowalcijk
> Priority: Major
>
> A strange error happens when launching spark-shell with {{--packages}}
> specified as sedona spark packages:
> {code}
> ::::::::::::::::::::::::::::::::::::::::::::::
> :: UNRESOLVED DEPENDENCIES ::
> ::::::::::::::::::::::::::::::::::::::::::::::
> :: org.apache.sedona#sedona-spark-shaded-3.0_2.13;1.4.0:
> java.text.ParseException: inconsistent module descriptor file found in
> 'https://repo1.maven.org/maven2/org/apache/sedona/sedona-spark-shaded-3.0_2.13/1.4.0/sedona-spark-shaded-3.0_2.13-1.4.0.pom':
> bad module name: expected='sedona-spark-shaded-3.0_2.13'
> found='sedona-spark-shaded-3.0_2.12';
> :: org.scalatest#scalatest_2.13;working@kontinuation: not found
> ::
> org.scala-lang.modules#scala-collection-compat_2.13;working@kontinuation: not
> found
> ::::::::::::::::::::::::::::::::::::::::::::::
> :::: ERRORS
> unknown resolver null
> central: bad module name found in
> https://repo1.maven.org/maven2/org/apache/sedona/sedona-spark-shaded-3.0_2.13/1.4.0/sedona-spark-shaded-3.0_2.13-1.4.0.pom:
> expected='sedona-spark-shaded-3.0_2.13 found='sedona-spark-shaded-3.0_2.12'
> {code}
> It complains that the POM of spark-shaded contains an inconsistent module
> name. Part of the POM file of {{sedona-spark-shaded-3.0_2.13;1.4.0}} looks
> like this:
> {code:xml}
> <?xml version="1.0" encoding="UTF-8"?>
> <project xmlns="http://maven.apache.org/POM/4.0.0";
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
> xsi:schemaLocation="http://maven.apache.org/POM/4.0.0
> http://maven.apache.org/maven-v4_0_0.xsd";>
> <parent>
> <artifactId>sedona-parent</artifactId>
> <groupId>org.apache.sedona</groupId>
> <version>1.4.0</version>
> </parent>
> <modelVersion>4.0.0</modelVersion>
>
> <artifactId>sedona-spark-shaded-${spark.compat.version}_${scala.compat.version}</artifactId>
> <name>${project.groupId}:${project.artifactId}</name>
> <description>A cluster computing system for processing large-scale spatial
> data: Spark Shaded.</description>
> <url>http://sedona.apache.org/</url>
> {code}
> The {{artifactId}} was not resolved to constants when publishing, so the
> dependency resolver uses the property definitions in parent POM to resolve
> {{${spark.compat.version}_${scala.compat.version}}}. The parent POM defined
> {{spark.compat.version}} as 3.0 and {{scala.compat.version}} as 2.12 in
> default activated profile, so the artifact name would be
> {{sedona-spark-shaded-3.0_2.12}}, which is inconsistent with
> {{sedona-spark-shaded-3.0_2.13}}.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
