[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-38040:
---------------------------------
Description:
{code}
./dev/mima
{code}
We don't currently run binary compatibility check in below modules:
{code}
[info] spark-parent: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-network-common: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-tags: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-unsafe: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-network-shuffle: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-kvstore: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-tools: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-token-provider-kafka-0-10: mimaPreviousArtifacts not set, not
analyzing binary compatibility
[info] spark-streaming-kafka-0-10-assembly: mimaPreviousArtifacts not set, not
analyzing binary compatibility
[info] spark-catalyst: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-repl: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-avro: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-sql-kafka-0-10: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-hive: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-assembly: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary
compatibility
{code}
However, there are some APIs under these modules. For example,
https://github.com/apache/spark/blob/master/external/avro/src/main/scala/org/apache/spark/sql/avro/functions.scala
for Avro,
https://github.com/apache/spark/tree/master/common/kvstore/src/main/java/org/apache/spark/util/kvstore
for KVStore (to be API), and
https://github.com/apache/spark/tree/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector
for Catalyst
was:
{code}
./dev/mima
{code}
We don't currently run binary compatibility check in below modules:
{code}
[info] spark-parent: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-network-common: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-tags: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-unsafe: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-network-shuffle: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-kvstore: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-tools: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-token-provider-kafka-0-10: mimaPreviousArtifacts not set, not
analyzing binary compatibility
[info] spark-streaming-kafka-0-10-assembly: mimaPreviousArtifacts not set, not
analyzing binary compatibility
[info] spark-catalyst: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-repl: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-avro: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-sql-kafka-0-10: mimaPreviousArtifacts not set, not analyzing
binary compatibility
[info] spark-hive: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-assembly: mimaPreviousArtifacts not set, not analyzing binary
compatibility
[info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary
compatibility
{code}
However, there are some APIs under these modules. For example,
https://github.com/apache/spark/blob/master/python/pyspark/sql/avro/functions.py
for Avro,
https://github.com/apache/spark/tree/master/common/kvstore/src/main/java/org/apache/spark/util/kvstore
for KVStore (to be API), and
https://github.com/apache/spark/tree/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector
for Catalyst
> Enable binary compatibility check for APIs in Catalyst, KVStore and Avro
> modules
> --------------------------------------------------------------------------------
>
> Key: SPARK-38040
> URL: https://issues.apache.org/jira/browse/SPARK-38040
> Project: Spark
> Issue Type: Test
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> {code}
> ./dev/mima
> {code}
> We don't currently run binary compatibility check in below modules:
> {code}
> [info] spark-parent: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-network-common: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-tags: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-unsafe: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-network-shuffle: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-kvstore: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-tools: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-token-provider-kafka-0-10: mimaPreviousArtifacts not set, not
> analyzing binary compatibility
> [info] spark-streaming-kafka-0-10-assembly: mimaPreviousArtifacts not set,
> not analyzing binary compatibility
> [info] spark-catalyst: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-repl: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-avro: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-sql-kafka-0-10: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-hive: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-assembly: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> {code}
> However, there are some APIs under these modules. For example,
> https://github.com/apache/spark/blob/master/external/avro/src/main/scala/org/apache/spark/sql/avro/functions.scala
> for Avro,
> https://github.com/apache/spark/tree/master/common/kvstore/src/main/java/org/apache/spark/util/kvstore
> for KVStore (to be API), and
> https://github.com/apache/spark/tree/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector
> for Catalyst
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
