[
https://issues.apache.org/jira/browse/SPARK-38040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17482855#comment-17482855
]
Apache Spark commented on SPARK-38040:
--------------------------------------
User 'HyukjinKwon' has created a pull request for this issue:
https://github.com/apache/spark/pull/35339
> Enable binary compatibility check for APIs in Catalyst, KVStore and Avro
> modules
> --------------------------------------------------------------------------------
>
> Key: SPARK-38040
> URL: https://issues.apache.org/jira/browse/SPARK-38040
> Project: Spark
> Issue Type: Test
> Components: Build
> Affects Versions: 3.3.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> {code}
> ./dev/mima
> {code}
> We don't currently run binary compatibility check in below modules:
> {code}
> [info] spark-parent: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-network-common: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-tags: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-unsafe: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-network-shuffle: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-kvstore: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-tools: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-token-provider-kafka-0-10: mimaPreviousArtifacts not set, not
> analyzing binary compatibility
> [info] spark-streaming-kafka-0-10-assembly: mimaPreviousArtifacts not set,
> not analyzing binary compatibility
> [info] spark-catalyst: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-repl: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-avro: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-sql-kafka-0-10: mimaPreviousArtifacts not set, not analyzing
> binary compatibility
> [info] spark-hive: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-assembly: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> [info] spark-examples: mimaPreviousArtifacts not set, not analyzing binary
> compatibility
> {code}
> However, there are some APIs under these modules. For example,
> https://github.com/apache/spark/blob/master/external/avro/src/main/scala/org/apache/spark/sql/avro/functions.scala
> for Avro,
> https://github.com/apache/spark/tree/master/common/kvstore/src/main/java/org/apache/spark/util/kvstore
> for KVStore (to be API), and
> https://github.com/apache/spark/tree/master/sql/catalyst/src/main/java/org/apache/spark/sql/connector
> for Catalyst
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
