[spark] branch branch-3.0 updated: [SPARK-31130][BUILD] Use the same version of `commons-io` in SBT

[dongjoon]

This is an automated email from the ASF dual-hosted git repository.

dongjoon pushed a commit to branch branch-3.0
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.0 by this push:
     new 74cb509  [SPARK-31130][BUILD] Use the same version of `commons-io` in 
SBT
74cb509 is described below

commit 74cb5094ec00c359bb70a456d6490f45bdd5ccd7
Author: Dongjoon Hyun <dongj...@apache.org>
AuthorDate: Thu Mar 12 09:06:29 2020 -0700

    [SPARK-31130][BUILD] Use the same version of `commons-io` in SBT
    
    ### What changes were proposed in this pull request?
    
    This PR (SPARK-31130) aims to pin `Commons IO` version to `2.4` in SBT 
build like Maven build.
    
    ### Why are the changes needed?
    
    [HADOOP-15261](https://issues.apache.org/jira/browse/HADOOP-15261) upgraded 
`commons-io` from 2.4 to 2.5 at Apache Hadoop 3.1.
    
    In `Maven`, Apache Spark always uses `Commons IO 2.4` based on `pom.xml`.
    ```
    $ git grep commons-io.version
    pom.xml:    <commons-io.version>2.4</commons-io.version>
    pom.xml:        <version>${commons-io.version}</version>
    ```
    
    However, `SBT` choose `2.5`.
    
    **branch-3.0**
    ```
    $ build/sbt -Phadoop-3.2 "core/dependencyTree" | grep commons-io:commons-io 
| head -n1
    [info]   | | +-commons-io:commons-io:2.5
    ```
    
    **branch-2.4**
    ```
    $ build/sbt -Phadoop-3.1 "core/dependencyTree" | grep commons-io:commons-io 
| head -n1
    [info]   | | +-commons-io:commons-io:2.5
    ```
    
    ### Does this PR introduce any user-facing change?
    
    No.
    
    ### How was this patch tested?
    
    Pass the Jenkins with `[test-hadoop3.2]` (the default PR Builder is `SBT`) 
and manually do the following locally.
    ```
    build/sbt -Phadoop-3.2 "core/dependencyTree" | grep commons-io:commons-io | 
head -n1
    ```
    
    Closes #27886 from dongjoon-hyun/SPARK-31130.
    
    Authored-by: Dongjoon Hyun <dongj...@apache.org>
    Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
    (cherry picked from commit 972e23d18186c73026ebed95b37a886ca6eecf3e)
    Signed-off-by: Dongjoon Hyun <dongj...@apache.org>
---
 project/SparkBuild.scala | 1 +
 1 file changed, 1 insertion(+)

diff --git a/project/SparkBuild.scala b/project/SparkBuild.scala
index b606bdd..1a2a7c3 100644
--- a/project/SparkBuild.scala
+++ b/project/SparkBuild.scala
@@ -621,6 +621,7 @@ object KubernetesIntegrationTests {
 object DependencyOverrides {
   lazy val settings = Seq(
     dependencyOverrides += "com.google.guava" % "guava" % "14.0.1",
+    dependencyOverrides += "commons-io" % "commons-io" % "2.4",
     dependencyOverrides += "xerces" % "xercesImpl" % "2.12.0",
     dependencyOverrides += "jline" % "jline" % "2.14.6")
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org