This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 9b647e80b9e [SPARK-42087][SQL][TESTS] Use `--no-same-owner` when
`HiveExternalCatalogVersionsSuite` untars
9b647e80b9e is described below
commit 9b647e80b9e6b9a2b7afc9045cb8c4aa9b690aae
Author: Dongjoon Hyun <[email protected]>
AuthorDate: Mon Jan 16 01:33:08 2023 -0800
[SPARK-42087][SQL][TESTS] Use `--no-same-owner` when
`HiveExternalCatalogVersionsSuite` untars
### What changes were proposed in this pull request?
This PR aims to use a new parameter `--no-same-owner` when
`HiveExternalCatalogVersionsSuite` untars
### Why are the changes needed?
**BEFORE**
```
rootedeccfee6d53:/spark# tar xfz spark-3.3.1-bin-hadoop3.tgz
rootedeccfee6d53:/spark# ls -al spark-3.3.1-bin-hadoop3
total 96
drwxr-xr-x 17 110302528 1000 544 Oct 15 10:32 .
drwxr-xr-x 4 root root 128 Jan 16 07:30 ..
-rw-r--r-- 1 root root 22940 Oct 15 10:32 LICENSE
-rw-r--r-- 1 root root 57842 Oct 15 10:32 NOTICE
drwxr-xr-x 3 110302528 1000 96 Oct 15 10:32 R
-rw-r--r-- 1 root root 4461 Oct 15 10:32 README.md
-rw-r--r-- 1 root root 165 Oct 15 10:32 RELEASE
drwxr-xr-x 29 110302528 1000 928 Oct 15 10:32 bin
drwxr-xr-x 8 110302528 1000 256 Oct 15 10:32 conf
drwxr-xr-x 5 110302528 1000 160 Oct 15 10:32 data
drwxr-xr-x 4 110302528 1000 128 Oct 15 10:32 examples
drwxr-xr-x 250 110302528 1000 8000 Oct 15 10:32 jars
drwxr-xr-x 4 110302528 1000 128 Oct 15 10:32 kubernetes
drwxr-xr-x 60 110302528 1000 1920 Oct 15 10:32 licenses
drwxr-xr-x 19 110302528 1000 608 Oct 15 10:32 python
drwxr-xr-x 29 110302528 1000 928 Oct 15 10:32 sbin
drwxr-xr-x 3 110302528 1000 96 Oct 15 10:32 yarn
```
**AFTER**
```
rootedeccfee6d53:/spark# tar xfz spark-3.3.1-bin-hadoop3.tgz --no-same-owner
rootedeccfee6d53:/spark# ls -al spark-3.3.1-bin-hadoop3
total 96
drwxr-xr-x 17 root root 544 Oct 15 10:32 .
drwxr-xr-x 4 root root 128 Jan 16 07:34 ..
-rw-r--r-- 1 root root 22940 Oct 15 10:32 LICENSE
-rw-r--r-- 1 root root 57842 Oct 15 10:32 NOTICE
drwxr-xr-x 3 root root 96 Oct 15 10:32 R
-rw-r--r-- 1 root root 4461 Oct 15 10:32 README.md
-rw-r--r-- 1 root root 165 Oct 15 10:32 RELEASE
drwxr-xr-x 29 root root 928 Oct 15 10:32 bin
drwxr-xr-x 8 root root 256 Oct 15 10:32 conf
drwxr-xr-x 5 root root 160 Oct 15 10:32 data
drwxr-xr-x 4 root root 128 Oct 15 10:32 examples
drwxr-xr-x 250 root root 8000 Oct 15 10:32 jars
drwxr-xr-x 4 root root 128 Oct 15 10:32 kubernetes
drwxr-xr-x 60 root root 1920 Oct 15 10:32 licenses
drwxr-xr-x 19 root root 608 Oct 15 10:32 python
drwxr-xr-x 29 root root 928 Oct 15 10:32 sbin
drwxr-xr-x 3 root root 96 Oct 15 10:32 yarn
```
### Does this PR introduce _any_ user-facing change?
No. This is a test-only improvement.
### How was this patch tested?
Pass the CIs.
Closes #39601 from dongjoon-hyun/SPARK-42087.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
---
.../org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala | 3 ++-
1 file changed, 2 insertions(+), 1 deletion(-)
diff --git
a/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala
b/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala
index 4f514aa44c2..a9d38cecc78 100644
---
a/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala
+++
b/sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveExternalCatalogVersionsSuite.scala
@@ -113,7 +113,8 @@ class HiveExternalCatalogVersionsSuite extends
SparkSubmitTestUtils {
val targetDir = new File(sparkTestingDir,
s"spark-$version").getCanonicalPath
Seq("mkdir", targetDir).!
- val exitCode = Seq("tar", "-xzf", downloaded, "-C", targetDir,
"--strip-components=1").!
+ val exitCode = Seq("tar", "-xzf", downloaded, "-C", targetDir,
"--strip-components=1",
+ "--no-same-owner").!
Seq("rm", downloaded).!
// For a corrupted file, `tar` returns non-zero values. However, we
also need to check
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]