This is an automated email from the ASF dual-hosted git repository.
chengpan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-kyuubi.git
The following commit(s) were added to refs/heads/master by this push:
new 1f403ec [KYUUBI #703][FOLLOWUP][DEPS][TEST] Reduce hudi spark
extraJars deps
1f403ec is described below
commit 1f403ec6184c72c14500df885d1b65ffc2855a8f
Author: simon <[email protected]>
AuthorDate: Sat Sep 11 07:50:33 2021 +0800
[KYUUBI #703][FOLLOWUP][DEPS][TEST] Reduce hudi spark extraJars deps
### _Why are the changes needed?_
Reduce hudi spark extraJars deps , it is unnecessary to submit all jars.
### _How was this patch tested?_
- [ ] Add some test cases that check the changes thoroughly including
negative and positive cases if possible
- [ ] Add screenshots for manual tests if appropriate
- [ ] [Run
test](https://kyuubi.readthedocs.io/en/latest/develop_tools/testing.html#running-tests)
locally before make a pull request
Closes #1072 from simon824/master.
Closes #703
2bb4af06 [simon] 1
e2164fa6 [simon] 1
dfc79ba6 [simon] && -> ||
6791f95b [simon] reduce hudi spark extraJars deps
ed4dc4b5 [Simon] Merge branch 'apache:master' into master
ea5db291 [simon] remove space
3d002afd [simon] fix "File line length exceeds 100 characters"
1939038e [simon] roll back
d25d3721 [simon] roll back
41232e55 [simon] remove dataLakeSuiteMixin tableOptions
68d6e891 [simon] fix error commit
b802603c [simon] add getTableOption
f6d37426 [Simon] Merge branch 'apache:master' into master
8b3b4b85 [simon] add tableOptions
Lead-authored-by: simon <[email protected]>
Co-authored-by: Simon <[email protected]>
Signed-off-by: Cheng Pan <[email protected]>
---
kyuubi-common/src/test/scala/org/apache/kyuubi/HudiSuiteMixin.scala | 6 ++----
1 file changed, 2 insertions(+), 4 deletions(-)
diff --git
a/kyuubi-common/src/test/scala/org/apache/kyuubi/HudiSuiteMixin.scala
b/kyuubi-common/src/test/scala/org/apache/kyuubi/HudiSuiteMixin.scala
index 3684c84..17cc5d2 100644
--- a/kyuubi-common/src/test/scala/org/apache/kyuubi/HudiSuiteMixin.scala
+++ b/kyuubi-common/src/test/scala/org/apache/kyuubi/HudiSuiteMixin.scala
@@ -28,12 +28,10 @@ trait HudiSuiteMixin extends DataLakeSuiteMixin {
override protected def warehouse: Path = Utils.createTempDir()
override protected def extraJars: String = {
- var extraJars = ""
System.getProperty("java.class.path")
.split(":")
- .filter(_.contains("jar"))
- .foreach(i => extraJars += i + ",")
- extraJars.substring(0, extraJars.length - 1)
+ .filter(i => i.contains("hudi") || i.contains("spark-avro"))
+ .mkString(",")
}
override protected def extraConfigs = Map(
