Github user HyukjinKwon commented on a diff in the pull request:
https://github.com/apache/spark/pull/15666#discussion_r143013333
--- Diff: R/pkg/tests/fulltests/test_context.R ---
@@ -167,6 +167,18 @@ test_that("spark.lapply should perform simple
transforms", {
sparkR.session.stop()
})
+test_that("add jar should work and allow usage of the jar on the driver
node", {
+ sparkR.sparkContext()
+
+ destDir <- file.path(tempdir(), "testjar")
+ jarName <- callJStatic("org.apache.spark.TestUtils", "createDummyJar",
+ destDir, "sparkrTests", "DummyClassForAddJarTest")
--- End diff --
Ah, it looks the problem is here. `createDummyJar` returns URI string, for
example,
```r
> normalizePath("file:/C:/a/b/c")
[1] "C:\\Users\\IEUser\\workspace\\spark\\file:\\C:\\a\\b\\c"
Warning message:
In normalizePath(path.expand(path), winslash, mustWork) :
path[1]="file:/C:/a/b/c": The filename, directory name, or volume label
syntax
is incorrect
```
This looks ending up with an weird path like
`"C:\\Users\\IEUser\\workspace\\spark\\file:\\C:\\a\\b\\c"`.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
