zjffdu commented on a change in pull request #3308: [ZEPPELIN-3986]. Cannot
access any JAR in yarn cluster mode
URL: https://github.com/apache/zeppelin/pull/3308#discussion_r257462579
##########
File path:
spark/interpreter/src/test/java/org/apache/zeppelin/spark/NewSparkInterpreterTest.java
##########
@@ -370,34 +370,6 @@ public void run() {
interpretThread.join();
}
- @Test
- public void testDependencies() throws IOException, InterpreterException {
- Properties properties = new Properties();
- properties.setProperty("spark.master", "local");
- properties.setProperty("spark.app.name", "test");
- properties.setProperty("zeppelin.spark.maxResult", "100");
- properties.setProperty("zeppelin.spark.useNew", "true");
- // disable color output for easy testing
- properties.setProperty("zeppelin.spark.scala.color", "false");
-
- // download spark-avro jar
- URL website = new
URL("http://repo1.maven.org/maven2/com/databricks/spark-avro_2.11/3.2.0/spark-avro_2.11-3.2.0.jar";);
- ReadableByteChannel rbc = Channels.newChannel(website.openStream());
- File avroJarFile = new File("spark-avro_2.11-3.2.0.jar");
- FileOutputStream fos = new FileOutputStream(avroJarFile);
- fos.getChannel().transferFrom(rbc, 0, Long.MAX_VALUE);
-
- properties.setProperty("spark.jars", avroJarFile.getAbsolutePath());
-
- interpreter = new SparkInterpreter(properties);
- assertTrue(interpreter.getDelegation() instanceof NewSparkInterpreter);
- interpreter.setInterpreterGroup(mock(InterpreterGroup.class));
- interpreter.open();
-
- InterpreterResult result = interpreter.interpret("import
com.databricks.spark.avro._", getInterpreterContext());
- assertEquals(InterpreterResult.Code.SUCCESS, result.code());
- }
Review comment:
We can not test user jar case in unit test (MutableURLClassLoader only exist
in real spark app which is launched via spark-submit) . So remove it here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
With regards,
Apache Git Services
