ArnavBalyan commented on PR #503:
URL: https://github.com/apache/incubator-livy/pull/503#issuecomment-3755720603
> Hi @ArnavBalyan , thanks for submitting a PR for this issue. I think the
change itself looks good, but I am not able to run the test successfully. This
is what I am getting on my machine:
>
> ```
> - should open files localized via spark.files by relative path *** FAILED
*** (672 milliseconds)
> ExecuteAborted(Traceback (most recent call last):
> File ".../pr-review/repl/scala-2.12/target/tmp/2817641729331086602",
line 664, in <module>
> sys.exit(main())
> ^^^^^^
> File ".../pr-review/repl/scala-2.12/target/tmp/2817641729331086602",
line 523, in main
> exec('from pyspark.sql import HiveContext', global_dict)
> File "<string>", line 1, in <module>
> ModuleNotFoundError: No module named 'pyspark') did not equal
ExecuteSuccess(JObject(List((text/plain,JString('hello-files')))))
(PythonInterpreterSpec.scala:300)
> ```
>
> Edit: It may be possible to move this test to `InteractiveIT` in
`livy-integration-test`, and then the `spark.livy.forceSparkFilesTest` part
would not be needed since integration tests already run with `LIVY_TEST=false`.
Hey Gyorgy, thanks for raising this let me check I was able to run the test
a while back, `livy-integration-test` is a great idea, will test it out and get
back
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
