RogPodge commented on issue #196: [LIVY-606][LIVY-152] fix the invalid conf of 
pyspark.archives and sparkr.package
URL: https://github.com/apache/incubator-livy/pull/196#issuecomment-531529974
 
 
   > 
   > 
   >  Sorry, what do you mean "I can't seem to replicate the stated behavior on 
my machine after trying to incorporate this PR"?
   
   After porting your PR to my local Livy instance, I still see the following 
in the Livy logs when I try to submit a pyspark application. 
   
   INFO yarn.Client: Uploading resource file:/opt/spark/python/lib/pyspark.zip 
-> 
hdfs://nmnode-0-0.nmnode-0-svc:9000/user/root/.sparkStaging/application_1568331306042_0026/pyspark.zip
   
   I noticed that the PR only makes changes to the InteractiveSession.scala, so 
how do we ensure that the pyspark.zip file is cached for Batch Sessions?
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to