Re: Spark issue moving from local to yarn-client

2019-03-14 Thread Dave Boyd
Ok, this had more information: > INFO [2019-03-15 02:00:46,364] ({pool-2-thread-3} > Logging.scala[logInfo]:54) - Logging events to > hdfs:///var/log/spark/applicationHistory/application_1551287663522_0145 > ERROR [2019-03-15 02:00:46,366] ({SparkListenerBus} > Logging.scala[logError]:91) -

Re: Spark issue moving from local to yarn-client

2019-03-14 Thread Jeff Zhang
This log is zeppelin server log, the root log should be in the spark interpreter log. The file name is something like this : zeppelin-interpreter-spark*.log Dave Boyd 于2019年3月15日周五 上午9:31写道: > Jeff: > > Running a simple spark.version paragraph I sometimes get this: > > INFO [2019-03-15

Re: Spark issue moving from local to yarn-client

2019-03-14 Thread Dave Boyd
Jeff: Running a simple spark.version paragraph I sometimes get this: INFO [2019-03-15 01:12:18,720] ({pool-2-thread-49} RemoteInterpreter.java[call]:142) - Open RemoteInterpreter org.apache.zeppelin.spark.SparkInterpreter INFO [2019-03-15 01:12:18,721] ({pool-2-thread-49}

Re: Spark issue moving from local to yarn-client

2019-03-14 Thread Jeff Zhang
Hi Dave, Could you paste the full stacktrace ? You can find it in the spark interpreter log file which is located in ZEPPELIN_HOME/logs Xun Liu 于2019年3月15日周五 上午8:21写道: > Hi > > You can first execute a simple statement in spark, through sparksql, to > see if it can run normally in YARN. > If

Re: Spark issue moving from local to yarn-client

2019-03-14 Thread Xun Liu
Hi You can first execute a simple statement in spark, through sparksql, to see if it can run normally in YARN. If sparksql is running without problems, check the zeppelin and spark on yarn issues. Also, what do you use for zeppelin-0.7.4? zeppelin-0.8.2? Is it a branch that you maintain