Thanks. I wonder why this is not widely reported in the user forum. The RELP shell is basically broken in 1.5 .0 and 1.5.1 -Yao
From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Sunday, October 25, 2015 12:01 PM To: Ge, Yao (Y.) Cc: user Subject: Re: Spark scala REPL - Unable to create sqlContext Have you taken a look at the fix for SPARK-11000 which is in the upcoming 1.6.0 release ? Cheers On Sun, Oct 25, 2015 at 8:42 AM, Yao <y...@ford.com<mailto:y...@ford.com>> wrote: I have not been able to start Spark scala shell since 1.5 as it was not able to create the sqlContext during the startup. It complains the metastore_db is already locked: "Another instance of Derby may have already booted the database". The Derby log is attached. I only have this problem with starting the shell in yarn-client mode. I am working with HDP2.2.6 which runs Hadoop 2.6. -Yao derby.log <http://apache-spark-user-list.1001560.n3.nabble.com/file/n25195/derby.log> -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-scala-REPL-Unable-to-create-sqlContext-tp25195.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org<mailto:user-unsubscr...@spark.apache.org> For additional commands, e-mail: user-h...@spark.apache.org<mailto:user-h...@spark.apache.org>