Hi We've just experienced an issue with the new Spark-1.1.0 and the start-thriftserver.sh script. We tried to launch start-thriftserver.sh with "--master yarn" option and got the following error message : Failed to load Hive Thrift server main class org.apache.spark.sql.hive.thriftserver.HiveThriftServer2. You need to build Spark with -Phive. In fact Spark was built with -Phive option, but the real problem was this one : Application appattempt_1411058337040_0118_000001 submitted by user xxxxx to unknown queue: default So the solution was to specified the queue, and it works : /opt/spark/sbin/start-thriftserver.sh --master yarn --queue spark-batch Hope this could help, as the error message is not really clear (and rather wrong). Helene --
Kelkoo SAS Société par Actions Simplifiée Au capital de € 4.168.964,30 Siège social : 8, rue du Sentier 75002 Paris 425 093 069 RCS Paris Ce message et les pièces jointes sont confidentiels et établis à l'attention exclusive de leurs destinataires. Si vous n'êtes pas le destinataire de ce message, merci de le détruire et d'en avertir l'expéditeur. |
- Issue with Spark-1.1.0 and the start-thriftserver.sh sc... Hélène Delanoeye