Hi,
This is because your Logger setting is set to OFF. Just add the following
lines into your code, probably this should resolve the issue.
IMPORTS that are needed.
import org.apache.log4j.Logger
import org.apache.log4j.Level
ADD the two lines to your code.
Logger.getLogger("org").setLevel(Level.ON)
Logger.getLogger("akka").setLevel(Level.ON)
Thanks.
On Tue, Apr 21, 2015 at 6:26 PM, bipin [via Apache Spark User List] <
ml-node+s1001560n22592...@n3.nabble.com> wrote:
> Hi all,
> I am facing an issue, whenever I run a job on my mesos cluster, I cannot
> see any progress on my terminal. It shows :
> [Stage 0:> (0 + 0)
> / 204]
> I have setup the cluster on AWS EC2 manually. I first run mesos master and
> slaves, then run spark on each slave machine. Then finally a spark-shell
> with mesos master as argument. The data is located on HDFS. The shell loads
> properly. But I cannot run the program over my spark cluster. Same program
> runs fine on standalone spark. I want to test the script on a a cluster.
>
> Here is my spark default.conf
>
> spark.executor.uri
> hdfs://masterip/user/ubuntu/spark-1.4.0-SNAPSHOT-bin-2.5.0-cdh5.3.2.tgz
> spark.master mesos://masterip:5050
> spark.eventLog.enabled true
> spark.eventLog.dir hdfs://masterip/user/ubuntu/sparkeventlogs
> spark.executor.memory 6g
> spark.driver.memory 5g
> spark.serializer org.apache.spark.serializer.KryoSerializer
>
> What could be the problem here ? Has anyone come across this ?
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
>
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-REPL-no-progress-when-run-in-cluster-tp22592.html
> To start a new topic under Apache Spark User List, email
> ml-node+s1001560n1...@n3.nabble.com
> To unsubscribe from Apache Spark User List, click here
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cHJhbm5veUBzaWdtb2lkYW5hbHl0aWNzLmNvbXwxfC0xNTI2NTg4NjQ2>
> .
> NAML
> <http://apache-spark-user-list.1001560.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
View this message in context:
http://apache-spark-user-list.1001560.n3.nabble.com/Spark-REPL-no-progress-when-run-in-cluster-tp22592p22594.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
