Boamba Daniela created SPARK-35485:
--------------------------------------
Summary: WARN TaskSchedulerImpl: Initial job has not accepted any
resources;
Key: SPARK-35485
URL: https://issues.apache.org/jira/browse/SPARK-35485
Project: Spark
Issue Type: Question
Components: SQL
Affects Versions: 2.4.7
Reporter: Boamba Daniela
Hello,
I'm trying a select request on spark-sql, but I have "WARN TaskSchedulerImpl:
Initial job has not accepted any resources;" message.
I can execute without error : show databases, use mydatabase, show tables ..
spark-env.sh
{quote}rity.auth.login.config=/opt/mapr/conf/mapr.login.conf
-Dzookeeper.sasl.client=false"
# MEMORY SETTINGS
export SPARK_DAEMON_MEMORY=2g
export SPARK_WORKER_MEMORY=4g
# Worker Directory
export SPARK_WORKER_DIR=$SPARK_HOME/tmp
# Environment variable for printing spark command everytime you run spark.Set
to "1" to print.
# export SPARK_PRINT_LAUNCH_COMMAND=1
#UI
export SPARK_SUBMIT_OPTS="$SPARK_SUBMIT_OPTS
-Djava.library.path=$SPARK_MAPR_HOME/lib"
export SPARK_MASTER_HOST=myhost
export SPARK_MASTER_IP=myhost
export SPARK_HISTORY_OPTS="$SPARK_HISTORY_OPTS
-Dspark.history.fs.logDirectory=maprfs:///apps/spark
-Djava.library.path=$SPARK_MAPR_HOME/lib"
#daniela
export SPARK_MASTER_OPTS="-Dspark.deploy.defaultCores=4"
export SPARK_MEM=4g
h6. Thank you very much.
Best regards,
daniela
{quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
