Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-04-01 Thread GUINKO Ferdinand
'start-master.sh': No such file or directory. It look like the settings I have done on the container were gone and were not saved when I exited. Don't the container save its settings when user exit? Thank you. --  «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-31 Thread JB Data31
find the *start-master.sh* file with command excuted as root *find / -name "start-master.sh" -print.* Check that the directory found is well put in the $PATH. As a first step go to the directory where the *start-master.sh* is with *cd* command and execute with command *./start-master.sh*. @*JB*Δ

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-31 Thread GUINKO Ferdinand
I have exited from the container, and logged in using:sudo docker run -it -p8080:8080 ubuntu Then I tried to launch Start Standalone Spark Master Server doing: start-master.sh and got the following message: bash: start-master.sh: command not foundSo I started the process of setting the environme

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread GUINKO Ferdinand
Thank you for your assistance! --  «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent, mais d'hommes profondément loyaux et intègres, des hommes qui ne craignent pas d'appeler le péché par son nom, des hommes dont la conscience soit aussi fidè

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread Mich Talebzadeh
Those two export lines means set SPARK_HOME and PATH *as environment variables* in the session you have in Ubuntu. Check this website for more info bash - How do I add environment variables? - Ask Ubuntu

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread GUINKO Ferdinand
This is what I am having now: root@33z261w1a18:/opt/spark# export SPARK_HOME=/opt/spark root@33z261w1a18:/opt/spark# export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbin:$SPARK_HOME/bin:$SPARK_HOME/sbin root@33z261w1a18:/opt/spark# echo $PATH /usr/local/sbin:/usr/lo

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread Mich Talebzadeh
Ok simple export SPARK_HOME=/opt/spark export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbin:$SPARK_HOME/bin:$SPARK_HOME/sbin then echo $PATH which start-master.sh and send the output HTH view my Linkedin profile

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread GUINKO Ferdinand
Where is SPARK? I also tried this: root@33z261w1a18:/opt/spark# whereis spark-shell spark-shell: /opt/spark/bin/spark-shell2.cmd /opt/spark/bin/spark-shell.cmd /opt/spark/bin/spark-shell --  «Ce dont le monde a le plus besoin, c'est d'hommes, non pas des hommes qu'on achète et qui se vendent,

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread GUINKO Ferdinand
The Spark installation I am trying to do is on an Ubuntu image on Docker. So there is no text editor installed on the Ubuntu image I have installed. I have installed gedit but had some graphic issues and couldn't lunch it. When I tried to lunch gedit, I had the following error message: root@33

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread GUINKO Ferdinand
Good day Talebzadeh, here are the outputs: cat ~/.profile root@33z261w1a18:/home# cat ~/.profile # ~/.profile: executed by Bourne-compatible login shells. if [ "$BASH" ]; then   if [ -f ~/.bashrc ]; then     . ~/.bashrc   fi fi mesg n 2> /dev/null || true export SPARK_HOME=/opt/spark export P

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-30 Thread Mich Talebzadeh
OK on your path where is SPARK? Try to edit your .profile with simple editor of your choice (vi, vim etc if you are on Linux) export PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/bin:/sbin *:$PATH* export SPARK_HOME=/opt/spark ## Add it to the PATH export PATH=$SPARK_HOM

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-29 Thread Mich Talebzadeh
OK just do cat ~/.profile and send the content please also do echo $PATH and send the output as well. HTH view my Linkedin profile *Disclaimer:* Use it at your own risk. Any and all responsibility for any loss, damage or des

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-29 Thread GUINKO Ferdinand
Hi Talebzadeh, thank you for your answer. I am sorry, but I don't  undertand what I need to do. It seems that I already put SPARK_HOME/sbin in my path as I have this line among the 3 lines I have sent in my initial email: echo "export PATH=$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin" >> ~/.profile

Re: Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-29 Thread Mich Talebzadeh
In my case export SPARK_HOME=/d4T/hduser/spark-3.1.1-bin-hadoop3.2 export PATH=$SPARK_HOME/bin:*$SPARK_HOME/sbin*:$PATH which start-master.sh /d4T/hduser/spark-3.1.1-bin-hadoop3.2/sbin/start-master.sh You need to add *$SPARK_HOME/sbin* to your path as well HTH view my Linkedin profile

Ubuntu 18.04: Docker: start-master.sh: command not found

2021-03-29 Thread GUINKO Ferdinand
Hi, I have installed Docker, Spark 3.1.1 and Hadoop 2.7 on Ubuntu 18.04. After I have executed the following 3 lines echo "export SPARK_HOME=/opt/spark" >> ~/.profile echo "export PATH=$PATH:$SPARK_HOME/bin:$SPARK_HOME/sbin" >> ~/.profile echo "export PYSPARK_PYTHON=/usr/bin/python3" >> ~/.profil