t 07:53, wrote:
> got it, I've added it into my notes.
> thank you
>
>
>
>
> Thanks&Best regards!
> San.Luo
>
> - 原始邮件 -
> 发件人：Mich Talebzadeh
> 收件人：Chanh Le
> 抄送人：罗辉 , focus , user <
> user@spark
>
> Thanks&Best regards!
> San.Luo
>
> - 原始邮件 -
> 发件人：Chanh Le
> 收件人：luohui20...@sina.com
> 抄送人：focus , user
> 主题：Re: run spark apps in linux crontab
> 日期：2016年07月21日 11点38分
>
> you should you use command.sh | tee file.log
>
, user
主题：Re: run spark apps in linux crontab
日期：2016年07月21日 11点38分
you should you use command.sh | tee file.log
On Jul 21, 2016, at 10:36 AM,
wrote:
thank you focus, and all.this problem solved by adding a line ". /etc/profile"
in my shell.
Th
RIPTS=/opt/myscripts
> export $SPARK_HOME=/opt/spark
>
> then, in my crontab job script daily_job.sh
>
> #!/bin/sh
>
> . /etc/profile
>
> $SPARK_HOME/bin/spark-submit $MYSCRIPTS/fix_fh_yesterday.py
>
> then, in crontab -e
>
> 0 8 * * * /home/user/daily_job.sh
>
>
!/bin/sh
>
> . /etc/profile
>
> $SPARK_HOME/bin/spark-submit $MYSCRIPTS/fix_fh_yesterday.py
>
> then, in crontab -e
>
> 0 8 * * * /home/user/daily_job.sh
>
> hope this helps~
>
>
>
>
> -- Original --
> From: "
t;
> $SPARK_HOME/bin/spark-submit $MYSCRIPTS/fix_fh_yesterday.py
>
> then, in crontab -e
>
> 0 8 * * * /home/user/daily_job.sh
>
> hope this helps~
>
>
>
>
> -- Original --
> *From:* "luohui20001";
> *Date:* 2016
Remember that the you need to souce your .bashrc
For your PATH to be set up.
From: luohui20...@sina.com [mailto:luohui20...@sina.com]
Sent: 20 July 2016 11:01
To: user
Subject: run spark apps in linux crontab
hi guys:
I add a spark-submit job into my Linux crontab list by the means below
hi guys: I add a spark-submit job into my Linux crontab list by the means
below ,however none of them works. If I change it to a normal shell script, it
is ok. I don't quite understand why. I checked the 8080 web ui of my spark
cluster, no job submitted, and there is not messages in /home/h
