Re: Extra output from Spark run

2015-03-05 Thread davidkl 
If you do not want those progress indication to appear, just set
spark.ui.showConsoleProgress to false, e.g:

System.setProperty("spark.ui.showConsoleProgress", "false");

Regards



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Extra-output-from-Spark-run-tp21920p21931.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Re: Extra output from Spark run

2015-03-05 Thread Sean Owen 
In the console, you'd find this draws a progress bar illustrating the
current stage progress. In logs, it shows up as this sort of 'pyramid'
since CR makes a newline.

You can turn it off with spark.ui.showConsoleProgress = false

On Thu, Mar 5, 2015 at 2:11 AM, cjwang  wrote:
> When I run Spark 1.2.1, I found these display that wasn't in the previous
> releases:
>
> [Stage 12:=>   (6 + 1) /
> 16]
> [Stage 12:>(8 + 1) /
> 16]
> [Stage 12:==> (11 + 1) /
> 16]
> [Stage 12:=>  (14 + 1) /
> 16]
>
> What do they mean and how can I get rid of them?
>
>
>
> --
> View this message in context: 
> http://apache-spark-user-list.1001560.n3.nabble.com/Extra-output-from-Spark-run-tp21920.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org

Extra output from Spark run

2015-03-04 Thread cjwang 
When I run Spark 1.2.1, I found these display that wasn't in the previous
releases:

[Stage 12:=>   (6 + 1) /
16]
[Stage 12:>(8 + 1) /
16]
[Stage 12:==> (11 + 1) /
16]
[Stage 12:=>  (14 + 1) /
16]

What do they mean and how can I get rid of them?



--
View this message in context: 
http://apache-spark-user-list.1001560.n3.nabble.com/Extra-output-from-Spark-run-tp21920.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org