Re: BlockManager WARNINGS and ERRORS

2016-03-27 Thread Ted Yu
The warning was added by:

SPARK-12757 Add block-level read/write locks to BlockManager

On Sun, Mar 27, 2016 at 12:24 PM, salexln <sale...@gmail.com> wrote:

> HI all,
>
> I started testing my code (https://github.com/salexln/FinalProject_FCM)
> with the latest Spark available in GitHub,
> and when I run it I get the following errors:
>
> *scala> val clusters = FuzzyCMeans.train(parsedData, 2, 20, 2.0)*
>
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 32:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 35:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 38:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 41:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
> 44:
> [rdd_8_0, rdd_35_0]
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
> machine; not re-adding it
> 16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
> machine; not re-adding it
>
> I did not get these previously, is it something new?
>
>
>
>
>
> --
> View this message in context:
> http://apache-spark-developers-list.1001551.n3.nabble.com/BlockManager-WARNINGS-and-ERRORS-tp16878.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
> For additional commands, e-mail: dev-h...@spark.apache.org
>
>


BlockManager WARNINGS and ERRORS

2016-03-27 Thread salexln
HI all,

I started testing my code (https://github.com/salexln/FinalProject_FCM) 
with the latest Spark available in GitHub, 
and when I run it I get the following errors:

*scala> val clusters = FuzzyCMeans.train(parsedData, 2, 20, 2.0)*

16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
32:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
35:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
38:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
41:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 ERROR Executor: 2 block locks were not released by TID =
44:
[rdd_8_0, rdd_35_0]
16/03/27 22:24:10 WARN BlockManager: Block rdd_8_0 already exists on this
machine; not re-adding it
16/03/27 22:24:10 WARN BlockManager: Block rdd_35_0 already exists on this
machine; not re-adding it

I did not get these previously, is it something new?





--
View this message in context: 
http://apache-spark-developers-list.1001551.n3.nabble.com/BlockManager-WARNINGS-and-ERRORS-tp16878.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.

-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org