Re: StorageLevel error.

2014-08-25 Thread taoist...@gmail.com 
you need import StorageLevel by:
import org.apache.spark.storage.StorageLevel



taoist...@gmail.com
 
From: rapelly kartheek
Date: 2014-08-25 18:22
To: user
Subject: StorageLevel error.
Hi,
Can someone help me with the following error:


scala val rdd = sc.parallelize(Array(1,2,3,4))
rdd: org.apache.spark.rdd.RDD[Int] = ParallelCollectionRDD[0] at parallelize at 
console:12

scala rdd.persist(StorageLevel.MEMORY_ONLY)
console:15: error: not found: value StorageLevel
  rdd.persist(StorageLevel.MEMORY_ONLY)
  ^


Thank you!!!

On Spark Standalone mode, Where the driver program will run?

2014-08-22 Thread taoist...@gmail.com 
Hi all,
1. On Spark Standalone mode, client sumbit application. Where the driver 
program will run? client or master?
2. Standalone is reliable? can use in production mode ?



taoist...@gmail.com