Re: Compile Spark with Maven & Zinc Scala Plugin

2015-03-06 Thread fenghaixiong
you can read this document : http://spark.apache.org/docs/latest/building-spark.html this might can solve you question and if you compile spark with maven you might need to set mave option like this befor you start compile it export MAVEN_OPTS="-Xmx2g -XX:MaxPermSize=512M -XX:ReservedCodeCacheSiz

Re: spark-stream programme failed on yarn-client

2015-03-06 Thread fenghaixiong
; # - SPARK_EXECUTOR_CORES, Number of cores for the workers (Default: 1). > # - SPARK_EXECUTOR_MEMORY, Memory per Worker (e.g. 1000M, 2G) (Default: 1G) > # - SPARK_DRIVER_MEMORY, Memory for Master (e.g. 1000M, 2G) (Default: 512 > Mb) > > > Thanks > Best Regards > >

spark-stream programme failed on yarn-client

2015-03-05 Thread fenghaixiong
Hi all, I'm try to write a spark stream programme so i read the s