;> Op 6-mrt.-2015 om 02:28 heeft "fightf...@163.com" het
>> volgende geschreven:
>>
>> Hi,
>>
>> You can first establish a scala ide to develop and debug your spark
>> program, lets say, intellij idea or eclipse.
>>
>> Thanks,
>> Sun.
o develop and debug your spark
> program, lets say, intellij idea or eclipse.
>
> Thanks,
> Sun.
>
> --
> fightf...@163.com
>
>
> *From:* Xi Shen
> *Date:* 2015-03-06 09:19
> *To:* user@spark.apache.org
> *Subject:* Spark code development pra
Hi,
>
> You can first establish a scala ide to develop and debug your spark program,
> lets say, intellij idea or eclipse.
>
> Thanks,
> Sun.
>
> fightf...@163.com
>
> From: Xi Shen
> Date: 2015-03-06 09:19
> To: user@spark.apache.org
> Subject: Spark code develop
Hi,
You can first establish a scala ide to develop and debug your spark program,
lets say, intellij idea or eclipse.
Thanks,
Sun.
fightf...@163.com
From: Xi Shen
Date: 2015-03-06 09:19
To: user@spark.apache.org
Subject: Spark code development practice
Hi,
I am new to Spark. I see every
Hi Xi,
Yes,
You can do the following:
val sc = new SparkContext("local[2]", "mptest")
// or .. val sc = new SparkContext("spark://master:7070", "mptest")
val fileDataRdd = sc.textFile("/path/to/dir")
val fileLines = fileDataRdd.take(100)
The key here - i.e. the answer to your specific que
Hi,
I am new to Spark. I see every spark program has a main() function. I
wonder if I can run the spark program directly, without using spark-submit.
I think it will be easier for early development and debug.
Thanks,
David
