Re: Spark MOOC - early access

[Kartik Mehta]

Awesome,

Thanks a ton for helping us all and futuristic planning,

Much appreciate it,

Regards,

Kartik
On May 21, 2015 4:41 PM, "Marco Shaw"  wrote:

>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *Hi Spark Devs and Users,BerkeleyX and Databricks are currently developing
> two Spark-related MOOC on edX (intro
> ,
> ml
> ),
> the first of which starts on June 1st.  Together these courses have over
> 75K enrolled students!To help students perform exercises course content, we
> have created a Vagrant box that contains Spark and IPython (running on
> Ubuntu 32-bit).  This will simplify user setup and helps us support them.
> We are writing to give you early access to the VM environment and the first
> assignment, and to request your help to test out the VM/assignment before
> we unleash it to 75K people (see instructions below). We’ve provided
> instructions below.  We’re happy to help if you have any difficulties
> getting the VM setup; please feel free to contact me (marco.s...@gmail.com
> )  with any issues, comments, or
> questions.Sincerely,Marco ShawSpark MOOC TA_(This is being sent
> as an HTML formatted email.  Some of the links have been duplicated just in
> case.)1. Install VirtualBox here
>  on your OS (see Windows
> tutorial here 
> (https://www.youtube.com/watch?v=06Sf-m64fcY
> ))2. Install Vagrant here
>  on your OS (see Windows tutorial
> here 
> (https://www.youtube.com/watch?v=LZVS23BaA1I
> ))3) Install virtual machine
> using the following steps: (see Windows tutorial here
> 
> (https://www.youtube.com/watch?v=ZuJCqHC7IYc
> ))a. Create a custom directory
> (e.g. c:\users\marco\myvagrant or /home/marco/myvagrant)b. Download the
> file
> 
> to the custom directory (NOTE: It must be named exactly "Vagrantfile" with
> no extension)c. Open a DOS prompt (Windows) or terminal (Mac/Linux) to the
> custom directory and issue the command "vagrant up"4) Perform basic
> commands in VM as described below: (see Windows tutorial here
> 
> (https://www.youtube.com/watch?v=bkteLH77IR0
> ))a. To start the VM, from a
> DOS prompt (Windows) or terminal (Mac/Linux), issue the command "vagrant
> up".b. To stop the VM, from a DOS prompt (Windows) or terminal (Mac/Linux),
> issue the command "vagrant halt".c. To erase or delete the VM, from a DOS
> prompt (Windows) or terminal (Mac/Linux), issue the command "vagrant
> destroy".d. Once the VM is running, to access the notebook, open a web
> browser to "http://localhost:8001 ".5) Using test
> notebook as described below: (see Windows tutorial here
> 
> (https://www.youtube.com/watch?v=mlfAmyF3Q-s
> ))a. To start the VM, from a
> DOS prompt (Windows) or terminal (Mac/Linux), issue the command "vagrant
> up".b. Once the VM is running, to access the notebook, open a web browser
> to "http://localhost:8001 ".c. Upload this IPython
> notebook:
> https://raw.githubusercontent.com/spark-mooc/mooc-setup/master/vm_test_student.ipynb
> .d.
> Run through the notebook.6) Play around with the first MOOC assignment
> (email Marco for details when you get to this point).7) Please answer the
> following questionsa. What machine are you using (OS, RAM, CPU, age)?b. How
> long did the entire process take?c. How long did the VM download take?
> Relatedly, where are you located?d. Do you have any other
> comments/suggestions?*
>

Re: JAVA for SPARK certification

[Kartik Mehta]

Awesome!!

Thank you Mr. Nathan,

Great to have a guide like you and helping us all,

Regards,

Kartik
On May 11, 2015 5:07 PM, "Paco Nathan"  wrote:

> Note that O'Reilly Media has test prep materials in development.
>
> The exam does include questions in Scala, Python, Java, and SQL -- and
> frankly a number of the questions are about comparing or identifying
> equivalent Spark techniques between two of those different languages. The
> questions do not go into much detail for any of the languages Scala,
> Python, Java -- emphasis is on using Spark, not language nuances. Also,
> there is no coding required: the questions typically to have several code
> blocks and you select among them to identify the best answer.
>
> Overall the exam is targeted at an "intermediate Spark user, with
> background as an application developer in either Python, Scala, or Java,
> and some familiarity with Big Data and distributed systems." Those were the
> requirements. Five different practice areas assess the following:
>
>   1. Understanding breadth of Spark API usage across Scala, Java, Python
>   2. Applying best practices to avoid runtime issues and performance
> bottlenecks
>   3. Distinguishing Spark features and practices from MapReduce usage
>   4. Integrating SQL, Streaming, ML, Graph atop the Spark unified engine
>   5. Solving typical use cases with Spark in Scala, Java, Python
>
>
> Understanding how Spark operates in a production environment is a major
> emphasis of the exam.
>
> Understanding about typical kinds of serialization exceptions is also
> important.  If you look through earlier talks about Spark best practices
> from Matei Zaharia, Patrick Wendell, Reynold Xin, et al., those are great
> for prep.
>
>
> BTW, the Kryterion platform allows a person taking the test to mark
> questions for revisiting later. So if a problem seems difficult or
> non-intuitive, just mark it and move on the to the next one. Then come back
> to the marked ones later.  Some questions are easier, some are harder, but
> the order is always randomized. There's a 90 minute limit; however, most
> people who pass finish within 60 minutes. So if you use "mark for later
> review" you'll likely have time at the end to revisit the harder questions.
>
>
> On Tue, May 5, 2015 at 7:05 AM, Gourav Sengupta  > wrote:
>
>> Hi,
>>
>> I think all the required materials for reference are mentioned here:
>> http://www.oreilly.com/data/sparkcert.html?cmp=ex-strata-na-lp-na_apache_spark_certification
>>
>> My question was regarding the proficiency level required for Java. There
>> are detailed examples and code mentioned for JAVA, Python and Scala in most
>> of the SCALA tutorials mentioned in the above link for reference.
>>
>>
>> Regards,
>> Gourav
>>
>> On Tue, May 5, 2015 at 3:03 PM, ayan guha  wrote:
>>
>>> Very interested @Kartik/Zoltan. Please let me know how to connect on LI
>>>
>>> On Tue, May 5, 2015 at 11:47 PM, Zoltán Zvara 
>>> wrote:
>>>
>>>> I might join in to this conversation with an ask. Would someone point
>>>> me to a decent exercise that would approximate the level of this exam (from
>>>> above)? Thanks!
>>>>
>>>> On Tue, May 5, 2015 at 3:37 PM Kartik Mehta 
>>>> wrote:
>>>>
>>>>> Production - not whole lot of companies have implemented Spark in
>>>>> production and so though it is good to have, not must.
>>>>>
>>>>> If you are on LinkedIn, a group of folks including myself are
>>>>> preparing for Spark certification, learning in group makes learning easy
>>>>> and fun.
>>>>>
>>>>> Kartik
>>>>> On May 5, 2015 7:31 AM, "ayan guha"  wrote:
>>>>>
>>>>>> And how important is to have production environment?
>>>>>> On 5 May 2015 20:51, "Stephen Boesch"  wrote:
>>>>>>
>>>>>>> There are questions in all three languages.
>>>>>>>
>>>>>>> 2015-05-05 3:49 GMT-07:00 Kartik Mehta :
>>>>>>>
>>>>>>>> I too have similar question.
>>>>>>>>
>>>>>>>> My understanding is since Spark written in scala, having done in
>>>>>>>> Scala will be ok for certification.
>>>>>>>>
>>>>>>>> If someone who has done certification can confirm.
>>>>>>>>
>>>>>>>> Thanks,
>>>>>>>>
>>>>>>>> Kartik
>>>>>>>> On May 5, 2015 5:57 AM, "Gourav Sengupta" <
>>>>>>>> gourav.sengu...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> Hi,
>>>>>>>>>
>>>>>>>>> how important is JAVA for Spark certification? Will learning only
>>>>>>>>> Python and Scala not work?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Gourav
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>
>>>
>>> --
>>> Best Regards,
>>> Ayan Guha
>>>
>>
>>
>

Re: JAVA for SPARK certification

[Kartik Mehta]

Production - not whole lot of companies have implemented Spark in
production and so though it is good to have, not must.

If you are on LinkedIn, a group of folks including myself are preparing for
Spark certification, learning in group makes learning easy and fun.

Kartik
On May 5, 2015 7:31 AM, "ayan guha"  wrote:

> And how important is to have production environment?
> On 5 May 2015 20:51, "Stephen Boesch"  wrote:
>
>> There are questions in all three languages.
>>
>> 2015-05-05 3:49 GMT-07:00 Kartik Mehta :
>>
>>> I too have similar question.
>>>
>>> My understanding is since Spark written in scala, having done in Scala
>>> will be ok for certification.
>>>
>>> If someone who has done certification can confirm.
>>>
>>> Thanks,
>>>
>>> Kartik
>>> On May 5, 2015 5:57 AM, "Gourav Sengupta" 
>>> wrote:
>>>
>>>> Hi,
>>>>
>>>> how important is JAVA for Spark certification? Will learning only
>>>> Python and Scala not work?
>>>>
>>>>
>>>> Regards,
>>>> Gourav
>>>>
>>>
>>

Re: JAVA for SPARK certification

[Kartik Mehta]

I too have similar question.

My understanding is since Spark written in scala, having done in Scala will
be ok for certification.

If someone who has done certification can confirm.

Thanks,

Kartik
On May 5, 2015 5:57 AM, "Gourav Sengupta"  wrote:

> Hi,
>
> how important is JAVA for Spark certification? Will learning only Python
> and Scala not work?
>
>
> Regards,
> Gourav
>

Re: Need a partner

[Kartik Mehta]

Hi Sami and fellow Spark friends,

I too am looking for joint learning, online.

I have set up spark but need to do on multi nodes on my home server. We can
form a group and do group learning?

Thanks,

Kartik
On Feb 10, 2015 11:52 AM, "King sami"  wrote:

> Hi,
>
> As I'm beginner in Spark, I'm looking for someone who's also beginner to
> learn and train on Spark together.
> Please contact me if interested
>
> Cordially,
>