Eran,
How much do you know in general about Map/Reduce? Do you know anything?
If not, this is a VERY nice explanation of what MR is about at a very
high conceptual level:
http://ksat.me/map-reduce-a-really-simple-introduction-kloudo/
However, going from the above link to implementing something
semi-complicated on Spark is a long journey ;)
I do not know any Hadoop but I have a sneaky suspicion that most of the
Spark primitives are mirror copies of how Hadoop does these things.
Figuring out what to use when and why will be your biggest challenge.
People will tell you to look at the Word Count example (like they
already have) and that's nice, but that's the tip of the iceberg. To
make Spark really useful and appealing to the broader audiences, it
should have a set of documents describing how to do the whole
"map/reduce thing" with its own primitives.
Good luck,
Ognen
On 2/4/14, 5:15 AM, goi cto wrote:
Hi,
I am a newbie with spark and scala and trying to get around.
I am looking for resources to learn more (if possible, by example) on
how to program with map & reduce functions.
Any good recommendations?
(I did the getting started guides on the site but still don't feel
comfortable with that)...
--
Eran | CTO
