Hi Umar, The Spark wiki at https://cwiki.apache.org/confluence/display/SPARK/Wiki+Homepage has a few pages on Spark internals (specifically the Python and Java APIs) and on how to build and contribute to Spark (https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark). Hopefully this is a start to learn the codebase.
Matei On Oct 25, 2013, at 12:27 PM, Umar Javed <[email protected]> wrote: > Hi, > > I want to build an extension to spark that needs me to understand the > existing spark components. Does anybody have an idea where to start? Should I > use a debugger, or are print statements the way to go? I'm using pyspark btw. > > cheers, > Umar
