Here is the initial design document for catalyst : https://docs.google.com/document/d/1Hc_Ehtr0G8SQUg69cmViZsMi55_Kf3tISD9GPGU5M1Y/edit
Strategies (many of which are in SparkStragegies.scala) are the part that creates the physical operators from a catalyst logical plan. These operators have execute() methods that actually call RDD operations. On Thu, Jan 22, 2015 at 3:19 PM, Nicholas Murphy <halcyo...@gmail.com> wrote: > Hi- > > Quick question: is there a design doc (or something more than “look at the > code”) for the query planner for Spark SQL (i.e., the component that > takes…Catalyst?…operator trees and translates them into SPARK operations)? > > Thanks, > Nick > --------------------------------------------------------------------- > To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org > For additional commands, e-mail: dev-h...@spark.apache.org > >
