Hi,

I'm curious as to how Spark does code generation for SQL queries.

Following through the code, I saw that an expression is parsed and compiled
into a class using Scala reflection toolbox.  However, it's unclear to me
whether the actual byte code is generated on the master or on each of the
executors.  If it generated on the master, how is the byte code shipped out
to the executors?

Thanks,
Akshat

https://databricks.com/blog/2014/06/02/exciting-performance-improvements-on-the-horizon-for-spark-sql.html

Reply via email to