> > Follow up question in this case: what is the cost of registering a temp > table? Is there a limit to the number of temp tables that can be registered > by Spark context? >
It is pretty cheap. Just an entry in an in-memory hashtable to a query plan (similar to a view).