Do you mean that the texts of the SQL queries being hardcoded in the code? What do you mean by "cannot shar the sql to all workers"?
On Tue, Jul 22, 2014 at 4:03 PM, hsy...@gmail.com <hsy...@gmail.com> wrote: > Hi guys, > > I'm able to run some Spark SQL example but the sql is static in the code. I > would like to know is there a way to read sql from somewhere else (shell for > example) > > I could read sql statement from kafka/zookeeper, but I cannot share the sql > to all workers. broadcast seems not working for updating values. > > Moreover if I use some non-serializable class(DataInputStream etc) to read > sql from other source, I always get "Task not serializable: > java.io.NotSerializableException" > > > Best, > Siyuan
