Sorry, typo. What I mean is sharing. If the sql is changing at runtime, how do I broadcast the sql to all workers that is doing sql analysis.
Best, Siyuan On Tue, Jul 22, 2014 at 4:15 PM, Zongheng Yang <zonghen...@gmail.com> wrote: > Do you mean that the texts of the SQL queries being hardcoded in the > code? What do you mean by "cannot shar the sql to all workers"? > > On Tue, Jul 22, 2014 at 4:03 PM, hsy...@gmail.com <hsy...@gmail.com> > wrote: > > Hi guys, > > > > I'm able to run some Spark SQL example but the sql is static in the > code. I > > would like to know is there a way to read sql from somewhere else (shell > for > > example) > > > > I could read sql statement from kafka/zookeeper, but I cannot share the > sql > > to all workers. broadcast seems not working for updating values. > > > > Moreover if I use some non-serializable class(DataInputStream etc) to > read > > sql from other source, I always get "Task not serializable: > > java.io.NotSerializableException" > > > > > > Best, > > Siyuan >
