Can you paste a small code example to illustrate your questions?
On Tue, Jul 22, 2014 at 5:05 PM, hsy...@gmail.com <hsy...@gmail.com> wrote: > Sorry, typo. What I mean is sharing. If the sql is changing at runtime, how > do I broadcast the sql to all workers that is doing sql analysis. > > Best, > Siyuan > > > On Tue, Jul 22, 2014 at 4:15 PM, Zongheng Yang <zonghen...@gmail.com> wrote: >> >> Do you mean that the texts of the SQL queries being hardcoded in the >> code? What do you mean by "cannot shar the sql to all workers"? >> >> On Tue, Jul 22, 2014 at 4:03 PM, hsy...@gmail.com <hsy...@gmail.com> >> wrote: >> > Hi guys, >> > >> > I'm able to run some Spark SQL example but the sql is static in the >> > code. I >> > would like to know is there a way to read sql from somewhere else (shell >> > for >> > example) >> > >> > I could read sql statement from kafka/zookeeper, but I cannot share the >> > sql >> > to all workers. broadcast seems not working for updating values. >> > >> > Moreover if I use some non-serializable class(DataInputStream etc) to >> > read >> > sql from other source, I always get "Task not serializable: >> > java.io.NotSerializableException" >> > >> > >> > Best, >> > Siyuan > >
