On Wed, May 20, 2015 at 10:17 PM, Yonik Seeley <[email protected]> wrote:
> On Wed, May 20, 2015 at 12:04 PM, Noble Paul <[email protected]> wrote: > > > > On Wed, May 20, 2015 at 8:41 PM, Yonik Seeley <[email protected]> wrote: > >> > >> On Wed, May 20, 2015 at 11:06 AM, Noble Paul <[email protected]> > wrote: > >> > The problem with streaming is data locality. Data needs to be > >> > transferred > >> > across network to do the processing > >> > >> Nothing saying that you can't process data before it's streamed out, > >> right? > > > > yes, if our query language is expressive enough . Sometimes you need a > > little programming language to achieve that > > Right - and different languages can go on top of the base streaming > stuff... either before or after the streaming step. > There's no reason we can't stream derived data - it doesn't need to be > just documents. > Yes, but is there away to do it now? If we can have a DSL which can do process docs and emit the processed data , then the streaming API may be able to do without data locality . I guess the streaming API run as a standalone program. can it not be running soemwhere in the Solr cluster itself? > > -Yonik > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [email protected] > For additional commands, e-mail: [email protected] > > -- ----------------------------------------------------- Noble Paul
