Jie, that's perfect, thanks. This doc, specifically: http://i.stanford.edu/~olston/publications/sigmod09.pdf is exactly the detailed explanation I was looking for.
2012/7/3 Jie Li <ji...@cs.duke.edu> > Some document here: http://wiki.apache.org/pig/PigIllustrate > > I agree that more tests are needed for illustrate, otherwise it can be > easily broken without notice. > > Jie > > On Tue, Jul 3, 2012 at 12:45 PM, Jon Coveney <jcove...@gmail.com> wrote: > > I was curious at a level slightly higher than "dig through the code" how > illustrate is so fast, and how it deals with joins effectively. Are there > any resources on this (or does anyone at Hortonworks want to write a tech > oriented blog post? :) > > >