Closest things already done to date is the join pushdown in the jdbc connector and the prototype code someone built a while back to do a join using HBase as a hash table. Aman and I have an ongoing thread discussing using elastic indexing and sideband communication to accelerate joins. If would be great if you could cover exactly what you're doing (including relevant stats), that would give us a better idea of how to point you in the right direction.
-- Jacques Nadeau CTO and Co-Founder, Dremio On Sat, Jan 16, 2016 at 5:18 AM, Stefán Baxter <[email protected]> wrote: > Hi, > > Can anyone point me to an implementation where joins are implemented with > full support for filters and efficient handling of joins based on indexes. > > The only code I have come across all seems to rely on complete scan of the > related table and that is not acceptable for the use case we are working on > (Lucene reader). > > Regards, > -Stefán >
