[Spark SQL] experimental join strategy

2017-10-23 Thread Jonathan Gray
Hi, I'm trying to implement a custom join strategy using the experimental extraStrategies extension point. I have created a very simple implementation (see the below gist) but currently it is failing and I don't understand why. https://gist.github.com/jongray/a413b5401c4edd47b7d8f559e5b2f79b I

Re: Nested/Chained case statements generate codegen over 64k exception

2016-07-25 Thread Jonathan Gray
be falling back to non-codegen it doesn't appear to completely. On 19 May 2016 at 09:25, Jonathan Gray <jonny.g...@gmail.com> wrote: > That makes sense, I will take a look there first. That will at least give > a clearer understanding of the problem space to determine when to fallback.

Re: Nested/Chained case statements generate codegen over 64k exception

2016-05-19 Thread Jonathan Gray
figure out how > we can do it more intelligently. > > > > On Sat, May 14, 2016 at 2:29 AM, Jonathan Gray <jonny.g...@gmail.com> > wrote: > >> Hi, >> >> I've raised JIRA SPARK-15258 (with code attached to re-produce problem) >> and would like to

Nested/Chained case statements generate codegen over 64k exception

2016-05-14 Thread Jonathan Gray
Hi, I've raised JIRA SPARK-15258 (with code attached to re-produce problem) and would like to have a go at fixing it but don't really know where to start. Could anyone provide some pointers? I've looked at the code associated with SPARK-13242 but was hoping to find a way to avoid the codegen