Thanks! Amazing how much that reminds me of writing .NET CLR functions and aggregates for SQL Server, something I've covered in our SQL Server book for the last 10 years.
Meanwhile, and forgive me if I'm being thick, but how does that architecture lend itself to vectorization of the code? -----Original Message----- From: Ted Dunning [mailto:[email protected]] Sent: Monday, August 17, 2015 3:37 AM To: user <[email protected]> Subject: Re: Benchmarks for Apache Drill Docs: https://drill.apache.org/docs/develop-custom-functions-introduction/ Some usable examples: https://github.com/mapr-demos/simple-drill-functions On Sun, Aug 16, 2015 at 11:06 PM, Andrew Brust < [email protected]> wrote: > >> the unusual code-embedding UDF system that Drill has << > Have a good link where I could read more about that? > > -----Original Message----- > From: Ted Dunning [mailto:[email protected]] > Sent: Monday, August 17, 2015 1:52 AM > To: user > Subject: Re: Benchmarks for Apache Drill > > On Sun, Aug 16, 2015 at 10:22 PM, Andrew Brust < > [email protected]> wrote: > > > I have to admit, I didn't realize columnar was such a big part of Drill. > > I guess that's consistent with Dremel, so it makes sense. I always > > thought the emphasis was on heterogenous data access, not on perf. Cool! > > > > The focus of Drill is to combine polymorphic heterogenous data with > performance. Some systems have polymorphism, some have performance. > Essentially none have both. > > > > > > > So with that in mind, does drill do much with vector processing/SIMD > > operation? > > > > Actually, a number of basic operations in Drill do get vectorized to use > the SIMD instructions of the underlying processor. Enabling that is the > rationale behind the unusual code-embedding UDF system that Drill has. >
