Regarding EXCEPT clause of drill

Hey team, I am trying to use EXCEPT operator of Apache drill but it's not working. Does Apache drill supports EXCEPT? Regards, Itisha

Re: Looking for advice on integrating with a custom data source

Andy, Glad to hear you got it working!! Can you share what data source you are working with? Is it completely custom to your organization? If not, would you consider submitting this as a pull request? Best, -- C > On Jan 15, 2020, at 9:07 AM, Andy Grove wrote: > > And boom! With just 3

Re: Looking for advice on integrating with a custom data source

And boom! With just 3 extra lines of code to adjust the CBO to make the row count inversely proportional to the number of predicates, my little Poc works :-) Now that I've achieved the instant gratification (relatively speaking!) of making something work, I think it's time to step back and start

RDBMS Storage Plugin Configurations

Question on the RDBMS Storage Plugin: is it possible to set various options for the database connection pool used for this storage plugin? For example, max number of connections, idle timeout, etc? Thanks. -- Jiang

Re: RDBMS Storage Plugin Configurations

Hi Jiang, Welcome to Drill! Just as an FYI, there are several improvements underway for the JDBC plugin: https://issues.apache.org/jira/browse/DRILL-7467 https://issues.apache.org/jira/projects/DRILL/issues/DRILL-7490

Re: About integration of drill and arrow

Hi Ted and Jiang, Thanks much for sharing your actual needs. As Ted noted, it can be VERY hard to learn what uses need. Not much different than the problem that a product manger has on a commercial product. A good place to start on these issues is to file a JIRA. Of particular value is the

Re: RDBMS Storage Plugin Configurations

Hi Jiang, Welcome to the Drill mailing list. I think you may be making some assumptions about how Drill works, perhaps based on how other DB-driven applications work. Drill is not primarily a front-end for an RDBS. Instead, it is primarily designed to scan distributed data as fast as possible

Re: About integration of drill and arrow

An interesting set of perspectives. The market has many systems similar to Drill dealing with relational data model. However, there are a large set of non-relational data from various APIs. An efficient and extensible query engine for this type of non-relational schema-on-demand data is what we

Re: About integration of drill and arrow

Jiang, It is sooo cool to hear from actual users in the real world. I would confirm that I have had real problems using drill on nested data. My particular problem wasn't lack of functions, however. It had to do with the fact that without nullable members of structures, I couldn't tell when

Re: Regarding EXCEPT clause of drill

Hi Itisha, Welcome to the Drill user mail list! For those readers (like me) who are not familiar with the keyword, EXCEPT works like UNION to join to SELECT statements: SELECT ... EXCEPT SELECT ... See [1]. Seems pretty useful. A quick check of our parser source code suggests that Drill does

Re: About integration of drill and arrow

Jiang, Thanks again for the feedback. See inline responses. > On Jan 15, 2020, at 5:30 PM, Jiang Wu wrote: > > An interesting set of perspectives. The market has many systems similar to > Drill dealing with relational data model. However, there are a large set > of non-relational data

Re: About integration of drill and arrow

On Wed, Jan 15, 2020 at 2:58 PM Paul Rogers wrote: > ... > > For example, Ted, you mention lack of nullability on structure members. > But, Drill represents structures as MAPs, and MAPs can have nullable > members. So, there is likely more to your request than the short summary > suggests.