Re: Speed Up Drill

Hello Sanjiv, It is a simple select with no filters or conditions and a few casts going against a database table. Can’t see how it could be possible to improve the query. Drill will ask for the whole table.Are you accessing the data directly in Drill through the cmd-line or using the web-ui

Re: Query XML-files with Drill

Hello Per, I (not in any way related to MapR engineering) used to develop an idea of a plugin for XML that is using on-the-fly behind the curtains conversion to JSON to utilize all the goodies Drill has for JSON but due to a stumbling block (XML needs the support of a very dynamic and flexible

Re: JDBC metadata from storage plugin

Hello Rahul, show tables in ., and describe should possibly provide what you would like to see. It works on my DB2 at least so please try and see if it works for you as well. Regards, Magnus > 11 aug 2016 kl. 15:09 skrev Rahul Raj : > > Hi, > > Does drill

Re: Issue with join query having same storage plugin name and same datatype

Please look at the plan generated by Drill: explain plan with implementation for SELECT… (An idea is to test the generated SQL in the plan in the DB to see what it does) One idea is to try to put one of the tables in a sub select table where you actively rename the column. WITH s0 as (

Re: Creating an Interpreter - %alias

Hello John, I assume you are talking about Zeppelin -> Drill? I’ve think I’ve seen it done. Let me check with the person I believe did what you ask for and ask how he did it. I think it is somewhat convenient to have one and the same ”tag” for all statements that goes against jdbc and just

Re: Regarding Drill Authentication

Hello Sanjiv, My personal unqualified guess as a regular user of Drill is that you have to write a custom authenticator to get it to talk to the Windows security framework. https://drill.apache.org/docs/configuring-user-authentication/#implementing-and-configuring-a-custom-authenticator

Re: Regarding Excel Files and Ms Access File.

/magpierre/drill/tree/DRILL-3878 <https://github.com/magpierre/drill/tree/DRILL-3878> Regards, Magnus --- Magnus Pierre | Systems Engineer +46 72 710 1935 mpie...@maprtech.com | http://www.mapr.com > 4 apr 2016 kl. 12:19 skrev Sanjiv Kumar <ktrsan...@gmail.com>: >

Experimental plugins

Experimental plugins: I strongly believe in the open architecture offered by Drill, and I would welcome a plugin dictionary separated from core Apache Drill where "experimental" and / or even commercial plugins could be shared. (similar to how Spark is dealing with packages) I believe experimental

Re: JDBC issues when accessing DB2

for consideration. Regards, Magnus > 30 mar 2016 kl. 13:30 skrev Magnus Pierre <mpie...@maprtech.com>: > > > Hello, > > I am trying to use the JDBC plugin with DB2 and have some issues: > I am connected to a particular database using the DB in the JDBC url. > Thing l

JDBC issues when accessing DB2

Hello, I am trying to use the JDBC plugin with DB2 and have some issues: I am connected to a particular database using the DB in the JDBC url. Thing look good: I can see metadata and I can interrogate tables: jdbc:drill:zk=local> show schemas; +---+ | SCHEMA_NAME |

Re: Making a Drill plugin as "runnable jar"

list. > > --Andries > >> On Mar 21, 2016, at 8:32 AM, Magnus Pierre <mpie...@maprtech.com> wrote: >> >> I am messing about with refining my XML parser for Apache Drill, and I >> would like to make a simple cmd-line interface towards the XML parser i

Making a Drill plugin as "runnable jar"

I am messing about with refining my XML parser for Apache Drill, and I would like to make a simple cmd-line interface towards the XML parser i built (which is not dependent on any Drill code, but used by Drill in my plugin), in the same jar, by providing a simple main making it possible to

Re: [E] Re: Multiple Delimiter Format

Jacques, My code is based on easyformat stuff (if remember correctly) public class XMLFormatPlugin extends EasyFormatPlugin, but I wouldn’t for the world be able to explain how it works :) Regards, /Magnus --- Magnus Pierre | Systems Engineer +46 72 710 1935 mpie...@maprtech.com

Re: [E] Re: Multiple Delimiter Format

Magnus --- Magnus Pierre | Systems Engineer +46 72 710 1935 mpie...@maprtech.com | http://www.mapr.com > 19 feb 2016 kl. 16:29 skrev Wilburn, Scott > <scott.wilb...@verizonwireless.com.INVALID>: > > Magnus, > Great suggestions. I would like to try to extend the functional

Re: [E] Re: Multiple Delimiter Format

Hello Scott, What you typically do is that you decide which separator will give you the most granular split (in your case comma) and then use SQL constructs to further transform the returned columns of the set to the structure you would like to have. In SQL you can always create additional

Re: 1.4 JDBC PlugIn - MySQL PERFORMANCE_SCHEMA causes INFORMATION_SCHEMA issues

I’ve seen it as well. My unqualified guess is that the engine gets confused with multiple databases named INFORMATION_SCHEMA and which makes it combine metadata from two different engines. Gets the metadata of a table from one and tries to use on the other… Regards, Magnus > 26 jan 2016 kl.

Re: 1.4 JDBC PlugIn - MySQL PERFORMANCE_SCHEMA causes INFORMATION_SCHEMA issues

ase it seems to complain about PERFORMANCE_SCHEMA in MySQL not > actually the info_schema. > > --Andries > >> On Jan 26, 2016, at 9:35 AM, Magnus Pierre <mpie...@maprtech.com> wrote: >> >> I’ve seen it as well. My unqualified guess is that the engine gets c

Re: 1.4 JDBC PlugIn - MySQL PERFORMANCE_SCHEMA causes INFORMATION_SCHEMA issues

| 128 > | null | null | null | > null| null | null| > . > . > . > . > . > +---+---+--+---+--++-++--++---+-+---++---+--------+ > 315 rows select

Re: LIMIT clause not being sent to MySQL server

Hello Daniel, Filters and joins are pushed down i.e. filters on column data. Limit is a special keyword not always supported by a database (different syntaxes for quite many databases) and as such I don’t think the push down rules works for that. Regards, Magnus > 3 dec 2015 kl. 10:00

Re: Insert to MySQL from Drill

Hello Nirav, To my knowledge (just a user so I don’t have any deep insights) there’s no such functionality as of now included in Apache Drill. It could be added but focus has been on getting data from RDBMS in a convenient way rather than moving data to RDBMS. Regards, Magnus > 1 dec 2015 kl.

XML in Apache Drill

Hello Drill Users, A few weeks ago i had the pleasure of writing a small SAX parser for XML that I was using in Storm to convert XML to JSON. Later I decided this would be great to put into Drill, mostly as a work around for the fact that Drill does not have native support for XML yet. With some