Re: Interesting result for JSON parsing

2019-02-21 Thread Jim Scott
Wow! That is really impressive. On Thu, Feb 21, 2019 at 1:14 AM Ted Dunning wrote: > This is interesting. > > https://twitter.com/kellabyte/status/1098447972809900037 > -- *Jim Scott*Mobile/Text | +1 (989) 450-0212 [image: MapR logo] <https://mapr.com/?utm_source=s

Re: "Crude-but-effective" Arrow integration

2019-01-30 Thread Jim Scott
gt; replace the mutators and writers, we might as well use the "result set > > loader" model which a) hides the details, and b) manages memory to a > given > > budget. Either way, UDFs must change if we move to Arrow for Drill > > internals. > > > > > > > > >> * Since Drill vectors and metadata are exposed via the Drill client to > > >> JDBC and ODBC, those must be revised as well. > > >> > > > > > > Ted: How much given the high level of compatibility? > > > > > > Paul: As with Drill internals, all JDBC/ODBC code that uses Drill > vector > > and metadata classes must be revised to use Arrow vectors and metadata, > > adapting the code to the changed APIs. This is not a huge technical > > challenge, it is just a pile of work. Perhaps this was done in that Arrow > > conversion PR. > > > > > > > > > > > >> * Since the wire format will change, clients of Drill must upgrade > their > > >> JDBC/ODBC drivers when migrating to an Arrow-based Drill.> > > > > > > > > > Ted: Doesn't this have to happen fairly often anyway? > > > > > > Ted: Perhaps this would be a good excuse for a 2.0 step. > > > > > > Paul: As Drill matures, users would appreciate the ability to use JDBC > > and ODBC drivers with multiple Drill versions. If a shop has 1000 > desktops > > using the drivers against five Drill clusters, it is impractical to > upgrade > > everything in one go. > > > > > > Paul: You hit the nail on the head: conversion to Arrow would justify a > > jump to "Drill 2.0" to explain the required big-bang upgrade (and, to > > highlight the cool new capabilities that come with Arrow.) > > > > > -- *Jim Scott*Mobile/Text | +1 (989) 450-0212 [image: MapR logo] <https://mapr.com/?utm_source=signature_medium=email_campaign=mapr-logo>

Re: Http Plugin

2016-12-12 Thread Jim Scott
t; I could only found a small section in contribution ides document. If there > is any document or minimal code base to start would be very usefull > > Thanks > -- *Jim Scott* Director, Enterprise Strategy & Architecture +1 (347) 746-9281 @kingmesal <https://twitter.com/k

pom.xml question

2015-11-16 Thread Jim Scott
I came across this setting in the surefire plugin -Ddrill.test.query.printing.silent=true I was curious about this. The way this is used in the code is to prevent calling system.out.print. Wouldn't it be better to replace the system.out.print statements with LOG statements and then remove this

Re: select from table with options

2015-11-07 Thread Jim Scott
ut I know that the SQL standards > > >> people in their wisdom decided to add a keyword to disambiguate. > > >> > > >> I had to fix some things in Calcite to enable this: > > >> https://github.com/dremio/calcite/pull/1/files > > >> Drill uses Frameworks.get

Re: Drill 1.3 Timing: Let's start the vote next week

2015-11-03 Thread Jim Scott
> >> > > > CTO and Co-Founder, Dremio > >> > > > > >> > > > On Mon, Oct 26, 2015 at 2:16 PM, Parth Chandra <par...@apache.org > > > >> > > wrote: > >> > > > > >> > > > > No problem with moving to the monthly cycle,

Re: select from table with options

2015-10-21 Thread Jim Scott
o any *type* of format) > >> > >> Which would allow to read a file without having to centrally configure > >> formats: https://drill.apache.org/docs/querying-plain-text-files/ > >> Which makes it easier to try to read an existing file. > >> Typically once

Re: Timing for 1.2 release, ideas around things to include

2015-10-02 Thread Jim Scott
gt;> > > > > > the > > > > > >>> > > > > > > > >> > planned > > > > > >>> > > > > > > > >> > > 1.3, but Drill UI Authentication would be > > > really > > &

Re: Apache MetaModel - an interesting future integration target

2015-09-19 Thread Jim Scott
an into recently incubated Apache project called > > > MetaModel: > > > > > > http://metamodel.apache.org/ > > > > > > Is anyone familiar with it? > > > > > > It looks to me, architecturally, that there could be a possible Drill > > 2.0+

Re: Maven build failing on checkstyle

2015-09-09 Thread Jim Scott
ne matches the illegal pattern '\s+$'. > > > > > > > > > /Users/ebegoli/drill/exec/java-exec/src/main/java/org/apache/drill/exec/store/StoragePlugin.java:74: > > > Line matches the illegal pattern '\s+$'. > > > > > > Audit done. > > > >

Re: Who is coming to Strata NYC?

2015-09-04 Thread Jim Scott
t; > > Maybe we can have a little gathering. > > > > > > -- > Tomer Shiran > CEO and Co-Founder, Dremio > -- *Jim Scott* Director, Enterprise Strategy & Architecture +1 (347) 746-9281 @kingmesal <https://twitter.com/kingmesal> <http://www.

Re: Dev tool

2015-09-01 Thread Jim Scott
t; > > > What are you all programming Drill with? > > > > > > IDEA, eclipse, vim, emacs, sublime, atom, ...? > > > > > > I started with Sublime with vim bindings, but I am switching to IDEA > > 14.1. > > > Easier to catch errors before runnin

Re: drill user experience

2015-07-20 Thread Jim Scott
in a more limited language. Stefan's recent experience should be a perfect opportunity to improve this documentation by describing the process better. -- *Jim Scott* Director, Enterprise Strategy Architecture +1 (347) 746-9281 http://www.mapr.com/ [image: MapR Technologies] http

Re: [GitHub] drill pull request: Enhanced logging and associated code hygiene

2015-07-20 Thread Jim Scott
and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- -- *Jim Scott* Director, Enterprise Strategy Architecture +1 (347) 746-9281 http://www.mapr.com/ [image: MapR Technologies] http

Testing a UDF

2015-07-20 Thread Jim Scott
! Jim -- *Jim Scott* Director, Enterprise Strategy Architecture +1 (347) 746-9281 http://www.mapr.com/ [image: MapR Technologies] http://www.mapr.com Now Available - Free Hadoop On-Demand Training http://www.mapr.com/training?utm_source=Emailutm_medium=Signatureutm_campaign=Free%20available

[jira] [Created] (DRILL-3474) Filename should be an available column when querying a directory

2015-07-08 Thread Jim Scott (JIRA)
Jim Scott created DRILL-3474: Summary: Filename should be an available column when querying a directory Key: DRILL-3474 URL: https://issues.apache.org/jira/browse/DRILL-3474 Project: Apache Drill

Re: [DISCUSS] Allowing the option to use github pull requests in place of reviewboard

2015-07-07 Thread Jim Scott
some useful work? -- *Jim Scott* Director, Enterprise Strategy Architecture +1 (347) 746-9281 http://www.mapr.com/ [image: MapR Technologies] http://www.mapr.com Now Available - Free Hadoop On-Demand Training http://www.mapr.com/training?utm_source

Re: [DISCUSS] Allowing the option to use github pull requests in place of reviewboard

2015-07-07 Thread Jim Scott
connector installed/enabled for Drill's Jira? I know for my company it's been sitting on the to-do list for a while, but we haven't actually installed it. Sent from my iPhone On Jul 7, 2015, at 8:25 PM, Jim Scott jsc...@maprtech.com wrote: The instructions for setting up JIRA

Opposite of FLATTEN

2015-06-29 Thread Jim Scott
Given a data set: 'ndb_no','description' '02001','SPICE OR HERB (US CFR)' '02001','ALLSPICE' '02001','FINELY GROUND' '02001','NOT HEAT-TREATED' '02001','COOKING METHOD NOT APPLICABLE' '02001','WATER REMOVED' '02001','NATURALLY DRIED' '02001','SUN DRIED' I'm seeking the capability to be able

[jira] [Created] (DRILL-3392) !set rowlimit N does not produce a limited query result set

2015-06-26 Thread Jim Scott (JIRA)
Jim Scott created DRILL-3392: Summary: !set rowlimit N does not produce a limited query result set Key: DRILL-3392 URL: https://issues.apache.org/jira/browse/DRILL-3392 Project: Apache Drill

Re: jdbc jars - maven repo

2015-06-18 Thread Jim Scott
, Jun 17, 2015 at 8:38 AM, Jim Scott jsc...@maprtech.com wrote: Are there plans to publish the Drill jdbc jars to the maven central repo? That would really help application developers to be able to connect to drill that much easier from their applications they are building

regex format

2015-06-18 Thread Jim Scott
I recall at some point the topic of supporting a regex format record reader came up, and I thought that Jacques said that he had this built into the test framework and that at some point it should find its way into a release use. The closest ticket I can find is: DRILL-739 and I don't think that

jdbc jars - maven repo

2015-06-17 Thread Jim Scott
Are there plans to publish the Drill jdbc jars to the maven central repo? That would really help application developers to be able to connect to drill that much easier from their applications they are building.

[jira] [Created] (DRILL-2945) Drill Will Not Start on Mac OSX When Disconnected from Network

2015-05-03 Thread Jim Scott (JIRA)
Jim Scott created DRILL-2945: Summary: Drill Will Not Start on Mac OSX When Disconnected from Network Key: DRILL-2945 URL: https://issues.apache.org/jira/browse/DRILL-2945 Project: Apache Drill

Re: Lets cut a 0.8 release

2015-03-19 Thread Jim Scott
someone else wants to raise their hand. I'd like to target 6pm pacific today as the cutoff line for patches. Let's get back on the monthly release cycle. As such, we can target 0.9 for mid-April, etc. thanks, Jacques -- *Jim Scott* Director, Enterprise Strategy Architecture +1 (347