Re: Complex types as @Workspace variables in UDFs

/codegen/templates/VarCharAggrFunctions1.java#L63 -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Apr 10, 2017 at 12:21 PM, Manuel Aristaran <man...@datawheel.us> wrote: > Hi, > > After banging my head for a few hours trying to implement an array > aggregation UDF (like P

Re: [HANGOUT] Topics for 10/04/16

te" the already introduced metadata and prepare apis the server exposes. It provides an improved BI user experience. It also introduces unit tests in the C++ client, something that was previously sorely missing. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Oct 4, 2016 at 9:47 AM,

Re: drill rest api converts all data types to string

FYI, it is already filed: https://issues.apache.org/jira/browse/DRILL-2373 -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Sep 16, 2016 at 8:56 AM, Sudheesh Katkam <skat...@maprtech.com> wrote: > Hi Niek, > > That is a bug; thank you for digging out the exact locati

Re: Drill 1.6 Cartesian or an inequality joins are not supporting ?

There is a developer flag that you can set to allow cartesian joins but this is prone to massive memory usage at the moment. If you need it for something small, you might find it useful. SET `planner.enable_nljoin_for_scalar_only` = false; -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri

Re: tmp noexec

Good idea. I should have thought of that :) -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Jul 29, 2016 at 10:12 AM, scott <tcots8...@gmail.com> wrote: > Thanks Jacques. I think I have solved my immediate problem. I added > -Djava.io.tmpdir=/newtmp to the DRILL_JAVA_OPTS varia

Re: tmp noexec

for changing the extraction location is here: https://github.com/xerial/snappy-java/blob/master/src/main/java/org/xerial/snappy/SnappyLoader.java Hopefully, someone from MapR can answer the question for the MapR library. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jul 27, 2016 at 8:22 AM

Re: tmp noexec

load cases). -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Jul 26, 2016 at 7:20 AM, scott <tcots8...@gmail.com> wrote: > Thanks Leon for the suggestion, but do you think this config change will > help with my startup problem? It looks like it changes operations for sort >

Re: Is it possible to Download the documentation?

You can check it out from here: https://github.com/apache/drill-site -- Jacques Nadeau CTO and Co-Founder, Dremio On Sat, Jul 2, 2016 at 9:58 PM, Denver Team <denverma...@gmail.com> wrote: > Is there a way to download the documentation for Apache Drill for offline > reading? >

Re: Dynamic UDFs support

trying to implement an alternative interface. -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Jun 16, 2016 at 11:32 AM, John Omernik <j...@omernik.com> wrote: > Honestly, I don't see it as a priority issue. I think some of the ideas > around community java UDFs could be a better a

Re: Profiles Gone in Web UI: The great profile heist

Odds are one of your profiles is corrupt. Last I checked, there was a bug that a corrupt profile would cause no profiles to show up in list. Check if any of your profiles are zero bytes and delete them. The UI should really handle this. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, May

[ANNOUNCE] New PMC Chair of Apache Drill

I'm pleased to announce that the Drill PMC has voted to elect Parth Chandra as the new PMC chair of Apache Drill. Please join me in congratulating Parth! thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: CTAS Out of Memory

Any chance you can do a jmap/jhat combo and take a look at what is holding the most memory? I'm guessing we're not managing the Postgres JDBC cursor or backpressure correctly. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, May 13, 2016 at 9:07 AM, Stefan Sedich <stefan.sed...@gmail.

Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

://issues.apache.org/jira/browse/DRILL-4383 -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, May 6, 2016 at 10:17 AM, Abhishek Girish <abhishek.gir...@gmail.com> wrote: > Hello, > > Assuming you have defined your replication factor setting inside your > cluster hdfs-site.xml, it might be w

Re: Query timeout when joining 2 parquet files over S3.

it is waiting for S3. You'll also need to look at the first start time to see how long planning is taking. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, May 1, 2016 at 12:11 PM, Rob Canavan <rxcana...@gmail.com> wrote: > Thanks Abhisek, that seems to have work. I can

Re: Hangout Anyone?

Quick one today: Attendees: Kumiko, Arrina, Jacques, Jason, Vitalli Main topic of discussion was missing column behavior. Jason explained that you can enable union type and use case statements to get exactly the behavior you need. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio

Hangout Anyone?

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Hangout starting at 10am

incompatible changes on public apis even if the our public commitment policy doesn't dictate it. The proposal is attached here: https://issues.apache.org/jira/browse/DRILL-4600 -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Apr 12, 2016 at 11:10 AM, Jacques Nadeau <jacq...@dremio.com>

Re: Performance querying a single column out of a parquet file

There was a major conflict between the patch and the metadata caching feature that came in right at the same time (right before it). I believe there was a discussion about this on the list. It would be great if a developer could pick this up. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon

Re: Query planner flow and optimizer rules

On your strategy, generally, rules should be independent and rel nodes should be immutable. I don't fully understand what you are trying to do but your description seems like a bit of an anti-pattern. You'll also need to figure out what phase or phases should include your rules. On Apr 4, 2016

Re: Query planner flow and optimizer rules

You should enable Calcite plan debugging. The instructions can be found by looking at the historical version of the Calcite howto before the logging framework changed in 1.5. [1] tracing section. Couple possibilities are you are not calculating distinct digests for your scan or your costs aren't

Re: Continued Avro Frustration

the kindness and shared goals of those in the community. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Apr 1, 2016 at 5:43 AM, Stefán Baxter <ste...@activitystream.com> wrote: > Hi, > > Is it at all possible that we are the only company trying to use Av

Re: adding int96 datatype in Drill

It sounds like Hive doesn't work with the full Parquet spec. Why don't we just fix that? Let's add Hive handling so that an annotated INT64 date works. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Apr 1, 2016 at 4:33 AM, Arina Yelchiyeva <arina.yelchiy...@gmail.com > wrote: &g

Re: error when starting drill-localhost mode

drill-localhost is to start the drill client and connect to an already running local Drillbit daemon. If you haven't started the daemon through drillbit.sh, you will see this error. If you want to dry out Drill in embedded mode, you should use drill-embedded instead of drill-localhost. -- Jacques

Re: Drill Hangout Starting

sion around removing spill files, Vitalli to update PR to clean up earlier than end of JVM. thanks everyone who attended! Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Mar 29, 2016 at 10:01 AM, Jacques Nadeau <jacq...@dremio.com> wrote: > https://plus.google.com/hangouts

Re: Reading Avro Arrays

. The arrays can have scalars or complex objects in them. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Mar 25, 2016 at 2:00 AM, Johannes Schulte < johannes.schu...@gmail.com> wrote: > Hi Stefan, > > thanks for this information - so it seems that there is currently no way

Re: Code too large

-- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 24, 2016 at 11:54 AM, Edmon Begoli <ebeg...@gmail.com> wrote: > Logs and queries attached. > > On Thu, Mar 24, 2016 at 2:22 PM, Edmon Begoli <ebeg...@gmail.com> wrote: > >> We are working on it. >> >

Re: Code too large

It would also good to get the full stack trace. Do you have jdk or only Joe on these machines? On Mar 24, 2016 5:27 AM, "Edmon Begoli" wrote: > Does anyone know what might be causing this exception: > > *Error: SYSTEM ERROR: CompileException: File >

Re: Case-sensitive view names?

Table and view names are case sensitive when using the FileSystemPlugin and a case sensitive filesystem. They are not case sensitive if the filesystem is case insensitive. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Mar 21, 2016 at 2:50 PM, Abhishek Girish <abhishek.gir...@gmail.

Re: Unable to access User Created Schema in SQL Server

I don't think we have tests covering this case so it may have issues. Can you file a JIRA? thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 17, 2016 at 11:11 PM, Sanjiv Kumar <ktrsan...@gmail.com> wrote: > *I want to know whether Apache Drill supports only d

Re: unable to start Drill 1.6.0

There was a change in Drill 1.3 or 1.4 that required additional specification. See here: https://drill.apache.org/docs/adding-custom-functions-to-drill/ -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 17, 2016 at 10:13 AM, Shankar Mane <shankar.m...@games24x7.com> wrote: >

Re: INSERT INTO workaround

understand correctly. I also noticed that you filed DRILL-4506 (I think). Is this related to what you are doing here or is that for independent use case? Can you give a little more overview of the pattern you're trying to achieve with that? thanks, Jacques -- Jacques Nadeau CTO and Co-Founder

Re: S3 query takes a long time to start

I've been thinking a lot of this. Definitely think there should be a clean fix to this but haven't had the cycles to suggest something. You up for looking at the code and trying to suggest something? thanks! -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Mar 10, 2016 at 8:06 AM, Oscar

Re: Error parsing SQL query

` AS FLOAT) / 1000 END from cp.`employee.json` xxx; Note that your example is missing the select and from clauses which is why I am asking for the complete query. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Mar 8, 2016 at 1:34 PM, Kashmar, Ali <ali.kash...@emc.com>

Re: Parallelism / data locality in HDFS/MapRFS

The flattening is surprising unless we're spending a long time in query setup. (This is shown by looking at the query start time for the 0-0 fragment in the query profile screen.) If you share the profile json files, we can also take a look and see what is up. thanks, Jacques -- Jacques Nadeau

Re: Max Buffer Size Reached

I think this is likely related to: https://issues.apache.org/jira/browse/DRILL-4410 A fix has been merged for this. Can you try from tip of master and see if this is resolved? thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Mar 7, 2016 at 6:04 AM, Vince Gonzalez <vgo

Re: selecting JSON nested field in storage plugin

You'll need to put your leaf fields inside a map vector to refer to them in the way you want. On Mar 4, 2016 5:04 PM, "Jiang Wu" wrote: > We are working on a custom Drill storage plugin to retrieve data from a > proprietary a JSON based storage. The drill version being

Re: Drill crashes on simple 'like' query

Hey Assaf, is there anything in the logs? Can you email me them directly or put on gist (can't attach to mailing list emails). If nothing there, can you enable Java assertions by adding -ea to drill-env.sh and see if we get a more helpful log or error messages? thanks, Jacques -- Jacques

Drill Hangout Starting

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Making Query to Remote MongoDB Faster

If the time is all spent in planning, that won't have much impact as query planning is not distributed. It sounds like we may be taking a while to plan queries against Mongo when there are a large number of collections. Can you open a JIRA that we can take a look at? -- Jacques Nadeau CTO and Co

Re: JDBC plugin case sensitive table names

That definitely looks like a bug. Can you file a JIRA? I'll get someone to look at it. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Feb 29, 2016 at 2:47 PM, Paul Mogren <pmog...@commercehub.com> wrote: > Hello, > > I just tried Drill with MS SQL Ser

Re: Making Query to Remote MongoDB Faster

I haven't had a chance to look at the profile in detail yet. Do you see consistent behavior on multiple queries? Does your mongodb happen to have a large number of collections and/or databases? (Just guessing here). -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 28, 2016 at 8:54 PM

Re: Drill Bit Heap Space Issues

Can you try to convert src_date to a date type? -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Feb 29, 2016 at 10:28 AM, John Omernik <j...@omernik.com> wrote: > I am running 6 drill bits, they were running with 20GB of Direct Memory and > 4 GB of Heap, and I altered them to r

Re: Making Query to Remote MongoDB Faster

Can you share what the profile looks like? Where is the time being spent? Unless something is really wrong (or these are gigabyte sized records), I'm guessing there is a configuration issue or bug you are hitting. -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 28, 2016 at 12:04 AM

Re: extractHeader in session variable?

You should use select with options. Examples are here: https://drill.apache.org/blog/2015/12/14/drill-1.4-released/ E.g.: SELECT * FROM TABLE(dfs.`/path/to/CO.dat`(type => 'text', extractHeader => true)); -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Feb 26, 2016 at 12

Re: Apache Drill - Read Java Objects

Based on how I understand your questions, you have serialized java objects with a field you want to query. How are the java objects serialized? -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Feb 18, 2016 at 6:48 PM, jorge gonzalez <jorge_...@yahoo.com.invalid > wrote: &

Re: crash when querying mongo

I don't believe the BSON reader (default as of 1.4) supports writing to union types yet. You'll need to also turn off the bson reader to take advantage of the union type support. ALTER SESSION/SYSTEM SET `store.mongo.bson.record.reader` = false; -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: [DISCUSS] New Feature: Drill Client Impersonation

Got it, makes sense. Do you have an interface proposal? I didn't see that. Also, what do you think about my comment and Keys response about moving pooling to the Driver and then making "connection" lightweight. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Feb 22, 2016

Re: [DISCUSS] New Feature: Drill Client Impersonation

Maybe I misunderstood the design document. I thought this was how the user would be changed: "Provide a way to change the user after the connection is made (details) through a session option" Did I miss something? -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Feb 22, 20

Re: [DISCUSS] New Feature: Drill Client Impersonation

One other question, have you considered pooling at the Driver level? This could work transparently with no API changes. Basically "connections" would simply be logical connections over the same tunnel. -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 21, 2016 at 5:07 PM, Jacq

Re: [DISCUSS] New Feature: Drill Client Impersonation

roundtrip, query profiles, etc to provide this functionality. See here: https://docs.oracle.com/cd/B28359_01/java.111/b31224/proxya.htm#BABEJEIA -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Feb 19, 2016 at 2:18 PM, Keys Botzum <kbot...@maprtech.com> wrote: > This is a great featu

Re: Need some help debugging slow S3 download speed

://hadoop.apache.org/docs/r2.7.1/hadoop-project-dist/hadoop-common/NativeLibraries.html -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 21, 2016 at 11:53 AM, Oscar Morante <spacep...@gmail.com> wrote: > I'm still fighting with this, so far I've tried: > > - Adding th

Re: SQL Error with DB storage engine

Yeah, looks similar. I added the information to the JIRA. -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Feb 18, 2016 at 8:11 AM, Zelaine Fong <zf...@maprtech.com> wrote: > Although not quite the same, DRILL-4374 was previously logged, and it looks > like that just

Re: Ports Drill Uses

on a particular node by setting drill.exec.http.enabled to false. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Feb 10, 2016 at 8:54 AM, John Omernik <j...@omernik.com> wrote: > Using https://drill.apache.org/docs/ports-used-by-drill/ as start, I was > wondering if it is possible

Re: Erroneous results in Drill with JOIN and CAST

You need to provide a length for varchar, otherwise you are truncating your values. Varchar without a length is equal to varchar(1). Try varchar(255) in your casts. On Feb 9, 2016 4:57 AM, "Milind Utsav" wrote: > Hello, > > I am trying to deploy Drill on production

Re: View causing poor performance on row queries on MapR-DB (and perhaps HBASE)

Ooops, correct block (debug)... -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 7, 2016 at 12:47 PM, Jacques Nadeau <jacq...@dremio.com> wrote: > I know that historically there have been bugs with pushing past too many > projects. I wonder if the intermedi

Re: View causing poor performance on row queries on MapR-DB (and perhaps HBASE)

modifying the logback.xml configuration file. For example, add the following block to get the information into the log file: Thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Sun, Feb 7, 2016 at 11:48 AM, Ted Dunning <ted.dunn...@gmail.com> wrote: > Expand

Re: Analyse web server logs in Drill

There are actually two separate pull requests my initial proposal and a separate alternate proposal by Jim. Both are short of done. Fyi original implementation as additional reference https://github.com/jacques-n/drill/tree/DRILL-3423 Clearly we should do better job of discussing design before

Re: Bug or Feature?

expected? -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Feb 4, 2016 at 8:21 AM, John Omernik <j...@omernik.com> wrote: > Prior to posting a JIRA, I thought I'd toss this here: > > If I have a directory: data with subdirectories with parquet files in it > > > data/2

Re: DRILL 1.4 - newline in strings not supported

We should enhance Drill's text reader so that you can disable splitting. Once done, an appropriately escaped newline character could be consumed. This is future work and I'm not aware of any way to solve this without this fix. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Feb 1, 2016 at 8

Re: DATA_WRITE ERROR: Failed to drop table

Can you confirm what version of Maven you were running. It seems like some older versions of Maven have a bug that shows with our new build. (I've seen the problem on maven 3.0.5). thanks, jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Jan 28, 2016 at 7:29 PM, Kumiko Yada

Hangout Starting

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

FYI, this is also in master now. -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 20, 2016 at 4:14 AM, Boris Chmiel < boris.chm...@yahoo.com.invalid> wrote: > Great ! Thanks Jacques; I expect to try your patch soon > > Le Samedi 16 janvier 2016 2h36, "rohit

Drill Hangout Starting

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Efficient joins in Drill - avoiding the massive overhead of scan based joins

has 10 million rows. When applying the join condition, only 10k rows are needed from the right side. How long does it take to read a few million records from Lucene? (Recently with Elastic we've been seeing ~50-100k/second per thread when only retrieving a single stored field.) -- Jacques Nadeau

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

want to wait until the next official release. Thanks for your patience. Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Jan 14, 2016 at 5:07 PM, Jacques Nadeau <jacq...@dremio.com> wrote: > Good catch. Reproduced now. Looking into it. > > -- > Jacques Nadeau &g

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

: This is the query that I have succesfully completing. Please confirm it is similar to your query: SELECT count(*) FROM dfs.`/data/tpch01/line/` a RIGHT JOIN derby.DRILL_DERBY_TEST.PERSON b ON a.cvalue = b.person_id -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 13, 2016 at 7:36 PM

Re: 1.5-SNAPSHOT and UDFs

for this kind of thing: DrillBuf myBuf = ... String bufAsString = ByteBufUtil.decodeString(myBuf.nioBuffer(), Charsets.UTF_8); -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Jan 8, 2016 at 12:04 PM, Stefán Baxter <ste...@activitystream.com> wrote: > So, > > This is happening due

Re: feature request

on that to provide a nice set of native Python bindings that would be even easier to use. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Jan 8, 2016 at 3:55 PM, Jin Chen <jc...@paloaltonetworks.com> wrote: > Hi, > Just want to know whether apachdrill has plan to support cl

Re: "Already had POJO for id" Error In SQL - Join B/W Redshift and HDFS

Can you turn on verbose errors and post the full stack trace of the error? You can enable verbose errors per the instructions here: https://drill.apache.org/docs/troubleshooting/#enable-verbose-errors -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 6, 2016 at 6:10 AM, <rohitkulk

Re: New user questions

. Can you try starting SQuirrel with the following additional option: -Ddrill.client.supports-complex-types=false -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Jan 6, 2016 at 3:45 PM, Eric Pederson <eric...@gmail.com> wrote: > Dear all: > > I'm a new Drill user using

RE: Does drill recognize new line correctly?

-+ > | a | b| > +++ > | 4 | hello | > +++ > 1 row selected (0.228 seconds) > > > it can't find {a: 7, b: "hello \ngoodbye"} record. > > Thank you. > > -- > Miura, Masahide > > -Original Message- &

Re: Where is the Drill Explorer and / or docs on installing it?

It sounds like maybe the docs should walk the user through installing iODBC as well if people are finding it confusing. Listing as a requirement maybe isn't enough. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Jan 5, 2016 at 8:35 AM, Andries Engelbrecht < aengelbre...@maprtech.com>

Re: Where is the Drill Explorer and / or docs on installing it?

It sounds like the docs need to be updated to state that iODBC must be installed on Mac. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Jan 4, 2016 at 1:30 PM, George Chow <geo...@overcoil.com> wrote: > To clarify: iODBC is a driver manager. > > OS X does not ship wit

Re: Notes on Drill Documentation

Do we clearly state that in distributed mode, you have to start the drillbit daemon on each node before attaching a client will work? -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Dec 30, 2015 at 12:06 PM, Kristine Hahn <kh...@maprtech.com> wrote: > Confirming that your feedback

Re: A field reference identifier must not have the form of a qualified name

Drill is not correctly escaping your dotted identifier throughout the engine. thanks, Jacques -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Dec 29, 2015 at 4:30 PM, AleCaste <aleca...@hotmail.com> wrote: > Indeed, a period in a key is still valid JSON. > So this should be f

Hangout Starting...

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Avro - Schema is good - Schema validation is bad

I think the main problem your hitting is that we should do a union of all files. In that case, as long as the field is in a single file, we're going to let the field through. There is a balancing between early termination and flexibility that we must provide. If someone types a field and it is

Hangout starting

Hey All, Hangout starting: https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Announcing new committer: Kristine Hahn

The Apache Drill PMC is very pleased to announce Kristine Hahn as a new committer. Kris has worked tirelessly on creating and improving the Drill documentation. She has been extraordinary in her engagement with the community and has greatly accelerated the speed to resolution of doc issues and

Re: Drill Query Problem

/test/java/org/apache/drill/exec/compile/TestLargeFileCompilation.java -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Dec 4, 2015 at 9:33 AM, Abdel Hakim Deneche <adene...@maprtech.com> wrote: > Hi Nirav, > > can you give us more information to help reproduce this iss

Re: Having difficulties using CASE statement to manage heterogeneous schemas

Steven, can you look at this? -- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Dec 2, 2015 at 10:05 AM, John Schneider <jschnei...@apixio.com> wrote: > All, Is there a link to Jira where I can log this error? > > _ > > john o schneider > j...@a

Re: Drill Installation on HBase RegionServers

? -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Dec 1, 2015 at 2:08 PM, Kevin Verhoeven <kevin.verhoe...@ds-iq.com> wrote: > On a cluster, do I have to install a drillbit on every RegionServer or can > I install a drillbit on a subset of the RegionServers? > > Thanks, > > Kevin > >

Hangout Starting Now

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Having difficulties using CASE statement to manage heterogeneous schemas

Did you enable the union type? You'll need to do that (for now) as Heterogeneous type support is currently an experimental feature. ALTER SESSION SET `exec.enable_union_type` = true; See here: https://drill.apache.org/docs/json-data-model/#experimental-feature:-heterogeneous-types -- Jacques

Re: REFRESH TABLE METADATA - Access Denied

> > The output from Drill and the Markup interpreter on Jira apparently had a > family argument at Thanksgiving, and don't agree on all things... Made my morning :)

Hangout starting

Not sure if people are around. I started a hangout if people want to chat. https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

[ANNOUNCE] Release of Apache Drill 1.3.0

It is our pleasure to announce the 1.3.0 release of Apache Drill. This release includes a number new features as well as the typical plethora of improvements and bug fixes. Highlights include: - Enhanced Amazon S3 Support - Support for Heterogeneous Types when querying JSON or MongoDB

Re: 'dir0' not found in any table

uff` group by dir0; +---+-+ | dir0 | EXPR$1 | +---+-+ | s2| 60175 | | s1| 60175 | +---+-+ select l_partkey from dfs.root.`/src/data/stuff` where dir0 = 's1' limit 1; ++ | l_partkey | ++ | 1552 | ++ -- Jacq

Re: 'dir0' not found in any table

It looks DRILL-3810 caused the regression (and it is limited to Avro files). Hopefully Kamesh can take a quick look. -- Jacques Nadeau CTO and Co-Founder, Dremio On Sat, Nov 21, 2015 at 1:44 PM, Stefán Baxter <ste...@activitystream.com> wrote: > Hi, > > I just crea

Re: a question about drill query parquet

-- Jacques Nadeau CTO and Co-Founder, Dremio On Wed, Nov 18, 2015 at 10:34 PM, Wangchangchun (A) < wangchangchu...@huawei.com> wrote: > Hi, everyone, can anybody help to answer me a question. > > I have used sparksql to create some table of parquet format. > And then I configured hi

Re: An extremely long time to run a query in EMR against S3 bucket of JSON files in GZ

an EMR script but it should be as simple as swapping out the install directory. -- Jacques Nadeau CTO and Co-Founder, Dremio On Tue, Nov 17, 2015 at 10:06 PM, Mikhailau, Alex <alex.mikhai...@mlb.com> wrote: > FYI, > > Adding native java.library.path started yielding file sy

Hangout Starting

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: XML in Apache Drill

This is cool. I haven't taken a look yet but I will. Thanks! -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Nov 12, 2015 at 2:35 AM, Magnus Pierre <mpie...@maprtech.com> wrote: > Hello Drill Users, > A few weeks ago i had the pleasure of writing a small SAX parser for

Re: How to setup user authentication for the WebUI?

Sr. Technical Writer > 415-497-8107 @krishahn skype:krishahn > > > On Thu, Nov 12, 2015 at 11:02 AM, Jacques Nadeau <jacq...@dremio.com> > wrote: > > > There is a lot of confusion here. I'll try to clear it up a little bit: > > > > - Apache Drill 1.2 does

Re: How to setup user authentication for the WebUI?

in the cluster -- Jacques Nadeau CTO and Co-Founder, Dremio On Thu, Nov 12, 2015 at 3:46 PM, Kristine Hahn <kh...@maprtech.com> wrote: > > > > Having that be 404 doesn't seem great either. > > Right. In this case, users probably won't encounter the problem again. The > do

Hangout Starting

https://plus.google.com/hangouts/_/dremio.com/drillhangout?authuser=0 -- Jacques Nadeau CTO and Co-Founder, Dremio

Re: Setting drill.exec.sort.external.spill.directories

The sys.boot data is the current node's configuration as seen from sys.drillbits. Right now, we don't have a way of looking across nodes. Good feature request though. -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Nov 9, 2015 at 11:00 AM, John Omernik <j...@omernik.com> wrote: &g

Re: UDFs and 1.3

/master/contrib/storage-hive/core/src/main/resources/drill-module.conf -- Jacques Nadeau CTO and Co-Founder, Dremio On Mon, Nov 9, 2015 at 11:30 AM, Stefán Baxter <ste...@activitystream.com> wrote: > Hi, > > Now they are but the outcome remains the same. > > Any additional

Re: Apache Drill 1.2 targetting JDBC / postgresql storage

Glad you've made some progress. Not sure why your .public is how you have to go about things. Will have to give that some more thought. At least you're over that hurdle for the minute. > 1. Uuid columns in postgres arent supported - I'll look to contribute code > to add support for this if its

Re: Apache Drill 1.2 targetting JDBC / postgresql storage

I'm not sure what the problem is. I was able to query successfully on my local machine using the same pattern. Here is my configuration so you can see if there is something different. https://github.com/jacques-n/drill/commit/8bd3289b0f5abbcabf33820297e7701d1da76ca0 Do you see anything

  1   2   3   >