Re: [VOTE] Release Apache Drill 1.21.2 - RC0

Mine as well -1 I merged the XML fix and will have a fix for the caching regression by mid-week. Best, -- C > On Apr 27, 2024, at 1:43 AM, James Turton wrote: > > To keep the mailing list appraised of goings on, some regressions are being > fixed (DRILL-8493, DRILL-8329) and another RC will

Re: How to config Drill in Squirrel SQL with the host and port where the database is

James, I wonder if there would be a way to simply ignore or remove the leading DRILL? Of course, if someone names a plugin "drill" that would then cause problems. --C > On Dec 7, 2023, at 00:41, James Turton wrote: > > This is what I consider to be a misfeature in Drill. At some point it was

Re: ChannelClosedException

ries btw? That error looks familiar... > > On 2023/10/10 15:58, Charles Givre wrote: >> Hi Desmond, >> Can you share a bit more? What version of Drill are you running? Java? >> etc. What data are you trying to query? >> Best, >> -- C >> >> &

Re: ChannelClosedException

Hi Desmond, Can you share a bit more? What version of Drill are you running? Java? etc. What data are you trying to query? Best, -- C > On Oct 10, 2023, at 2:02 AM, > wrote: > > Hi Team, > > > > When I run a Query for a limited number of records it returns the results. > When I

Re: Apache Drill - Azure blob connection time out

HI Eric, Welcome to Drill. A few questions: 1. Can you update to Drill 1.21.1? Drill 1.19 is fairly old. 2. What happens when you do a `show databases` query? You didn't mention the size of the file you are querying but my gut is saying that this is a connection issue. Best, -- C > On

Re: Mongodb metastore..

Hi there, Welcome to Drill! I think you have several problems going on there. First of all, the mongo metastore has nothing to do with being able to query mongo with Drill. The first thing you need to get working is the mongoDB storage plugin. You didn't say whether that is in fact working or

Re: Issue Querying Drill in Mongo

Hi Srinath, Unfortunately, the mailing list doesn't support images. Could you resent with text of the queries? > On Aug 4, 2023, at 5:07 AM, Srikanth Nallela > wrote: > > Hi , > > 1 .I am trying to get data based on object id in mongo not getting any data. >

Re: Respecting formats restriction when using storage-plugins-override.conf

ding the defaut storages with the > “override” file. This seems to work except the strange behaviour with the > formats. > > regards > Stefan > > Sent from Outlook for iOS<https://aka.ms/o0ukef> > > From: Charles Givre > Sent

Re: Respecting formats restriction when using storage-plugins-override.conf

"shp" > ] >}, >"image": { > "type": "image", > "extensions": [ >"jpg", >"jpeg", >"jpe", >"tif", > "tiff", >

Re: Respecting formats restriction when using storage-plugins-override.conf

e > } > } > "storage": { > s3: { >type: "file", >connection: "s3a://", >config: { > "fs.s3a.aws.credentials.provider": > "org.apache.hadoop.fs.s3a.AnonymousAWSCredentialsProvider", > "fs.s3a.endpoint&qu

Re: Respecting formats restriction when using storage-plugins-override.conf

s? > > Stefan > > On Mon, Jul 10, 2023 at 6:17 PM Charles Givre wrote: > >> Hi Stefan, >> My apologies.. Ok.. so the issue is that the storage-plugins-override.conf >> is being ignored. I've never actually used this feature, so I wasn't >> familiar

Re: Respecting formats restriction when using storage-plugins-override.conf

; file. E.g. I have a (local) file type storage and I define two formats > (parquet and json) in it. Drill does not respect my restriction to two > formats in the config file but creates all formats known to Drill (like > iceberg, xml etc.). > > regards > Stefan > > On

Re: Respecting formats restriction when using storage-plugins-override.conf

HI Stefan, Thanks for your interest in Drill. You have to define the format config for each storage plugin. Otherwise Drill doesn't know what extension to associate with what format plugin. Out of curiosity, why are you using the .conf files for this? -- C > On Jul 9, 2023, at 12:03

Re: Error querying MongoDB from Drill

@clustername.mongodb.net/ > > Thanks > Pinaki > >> On 2023/05/03 02:45:42 Charles Givre wrote: >> Pinaki, >> Can you please try with Drill 1.21.1? I believe this issue was resolved. >> Best, >> -- C >> >>>> On May 2, 2023, at 9:10 PM, Pin

Re: Error querying MongoDB from Drill

Pinaki, Can you please try with Drill 1.21.1? I believe this issue was resolved. Best, -- C > On May 2, 2023, at 9:10 PM, Pinaki Ghosh wrote: > > Hi, > > I am receiving the error below when querying a collection in a MongoDB > cluster from Drill UI (Drill version 1.20.3). > > select * from

Re: [ANNOUNCE] Apache Drill 1.21.1 Released

Great work everyone! One thing to note is that hidden in this bug fix release is the update to Calcite 1.34, which also includes bug fixes to the date functions as well as adding some new functionality to Drill! James, I couldn't remember what new operators it added but would you mind please

Re: [VOTE] Release Apache Drill 1.21.1 - RC0

Hello all, Built from source, ran various queries. LGTM +1 (Binding) -- C > On Apr 19, 2023, at 5:26 AM, James Turton wrote: > > Hi all > > I'd like to propose the first release candidate (RC0) of Apache Drill, > version 1.21.1. > > The release candidate covers a total of 12 resolved Jira

Re: exec stored proceduer

Hi Hongwei, Thanks for your interest in Drill. To the best of my knowledge, Drill does not support stored procedures. We'd welcome the contribution however! Best, -- C > On Mar 27, 2023, at 10:14 PM, Hongwei Zhao > wrote: > > Hello guys, > > We are using Drill. > But now we want to call

Re: Latest JDK version supported by drill

Hi Prabhakar, Drill is tested against Java 8, 11, and 17. We just released Drill 1.21 and would highly recommend that you update to that. Best, -- C > On Mar 1, 2023, at 5:34 AM, Prabhakar Bhosale wrote: > > Hi Team, > COuld you please help with the latest version of OPenJDK supported by

Re: [VOTE] Release Apache Drill 1.21.0 - RC0

Built Drill from source on Java 11. I encountered 1 small issue, which I don't think is a blocker, but should definitely be documented somewhere. Specifically, if there is not a file called git.properties in the root folder, the build will fail at the distribution phase. We could either

Re: AbstractMethodError

HI Dinesh, Thanks for sending but you really have to give us a lot more information to be able to help here: 1. What version of Drill are you using? 2. What NoSQL databases are you connecting to? How are they configured? 3. Did you do any kind of upgrade and noticed that things weren't

Re: [VOTE] Release Apache Drill 1.20.3 - RC0

Hello all, Just a reminder, to please try this out and record your vote here. I think we need one more vote to publish the RC0. Best, -- C > On Dec 28, 2022, at 1:21 AM, James Turton wrote: > > Herewith an attempt to unmangle the formatting of my original email :(. > > Hi all, > > I'd like

Re: Image Metadata Format Plugin: FileDateTime

Hi Uwe, Welcome to Drill! I'm glad you got that sorted out. Here are a few tricks which might help you out: 1. Drill implicit columns: One thing you might not be aware of is that Drill has some implicit columns which do not appear when you execute a SELECT * query. Different columns exist

Re: About a "DRILL-5033" fix

t; I actually want to submit my changes, but I am being denied to push any > changes to the Drill repo. How to do the pull request in Git ? Are there any > permissions required to get beforehand pushing to the repo ? > > > Le mer. 28 déc. 2022 à 15:46, Charles Givre <mailto:cgi

Towards Drill 1.21

Hello all, I hope everyone is having a great holiday season. I'd like to officially start the discussion around Drill 1.21 release. Target date for a release candidate would be mid-January, but there's an external dependency on Calcite, so we'll see. There is some work pending which I

Re: About a "DRILL-5033" fix

Hi Marc, Thanks for this. Here's the thing... Let's say you have json that looks like this: { "foo":null },{ "foo": 3.5 } If you take the approach that `null` is treated like a string, you will get a schema change exception when you read the next row. Our current approach is

Re: [VOTE] Release Apache Drill 1.20.3 - RC0

Built Drill from source. Ran tests locally. No issues. +1 from me. -- C > On Dec 27, 2022, at 5:29 AM, James Turton wrote: > > |Hi all, I'd like to propose the first release candidate (RC0) of Apache > Drill, version 1.20.3. This is very likely to be the final update to the > 1.20.x series

Towards Drill 2.0

Hello all, We've been doing a lot of really great work on Drill in the last few months, and I wanted to thank those who have been involved with releasing the bug fix releases throughout the year. With all that said, there's been enormous progress on Drill 2.0 and while it isn't quite what we

Re: How to query a Json file without using JDBC connector?

the file system, how to execute >> such >>>>> query in Java syntax? >>>>> >>>>> Drill only runs queries written in SQL. You can send that SQL from your >>>>> Java application to Drill using JDBC or Drill's REST API. If you >>

Re: How to query a Json file without using JDBC connector?

> > Le jeu. 24 nov. 2022 à 23:31, Charles Givre a écrit : > >> Hi Marc, >> Welcome to Drill! Firstly, take a look at the docs for querying a file >> system: https://drill.apache.org/docs/querying-a-file-system-introduction/ >> >> When you start up dr

Re: How to query a Json file without using JDBC connector?

Hi Marc, Welcome to Drill! Firstly, take a look at the docs for querying a file system: https://drill.apache.org/docs/querying-a-file-system-introduction/ When you start up drill out of the box, there is a connector called dfs which points to the local filesystem. You can configure a

Re: Error While Querying Druid from drill

Hey James, Would it make sense to use OkHttp since it is in use elsewhere? Sent from my iPhone > On Sep 15, 2022, at 08:16, James Turton wrote: > > Sorry about that, that's a bug. Please watch the following Jira issue I just > created. This looks like a simple fix so we'll try to have this

Re: [VOTE] Release Apache Drill 1.20.2 - RC1

Downloaded RC1. Unzipped tarball, ran test queries. LGTM +1. Vote +1 (binding) > On Aug 1, 2022, at 6:33 AM, James Turton wrote: > > I'd like to propose the second release candidate (RC1) of Apache Drill, > version 1.20.2. The release candidate covers a total of 23 resolved Jiras > since

Re: [VOTE] Release Apache Drill 1.20.2 - RC0

Downloaded built release. Ran various queries. +1 from me. (Binding) > On Jul 21, 2022, at 10:47 AM, James Turton wrote: > > This is just a resend that attempts to fix the mangled formatting in the > first attempt. > > I'd like to propose the first release candidate (RC0) of Apache Drill,

Re: [DISCUSS] Drill 1.20.2 bugfix release

Hey James, Thanks for doing this. There are a few CI and CVE related PRs that we might want to think about including such as the one below. Also I seem to remember that Vova made a fix to the Calcite fork that fixed a bug relating to Elasticsearch. I know he's working on some other things,

Re: [QUESTION] Does Drill support regular expression functions?

Hi Luoc, To answer your question, yes Drill has a collection of REGEX functions. Please take a look here: https://drill.apache.org/docs/string-manipulation/#like. Best, -- C > On Jun 8, 2022, at 4:46 AM, luoc wrote: > > Hi all, > > I want to know if the Drill can support regular

Re: Apache drill: how to build a custom ODBC/JDBC driver that performs rest api calls

Hi Damien, Thanks for your interest in Drill. I'm one of the main authors of the HTTP plugin, and it does implement filter pushdowns, but not join filters. This is quite tricky to build in a generic way for APIs, but I'd be happy to discuss with you further. We'd certainly welcome the

Re: [VOTE] Release Apache Drill 1.20.0 - RC5

Tested on various queries in embedded mode. +1 from me. (binding) > On Feb 23, 2022, at 12:34 AM, James Turton wrote: > > Hi all > > I'd like to propose the sixth release candidate (RC5) of Apache Drill, > version 1.20.0 which differs from the previous RC in the following. > > DRILL-8144:

Re: [VOTE] Release Apache Drill 1.20.0 - RC4

+1 for release. Great work everyone!! -- C > On Feb 18, 2022, at 8:40 AM, Z0ltrix wrote: > > +1 for release. > > - Installed Hadoop2 RC4 in our developement-environment on aws ec2 (ubuntu > 18.04) > - zookeeper 3.6.5, > > - hadoop 2.9.2 > > - hbase 1.5.0 > - phoenix 4.15.0 > >

Re: MSSQL query with Limit

Hi Naser Thanks for your question. I believe this was fixed in the latest version of Drill (1.20) which will be released any day now. Sent from my iPhone > On Feb 9, 2022, at 17:07, Naser Khodabin > wrote: > > Hi! > > I'm wondering if there is a way to query MSSQL in apache drill

Drill Board Report

# Description: The mission of Drill is the creation and maintenance of software related to Schema-free SQL Query Engine for Apache Hadoop, NoSQL and Cloud Storage ## Issues: No blocking issues. ## Membership Data: Apache Drill was founded 2014-11-18 (7 years ago) There are currently 60

Re: [VOTE] Release Apache Drill 1.20.0 - RC0

Hello all, I hate to be the downer, but we found a minor bug in the REST API. I’ve already submitted a PR to fix (https://github.com/apache/drill/pull/2453 ). So I’d have to give a -1 for RC0 in favor of merging this PR. Thanks, — C > On Feb 7,

Re: 1.20.0-SNAPSHOT: UserRemoteException: SYSTEM ERROR: UnsupportedOperationException

I wonder if some of the other pushdowns are negatively affecting the speed. That's really the only difference here. > On Feb 1, 2022, at 10:36 AM, Daniel Clark wrote: > > Hi James, > > The amended query runs, however, over 2x slower than Drill 1.19. Thanks. > > > On Tue, Feb 1, 2022 at

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

ting the configuration is successful, but if I go back to update the > mongo configuration again, I don't see the parameter listed. > > On Sat, Jan 29, 2022 at 6:46 PM Charles Givre wrote: > >> Hi Daniel, >> I just submitted DRILL-8118 (https://github.com/apache/drill/i

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

uration again, I don't see the parameter listed. > > On Sat, Jan 29, 2022 at 6:46 PM Charles Givre wrote: > >> Hi Daniel, >> I just submitted DRILL-8118 (https://github.com/apache/drill/issues/2440 < >> https://github.com/apache/drill/issues/2440>). Please take a

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

ank you Charles. > > On Fri, Jan 28, 2022 at 12:30 PM Charles Givre <mailto:cgi...@gmail.com>> wrote: > >> Hey Daniel, >> I looked at the mongo docs, and I'm going to add a config option to add >> the "spill to disk" for mongo. I'll do it over the w

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

Hey Daniel, I looked at the mongo docs, and I'm going to add a config option to add the "spill to disk" for mongo. I'll do it over the weekend and submit a PR to Drill. This is a very minor fix. Best, -- C > On Jan 28, 2022, at 12:28 PM, Daniel Clark wrote: > > I've attached the json

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

nt making the call to the mongodb server. Is it possible to add this > parameter to the mongo storage plugin, similar to how you added the > "batchSize" parameter for the 1.20 release? > > On Fri, Jan 28, 2022 at 9:54 AM Charles Givre wrote: > >> Daniel, >> Than

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

> On Jan 28, 2022, at 9:43 AM, Daniel Clark wrote: > > Hi Charles, > > Yes "supportsSortPushdown" is set to true. I left it at the default. I'll > try setting it to false, and try again. Thanks for the feedback. > > On Fri, Jan 28, 2022 at 9:38 AM Charles Givre w

Re: 1.20.0-SNAPSHOT: Sort exceeded memory limit of 104857600 bytes

Hey Daniel, Did you have the sort pushdown enabled? This is one change that we added to the mongo pushdown since 1.19 and might be affecting your query. Best, -- C > On Jan 28, 2022, at 9:32 AM, Daniel Clark wrote: > > Hello, > > While evaluating 1.20.0-SNAPSHOT release performance, I

Re: Converting Tableau Report that uses flattened MongoDB virtual tables to use Apache Drill

HI Daniel. Welcome to Drill! I think you might have misunderstood how Drill handles views. Views in Drill are stored as a JSON file on a writable file system. Now, that is just where the actual view info is stored. Views can contain data from any storage plugin. So, let’s say that I have

Re: [DISCUSS] Refactoring Drill's CSV (Text) Reader

and also pushing forward in a 2.x series? > My own feeling is that to get the most value from a good proposal such as the > below, we don't want to conceal everything behind default-false options in > order to avoid breaking Drill 1.x users, we want to embrace the breakage > which (to

[DISCUSS] Refactoring Drill's CSV (Text) Reader

Hello Drill Community, I would like to put forward some thoughts I've had relating to the CSV reader in Drill. I would like to propose a few changes which could actually be breaking changes, so I wanted to see if there are any strongly held opinions in the community. Here goes: The

Re: Drill 1.20 release plan

Hi Luoc, IMHO there are a few PRs in flight that I’d like to see included in the next release. I sent them in slack, but so that they are preserved for the mailing list. I'd like to see DRILL-1282, DRILL-7938, DRILL-8027, DRILL-8028 and possibly DRILL-8009 and DRILL-7978 get merged for the

Re: About Nodes with differents source configuration

Hi Victor, Welcome to Drill! Your use case is actually quite straightforward. First, you'd have to create connections to both your MySQL and Oracle databases. This can be done from a single Drill node, but since you are looking to join across data sources, I would recommend having more than

Re: avg problem

Hi Marc, Welcome to Drill! Ok… let’s tackle this. Firstly, Drill uses more or less standard ANSI SQL This means that constants are escaped with single quotes, and fields are escaped with backpacks. Functions do not require the dollar sign. Thus… Try this: SELECT SUM( `ID`) AS `F0`,

Re: Query the HBase data in Drill

Hi Luoc, There actually is a pending PR which we should merge before we do any additional work to the HBase plugin which is DRILL-7985 [1]. This PR introduces a new framework for pushdowns which will make it a lot easier to implement pushdowns for the various storage plugins. I would

Re: querying nested parquet directory structure

t;> >> On August 20, 2021 6:49:42 AM EDT, luoc wrote: >>> Best practices. Schema-free in Drill. >>> >>>> 在 2021年8月20日，12:04，Charles Givre 写道： >>>> >>>> Hi Rafael, >>>> If you're asking what I think you're asking, it s

Re: querying nested parquet directory structure

Hi Rafael, If you're asking what I think you're asking, it sounds as if you'd like to query multiple files in a nested directory. If that's the case, I have some good news... Drill allows you to query entire directories as if they were one big file. Effectively Drill performs a UNION on

Re: Iceberg or deltalake table as input for drill queries

It sounds like there is interest in developing a storage plugin for Drill to query Apache Iceberg. We've actually discussed this internally as well. We could start looking into this. -- C > On Jul 5, 2021, at 11:05 AM, luoc wrote: > > Hi z0ltrix, > There are two links to contribute the

Re: Drill on AIX

Hi Prabhakar, To the best of my knowledge, Drill is not currently certified on IBM AIX. I'm sure the community would welcome the opportunity to get it certified. -- C > On Jul 6, 2021, at 6:20 AM, Prabhakar Bhosaale wrote: > > Hi Team, > Is Dril version 1.16 and onwards tested and certified

Re: Drill and Firebird database

Hi Robert, Could you share the version of Drill you are using as well as the configuration for your Firebird plugin? (Obviously don’t include hostnames or creds) Thx, — C > On Jun 21, 2021, at 2:58 PM, Lehrbass, Robert > wrote: > > Hi there, > > I have an Apache Drill installation, with

Re: Supported compression methods

Hey Sean, Thanks for your interest in Drill. Maybe we could take a step back here. Could you explain your use case in a little more detail? It sounds to me like you'd like the ability to write compressed parquet files and to choose the compression codec. This might be a good feature to add

Re: drill queries from Python?

Well, y'all beat me to it! In addition to drillpy/pydrill, there is an sqlalchemy dialect which is available here: https://github.com/JohnOmernik/sqlalchemy-drill and via pip. If you're using Jupyter Notebooks, there also is an integration for

Re: Issue | Snowflake Date column gives previous date from Apache Drill

Hi Aishwarya, Is the date coming from Oracle coming out with a timezone? It sounds to me like the issue is a case of mismatched timezones and we just have to sort that out. — C > On May 27, 2021, at 9:43 AM, luoc wrote: > > > Hi Aishwarya, > Could you please post the query text for your

Re: Cryptographic Function AES

Hi Hoa, Thanks for your interest in Drill! The AES function is implemented as a user defined function (UDF) and the code for that can be found here [1]. Drill uses Apache libraries for the actual encryption/decryption but if you have any suggestions as to how to improve the function please

Re: Need details on sybase jdbc jar integrate with apache drill

Hi Sanjay, Can you please share the your configuration and the full stack trace you got? (Please do not include credentials) Thanks! -- C > On May 5, 2021, at 3:07 AM, Sanjay Kumar Mishra wrote: > > Hi Team, > > I am using apache drill 1.18 and created storage plugin for sybase rdbms >

Re: Release Date for v1.19.0

Hi Ravi, Thanks for your interest in Drill. A new release is in the works which will contain the XML capability, however, It will probably be closer to the end of May before that is released. The Apache Foundation has a rigorous release process for all Apache products, so we have to make sure

Re: Version 1.19.0 Release date

Hi Ravi, We're in the process of working up a release, but it probably won't be for another month or so. With that said, you could probably build Drill 1.18 with the XML plugin. -- C > On Apr 29, 2021, at 8:46 AM, Ravi Kutaphale wrote: > > Hi, > I am evaluting if Ican use drill on one of

Re: Drill Question : DROP TABLE (Deleting dataset)

HI Jinsong, Can you send links to the images? Our email list does not support images. > On Apr 29, 2021, at 7:16 AM, > wrote: > > SQL as follows. >

Drill Question

Hi Jinseong, I saw your question on the Drill list. I think the issue you're having is relating to the quotes. Single quotes should be used to escape string values. Back ticks should be used for the actual variable name. IE: ALTER SYSTEM SET `system.some_variable` = 'value'; Please let us

Re: Could not obtain block: BP2026912985 error during the HDFS query

It would be nice to document the solution somewhere so that if someone else has this issue there is some reference. Best, -- C > On Mar 26, 2021, at 11:23 AM, luoc wrote: > > Hello, > Glad to see that you have resolved the issues. BTW, Are you interested in > contribute the ideas (described

Re: Question about multiple queries through REST API

HI there, I don't think the Drill REST API accepts multiple queries in one request. However there is an alternative which doesn't appear to be in the documentation. When you submit your query there is a parameter called defaultSchema (I think) that you can set that has the effect of executing

Re: Query Avro based Kafka Topic using drill

HI Vibhor, Drill doesn't currently support reading Avro messages from Kafka. However Drill DOES support reading Avro files. It looks as if the Kafka plugin was designed to accept Avro but nobody ever added the Avro reader. It would not be terribly difficult to use Drill's existing Avro

Re: [DISCUSSION] Roles and Privileges, Security, Secrets

I think the issue that started this whole thread is that the non-file based storage plugins. Consider the following situation: You have users A and B who want to access an RDBMS via Drill. As currently implemented, we have a few options: 1. Admin supplies a global credential for Drill

Re: Getting problem on Schema Selection on Apache drill

Hi Subhayu, I responded to your first request in the email list. Are you subscribed to it? Here's what I wrote: Are you using the REST interface or the Drill UI to query? If so this is the cause of your problem as it has no concept of a session. So the "USE" query executes but it is not

Re: Getting problem on Schema Selection on Apache drill

Hi Subhayu, Are you using the REST interface or the Drill UI to query? If so this is the cause of your problem as it has no concept of a session. So the "USE" query executes but it is not attached to any session. My hunch is that if you tried this in the CLI it will work. Your question

Re: Does drill support variable arguments in customer UDAF

Hi there, Drill does support VARARG UDFs. Take a look at this PR for an example: https://github.com/apache/drill/pull/1835 -- C > On Oct 28, 2020, at 4:22 AM, wingc.s...@qq.com wrote: > > I have seen themailing list history.The same problem is

Re: What is the most memory-efficient technique for selecting several million records from a CSV file

) > > The first time this is called it throws a " NoClassDefFoundError ": > > java.lang.NoClassDefFoundError: > oadd/org/apache/drill/exec/store/StoragePluginRegistry. > > I think this is related to https://github.com/jpype-project/jpype/is

Re: What is the most memory-efficient technique for selecting several million records from a CSV file

Hey Gareth, There were some PRs floating about due to some issues with JayDeBeApi and it's dependency with JPype. Do you happen to know what version of JayDeBeApi and JPype you are using? Also would you mind posting the connection code? Thanks! -- C > On Oct 26, 2020, at 5:10 AM, Gareth

Re: ODBC driver status?

older. > > But if I try to use the same code from java standalone application then it > works perfectly. So any suggestions on how to resolve this issue?" > > On Thu, Oct 22, 2020 at 5:19 PM Charles Givre wrote: > >> Hi Prabhakar, >> Thanks for sending th

Re: ODBC driver status?

Hi Prabhakar, Thanks for sending this. Would you mind documenting these issues with the JDBC driver in JIRA (issues.apache.org )? Thanks! -- C > On Oct 22, 2020, at 2:16 AM, Prabhakar Bhosaale wrote: > > Hi, > > Just some additional information on JDBC driver

Re: How to make the Drill query optimizer always push down clauses

[Carolina Gomes] > CEO, AfterData.ai <https://www.afterdata.ai/> > +1 (416) 931 4774 > > > > > ᐧ > > On Wed, 23 Sep 2020 at 15:19, Charles Givre wrote: > >> I just sent a link.. Please let me know if it doesn't do the trick. >> --C >> >>&g

Re: How to make the Drill query optimizer always push down clauses

I just sent a link.. Please let me know if it doesn't do the trick. --C > On Sep 23, 2020, at 3:17 PM, Paul Rogers wrote: > > Absolutely. I'm not sure who manages it. I'll ask (on Slack). > > - Paul > > On Wed, Sep 23, 2020 at 12:14 PM Carolina Gomes wrote: > >> Also, could I be added to

Re: How to make the Drill query optimizer always push down clauses

Hi Carolina, You should be able to join with this link: https://apache-drill.slack.com -- C > On Sep 23, 2020, at 3:14 PM, Carolina Gomes wrote: > > Also, could I be added to the Slack channel? > > On Wed, Sep 23, 2020 at 2:57 PM Carolina Gomes wrote: > >>

Re: Support for JSONPath while querying JSON data in drill

To add to what Paul is saying, can you explain a bit more about what your goals are with JSON Path? -- C > On Sep 14, 2020, at 12:53 PM, Paul Rogers wrote: > > Hi Vimal, > > Drill does not support JSON Path. Instead, Drill attempts to read your JSON > into records which you can then

Re: [VOTE] Release Apache Drill 1.18.0 - RC0

Hi Abhishek, I downloaded the built executables and ran queries in embedded mode against files and APIs. All went well, so you have a +1 from me. -- C > On Aug 30, 2020, at 1:14 PM, Abhishek Girish wrote: > > Hi all, > > I'd like to propose the first release candidate (RC0) of Apache Drill,

Re: [VOTE] Release Apache Drill 1.18.0 - RC0

hek Girish >>> wrote: >>> >>>> Yup we can certainly include it if RC0 fails. So far I’m inclined to not >>>> consider it a blocker. I’ve requested Vova and Anton to take a look. >>>> >>>> So folks, please continue to test t

Re: [VOTE] Release Apache Drill 1.18.0 - RC0

is > closed asap. > > Regards, > Abhishek > > On Sun, Aug 30, 2020 at 6:07 PM Charles Givre wrote: > >> HI Abhishek, >> >> Can we merge DRILL-7781? We really shouldn't ship something with a simple >> bug like this. >> >> -- C >> >&

Re: [VOTE] Release Apache Drill 1.18.0 - RC0

HI Abhishek, Can we merge DRILL-7781? We really shouldn't ship something with a simple bug like this. -- C > On Aug 30, 2020, at 8:40 PM, Abhishek Girish wrote: > > Advanced tests from [5] are also complete. All 7500+ tests passed, except > for a few relating to known resource issues

Re: GitHub raw data as a Data source

Paul, Actually, there was a PR which added some code so that you can read CSVs from APIs, so no coding necessary! You have to be using the latest build of Drill 1.18-SNAPSHOT. Follow the instructions here to set up the HTTP plugin: [1] The key parameter is the `inputType` parameter which

Re: HDFS file is listable but not queryable (object not found)

gt; On Thu, Jul 23, 2020 at 8:58 AM Updike, Clark < >> clark.upd...@jhuapl.edu> >>wrote: >> >>> Oops, sorry. No luck there either unfortunately: >>> >>> apache drill> SELECT * FROM hdfs.`/tmp/employee.json`; >>>

Re: HDFS file is listable but not queryable (object not found)

020/tmp/employee.json > > apache drill> select * from hdfs.root.`hdfs://nn01:8020/tmp/employee.json`; > Error: VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Object > 'hdfs://nn01:8020/tmp/employee.json' not found within 'hdfs.root' > > > On 7/23/20, 11:30

Re: HDFS file is listable but not queryable (object not found)

ed. Can you use the default and try again? > > Hope this helps, > Rafael > > > On Thu, Jul 23, 2020 at 11:30 AM Charles Givre wrote: > >> Hi Clark, >> That's strange. My initial thought is that this could be a permission >> issue. However, it might also be that

Re: HDFS file is listable but not queryable (object not found)

Hi Clark, That's strange. My initial thought is that this could be a permission issue. However, it might also be that Drill isn't finding the file for some reason. Could you try: SELECT * FROM hdfs.`` Best, --- C > On Jul 23, 2020, at 11:23 AM, Updike, Clark wrote: > > This is in

Re: Can Drill be configured for Production grade clusters to query Hive?

iguration > setting should also include the list of other nameservices, HA or > otherwise, as a comma-separated list. > > > dfs.nameservices > mycluster > > > > > Is this something Drill support or tested? > > Thanks, > Ravi > &g

Re: Can Drill be configured for Production grade clusters to query Hive?

Could you try with the IP address of hadoop-qa and see if that works? -- C > On Jul 14, 2020, at 4:22 PM, ravi kanth wrote: > > Hi Team, > > I have a Drill cluster with 4 nodes. I wanted to make use of the Drill > cluster to query a Hive Metastore Service which is built on top of HA > enabled

Re: Slack space

Hi Diego, Welcome to Drill. Here's an invite link for the Slack channel: https://join.slack.com/t/apache-drill/shared_invite/zt-6zusyv02-Lr4RTS4L1lnrryWAlGYPDw Best, --C > On Jul 6, 2020, at 5:31 PM,

Re: Initial Oracle Setup

the same data > might be the way to go for the reasons that you mentioned, if you wouldn't > mind, is there a framework or two that you'd recommend off the top of your > head? > > Again, thanks so much for your help. > Chris > > -Original Message- > From: Charles Gi

Re: Initial Oracle Setup

might have to do > that for the time being to test my POC further. I'll let you know if I run > into any issues with that, thanks again I appreciate all of your help ! If > you guys develop a fix for that and need someone to test it, let me know and > I'd be happy to do that for you! &g

  1   2   3   4   >