Re: Proposal for Skipping Records

Agree with Julian. Users definitely should not have to interpret failure scenarios (i.e. warnings or errors) by having to look at Exceptions in the logs. On Mon, Nov 16, 2015 at 3:07 PM, Julian Hyde wrote: > Fair enough. > > Remember that end users don’t (in general) write Java functions and don

test

test email

Re: Drill Issues

Hello Sanjiv, I work with the Drill team. I don't have your previous email (I joined the user group recently). I can take a look at your join query problem and your multiple columns having same name and same type issue. Please share/resend your earlier email, and I can take a look. Two things (1)

Re: query from hbase issue

So I tried to create the table using HBase API (with no data inserted into table) and I got the query plan for drill 1.7.0 Drill 1.7.0-SNAPSHOT commit ID : 09b26277 0: jdbc:drill:schema=dfs.tmp> describe browser_action2; +--++--+ | COLUMN_NAME | DATA_TYPE |

Re: query from hbase issue

, qiang li wrote: > Hi Khurram, Thanks very much to reproduce it, so what's the conclusion? > > Any idea how to sovle it? > > 2016-05-18 17:02 GMT+08:00 Khurram Faraaz : > >> So I tried to create the table using HBase API (with no data inserted >> into table) and I

Re: query from hbase issue

Hello Qiang, DRILL-4686 is reported to track this problem. Thanks, Khurram On Wed, May 18, 2016 at 3:16 PM, qiang li wrote: > Ok, Thanks very much. > > 2016-05-18 17:44 GMT+08:00 Khurram Faraaz : > >> Hello Qiang, >> >> Someone from our Drill team (in San Jose

Re: inconsistent size and next functions in some FieldReader classes

repeated_count does work on nested objects, please take a look at the fix for DRILL-2851 Here is a working example, I am on Drill 1.7.0 git commit ID: git.commit.id =09b262776 I have used a file in my query below, that is also available on that JI

Re: query from hbase issue

the data set > similar ? If you are unable to repro the exact same issue, perhaps qiang > should file a JIRA with a smaller repro if possible. > > > > On Thu, May 19, 2016 at 8:35 AM, Khurram Faraaz > wrote: > > > Hello Qiang, > > > > DRILL-468

Re: Drill Issues

You can use CONVERT_TO and CONVERT_FROM functions, to get HDFS bytes read/write from drill queries. https://drill.apache.org/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions On Mon, May 23, 2016 at 11:28 AM, vinita.go...@siemens.com < vinita.go...@siemens.com> wrote

Re: Regarding Excel Files and Ms Access File.

Sanjiv you can try to export your data from MS Excel file to a text/CSV file, using the Save As option. and then query that CSV/text file from Drill. On Thu, May 19, 2016 at 12:38 AM, Antonio Romero (carnorom) < carno...@cisco.com> wrote: > http://ucanaccess.sourceforge.net/site.html > > This wou

Re: Hbase SQL

Can you try these two queries ?, and are you trying to execute your query from Drill's sqlline prompt or from a Java program ? select X.CF.`11503` from hbase.`X**` where convert_from(row_key, 'bigint_be') = 916124337090; and this one select X.CF.`11503` from hbase.`X**` where convert_from(row_ke

Re: Drill taking way too long to plan query

Can you please share the query plan for that long running query here ? On Thu, Jun 23, 2016 at 11:40 PM, Tanmay Solanki < tsolank...@yahoo.in.invalid> wrote: > I am trying to run a query on Apache drill to simply count the number of > rows in a table stored in parquet format in S3. I am running t

Re: Drill JDBC Interpreter: Connection Refused

This one works just fine for me final String URL_STRING = "jdbc:drill:schema=dfs.tmp;drillbit="; replace IPADDRESS with your IP address in the above line. On Tue, Jul 12, 2016 at 12:08 PM, Krishnaprasad A S < krishna.pra...@flytxt.com> wrote: > Yes, I tried with url *jdbc:drill:drillbit=:31010*

Re: Drill JDBC Interpreter: Connection Refused

Also try using port number 5181 in your drill-override.conf, instead of 2181, and then stop and start Drillbit and re-run your program. On Tue, Jul 12, 2016 at 1:08 PM, Khurram Faraaz wrote: > This one works just fine for me > > final String URL_STRING = "jdbc:drill:schema=df

Overflow detection in Drill

Hi All, As of today Drill does not handle overflow detection and does not report that was an overflow to users, instead we just return results that are incorrect. This issue has been discussed (but not in detail) in the past. It would be great if Drill also handled overflow detection in data of t

Re: Overflow detection in Drill

016 at 2:07 AM, Khurram Faraaz wrote: > Hi All, > > As of today Drill does not handle overflow detection and does not report > that was an overflow to users, instead we just return results that are > incorrect. This issue has been discussed (but not in detail) in the past. > &g

Re: [Drill-Questions] Speed difference between GZ and BZ2

What is the data format within those .gz and .bz2 files ? It is parquet or JSON or plain text (CSV) ? Also, what was this config parameter `store.parquet.compression` set to, when ypu ran your test ? - Khurram On Sun, Jul 31, 2016 at 11:17 PM, Shankar Mane wrote: > Awaiting for response.. > > O

Re: [Drill-Questions] Speed difference between GZ and BZ2

t; > On Mon, Aug 1, 2016 at 3:27 PM, Khurram Faraaz > wrote: > > > What is the data format within those .gz and .bz2 files ? It is parquet > or > > JSON or plain text (CSV) ? > > Also, what was this config parameter `store.parquet.compression` set to, > > when y

Re: [Drill-Questions] Speed difference between GZ and BZ2

sv" : { > "type" : "text", > "extensions" : [ "tsv" ], > "delimiter" : "\t" > }, > "parquet" : { > "type" : "parquet" > }, &

Re: [Drill-Questions] Speed difference between GZ and BZ2

"delimiter" : "," > }, > "tsv" : { > "type" : "text", > "extensions" : [ "tsv" ], > "delimiter" : "\t" > }, > "parquet

Re: Query hangs on planning

You mentioned "*But if I uncomment the where clause then it runs for a couple of hours until it runs out of memory.*" Can you please share the OutOfMemory details from drillbit.log and the value of DRILL_MAX_DIRECT_MEMORY Can you also try to see what happens if you retain just this line where upl

Re: Query hangs on planning

'm gonna try again on the cluster to make > sure. > > Thanks, > Oscar > > > On Tue, Aug 09, 2016 at 04:13:17PM +0530, Khurram Faraaz wrote: > >> You mentioned "*But if I uncomment the where clause then it runs for a >> couple of hours until it runs out of m

Re: Fetch queries status from drill prompt

There is an open JIRA DRILL-4258 Once that is fixed/implemented you can query from sys.queries or sys.statements to know about all SQL statements that are in different states. Khurram On Fri, Aug 19, 2016 at 4:45 PM, Anup Tiwari wrote: > Thanks

Re: Question related to handling of nulls in csv

There are two things you need to take care of in your example, 1. you should tell Drill skip the header from your CSV file. (add skipFirstLine into your storage plugin) 2. you are doing a sum over string data (varchar), so you will need to cast your data in column "c" to integer before you do the

Re: Query hangs on planning

the record, I think this was just bad memory configuration after all. > I retested on bigger machines and everything seems to be working fine. > > > On Tue, Aug 09, 2016 at 10:46:33PM +0530, Khurram Faraaz wrote: > >> Oscar, can you please report a JIRA with the required steps

Re: Speed up Drill

You are doing a scan over a file, and there is no predicate/filter in your query, which means Drill will have to Scan the entire file. Also Apache Drill's latest released version is 1.8.0, you may want to try your query on Apache Drill 1.8.0. On Thu, Sep 1, 2016 at 11:34 AM, wrote: > Hello

Re: Date Formatting Question

Here is the link to currently supported datetime functions in Drill https://drill.apache.org/docs/date-time-functions-and-arithmetic/#extract On Fri, Sep 9, 2016 at 12:32 AM, Charles Givre wrote: > Hello everyone, > I have a question about formatting dates. Let's say that I have some data > wh

Re: NULL values for DATE type columns using JDBC connector

This is related to DRILL-4842 On Wed, Sep 14, 2016 at 12:31 AM, Sudheesh Katkam wrote: > Hi Dan, > > Per documentation , I > don’t think sql4es is in the list of actively tested JDBC drivers. But a > “WHERE something IS NOT NULL” returning NULL

Re: Cannot cancel query - stuck in CANCELLATION_REQUESTED

Can you please get the jstack for the hung Drillbit process ? And what version of Drill are you running ? I found this jira DRILL-4355 maybe related, not sure though. Thanks, Khurram On Mon, Sep 26, 2016 at 2:11 PM, Dan Markhasin wrote: > I am

Re: Error parsing JSON

Can you please share your SQL query ? On Wed, Oct 12, 2016 at 7:38 PM, Dan Blondowski < dan.blondow...@dhigroupinc.com> wrote: > Hello. > > I have a json file with 2 records (see attached). > > When I run a query against it I get this error: > > *Error: DATA_READ ERROR: Error parsing JSON - You t

Re: Error parsing JSON

Daniel Blondowski > > Big Data Architecture/Engineering > DHI Group, Inc. > > dan.blondow...@dice.com > 515-313-2137 > > > > > > On 10/12/16, 9:52 AM, "Khurram Faraaz" wrote: > > >Can you please share your SQL query ? > > > >On We

Re: Error parsing JSON

Since your JSON file has different types of data (line int, boolean, strings etc) we need to tell Drill to consider all data in that JSON file as text. This is by design, and this is not trial and error. Such occurrence of different types of data in a JSON file is called SchemaChange and to avoid t

Re: Drill connecting to Azure DocumentDB store

If Azure DocumentDB supports JDBC / ODBC driver, then yes we can query using SQL from Drill. I see that Azure Document DB does support SQL. On Thu, Oct 13, 2016 at 5:29 AM, Sameer Nori wrote: > Can Drill connect to the Azure Document DB store? > > Thanks, > > > -- > > Sameer Nori > > Sr Product

Re: [Drill 1.6] : Number format exception due to Empty String

Anup, can you please - share your parquet data file (also your CTAS statement that you used to create that parquet file) - and the SQL query you are running That way we can run your query against your data file on latest Drill 1.9.0, and share results with you. On Sat, Oct 15, 2016 at 4:36 P

Re: Drill Over MongoDB | Unable to access filelds from complex Json Object

Hello Vikram. I tried using your data on Drill 1.9.0 [test@test-01 ~]# cat mongo_test.json { "_id" : " some_value ", "_updated" : " some_value ", "brands" : [ " some_value " ], "_created" : " some_value ", "_status" : " some_value ", "metadata" : { "use

Re: Drill Join query optimization

What version of Drill are you on ? Can you please share the query plan for your query ? Please share the table definitions ? Is this a standalone setup or cluster of Drillbits ? On Fri, Nov 4, 2016 at 2:23 PM, wrote: > Hello, > > I am working on a proof of concept to optimize the performance of

Re: Last Column showing blank in csv file

You should set skipFirstLine to true, in the formats area of the storage plugin configuration. Doing the above will ensure that Drill skips the first line of your CSV file. And your query should look like, 0: jdbc:drill:schema=dfs.tmp> select columns[0] sepalen, columns[1] sepalwidth, columns[2] p

Re: Last Column showing blank in csv file

Please share (attach) your CSV data files here. Also please share your exact queries and the actual output that Drill returns to you. That way someone here can take a look. On Mon, Nov 28, 2016 at 6:30 PM, Sanjiv Kumar wrote: > Ya Its working but what if i am using :- > select A.`sepalen`, A.

Re: Last Column showing blank in csv file

Thanks. What version of Drill are you using ? And is this on Linux ? On Tue, Nov 29, 2016 at 11:40 AM, Sanjiv Kumar wrote: > I already pasted the csv file. Just copy and save it as csv. I am also > attaching csv file. And the query is same as i mention above. > > select A.`sepalen`, A.`sepalwid

Re: Last Column showing blank in csv file

I am not exactly sure this will work (I haven't tried it on Windows 10) Setting lineDelimiter to '\r\n' should try to help in your case, can you please try. For details look at DRILL-3149 Example: select * from table(dfs.`my_table`(type=>'text',

Re: [1.9.0] : Error: SYSTEM ERROR: MalformedInputException: Input length = 1

Is your data the same on 1.6.0 and 1.9.0, or did your data change by any chance when/after upgrading from 1.6.0 to 1.9.0 ? On Wed, Dec 7, 2016 at 12:22 PM, Pratik Khedkar < pratik.khed...@games24x7.com> wrote: > Hi Team, > > I am getting below error after upgrading drill from 1.6 to 1.9. > Workin

Re: Help in running drill jdbc code from tomcat server.

Can you share the jdbc connection string and the error you see in the drillbit.log file ? On Mon, Dec 12, 2016 at 2:58 PM, wrote: > Hi, > > > I am getting an error when I am invoking drill jdbc code from apache > tomcat server. The same piece of code is executing fine while connecting it > from

Re: hangout starting in a bit

Can we please have the link to the hangout ? On Tue, Dec 13, 2016 at 11:32 PM, Parth Chandra wrote: > >

Re: Drill with Parquet

Hello Manjeet, What error do you see on the prompt from where you submit the CTAS statement ? Can you please share the stacktrace/error information from the drillbit.log file ? is your CTAS (the one that failed), is it over CSV/JSON files ? And when you say your SELECT statement is not working, w

Re: Limit ALL not working with offset

This looks like a bug. Thanks for reporting this issue. I tried a similar query on apache Drill 1.10.0 and Drill returns wrong results when compared to Postgres, for a query that uses LIMIT and OFFSET clause in the same query. We need to file a JIRA to track this issue. {noformat} 0: jdbc:drill:sc

Re: Limit ALL not working with offset

1. DRILL-5165 <https://issues.apache.org/jira/browse/DRILL-5165> is reported to track this issue. On Tue, Dec 27, 2016 at 2:06 PM, Khurram Faraaz wrote: > This looks like a bug. Thanks for reporting this issue. > I tried a similar query on apache Drill 1.10.0 and Drill r

Re: Drill with Parquet

Please look at these examples on the documentation links below here is the link to supported datatypes in Drill - https://drill.apache.org/docs/supported-data-types/ and link to CTAS in Drill - http://drill.apache.org/docs/create-table-as-ctas-command/ On Thu, Dec 29, 2016 at 4:40 PM, Manjeet Si

Re: Drill with Parquet

here is an example of CTAS over a parquet file. (the parquet file is under /drill/testdata/join/typeall_l directory) CREATE TABLE l_tblprtnby_intcl PARTITION BY( col_int ) AS SELECT * FROM dfs.`/drill/testdata/join/typeall_l`; On Thu, Dec 29, 2016 at 5:32 PM, Khurram Faraaz wrote: > Ple

Re: How to use CASE in apache drill

Are the two columns CS.ProviderID and b.`Value` of the same datatypes in your SQL statement ? From: Sanjiv Kumar Sent: Friday, January 20, 2017 1:59:35 PM To: user@drill.apache.org Subject: How to use CASE in apache drill I Have one doubt regarding CASE in Apache

Re: How to enable decimal value

Can you share your query and the results ? And did you set planner.enable_decimal_data_type=true at session level or system level ? From: Sanjiv Kumar Sent: Wednesday, February 8, 2017 3:15:08 PM To: user@drill.apache.org Subject: How to enable decimal value He

Re: Drill 1.9 Null pointer Exception

Hi Anas, Not sure what is causing the NPE, is your HBase version same as before ? This assertion that you see in the stack trace below, was recently fixed in DRILL-5040, you may want to try to latest available build Drill 1.10.0 Caused by: java.lang.AssertionError: Internal error: Error whil

Re: Drill 1.9 Null pointer Exception

td | Bangalore | +91-7736368236 -Original Message- From: Khurram Faraaz [mailto:kfar...@mapr.com] Sent: 02 March 2017 14:02 To: user@drill.apache.org Cc: prasann...@trinitymobility.com; 'Sushil' Subject: Re: Drill 1.9 Null pointer Exception Hi Anas, Not sure what is causin

Re: Display of query result using command line

Three million rows is too many rows, for sqlline to print. Try doing a COUNT(*) and see if that query returns the correct count on that table. Thanks, Khurram From: PROJJWAL SAHA Sent: Wednesday, March 15, 2017 7:41:00 PM To: user@drill.apache.org Subject: Di

Re: Wrong property value

We should report a documentation JIRA to track this. From: Padma Penumarthy Sent: Monday, March 27, 2017 7:21:02 PM To: user@drill.apache.org Subject: Re: Wrong property value Yes, you are right. We need to update the documentation with the correct option name.

Re: Data read error while query Hbase table.

Can you please share the stack trace from drillbit.log, and what version of Drill are you on ? Thanks, Khurram From: nagesh bigdata Sent: Monday, April 10, 2017 8:34:59 AM To: user@drill.apache.org Subject: Data read error while query Hbase table. Hi , I jus

Re: Fetch temporary tables data of PostgreSQL from Apache Drill

Temporary tables are session specific, how are you trying to access them from Drill ? If the temporary table was created in Postgres in a different session, you can not access that temporary table from Drill using another session. Temporary tables get dropped once session terminates. Thanks,

Re: Drill query are stuck in ENQUEUED mode

Does your query execute and complete when you set exec.queue.enable = false ? The default is to set exec.queue.enable to false. Thanks, Khurram From: jasbir.s...@accenture.com Sent: Wednesday, May 3, 2017 5:58:48 PM To: user@drill.apache.org Cc: maneesh.koth..

Re: Increasing store.parquet.block-size

1. DRILL-2478 is Open for this issue. 2. I have added more details into the comments. Thanks, Khurram From: Shuporno Choudhury Sent: Friday, June 9, 2017 12:48:41 PM To: user@drill.apache.org Subject: Incre

Re: Increasing store.parquet.block-size

g. But other issue connected to impossibility to use long values for parquet block-size. This issue can be independent task or a sub-task of updating Drill project to a latest parquet library. Kind regards Vitalii On Fri, Jun 9, 2017 at 10:25 AM, Khurram Faraaz mailto:kfar...@mapr.com>> wro

Re: Increasing store.parquet.block-size

Thanks Padma. From: Padma Penumarthy Sent: Thursday, June 15, 2017 8:58:44 AM To: user@drill.apache.org Subject: Re: Increasing store.parquet.block-size Sure. I will check and try to fix them as well. Thanks, Padma > On Jun 14, 2017, at 3:12 AM, Khurram Far

Re: Error when timestamp IN clause contains more elements

I tried the below query using data from your query from the IN clause (as is), I didn't see an error/Exception on sqlline, I am on Drill 1.11.0 0: jdbc:drill:schema=dfs.tmp> select * from (values(137676420)) WHERE EXPR$0 IN (137667780, 137676420, 137685060, 137702340, 13772

Re: regex replace in string

Can you please share your CSV file, the SQL query and the version of Drill that you are on. So someone can take a look and try to reproduce the error that you are seeing. Thanks, Khurram From: Divya Gehlot Sent: Wednesday, July 26, 2017 3:18:08 PM To: user@dr

Re: regex replace in string

se go ahead and download it and try your file with that release. Let us know if you still have a problem. Thanks, - Paul > On Jul 26, 2017, at 6:14 AM, Khurram Faraaz wrote: > > Can you please share your CSV file, the SQL query and the version of D

Re: regex replace in string

Drill docs mention that REGEXP_REPLACE function uses http://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html Link to REGEXP_REPLACE doc - https://drill.apache.org/docs/string-manipulation/#regexp_replace From: Paul Rogers Sent: Thursday, July 27

Re: Non-ascii characters still fails on Drill 1.11

We need to add a unit test, the last comment in DRILL-4039 suggests that we add a unit test for that fix. Thanks, Khurram From: Arina Yelchiyeva Sent: Friday, August 11, 2017 5:03:44 PM To: user Subject: Re: Non-ascii characters still fails on Drill 1.11 Hi R

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

Can you please try this, since you mention column has empty values try using null instead of zero, because 0 (zero) is not null. CASE WHEN `Capacity` = '' THEN CAST(null AS integer) ELSE CAST(`Capacity` AS integer) END AS `Capacity` Thanks, Khurram From: D

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

Apache Drill JIRA mentioned to use 0 instead of null to get rid of error . unfortunately it did not work in my case :( Thanks, Divya On 14 August 2017 at 14:56, Khurram Faraaz wrote: > Can you please try this, since you mention column has empty values try > using null instead of zero, b

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarCharVector, field= Capacity Thanks, Divya On 14 August 2017 at 17:56, Khurram Faraaz wrote: > You should look at DRILL-3214 which is Open. And DRILL-4503 is open for >

Re: Query Optimization

Please share your SQL query and the query plan. To get the query plan, execute EXPLAIN PLAN FOR ; Thanks, Khurram From: Divya Gehlot Sent: Friday, August 18, 2017 7:15:18 AM To: user@drill.apache.org Subject: Re: Query Optimization Hi , Yes its the same query

Re: Queries getting CANCELED

Can you please share your query that generates/creates the CSV ? What is the size of the CSV file ? What version of Drill are you on ? Thanks, Khurram From: Rahul Raj Sent: Tuesday, October 17, 2017 7:09:35 PM To: user@drill.apache.org Subject: Queries gettin

Re: Issue in executing query on Drill Cluster

Hi Chetan, 1. What are the permissions to the file /datalake/replicator/testdemo2 ? 2. Are you connecting as the same user to Drill in both cases, (i) in embedded mode, and (ii) in the 4 node Drillbit cluster ? Thanks, Khurram From: Chetan Kothari Sent

Re: Issue in executing query on Drill Cluster

gards Chetan -Original Message- From: Khurram Faraaz [mailto:kfar...@mapr.com] Sent: Wednesday, October 18, 2017 12:18 PM To: user@drill.apache.org Subject: Re: Issue in executing query on Drill Cluster Hi Chetan, 1. What are the permissions to the file /datalake/replicator/test

Re: Apache Drill connection issue in tableau

To adjust the timeout you can set a higher value for the drill.exec.user.timeout in conf/drill-override.conf, the value is specified in seconds. From: Divya Gehlot Sent: Thursday, November 2, 2017 11:21:16 PM To: user@drill.apache.org Subject: Re: Apache Drill c

Re: Code too large

Can you please share the exact query as is (without formatting) here. And the error that you see on Drill 1.11.0, so we can try and repro it. Thanks, Khurram From: Anup Tiwari Sent: Wednesday, February 14, 2018 3:14:01 AM To: user@drill.apache.org Subject: Re:

Re: Code too large

throw new SchemaChangeException("Failure while loading vector vv3460 with id: TypedFieldId [fieldIds=[61], remainder=null].");} vv3460 = ((NullableVarCharVector) tmp3462);}} public void __DRILL_INIT__()throws SchemaChangeException

Re: Apache Drill 1.12.0

How many unique values does col4 have in bdl.schema.view_in_greenplum ? Thanks, Khurram From: Robles, Edgardo Sent: Friday, February 23, 2018 8:27:59 AM To: user@drill.apache.org Subject: Apache Drill 1.12.0 Hi, I am evaluating Apache Drill and have run into

Re: Apache Drill Automatically Converts Large Numbers to Exponents

Hi Peter, Where do you see large numbers being represented/displayed as exponents, in Drill (and what version of Drill are you on) ? 1. Do you see that behavior on sqlline prompt ? 2. Do you see it from a JDBC application ? 3. Do you see that on Drill's Web UI ? 4. If you don't see it on

Re: Drill error

Hi Nitin, Can you please share the description of the table (i.e. column types) ? Is this a parquet table or JSON ? Also please share the version of Drill and the drillbit.log Thanks, Khurram On Wed, Jun 27, 2018 at 9:45 AM, Nitin Pawar wrote: > here are the details > > query: > > select Accou

Re: CTAS throwing NPE

Hello Ranjit, The query is missing, can you please share the query here ? Also what version of Drill are you on ? Thanks, Khurram On Tue, Jul 3, 2018 at 4:42 PM, Ranjit Reddy wrote: > > I have a query that we are using it to create a table. Select query runs > fine, when a table is created fro

Re: Best Practice to check Drillbit status(Cluster mode)

You can run the below query, and look for the *state *column in the result of the query. Online drillbits will be marked as ONLINE. select * from sys.drillbits; - Khurram On Tue, Jul 10, 2018 at 12:24 AM, Divya Gehlot wrote: > Hi, > I would like to know the best practice to check the Drillbits

Re: Apache Drill Queries Take so Long after which Webconsole dies and I don't see results

Hi, 1. What version of Drill are you running your query on ? 2. How were your parquet files created ? (were they created on Drill or another system, like Hive etc.) 3. Can you please share the parquet schema of the parquet file being queried ? Thanks, Khurram On Wed, Aug 1, 2018 at 3:24 AM, P

Re: Cannot connect over JDBC from LibreOffice Base to Drill (embedded)

Hello Randy, Do you use a username/password to connect to Drill, in your JDBC connection string ? What do the Drill logs say, the drillbit.log and drillbit.out files under logs directory ? Can you connect to Drill from sqlline prompt ? Thanks, Khurram On Sat, Sep 1, 2018 at 1:19 PM, Randy Simons

Re: Failure while reading messages from kafka

Can you please share the stack trace from drillbit.log and the version of Kafka that you are on ? Thanks, Khurram On Tue, Sep 4, 2018 at 11:39 AM, Matt wrote: > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues. > apache.org_jira_browse_DRILL-2D6723&d=DwIBaQ&c=cskdkSMqhcnjZxdQVpwTXg&r

Re: S3 Storage Plugin - IAM roles support

Hi Nitin, You can read the details from here - http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles A drill user hit the same issue in the past and he has documented the steps for others to benefit. Hope that helps. Regards, Khurram On Mon, Sep 17, 2018 at 2:20 PM, Nitin S

Re: to_date() string to date conversion ERROR

Hello Herman, That information about setting the timezone is available here in the Apache Drill docs https://drill.apache.org/docs/data-type-conversion/ Configure the default time zone format in /conf/drill-env.sh by adding -Duser.timezone=UTC to DRILL_JAVA_OPTS. For example: export DRILL_JAVA_O

Re: Kafka Plugin in Drill 1.14

Hi, You can find details here - https://drill.apache.org/docs/kafka-storage-plugin/ When you install Drill, a preconfigured Kafka storage plugin is available on the Storage page in the Drill Web Console. Once you enable and configure the storage plugin, you can query Kafka from Drill. Thanks, Kh

Re: Failed to fetch parquet metadata after 15000ms

Hi Karthik, You can try setting the session/system option, exec.queue.timeout_millis to a higher value, the default is 30 Thanks, Khurram On Mon, Oct 8, 2018 at 10:40 AM karthik.R wrote: > Hi, > I am frequently getting below exception when running a query in drill 1.14. > Could you please

Re: Query hung in Cancelled_Requested state

Hi Divya, Please see link below for more info, I have added details of how to Cancel a query using the REST API https://drill.apache.org/docs/rest-api-introduction/ GET /profiles/cancel/{queryid} Cancel the query that has the given queryid. Parameter queryid--The UUID of the query in standard U

Re: Hbase tables in apache drill not showing up

Hi, What is the version of Drill and HBase that you are using ?, Do you see any errors in drillbit.log file ? You will have to enable the HBase storage plugin on Drill web UI, and ensure it is enabled { "type": "hbase", "config": { "hbase.zookeeper.quorum": "1.2.

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

Congratulations Hanu! On Thu, Nov 1, 2018 at 10:14 AM Gautam Parai wrote: > Congratulations Hanumath! Well deserved :) > > Gautam > > On Thu, Nov 1, 2018 at 9:44 AM AnilKumar B wrote: > > > Congratulations Hanumath. > > > > Thanks & Regards, > > B Anil Kumar. > > > > > > On Thu, Nov 1, 2018 at

Re: Join tables from different databases returns empty result

Hi, You will have to create a new storage plugin from Drill's Web UI, you can find the details on the below documentation link, to query MySQL tables from Apache Drill. https://drill.apache.org/docs/rdbms-storage-plugin/ Also please share the query plan if you can generate one using EXPLAIN FOR c

Re: Drill “VALIDATION ERROR: A table or view with given name already exists in schema” for empty directory

Vitalii, this could be related to https://issues.apache.org/jira/browse/DRILL-2775 Regards, Khurram On Wed, Dec 5, 2018 at 4:51 PM Vitalii Diravka wrote: > Hi Reed, > > It looks like a bug. Could you please create a jira ticket with an above > description? > > https://urldefense.proofpoint.com/

Re: [ANNOUNCE] New Committer: Karthikeyan Manivannan

Congratulations Karthik!! On Fri, Dec 7, 2018 at 11:12 AM Abhishek Girish wrote: > Congratulations Karthik! > > On Fri, Dec 7, 2018 at 11:11 AM Arina Ielchiieva wrote: > > > The Project Management Committee (PMC) for Apache Drill has invited > > Karthikeyan > > Manivannan to become a committer,

Re: Caused by: org.apache.drill.exec.exception.DrillbitStartupException: Drillbit is disallowed to bind to loopback address in distributed mode.

Try using port number 5181 instead of port 2181. Regards, Khurram On Fri, Dec 7, 2018 at 4:19 PM Alaa Salmo wrote: > Hi All, > > I am trying to install Hadoop/Zookeeper with Apache Drill (distributed > mode). I am facing the following error > "org.apache.drill.exec.exception.DrillbitStartupExce

Re: Drill connection using jdbc

Hi Tushar, This example works just fine for me, you may want to use the template import org.apache.log4j.Logger; import java.sql.Connection; import java.sql.ResultSet; import java.sql.SQLException; import java.sql.Statement; import java.sql.Types; import java.sql.*; import java.io.*; import java

Re: Problem Creating Views In Apache Drill

Hi Peter, What version of Drill are you on ? Thanks, Khurram On Fri, Jan 11, 2019 at 12:20 PM Gautam Parai wrote: > Hi Peter, > > Do you see the same error when you run the query instead? > > SELECT id, settlement, settlement_type, > to_timestamp(to_char(settlement_date, '#')) as settlement_d

Re: RESOURCE ERROR: External Sort encountered an error while spilling to disk

Can you also share the stack trace from drillbit.log for the below error RESOURCE ERROR: External Sort encountered an error while spilling to disk And what is the version of Drill that you are running ? Please share the table definition and the number of rows in that table, which is being queried.

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

1. Downloaded tar and installed binaries on a single node. 2. Ran simple SQL queries from web UI. 3. Ran SQL queries from sqlline prompt. 4. Navigated across different tabs on web UI. 5. Exported storage plugins, using the new Export option available on web UI. Looks good! On Mon, Apr 22, 2019 at

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

i see the correct version and commit, I deployed the binaries to test. Apache Drill 1.16.0 "Start your SQL engine." apache drill> select * from sys.version; +-+--+-+---+-

Re: help needed

Hi Ahmad, You will need a storage plugin for HBase and one more for Hive, please refer to the doc links below for more info. Please share more details about any errors that might see. https://drill.apache.org/docs/hbase-storage-plugin/ https://drill.apache.org/docs/hive-storage-plugin/ Thanks,

  1   2   >