Re: Hbase SQL

2016-06-17 Thread Khurram Faraaz
Can you try these two queries ?, and are you trying to execute your query from Drill's sqlline prompt or from a Java program ? select X.CF.`11503` from hbase.`X**` where convert_from(row_key, 'bigint_be') = 916124337090; and this one select X.CF.`11503` from hbase.`X**` where

Re: Drill Issues

2016-05-18 Thread Khurram Faraaz
Hello Sanjiv, I work with the Drill team. I don't have your previous email (I joined the user group recently). I can take a look at your join query problem and your multiple columns having same name and same type issue. Please share/resend your earlier email, and I can take a look. Two things

Re: query from hbase issue

2016-05-19 Thread Khurram Faraaz
n (1.6) that he was using. Also, is the data set > similar ? If you are unable to repro the exact same issue, perhaps qiang > should file a JIRA with a smaller repro if possible. > > > > On Thu, May 19, 2016 at 8:35 AM, Khurram Faraaz <kfar...@maprtech.com> > wrote: > &g

Re: Drill Issues

2016-05-23 Thread Khurram Faraaz
You can use CONVERT_TO and CONVERT_FROM functions, to get HDFS bytes read/write from drill queries. https://drill.apache.org/docs/supported-data-types/#data-types-for-convert_to-and-convert_from-functions On Mon, May 23, 2016 at 11:28 AM, vinita.go...@siemens.com < vinita.go...@siemens.com>

Re: Regarding Excel Files and Ms Access File.

2016-05-23 Thread Khurram Faraaz
Sanjiv you can try to export your data from MS Excel file to a text/CSV file, using the Save As option. and then query that CSV/text file from Drill. On Thu, May 19, 2016 at 12:38 AM, Antonio Romero (carnorom) < carno...@cisco.com> wrote: > http://ucanaccess.sourceforge.net/site.html > > This

test

2016-05-17 Thread Khurram Faraaz
test email

Re: query from hbase issue

2016-05-18 Thread Khurram Faraaz
So I tried to create the table using HBase API (with no data inserted into table) and I got the query plan for drill 1.7.0 Drill 1.7.0-SNAPSHOT commit ID : 09b26277 0: jdbc:drill:schema=dfs.tmp> describe browser_action2; +--++--+ | COLUMN_NAME | DATA_TYPE |

Re: Drill JDBC Interpreter: Connection Refused

2016-07-12 Thread Khurram Faraaz
This one works just fine for me final String URL_STRING = "jdbc:drill:schema=dfs.tmp;drillbit="; replace IPADDRESS with your IP address in the above line. On Tue, Jul 12, 2016 at 12:08 PM, Krishnaprasad A S < krishna.pra...@flytxt.com> wrote: > Yes, I tried with url

Re: Drill JDBC Interpreter: Connection Refused

2016-07-12 Thread Khurram Faraaz
Also try using port number 5181 in your drill-override.conf, instead of 2181, and then stop and start Drillbit and re-run your program. On Tue, Jul 12, 2016 at 1:08 PM, Khurram Faraaz <kfar...@maprtech.com> wrote: > This one works just fine for me > > final String URL_STRING = &qu

Re: Overflow detection in Drill

2016-07-26 Thread Khurram Faraaz
t 2:07 AM, Khurram Faraaz <kfar...@maprtech.com> wrote: > Hi All, > > As of today Drill does not handle overflow detection and does not report > that was an overflow to users, instead we just return results that are > incorrect. This issue has been discussed (but no

Overflow detection in Drill

2016-07-25 Thread Khurram Faraaz
Hi All, As of today Drill does not handle overflow detection and does not report that was an overflow to users, instead we just return results that are incorrect. This issue has been discussed (but not in detail) in the past. It would be great if Drill also handled overflow detection in data of

Re: [Drill-Questions] Speed difference between GZ and BZ2

2016-08-04 Thread Khurram Faraaz
am querying select only.) > > > On Mon, Aug 1, 2016 at 3:27 PM, Khurram Faraaz <kfar...@maprtech.com> > wrote: > > > What is the data format within those .gz and .bz2 files ? It is parquet > or > > JSON or plain text (CSV) ? > > Also, what was this config parame

Re: [Drill-Questions] Speed difference between GZ and BZ2

2016-08-04 Thread Khurram Faraaz
}, > "tsv" : { > "type" : "text", > "extensions" : [ "tsv" ], > "delimiter" : "\t" > }, > "parquet" : { > "type" : "

Re: Query hangs on planning

2016-08-09 Thread Khurram Faraaz
with 8/16. I'm gonna try again on the cluster to make > sure. > > Thanks, > Oscar > > > On Tue, Aug 09, 2016 at 04:13:17PM +0530, Khurram Faraaz wrote: > >> You mentioned "*But if I uncomment the where clause then it runs for a >> couple of hours until it ru

Re: How to enable decimal value

2017-02-08 Thread Khurram Faraaz
Can you share your query and the results ? And did you set planner.enable_decimal_data_type=true at session level or system level ? From: Sanjiv Kumar Sent: Wednesday, February 8, 2017 3:15:08 PM To: user@drill.apache.org Subject: How to

Re: How to use CASE in apache drill

2017-01-20 Thread Khurram Faraaz
Are the two columns CS.ProviderID and b.`Value` of the same datatypes in your SQL statement ? From: Sanjiv Kumar Sent: Friday, January 20, 2017 1:59:35 PM To: user@drill.apache.org Subject: How to use CASE in apache drill I Have one doubt

Re: Fetch queries status from drill prompt

2016-08-19 Thread Khurram Faraaz
There is an open JIRA DRILL-4258 Once that is fixed/implemented you can query from sys.queries or sys.statements to know about all SQL statements that are in different states. Khurram On Fri, Aug 19, 2016 at 4:45 PM, Anup Tiwari

Re: [Drill-Questions] Speed difference between GZ and BZ2

2016-08-05 Thread Khurram Faraaz
: [ "csv" ], > "delimiter" : "," > }, > "tsv" : { > "type" : "text", > "extensions" : [ "tsv" ], > "delimiter" : "\t" >

Re: Drill 1.9 Null pointer Exception

2017-03-02 Thread Khurram Faraaz
A, Trinity Mobility Pvt. Ltd | Bangalore | +91-7736368236 -Original Message----- From: Khurram Faraaz [mailto:kfar...@mapr.com] Sent: 02 March 2017 14:02 To: user@drill.apache.org Cc: prasann...@trinitymobility.com; 'Sushil' <sus...@trinitymobility.com> Subject: Re: Drill 1.9 Null point

Re: Query hangs on planning

2016-08-31 Thread Khurram Faraaz
com> wrote: > For the record, I think this was just bad memory configuration after all. > I retested on bigger machines and everything seems to be working fine. > > > On Tue, Aug 09, 2016 at 10:46:33PM +0530, Khurram Faraaz wrote: > >> Oscar, can you please report

Re: Date Formatting Question

2016-09-08 Thread Khurram Faraaz
Here is the link to currently supported datetime functions in Drill https://drill.apache.org/docs/date-time-functions-and-arithmetic/#extract On Fri, Sep 9, 2016 at 12:32 AM, Charles Givre wrote: > Hello everyone, > I have a question about formatting dates. Let's say that I

Re: NULL values for DATE type columns using JDBC connector

2016-09-15 Thread Khurram Faraaz
This is related to DRILL-4842 On Wed, Sep 14, 2016 at 12:31 AM, Sudheesh Katkam wrote: > Hi Dan, > > Per documentation , I > don’t think sql4es is in the list of actively tested JDBC drivers. But a > “WHERE something IS

Re: Question related to handling of nulls in csv

2016-08-24 Thread Khurram Faraaz
There are two things you need to take care of in your example, 1. you should tell Drill skip the header from your CSV file. (add skipFirstLine into your storage plugin) 2. you are doing a sum over string data (varchar), so you will need to cast your data in column "c" to integer before you do the

Re: Cannot cancel query - stuck in CANCELLATION_REQUESTED

2016-09-26 Thread Khurram Faraaz
Can you please get the jstack for the hung Drillbit process ? And what version of Drill are you running ? I found this jira DRILL-4355 maybe related, not sure though. Thanks, Khurram On Mon, Sep 26, 2016 at 2:11 PM, Dan Markhasin

Re: Drill Over MongoDB | Unable to access filelds from complex Json Object

2016-10-27 Thread Khurram Faraaz
Hello Vikram. I tried using your data on Drill 1.9.0 [test@test-01 ~]# cat mongo_test.json { "_id" : " some_value ", "_updated" : " some_value ", "brands" : [ " some_value " ], "_created" : " some_value ", "_status" : " some_value ", "metadata" : {

Re: Last Column showing blank in csv file

2016-11-28 Thread Khurram Faraaz
Please share (attach) your CSV data files here. Also please share your exact queries and the actual output that Drill returns to you. That way someone here can take a look. On Mon, Nov 28, 2016 at 6:30 PM, Sanjiv Kumar wrote: > Ya Its working but what if i am using :- >

Re: Last Column showing blank in csv file

2016-11-29 Thread Khurram Faraaz
Thanks. What version of Drill are you using ? And is this on Linux ? On Tue, Nov 29, 2016 at 11:40 AM, Sanjiv Kumar wrote: > I already pasted the csv file. Just copy and save it as csv. I am also > attaching csv file. And the query is same as i mention above. > > select

Re: Last Column showing blank in csv file

2016-11-28 Thread Khurram Faraaz
You should set skipFirstLine to true, in the formats area of the storage plugin configuration. Doing the above will ensure that Drill skips the first line of your CSV file. And your query should look like, 0: jdbc:drill:schema=dfs.tmp> select columns[0] sepalen, columns[1] sepalwidth, columns[2]

Re: Drill Join query optimization

2016-11-04 Thread Khurram Faraaz
What version of Drill are you on ? Can you please share the query plan for your query ? Please share the table definitions ? Is this a standalone setup or cluster of Drillbits ? On Fri, Nov 4, 2016 at 2:23 PM, wrote: > Hello, > > I am working on a proof of

Re: Error parsing JSON

2016-10-12 Thread Khurram Faraaz
Can you please share your SQL query ? On Wed, Oct 12, 2016 at 7:38 PM, Dan Blondowski < dan.blondow...@dhigroupinc.com> wrote: > Hello. > > I have a json file with 2 records (see attached). > > When I run a query against it I get this error: > > *Error: DATA_READ ERROR: Error parsing JSON - You

Re: Error parsing JSON

2016-10-12 Thread Khurram Faraaz
Daniel Blondowski > > Big Data Architecture/Engineering > DHI Group, Inc. > > dan.blondow...@dice.com > 515-313-2137 > > > > > > On 10/12/16, 9:52 AM, "Khurram Faraaz" <kfar...@maprtech.com> wrote: > > >Can you please share your SQL

Re: Drill connecting to Azure DocumentDB store

2016-10-13 Thread Khurram Faraaz
If Azure DocumentDB supports JDBC / ODBC driver, then yes we can query using SQL from Drill. I see that Azure Document DB does support SQL. On Thu, Oct 13, 2016 at 5:29 AM, Sameer Nori wrote: > Can Drill connect to the Azure Document DB store? > > Thanks, > > > -- > > Sameer

Re: Error parsing JSON

2016-10-12 Thread Khurram Faraaz
Since your JSON file has different types of data (line int, boolean, strings etc) we need to tell Drill to consider all data in that JSON file as text. This is by design, and this is not trial and error. Such occurrence of different types of data in a JSON file is called SchemaChange and to avoid

Re: [Drill 1.6] : Number format exception due to Empty String

2016-10-15 Thread Khurram Faraaz
Anup, can you please - share your parquet data file (also your CTAS statement that you used to create that parquet file) - and the SQL query you are running That way we can run your query against your data file on latest Drill 1.9.0, and share results with you. On Sat, Oct 15, 2016 at 4:36

Re: Help in running drill jdbc code from tomcat server.

2016-12-12 Thread Khurram Faraaz
Can you share the jdbc connection string and the error you see in the drillbit.log file ? On Mon, Dec 12, 2016 at 2:58 PM, wrote: > Hi, > > > I am getting an error when I am invoking drill jdbc code from apache > tomcat server. The same piece of code is executing fine

Re: hangout starting in a bit

2016-12-13 Thread Khurram Faraaz
Can we please have the link to the hangout ? On Tue, Dec 13, 2016 at 11:32 PM, Parth Chandra wrote: > >

Re: [1.9.0] : Error: SYSTEM ERROR: MalformedInputException: Input length = 1

2016-12-07 Thread Khurram Faraaz
Is your data the same on 1.6.0 and 1.9.0, or did your data change by any chance when/after upgrading from 1.6.0 to 1.9.0 ? On Wed, Dec 7, 2016 at 12:22 PM, Pratik Khedkar < pratik.khed...@games24x7.com> wrote: > Hi Team, > > I am getting below error after upgrading drill from 1.6 to 1.9. >

Re: Last Column showing blank in csv file

2016-12-03 Thread Khurram Faraaz
I am not exactly sure this will work (I haven't tried it on Windows 10) Setting lineDelimiter to '\r\n' should try to help in your case, can you please try. For details look at DRILL-3149 Example: select * from table(dfs.`my_table`(type=>'text',

Re: Drill with Parquet

2016-12-29 Thread Khurram Faraaz
Please look at these examples on the documentation links below here is the link to supported datatypes in Drill - https://drill.apache.org/docs/supported-data-types/ and link to CTAS in Drill - http://drill.apache.org/docs/create-table-as-ctas-command/ On Thu, Dec 29, 2016 at 4:40 PM, Manjeet

Re: Limit ALL not working with offset

2016-12-27 Thread Khurram Faraaz
This looks like a bug. Thanks for reporting this issue. I tried a similar query on apache Drill 1.10.0 and Drill returns wrong results when compared to Postgres, for a query that uses LIMIT and OFFSET clause in the same query. We need to file a JIRA to track this issue. {noformat} 0:

Re: Limit ALL not working with offset

2016-12-27 Thread Khurram Faraaz
1. DRILL-5165 <https://issues.apache.org/jira/browse/DRILL-5165> is reported to track this issue. On Tue, Dec 27, 2016 at 2:06 PM, Khurram Faraaz <kfar...@maprtech.com> wrote: > This looks like a bug. Thanks for reporting this issue. > I tried a similar query on a

Re: Drill with Parquet

2016-12-26 Thread Khurram Faraaz
Hello Manjeet, What error do you see on the prompt from where you submit the CTAS statement ? Can you please share the stacktrace/error information from the drillbit.log file ? is your CTAS (the one that failed), is it over CSV/JSON files ? And when you say your SELECT statement is not working,

Re: Wrong property value

2017-03-27 Thread Khurram Faraaz
We should report a documentation JIRA to track this. From: Padma Penumarthy Sent: Monday, March 27, 2017 7:21:02 PM To: user@drill.apache.org Subject: Re: Wrong property value Yes, you are right. We need to update the documentation with the

Re: Display of query result using command line

2017-03-15 Thread Khurram Faraaz
Three million rows is too many rows, for sqlline to print. Try doing a COUNT(*) and see if that query returns the correct count on that table. Thanks, Khurram From: PROJJWAL SAHA Sent: Wednesday, March 15, 2017 7:41:00 PM To:

Re: Data read error while query Hbase table.

2017-04-09 Thread Khurram Faraaz
Can you please share the stack trace from drillbit.log, and what version of Drill are you on ? Thanks, Khurram From: nagesh bigdata Sent: Monday, April 10, 2017 8:34:59 AM To: user@drill.apache.org Subject: Data read error while query

Re: Fetch temporary tables data of PostgreSQL from Apache Drill

2017-04-18 Thread Khurram Faraaz
Temporary tables are session specific, how are you trying to access them from Drill ? If the temporary table was created in Postgres in a different session, you can not access that temporary table from Drill using another session. Temporary tables get dropped once session terminates.

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

2017-08-15 Thread Khurram Faraaz
eading vector. Expected vector class of org.apache.drill.exec.vector.NullableIntVector but was holding vector class org.apache.drill.exec.vector.NullableVarCharVector, field= Capacity Thanks, Divya On 14 August 2017 at 17:56, Khurram Faraaz <kfar...@mapr.com> wrote: > You should look at D

Re: Non-ascii characters still fails on Drill 1.11

2017-08-11 Thread Khurram Faraaz
We need to add a unit test, the last comment in DRILL-4039 suggests that we add a unit test for that fix. Thanks, Khurram From: Arina Yelchiyeva Sent: Friday, August 11, 2017 5:03:44 PM To: user Subject: Re: Non-ascii characters

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

2017-08-14 Thread Khurram Faraaz
tried this first but some post in Apache Drill JIRA mentioned to use 0 instead of null to get rid of error . unfortunately it did not work in my case :( Thanks, Divya On 14 August 2017 at 14:56, Khurram Faraaz <kfar...@mapr.com> wrote: > Can you please try this, since you mention c

Re: UNSUPPORTED_OPERATION ERROR: Hash aggregate does not support schema changes

2017-08-14 Thread Khurram Faraaz
Can you please try this, since you mention column has empty values try using null instead of zero, because 0 (zero) is not null. CASE WHEN `Capacity` = '' THEN CAST(null AS integer) ELSE CAST(`Capacity` AS integer) END AS `Capacity` Thanks, Khurram From:

Re: Error when timestamp IN clause contains more elements

2017-07-14 Thread Khurram Faraaz
I tried the below query using data from your query from the IN clause (as is), I didn't see an error/Exception on sqlline, I am on Drill 1.11.0 0: jdbc:drill:schema=dfs.tmp> select * from (values(137676420)) WHERE EXPR$0 IN (137667780, 137676420, 137685060, 137702340,

Re: regex replace in string

2017-07-27 Thread Khurram Faraaz
Drill docs mention that REGEXP_REPLACE function uses http://docs.oracle.com/javase/8/docs/api/java/util/regex/Pattern.html Link to REGEXP_REPLACE doc - https://drill.apache.org/docs/string-manipulation/#regexp_replace From: Paul Rogers

Re: regex replace in string

2017-07-26 Thread Khurram Faraaz
Can you please share your CSV file, the SQL query and the version of Drill that you are on. So someone can take a look and try to reproduce the error that you are seeing. Thanks, Khurram From: Divya Gehlot Sent: Wednesday, July 26,

Re: regex replace in string

2017-07-26 Thread Khurram Faraaz
d try your file with that release. Let us know if you still have a problem. Thanks, - Paul > On Jul 26, 2017, at 6:14 AM, Khurram Faraaz <kfar...@mapr.com> wrote: > > Can you please share your CSV file, the SQL query and the version of Drill > that you are on. So someone can

Re: Query Optimization

2017-08-17 Thread Khurram Faraaz
Please share your SQL query and the query plan. To get the query plan, execute EXPLAIN PLAN FOR ; Thanks, Khurram From: Divya Gehlot Sent: Friday, August 18, 2017 7:15:18 AM To: user@drill.apache.org Subject: Re: Query Optimization

Re: Drill query are stuck in ENQUEUED mode

2017-05-03 Thread Khurram Faraaz
Does your query execute and complete when you set exec.queue.enable = false ? The default is to set exec.queue.enable to false. Thanks, Khurram From: jasbir.s...@accenture.com Sent: Wednesday, May 3, 2017 5:58:48 PM To:

Re: Increasing store.parquet.block-size

2017-06-09 Thread Khurram Faraaz
1. DRILL-2478 is Open for this issue. 2. I have added more details into the comments. Thanks, Khurram From: Shuporno Choudhury Sent: Friday, June 9, 2017 12:48:41 PM To:

Re: Increasing store.parquet.block-size

2017-06-15 Thread Khurram Faraaz
017, at 3:12 AM, Khurram Faraaz <kfar...@mapr.com> wrote: > > Thanks Padma. There are some more related failures reported in DRILL-2478, do > you think we should fix them too, if it is an easy fix. > > > Regards, > > Khurram > > &

Re: Increasing store.parquet.block-size

2017-06-14 Thread Khurram Faraaz
nt task or a sub-task of updating Drill project to a latest parquet library. Kind regards Vitalii On Fri, Jun 9, 2017 at 10:25 AM, Khurram Faraaz <kfar...@mapr.com<mailto:kfar...@mapr.com>> wrote: 1. DRILL-2478<https://issues.apache.org/jira/browse/DRILL-2478> is Open for this i

Re: Issue in executing query on Drill Cluster

2017-10-18 Thread Khurram Faraaz
How do we fix it? Regards Chetan -Original Message- From: Khurram Faraaz [mailto:kfar...@mapr.com] Sent: Wednesday, October 18, 2017 12:18 PM To: user@drill.apache.org Subject: Re: Issue in executing query on Drill Cluster Hi Chetan, 1. What are the permissions to th

Re: Issue in executing query on Drill Cluster

2017-10-18 Thread Khurram Faraaz
Hi Chetan, 1. What are the permissions to the file /datalake/replicator/testdemo2 ? 2. Are you connecting as the same user to Drill in both cases, (i) in embedded mode, and (ii) in the 4 node Drillbit cluster ? Thanks, Khurram From: Chetan Kothari

Re: Queries getting CANCELED

2017-10-17 Thread Khurram Faraaz
Can you please share your query that generates/creates the CSV ? What is the size of the CSV file ? What version of Drill are you on ? Thanks, Khurram From: Rahul Raj Sent: Tuesday, October 17, 2017 7:09:35 PM To:

Re: Apache Drill connection issue in tableau

2017-11-03 Thread Khurram Faraaz
To adjust the timeout you can set a higher value for the drill.exec.user.timeout in conf/drill-override.conf, the value is specified in seconds. From: Divya Gehlot Sent: Thursday, November 2, 2017 11:21:16 PM To: user@drill.apache.org

Re: Apache Drill Automatically Converts Large Numbers to Exponents

2018-05-08 Thread Khurram Faraaz
Hi Peter, Where do you see large numbers being represented/displayed as exponents, in Drill (and what version of Drill are you on) ? 1. Do you see that behavior on sqlline prompt ? 2. Do you see it from a JDBC application ? 3. Do you see that on Drill's Web UI ? 4. If you don't see it

Re: Drill error

2018-06-27 Thread Khurram Faraaz
Hi Nitin, Can you please share the description of the table (i.e. column types) ? Is this a parquet table or JSON ? Also please share the version of Drill and the drillbit.log Thanks, Khurram On Wed, Jun 27, 2018 at 9:45 AM, Nitin Pawar wrote: > here are the details > > query: > > select

Re: Code too large

2018-02-14 Thread Khurram Faraaz
Can you please share the exact query as is (without formatting) here. And the error that you see on Drill 1.11.0, so we can try and repro it. Thanks, Khurram From: Anup Tiwari Sent: Wednesday, February 14, 2018 3:14:01 AM To:

Re: Code too large

2018-02-20 Thread Khurram Faraaz
kdkSMqhcnjZxdQVpwTXg=H5JEl9vb-mBIjic10QAbDD2vkUUKAxjO6wZO322RtdI=REIpiPGn0G5wyx7pQLeSqlcxzhPl7nyVZH0N5737hhw=XcZrMGyI88G8MAc8PO37lcr2KmhvvvsmRNCy4QdPz4M= Thanks, Arjun From: Khurram Faraaz <kfar...@mapr.com> Sent: Thursday, February 15, 2018 12:55 AM To: user@

Re: Apache Drill 1.12.0

2018-02-23 Thread Khurram Faraaz
How many unique values does col4 have in bdl.schema.view_in_greenplum ? Thanks, Khurram From: Robles, Edgardo Sent: Friday, February 23, 2018 8:27:59 AM To: user@drill.apache.org Subject: Apache Drill 1.12.0 Hi, I am evaluating

Re: Apache Drill Queries Take so Long after which Webconsole dies and I don't see results

2018-08-01 Thread Khurram Faraaz
Hi, 1. What version of Drill are you running your query on ? 2. How were your parquet files created ? (were they created on Drill or another system, like Hive etc.) 3. Can you please share the parquet schema of the parquet file being queried ? Thanks, Khurram On Wed, Aug 1, 2018 at 3:24 AM,

Re: Cannot connect over JDBC from LibreOffice Base to Drill (embedded)

2018-09-01 Thread Khurram Faraaz
Hello Randy, Do you use a username/password to connect to Drill, in your JDBC connection string ? What do the Drill logs say, the drillbit.log and drillbit.out files under logs directory ? Can you connect to Drill from sqlline prompt ? Thanks, Khurram On Sat, Sep 1, 2018 at 1:19 PM, Randy

Re: Failure while reading messages from kafka

2018-09-04 Thread Khurram Faraaz
Can you please share the stack trace from drillbit.log and the version of Kafka that you are on ? Thanks, Khurram On Tue, Sep 4, 2018 at 11:39 AM, Matt wrote: > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues. > apache.org_jira_browse_DRILL-2D6723=DwIBaQ=cskdkSMqhcnjZxdQVpwTXg= >

Re: Best Practice to check Drillbit status(Cluster mode)

2018-07-10 Thread Khurram Faraaz
You can run the below query, and look for the *state *column in the result of the query. Online drillbits will be marked as ONLINE. select * from sys.drillbits; - Khurram On Tue, Jul 10, 2018 at 12:24 AM, Divya Gehlot wrote: > Hi, > I would like to know the best practice to check the

Re: Failed to fetch parquet metadata after 15000ms

2018-10-08 Thread Khurram Faraaz
Hi Karthik, You can try setting the session/system option, exec.queue.timeout_millis to a higher value, the default is 30 Thanks, Khurram On Mon, Oct 8, 2018 at 10:40 AM karthik.R wrote: > Hi, > I am frequently getting below exception when running a query in drill 1.14. > Could you please

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

2018-11-01 Thread Khurram Faraaz
Congratulations Hanu! On Thu, Nov 1, 2018 at 10:14 AM Gautam Parai wrote: > Congratulations Hanumath! Well deserved :) > > Gautam > > On Thu, Nov 1, 2018 at 9:44 AM AnilKumar B wrote: > > > Congratulations Hanumath. > > > > Thanks & Regards, > > B Anil Kumar. > > > > > > On Thu, Nov 1, 2018 at

Re: Query hung in Cancelled_Requested state

2018-10-26 Thread Khurram Faraaz
Hi Divya, Please see link below for more info, I have added details of how to Cancel a query using the REST API https://drill.apache.org/docs/rest-api-introduction/ GET /profiles/cancel/{queryid} Cancel the query that has the given queryid. Parameter queryid--The UUID of the query in standard

Re: Hbase tables in apache drill not showing up

2018-10-29 Thread Khurram Faraaz
Hi, What is the version of Drill and HBase that you are using ?, Do you see any errors in drillbit.log file ? You will have to enable the HBase storage plugin on Drill web UI, and ensure it is enabled { "type": "hbase", "config": { "hbase.zookeeper.quorum":

Re: Join tables from different databases returns empty result

2018-11-06 Thread Khurram Faraaz
Hi, You will have to create a new storage plugin from Drill's Web UI, you can find the details on the below documentation link, to query MySQL tables from Apache Drill. https://drill.apache.org/docs/rdbms-storage-plugin/ Also please share the query plan if you can generate one using EXPLAIN FOR

Re: to_date() string to date conversion ERROR

2018-10-03 Thread Khurram Faraaz
Hello Herman, That information about setting the timezone is available here in the Apache Drill docs https://drill.apache.org/docs/data-type-conversion/ Configure the default time zone format in /conf/drill-env.sh by adding -Duser.timezone=UTC to DRILL_JAVA_OPTS. For example: export

Re: Kafka Plugin in Drill 1.14

2018-10-04 Thread Khurram Faraaz
Hi, You can find details here - https://drill.apache.org/docs/kafka-storage-plugin/ When you install Drill, a preconfigured Kafka storage plugin is available on the Storage page in the Drill Web Console. Once you enable and configure the storage plugin, you can query Kafka from Drill. Thanks,

Re: [ANNOUNCE] New Committer: Karthikeyan Manivannan

2018-12-07 Thread Khurram Faraaz
Congratulations Karthik!! On Fri, Dec 7, 2018 at 11:12 AM Abhishek Girish wrote: > Congratulations Karthik! > > On Fri, Dec 7, 2018 at 11:11 AM Arina Ielchiieva wrote: > > > The Project Management Committee (PMC) for Apache Drill has invited > > Karthikeyan > > Manivannan to become a

Re: Caused by: org.apache.drill.exec.exception.DrillbitStartupException: Drillbit is disallowed to bind to loopback address in distributed mode.

2018-12-08 Thread Khurram Faraaz
Try using port number 5181 instead of port 2181. Regards, Khurram On Fri, Dec 7, 2018 at 4:19 PM Alaa Salmo wrote: > Hi All, > > I am trying to install Hadoop/Zookeeper with Apache Drill (distributed > mode). I am facing the following error >

Re: Problem Creating Views In Apache Drill

2019-01-11 Thread Khurram Faraaz
Hi Peter, What version of Drill are you on ? Thanks, Khurram On Fri, Jan 11, 2019 at 12:20 PM Gautam Parai wrote: > Hi Peter, > > Do you see the same error when you run the query instead? > > SELECT id, settlement, settlement_type, > to_timestamp(to_char(settlement_date, '#')) as

Re: Drill connection using jdbc

2019-01-08 Thread Khurram Faraaz
Hi Tushar, This example works just fine for me, you may want to use the template import org.apache.log4j.Logger; import java.sql.Connection; import java.sql.ResultSet; import java.sql.SQLException; import java.sql.Statement; import java.sql.Types; import java.sql.*; import java.io.*; import

Re: S3 Storage Plugin - IAM roles support

2018-09-17 Thread Khurram Faraaz
Hi Nitin, You can read the details from here - http://drill-user.incubator.apache.narkive.com/mP5GE7fq/s3-using-iam-roles A drill user hit the same issue in the past and he has documented the steps for others to benefit. Hope that helps. Regards, Khurram On Mon, Sep 17, 2018 at 2:20 PM, Nitin

Re: RESOURCE ERROR: External Sort encountered an error while spilling to disk

2019-03-12 Thread Khurram Faraaz
Can you also share the stack trace from drillbit.log for the below error RESOURCE ERROR: External Sort encountered an error while spilling to disk And what is the version of Drill that you are running ? Please share the table definition and the number of rows in that table, which is being

Re: “Failed to construct kafka consumer” using Apache Drill

2019-06-11 Thread Khurram Faraaz
Hi, By looking at the stack trace, the issue seems to not originate from Drill, instead it is a Kafka issue, did you try to increase the limit on the OS to avoid the Too many files open error ? What version of Apache Drill, Kafka and OS are you trying this on ? Caused by:

Re: DFS No extension files

2019-06-11 Thread Khurram Faraaz
Hi, Can you please share the exact error message that you see ? And the details from drillbit.log for that error too. What is the type of file that you are interested/trying to query from Drill ? Is it parquet, JSON, CSV or a directory ? If you can please answer those questions we can better

Re: Heap memory - leak

2019-06-12 Thread Khurram Faraaz
Hi Dweep, I see that you are using the REST API to execute the queries. The recommended way for complex queries that are resource intensive, is to always use either the JDBC/ODBC driver to submit queries for execution. Here is a difference for your reference. Please use JDBC/ODBC to execute your

Re: “Failed to construct kafka consumer” using Apache Drill

2019-06-12 Thread Khurram Faraaz
To increase your open file limits on your system, please refer to the content on below link. Let us know if that resolved it for you. https://easyengine.io/tutorials/linux/increase-open-files-limit/ Thanks, Khurram On Tue, Jun 11, 2019 at 10:45 PM Khurram Faraaz wrote: > Hi, > > B

Re: help needed

2019-05-09 Thread Khurram Faraaz
Hi Ahmad, You will need a storage plugin for HBase and one more for Hive, please refer to the doc links below for more info. Please share more details about any errors that might see. https://drill.apache.org/docs/hbase-storage-plugin/ https://drill.apache.org/docs/hive-storage-plugin/ Thanks,

Re: WELCOME to user@drill.apache.org

2019-05-14 Thread Khurram Faraaz
orage plugin in shown below > > { > "type": "hive", > "configProps": { > "hive.metastore.uris": "thrift://hadoop2:9083", > "hive.metastore.sasl.enabled": "false", > "fs.default.name": &quo

Re: WELCOME to user@drill.apache.org

2019-05-14 Thread Khurram Faraaz
ow to the jars\3rdparty folder . > > -rw-r--r-- 1 root root 6345039 May 14 15:51 > hive-metastore-1.2.1000.2.6.5.0-292.jar > -rw-r--r-- 1 root root 122581 May 14 15:52 > hive-contrib-1.2.1000.2.6.5.0-292.jar > -rw-r--r-- 1 root root 120473 May 14 15:52 > hive-hbase-

Re: WELCOME to user@drill.apache.org

2019-05-23 Thread Khurram Faraaz
plugin is not liking the config file > > > > It says “please rety: Error while creating/update storage: null > > > > Please help > > > > *From:* Khurram Faraaz [mailto:kfar...@mapr.com] > *Sent:* Tuesday, May 14, 2019 6:35 PM > *To:* user@drill.apache.or

Re: Drill: Cannot decode handshake

2019-05-23 Thread Khurram Faraaz
Hi, Can you please confirm that you have followed the steps that are documented here, Installing the Driver on Mac OS X https://drill.apache.org/docs/installing-the-driver-on-mac-os-x/ Configuring ODBC on Mac OS X https://drill.apache.org/docs/configuring-odbc-on-mac-os-x/ Thanks, Khurram On

Re: WELCOME to user@drill.apache.org

2019-05-14 Thread Khurram Faraaz
Hi Ahmad, Does the "show tables" command work for you from Hive shell ? Can you please share you Hive version that is being used ? And share the content from your Hive storage plugin, which is available on the storage tab on Drill web UI. Thanks, Khurram On Tue, May 14, 2019 at 10:07 AM Ahmad,

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

2019-04-24 Thread Khurram Faraaz
i see the correct version and commit, I deployed the binaries to test. Apache Drill 1.16.0 "Start your SQL engine." apache drill> select * from sys.version;

Re: [ANNOUNCE] New PMC Chair of Apache Drill

2019-08-23 Thread Khurram Faraaz
Congratulations Charles, and thank you Arina. Regards, Khurram On Fri, Aug 23, 2019 at 2:54 PM Niels Basjes wrote: > Congratulations Charles. > > Niels Basjes > > On Thu, Aug 22, 2019, 09:28 Arina Ielchiieva wrote: > > > Hi all, > > > > It has been a honor to serve as Drill Chair during the