Re: Drill + parquet

2020-02-04 Thread Arina Yelchiyeva
Please look into logs for more details. Not sure why you see these errors but Drill can perfectly query singe files, subset of files and directories. select * from dfs.tmp.`*.parquet` limit 4; select * from dfs.tmp.`0_0_0.parquet`; Kind regards, Arina > On Feb 4, 2020, at 7:10 PM, Nitin Pawar

Re: Problem running Drill in a Docker container in OpenShift

2020-02-04 Thread Arina Yelchiyeva
Abhishek, looks like Paul is planning to put on hold his efforts since he expects you open-source version to be out soon. Do you have an ETA? This work is important for the community and it would be nice if is completed in this release. Here Jira to tract the efforts:

Re: RDBMS Storage Plugin Configurations

2020-01-16 Thread Arina Yelchiyeva
In the scope of DRILL-7467 one of the enhancements will be to add opportunity to control basic data source setup thought the storage plugin config. You will be able to indicate basic data source parameters and their values: https://commons.apache.org/proper/commons-dbcp/configuration.html

Re: querying json from multiple subdirectories

2020-01-14 Thread Arina Yelchiyeva
Hi, Drill can easily query directories including subdirectories and then join data with other directories, tables etc. Please refer to Drill documentation for more details. For example, you can start from this article: https://drill.apache.org/docs/querying-directories/

Re: Official Apache Drill Docker Images

2020-01-09 Thread Arina Yelchiyeva
Nice ;) > On Jan 9, 2020, at 7:33 PM, Volodymyr Vysotskyi wrote: > > Hi all, > > Some time ago we have introduced Docker Images for Drill and published them > under custom repository. > But now we have Official Docker Repository for Apache Drill placed in >

Re: Parquet INT64 Nullable Type Support

2020-01-07 Thread Arina Yelchiyeva
Hi David, Looks like this is a bug. Could you please file a Jira? It would be nice if you could provide file example so the fix can be checked. But looking in the code we just need to handle int64 here:

Re: [VOTE] Release Apache Drill 1.17.0 - RC2

2019-12-27 Thread Arina Yelchiyeva
orm; there > is no way for someone like Charles or I to perform the crucial verification > step. I think we could do most of the other tasks. > Thanks, > - Paul > > > >On Friday, December 27, 2019, 01:18:48 AM PST, Arina Yelchiyeva > wrote: > > Hi Pa

Re: [ANNOUNCE] Apache Drill 1.17.0 Released

2019-12-27 Thread Arina Yelchiyeva
Congrats everyone, great job! Kind regards, Arina > On 26 Dec 2019, at 20:32, Igor Guzenko wrote: > > Many thanks to everyone who has contributed to the release! Great work! > >> On Thu, Dec 26, 2019 at 8:27 PM Abhishek Girish wrote: >> >> Congratulations, everyone! >> >> On Thu, Dec 26,

Re: [VOTE] Release Apache Drill 1.17.0 - RC2

2019-12-27 Thread Arina Yelchiyeva
Hi Paul, thanks for verifying the release. Regression for the release is considered something that worked in previous version, in our case in 1.16 and stopped working in the released, in our case case 1.17. Vova has checked both sqltypeof issues, they behave the same in 1.16 so from the

Re: [VOTE] Release Apache Drill 1.17.0 - RC2

2019-12-24 Thread Arina Yelchiyeva
Verified checksums and signatures. Unpacked tar.gz and started in embedded mode on Windows (used Java 8, 11). Run simple queries. Did not perform any sophisticated checks, since it is already the third candidate. +1 (binding) Kind regards, Arina > On Dec 23, 2019, at 5:01 PM, Charles Givre

Re: [VOTE] Release Apache Drill 1.17.0 - RC1

2019-12-19 Thread Arina Yelchiyeva
Verified checksums and signatures. Checked persistent and temporary tables creation. Checked Web UI (profiles, logs, options, query submission) Checked dynamic UDFs. Run ad-hoc queries. +1 (binding) Kind regards, Arina > On Dec 18, 2019, at 7:03 PM, Igor Guzenko wrote: > > Hi all, > > I've

Re: [ANNOUNCE] New PMC member: Ihor Guzenko

2019-12-13 Thread Arina Yelchiyeva
Congratulations, Ihor! > On Dec 13, 2019, at 3:38 PM, Volodymyr Vysotskyi wrote: > > I am pleased to announce that Drill PMC invited Ihor Guzenko to > the PMC and he has accepted the invitation. > > Congratulations Ihor and welcome! > > - Vova > (on behalf of Drill PMC)

Re: [VOTE] Release Apache Drill 1.17.0 - RC0

2019-12-10 Thread Arina Yelchiyeva
And one more regression: https://issues.apache.org/jira/browse/DRILL-7476 Kind regards, Arina > On Dec 10, 2019, at 1:59 PM, Igor Guzenko wrote: > > Hi all, > > I've found regression with repeated maps in parquet [1]. Also I personally >

Re: Slack Channel invitation Link

2019-12-03 Thread Arina Yelchiyeva
I am not sure if Drill Slack channel is widely used though. I think User / Dev mailing lists capture more activity. Kind regards, Arina > On Dec 3, 2019, at 7:42 AM, Rameshwar Mane wrote: > > > Hi Abhishek, > Thanks for sharing invitation link. > Thanks and Regards > Rameshwar Mane > On Dec 2

Re: Apache Drill Query regarding configuring S3 datasource from linux

2019-11-21 Thread Arina Yelchiyeva
Please see REST API documentatation - https://drill.apache.org/docs/rest-api-introduction/ > On Nov 21, 2019, at 9:44 AM, Vibhor Goyal wrote: > > Hi Team, > > for one of the requirement , i want to configure and query parquet files > from S3. Could you please help with the steps to configure

Re: Column alias in group by behavior in 1.16

2019-08-20 Thread Arina Yelchiyeva
Resolutions of aliases and columns names is not done in Drill, on the contrary, it done by Calcite. There were some discussions around inconsistencies you mentioning but it's up to the Calcite community to fix them. [1] https://issues.apache.org/jira/browse/CALCITE-2799 Kind regards, Arina >

Re: Documentation feedback

2019-08-13 Thread Arina Yelchiyeva
Feel free to submit PRs to update site documentation (https://github.com/apache/drill/tree/gh-pages ) and Dev documentation (https://github.com/apache/drill/blob/master/docs/dev/Docker.md

Re: Apache Drill 1.10.0 - Issue with combination of Like operator & newline (\n) character in data

2019-07-17 Thread Arina Yelchiyeva
Hi Shankar, To verify behavior on the latest Drill version, you can download Drill from here https://drill.apache.org/download/ . Kind regards, Arina > On Jul 17, 2019, at 2:29 PM, Shankar Mane wrote: > > Hi All, > > I am facing some issues while using

Re: show files problem

2019-07-15 Thread Arina Yelchiyeva
Hi, The issue you are describing was fixed in DRILL-6753 [1] which was included into 1.15.0 release. I suspect you are trying to upgrade to some 1.15.0-SNAPSHOT version rather than on 1.15.0 final version. [1] https://issues.apache.org/jira/browse/DRILL-6753 Kind regards, Arina > On Jul 15,

Apache Drill Hangout - June 11, 2019

2019-06-11 Thread Arina Yelchiyeva
Hi all, We will have our bi-weekly hangout June 11th, at 10 AM PST (link: https://meet.google.com/yki-iqdf-tai ). If there are any topics you would like to discuss during the hangout please respond to this email. Kind regards, Arina

Re: cant select from hive table

2019-05-24 Thread Arina Yelchiyeva
Default is keyword, use it back-ticks (select * from hive.`default`.test). > On May 24, 2019, at 10:59 PM, Ahmad, Sami wrote: > > As you can see , the show table command sees the table but select command > cant find it . > > pache drill (hive.default)> show tables; >

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

2019-04-26 Thread Arina Yelchiyeva
Thank you, Sorabh! > On Apr 26, 2019, at 6:42 PM, SorabhApache wrote: > > Sure. I will do it. > > Thanks, > Sorabh > > On Fri, Apr 26, 2019 at 8:35 AM Arina Yelchiyeva > wrote: > >> Sure, we can discuss it during Hangout. >> Sorabh, since you

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

2019-04-26 Thread Arina Yelchiyeva
Perhaps under a separate 'release' subdirectory either in contrib or >> docs ? >> >> On Fri, Apr 26, 2019 at 12:46 AM Arina Yelchiyeva < >> arina.yelchiy...@gmail.com> wrote: >> >>> Maybe we should include these scripts directly into Drill project (of &

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

2019-04-26 Thread Arina Yelchiyeva
Maybe we should include these scripts directly into Drill project (of course if Parth does not mind), maybe in doc module? This way we will be able to modify them if needed using regular PR process and everybody will know where to find them. Any thoughts? Kind regards, Arina > On Apr 26,

Re: [DISCUSS] Including Features that Need Regular Updating?

2019-03-22 Thread Arina Yelchiyeva
I am not sure that library update should be included in the release process. On the contrary, I think it should be done via regular PR process. Of course, you always have to find a volunteer :) Kind regards, Arina > On Mar 22, 2019, at 8:39 PM, Bob Rudis wrote: > > Two rly  UDFs, too! > >

Re: Drill fails to query pcap files

2019-02-06 Thread Arina Yelchiyeva
from my iPhone > > > On Feb 6, 2019, at 12:15, Arina Yelchiyeva > wrote: > > > > Hi Giovanni, > > > > I don't think Drill pcap format reader has such functionality. > > > > Kind regards, > > Arina > > > >> On Wed, Feb 6, 2019 at 6:39 PM Gi

Re: Drill fails to query pcap files

2019-02-06 Thread Arina Yelchiyeva
Hi Giovanni, I don't think Drill pcap format reader has such functionality. Kind regards, Arina On Wed, Feb 6, 2019 at 6:39 PM Giovanni Conte wrote: > Hi, > I'm trying to query a pcap file and I know that there are corrupted rows > (precisely line 6407), > I need a command to skip this rows

Re: [DISCUSS] Format plugins in contrib module

2019-02-06 Thread Arina Yelchiyeva
format-plugins > > include their plugins in the bootstrap-storage-plugins.json? I was > > thinking also that we might want to have some guidelines for unit tests > for > > format plugins. I’m doing some work on the HTTPD format plugin and found > > some issues which cause it

[DISCUSS] Format plugins in contrib module

2019-02-05 Thread Arina Yelchiyeva
Hi all, Before we were adding new formats / plugins into the exec module. Eventually we came up to the point that exec package size is growing and adding plugin and format contributions is better to separate out in the different module. Now we have contrib module where we add such

Apache Drill Hangout - 08 Jan, 2019

2019-01-08 Thread Arina Yelchiyeva
Hi all, Apache Drill hangout will be held today at 10 am PST. Link - http://meet.google.com/yki-iqdf-tai Gautam / Karthik is planning to talk about Statistics project. If there are any another questions / topics, feel free to send them as reply to this

Re: hmac_sha256 in drill

2019-01-04 Thread Arina Yelchiyeva
Hi Dweep, Drill does not support such function (use sys.functions table for the full list of supported functions). Alternatively you can implement your own UDF [1]. [1] https://drill.apache.org/docs/adding-custom-functions-to-drill/ Kind regards, Arina On Fri, Jan 4, 2019 at 1:27 PM Dweep

Re: Plugin Info in INFORMATION_SCHEMA

2019-01-04 Thread Arina Yelchiyeva
Hi Charles. Please look into information_schema.schema table, specifically in type column. Also there is describe schema command [1] but it returns result in json. [1] https://drill.apache.org/docs/describe/ Kind regards, Arina On Fri, Jan 4, 2019 at 8:21 AM Charles Givre wrote: > Hello

Re: SQL Query Error: VALIDATION ERROR: Unable to create or drop tables/views. Schema [hdfs] is immutable.

2018-12-09 Thread Arina Yelchiyeva
When workspace is not indicated, `default` workspace is used, it is added implicitly and usually is not show in the storage config. To see that such workspace exists use `show schemas` command that will list all workspaces. In your case, there are several options: 1. add root workspace to the

Re: Caused by: org.apache.drill.exec.exception.DrillbitStartupException: Drillbit is disallowed to bind to loopback address in distributed mode.

2018-12-08 Thread Arina Yelchiyeva
, we need to add > allow_loopback_address_binding under drill.exec in Drill configuration file > (drill-override.conf). We need to set allow_loopback_address_binding to > true. > > > > On Sat, Dec 8, 2018 at 12:22 PM Arina Yelchiyeva > wrote: > >>

Re: Caused by: org.apache.drill.exec.exception.DrillbitStartupException: Drillbit is disallowed to bind to loopback address in distributed mode.

2018-12-08 Thread Arina Yelchiyeva
Please refer to this answer on the stackoverflow: https://stackoverflow.com/questions/40506221/how-to-start-drillbit-locally-in-distributed-mode > On Dec 8, 2018, at 2:10 AM, Alaa Salmo wrote: > > Hi All, > > I am trying to install Hadoop/Zookeeper with Apache Drill (distributed > mode). I am

Schema Provision using File / Table Function

2018-11-08 Thread Arina Yelchiyeva
Hi all, besides the initiative to allow providing metadata in the Drill metastore, there also can be an option to provide table schema using file and / or table function. I have created Jira DRILL-6835 [1] with the link to the design document. Those who are interested, are welcome to read it and

Re: November Apache Drill board report

2018-11-07 Thread Arina Yelchiyeva
t; > > > ## Releases: > > > > > > > > - 1.14.0 was released on Sat Aug 04 2018 > > > > > > > > ## Mailing list activity: > > > > > > > > - d...@drill.apache.org: > > > > - 427 subscribers (down -6 in t

Re: November Apache Drill board report

2018-11-01 Thread Arina Yelchiyeva
Thanks, Aman! Updated the report. I went too far with 2019, luckily the meet up will be much earlier :) = ## Description: - Drill is a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage. ## Issues: - There are no issues requiring board attention at this time. ## Activity:

Re: Performance issues while fetching data from Amazon S3

2018-10-30 Thread Arina Yelchiyeva
Though in both cases the problem is the same (slow performance) but Drilll setup is different. Jyotsana, you can share more details (including setup details, query profile etc) in the existing Jira or create new one and link both Jiras. Kind regards, Arina On Tue, Oct 30, 2018 at 6:21 AM Pritesh

Re: [HANGOUT] 29th Oct 2018 (9PM PST)

2018-10-30 Thread Arina Yelchiyeva
Is there a recording of the meeting? Kind regards, Arina > On Oct 30, 2018, at 7:19 AM, weijie tong wrote: > > Hi : > Thanks for the invitation. Here is slide: JPPD > > >> On Tue, Oct 30,

Re: Query hung in Cancelled_Requested state

2018-10-26 Thread Arina Yelchiyeva
If query is in cancellation_requested state for days, the only way to kill it to restart the Drillbits. Kind regards, Arina > On Oct 26, 2018, at 10:45 AM, Khurram Faraaz wrote: > > Hi Divya, > > Please see link below for more info, I have added details of how to Cancel > a query using the

Re: Drill UDFs doc

2018-10-11 Thread Arina Yelchiyeva
Build-in functions are located in the java-exec module. Some are generated using freemarker, some are located in the org.apache.drill.exec.store.hive package. Currently to get full list of the UDFs, you need to turn on trace logging and check the logs [1]. The good news, currently Kunal is working

Re: Drill Log file plugin not working in Drill 1.14

2018-10-11 Thread Arina Yelchiyeva
sh to https://drill.apache.org/docs/logfile-plugin/ , there is no > need update the docs? > > Thanks, > Divya > > On Mon, 8 Oct 2018 at 15:40, Arina Yelchiyeva > wrote: > > > Hi Divya, > > > > You can create PR for docs update. Charles and Bridget can review it. > &

Re: Drill Log file plugin not working in Drill 1.14

2018-10-08 Thread Arina Yelchiyeva
Hi Divya, You can create PR for docs update. Charles and Bridget can review it. Example of the PR - https://github.com/apache/drill/pull/1479 Kind regards, Arina > On Oct 8, 2018, at 9:45 AM, Divya Gehlot wrote: > > Thank you so much Paul ! > It

Re: Kafka Plugin in Drill 1.14

2018-10-08 Thread Arina Yelchiyeva
Did you run older Drill versions on Windows before? Bootstap plugins are loaded when there is no stored plugins configs on your environment. Check if you have drill/sys.storage_plugins folder on your system. Location depends on your settings, for Windows in could be in tmp folder on one of your

Re: Possible to limit the amount of files produced by Drill when running CREATE TABLE statements?

2018-09-26 Thread Arina Yelchiyeva
Consider adjusting the following config options [1]: planner.slice_target planner.width.max_per_node planner.width.max_per_query [1] https://drill.apache.org/docs/configuration-options-introduction/ On Wed, Sep 26, 2018 at 4:58 AM Divya Gehlot wrote: > Even I looked for it and I couldn't find

Re: Calcite 1.17

2018-09-24 Thread Arina Yelchiyeva
are present in the new branch. I will test on Drill > master > > and update you. > > > > Regards, > > Rahul > > > > On Tue, Sep 18, 2018 at 4:43 PM Arina Yelchiyeva < > > arina.yelchiy...@gmail.com> wrote: > > > >> For each new DrillCalcite

***UNCHECKED*** Re: trim special character in table column

2018-09-19 Thread Arina Yelchiyeva
Hi Divya, are you trying to replace slash in the middle? ltrim will do the replacement at the begging of the string. If yes, you might new regexp_replace function. select '/abc', ltrim('/abc', '/') from (values(1));

Re: Calcite 1.17

2018-09-18 Thread Arina Yelchiyeva
went through the latest pull requests on DrillCalcite, but could not find > any specific pull requests for upgrading to 1.17. I might have missed > something here. > Could you tell me if there is one? > > Regards, > Rahul > > On Tue, Sep 18, 2018 at 4:10 PM Arina Yelchiyeva <

Re: Calcite 1.17

2018-09-18 Thread Arina Yelchiyeva
Rahul, could you please try on the latest Drill master and check if issue is resolved? Kind regards, Arina On Tue, Sep 18, 2018 at 1:38 PM Arina Yelchiyeva wrote: > Upcoming Drill 1.15 will have Calcite 1.17. > > Kind regards, > Arina > > On Tue, Sep 18, 2018 at 1:25 PM

Re: Calcite 1.17

2018-09-18 Thread Arina Yelchiyeva
Upcoming Drill 1.15 will have Calcite 1.17. Kind regards, Arina On Tue, Sep 18, 2018 at 1:25 PM Rahul Raj wrote: > Hi, > > Are there any plans to merge Calcite 1.17 to Drill? Fix for DRILL-5578 > is available on Calcite > 1.17. > > Regards, >

Re: [IDEAS] Drill start up quotes

2018-09-11 Thread Arina Yelchiyeva
Some quotes ideas: drill never goes out of style everything is easier with drill Kunal, regarding config, sounds reasonable, I'll do that. Kind regards, Arina On Tue, Sep 11, 2018 at 12:17 AM Benedikt Koehler wrote: > You told me to drill sergeant! (Forrest Gump) > > Benedikt > @furukama >

Re: [DISCUSSION] current project state

2018-08-14 Thread Arina Yelchiyeva
1. Regarding Drill metastore, its under investigation, please follow up with DRILL-6552. 2. UDFs: I would not say, it's that quit to write UDFs in Drill. Definitely, it could have been done easier but even for current state we have good manuals. Regarding adding support for different languages

Re: JAVA_HOME on Windows

2018-07-10 Thread Arina Yelchiyeva
Hi Katsuya, Do you have JDK installed? [1] https://drill.apache.org/docs/embedded-mode-prerequisites/ Kind regards, Arina On Tue, Jul 10, 2018 at 6:14 PM Katsuya Horiuchi < katsuya.horiuchi@gmail.com> wrote: > Hello, > > I found this project last week and I would like to use it on

Re: [DISCUSS] case insensitive storage plugin and workspaces names

2018-06-13 Thread Arina Yelchiyeva
> > follow SQL rules and be case insensitive. > > > > I believe that, if we sit down and work out exactly what users would > > expect, and what is required to handle both case sensitive and case > > insensitive names, we'll end up with a solution not far from the above -- >

Re: Hangout tomorrow (get your tickets now)

2018-06-12 Thread Arina Yelchiyeva
You can join the call by the following link: https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc Kind regards, Arina On Tue, Jun 12, 2018 at 7:40 PM Samiksha Kapoor wrote: > Hi Parth, > > I tried to join the call but it was not getting connected. I have issue > regarding drill

Re: [DISCUSS] case insensitive storage plugin and workspaces names

2018-06-12 Thread Arina Yelchiyeva
2]. > > [1] > https://dev.mysql.com/doc/refman/8.0/en/identifier-case-sensitivity.html > [2] > http://www.postgresqlforbeginners.com/2010/11/gotcha-case-sensitivity.html > > > > On Tue, Jun 12, 2018 at 5:01 AM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com>

Re: Hangout tomorrow (get your tickets now)

2018-06-12 Thread Arina Yelchiyeva
I'd like to discuss case insensitive storage plugin and workspaces names (sent the email to the dev & user mailing lists with the details). Kind regards, Arina On Tue, Jun 12, 2018 at 4:07 AM Timothy Farkas wrote: > Hi, > > I'd like to give the presentation for the resource management

[DISCUSS] case insensitive storage plugin and workspaces names

2018-06-12 Thread Arina Yelchiyeva
Hi all, Currently Drill we treat storage plugin names and workspaces as case-sensitive [1]. Names for storage plugins and workspaces are defined by the user. So we allow to create plugin -> DFS and dfs, workspace -> tmp and TMP. I have a suggestion to move to case insensitive approach and won't

Re: Avro storage format behaviour

2018-03-01 Thread Arina Yelchiyeva
As Paul has mentioned in PR [1] when we move to new scan framework it will handle implicit columns for all file readers. I guess till that let's treat avro as other file formats (for example, parquet) so users can benefit from implicit columns for this format as well. [1]

Re: Base64 encoded results for Drill query (>10.000 columns)

2018-02-28 Thread Arina Yelchiyeva
Hi Daniel, not sure if there is another way. Looks like you'll have to use CONVERT_FROM function for each column. Kind regards Arina On Fri, Feb 23, 2018 at 10:56 AM, Daniel Müller < daniel.muel...@hs-offenburg.de> wrote: > Hi there, > > I started working with Drill a few weeks ago and I'm

Re: Drill 1.12 and OpenTSDB

2018-02-01 Thread Arina Yelchiyeva
Hi Sanel, this is a bug. Fix was prepared and will be merged soon into the master. [1] https://issues.apache.org/jira/browse/DRILL-6119 [2] https://github.com/apache/drill/pull/1102 Kind regards Arina On Thu, Feb 1, 2018 at 3:56 PM, Sanel Zukan wrote: > Hi, > > I've noticed

Re: Drill older versions

2017-11-25 Thread Arina Yelchiyeva
Hi Anandhu, you can find it in achieve [1] or build from source. [1] http://archive.apache.org/dist/drill/ Kind regards Arina On Thu, Nov 23, 2017 at 1:19 PM, Anandhu Ajayakumar < aajayaku...@menervasoftware.com> wrote: > Hi, > > I am trying to download drill 1.7.0. > The link in the release

Re: Apache Drill Cookbook

2017-11-04 Thread Arina Yelchiyeva
If I am not mistaken Charles was working on the book... Kind regards Arina On Sat, Nov 4, 2017 at 2:56 AM, Bob Rudis wrote: > From what I recall there was a Drill book in the works but I haven't > seen much on it in over a year. > > On Fri, Nov 3, 2017 at 8:53 PM, Saurabh

Re: Non-ascii characters still fails on Drill 1.11

2017-08-11 Thread Arina Yelchiyeva
Hi Rahul, you need to update system property *saffron.default.charset* to *UTF-16LE*. Kind regards Arina On Fri, Aug 11, 2017 at 9:18 AM, Rahul Raj wrote: > Issue persist even with JDBC driver 1.11.0. > > On Fri, Aug 11, 2017 at 11:35 AM, Rahul Raj

Re: Drill UI (8047) Default User and Password

2017-08-10 Thread Arina Yelchiyeva
Currently if you did not configure authorization, Drill does not require entering login and password. All queries will be run under the user who started the drillbit. On Web UI, user who ran the queries will be shown as anonymous. Though if you did than it would depend on those users whom you have

[ANNOUNCE] Apache Drill 1.11.0 Released

2017-07-31 Thread Arina Yelchiyeva
On behalf of the Apache Drill community, I am happy to announce the release of Apache Drill 1.11.0. For information about Apache Drill, and to get involved, visit the project website [1]. This release of Drill provides the following new features and improvements [2]: Cryptography-related

[RESULT] [VOTE] Release Apache Drill 1.11.0 rc0

2017-07-28 Thread Arina Yelchiyeva
The vote passes. Thanks to everyone who has tested the release candidate and given their comments and votes. Final tally: 3x +1 (binding): Parth, Jinfeng, Aman 6x +1 (non-binding): Arina, Kunal, Padma, Abhishek, Sorabh, Khurram No 0s or -1s. I'll start the process for pushing the release

Re: created parquet table using with partition ddint create the partition directories

2017-07-28 Thread Arina Yelchiyeva
Hi Divya, this is the expected behavior [1]: The output of CTAS using a PARTITION BY clause creates separate files. Each >> file contains one partition value, and Drill can create multiple files for >> the same partition value. > > Partition pruning uses the Parquet column statistics to

Re: [HANGOUT] Topics for 7/25/17

2017-07-25 Thread Arina Yelchiyeva
u all for attending the hangout today. Kind regards Arina On Tue, Jul 25, 2017 at 8:04 PM, Arina Yelchiyeva < arina.yelchiy...@gmail.com> wrote: > Hangouts is starting now... > > On Tue, Jul 25, 2017 at 7:41 AM, Padma Penumarthy <ppenumar...@mapr.com> > wrote: > >> I

[HANGOUT] Topics for 7/25/17

2017-07-24 Thread Arina Yelchiyeva
Hi all, We'll have the hangout tomorrow at the usual time [1]. Any topics to be discussed? [1] https://drill.apache.org/community-resources/ Kind regards Arina

Re: unable to read text file on windows embedded mode

2017-07-21 Thread Arina Yelchiyeva
Hi Divya, the reason Drill does not see .txt file is that it is not defined in storage plugin (dfs) formats. You can add new format to the storage plugin using Web UI or use table function [1]. [1] https://drill.apache.org/docs/plugin-configuration-basics/ Kind regards Arina On Fri, Jul 21,

Re: Running drill on Windows

2017-07-20 Thread Arina Yelchiyeva
e on Windows, unless someone > volunteers to certify Drill on the platform. > > On Wed, Jul 19, 2017 at 10:19 AM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > > > Having JAVA_HOME without spaces is general requirement for installation > on > > Windows. >

Re: Running drill on Windows

2017-07-19 Thread Arina Yelchiyeva
ction > as expected (provided run under cygwin env)? We could then document this. > > -Abhishek > > > On Wed, Jul 19, 2017 at 2:35 AM Arina Yelchiyeva < > arina.yelchiy...@gmail.com> > wrote: > > > Hi, > > > > it might be that the problem is that you

Re: Running drill on Windows

2017-07-19 Thread Arina Yelchiyeva
Hi, it might be that the problem is that your JAVA_HOME contains spaces. Discussed in DRILL-5280. Posted detailed answer on stackoverflow as well. Kind regards Arina On Tue, Jul 18, 2017 at 1:11 PM, Med Dhaker Abdeljawed < med.dhaker.abdelja...@gmail.com> wrote: > 1down votefavorite >

Re: CP storage plugin files listing

2017-07-18 Thread Arina Yelchiyeva
I don't think currently it is possible. For cp files Drill uses ClassPathFileSystem where listStatus method is unsupported [1]. [1] https://github.com/arina-ielchiieva/drill/blob/master/exec/java-exec/src/main/java/org/apache/drill/exec/store/ClassPathFileSystem.java#L103 Kind regards Arina On

Re: Windows system Initiation Error

2017-04-19 Thread Arina Yelchiyeva
t for the help :). > Thanks and Regards, > Vignesh K > > On Tue, Apr 18, 2017 at 8:17 PM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > >> Initially, for local udf pah Drill uses DRILL_TMP_DIR >> + drill.exec.udf.directory.local and only if DRILL_TMP_DIR

Re: Windows system Initiation Error

2017-04-18 Thread Arina Yelchiyeva
ta\Local\Temp;C:\ > Python27;\drill\udf\udf\local] > must exist > > Thanks and Regards, > Vignesh K > > On Tue, Apr 18, 2017 at 7:16 PM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > > > Local UDF directory is created from: Dril

Re: Windows system Initiation Error

2017-04-18 Thread Arina Yelchiyeva
fn.FunctionImplementationRegistry.( > FunctionImplementationRegistry.java:127) > at > org.apache.drill.exec.server.DrillbitContext.( > DrillbitContext.java:95) > at > org.apache.drill.exec.work.WorkManager.start(WorkManager.java:106) > at > org.apache.dri

Re: Windows system Initiation Error

2017-04-18 Thread Arina Yelchiyeva
Hi Vignesh, In previous email thread David suggested to change: udf.directory.root: "/C:/Temp/" /C:/Temp/ is syntax that can be used on Windows [1]. Can you please try this variant? [1] https://drill.apache.org/docs/dynamic-udfs/ Kind regards Arina On Tue, Apr 18, 2017 at 3:04 PM, Vignesh

Re: Temporary table issue

2017-04-07 Thread Arina Yelchiyeva
t can work like this also. > > But how to use it with Java collection, Array List which has records > ranging from 5000 - 100,000. > For every different hit, I will be creating a different temporary table. > > > Regards, > Jasbir Singh > > -Original Message- &

Re: Temporary table issue

2017-04-05 Thread Arina Yelchiyeva
HI Jasbir, may be union all and values(1) can help you. Example: create temporary table t1 as select i1, i2 from ( select 0 as i1, 5 as i2 from (values(1)) union all select 5 as i1, 10 as i2 from (values(1))); Kind regards Arina On Wed, Apr 5, 2017 at 7:31 PM,

Re: Wrong alias name in Window function

2017-03-31 Thread Arina Yelchiyeva
pache.drill.exec.planner.sql.DrillSqlWorker.getQueryPlan():131 > org.apache.drill.exec.planner.sql.DrillSqlWorker.getPlan():79 > org.apache.drill.exec.work.foreman.Foreman.runSQL():1050 > org.apache.drill.exec.work.foreman.Foreman.run():281 > java.util.concurrent.ThreadPoolExecut

Re: Wrong alias name in Window function

2017-03-28 Thread Arina Yelchiyeva
( DYNAMIC_SCHEMA_2.date_id >= 2015021100 AND > DYNAMIC_SCHEMA_2.date_id <= 2017031223 ) > > On Tue, Mar 28, 2017 at 12:40 PM Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > > > Hi Amir, > > > > Which version of Drill are you using? > &g

Re: Wrong alias name in Window function

2017-03-28 Thread Arina Yelchiyeva
Hi Amir, Which version of Drill are you using? I have tried to reproduce the issue in embedded mode and in also using jdbc but no luck. Kind regards Arina On Tue, Mar 28, 2017 at 10:25 AM, Amir Kafri wrote: > Hi All, > > I think I've encountered a bug: > > I'm running the

Re: How to avoid case sensitivity in group by

2017-02-08 Thread Arina Yelchiyeva
You can wrap state column in upper / lower function prior to count. Kind regards Arina On Wed, Feb 8, 2017 at 1:45 PM, Sanjiv Kumar wrote: > Drill Environment:- OS:- Window 10 >Version:- 1.9 >Mode:- embedded mode > > I have a column

Re: Drill contribution guidelines

2017-01-30 Thread Arina Yelchiyeva
Hi Rahul, 1. Create fork from https://github.com/apache/drill/ 2. Create branch with your Jira number in your mirrored repository (ex: DRILL-1234) 3. Once changes are ready (preferable in one commit), create pull request against https://github.com/apache/drill/ 4. Mention the Jira number in the

Re: How to create a UDF with variable length parameters ?

2017-01-17 Thread Arina Yelchiyeva
You can create several functions with the same name but with different parameters types and / or quantity. Example: *bool_or* [1] function can have different input parameter: BitHolder or NullableBitHolder *maxdir* [2] can have one or two input parameters (but code is in template you have to

Re: Regarding Drill Select query

2017-01-17 Thread Arina Yelchiyeva
I am not quite sure why name column from your db is not returning results. I see you created Jira that this column returns empty result using REST API. When I join two tables where one of them has name column I don't have problems you are describing. On Tue, Jan 17, 2017 at 4:37 PM, Sanjiv Kumar

Re: Regarding Drill Select query

2017-01-17 Thread Arina Yelchiyeva
No, analytical functions do not require group by. On Tue, Jan 17, 2017 at 3:41 PM, Sanjiv Kumar wrote: > Hello Arina > I have used same name as in my db table, but still name > showing null.. > > NOTE:- One more thing i have to mention if i group by all the

Re: Regarding Drill Select query

2017-01-17 Thread Arina Yelchiyeva
Issue you are describing is not connected with analytic function. T3.Name is showing since blank since Drill couldn't find such column. Please use case indicated in your table, for example, T3.`name` AS `Name`. Kind regards Arina On Tue, Jan 17, 2017 at 2:42 PM, Sanjiv Kumar

Re: Regarding Drill Select query

2017-01-17 Thread Arina Yelchiyeva
Hi Sanjiv, you can use analytic function: *select id, name, salary, count(1) over() as cnt from t* or even *select *, count(1) over() as cnt from t* You can you star instead of 1 as well (*select *, count(*) over() as cnt from t*) Kind regards Arina On Tue, Jan 17, 2017 at 1:36 PM, Sanjiv

Re: NPE on Select with Options on CSV File

2016-12-28 Thread Arina Yelchiyeva
Hi John, I don' think problem is in your data. I guess the problem in select with options. I managed to reproduce similar error locally by querying two csv files: First file (2 records): key_header, value_header key_1,value_1 Second file (50 records): key_header, value_header key_1,value_1

Apache Drill Hangout Minutes - 12/27/16

2016-12-27 Thread Arina Yelchiyeva
Attendees: John, Vitalli, Roman, Serhii, Arina 1) John: email with NPE during select text file with options (email to user list from Dec 8). It's hard to tell from error what is the reason of the failure. Probably data set is needed to find the root cause. 2) Arina: when in storage plugin is

Re: [HANGOUT] Suggestions for topics for 27/12

2016-12-27 Thread Arina Yelchiyeva
Handout is starting now. On Mon, Dec 26, 2016 at 1:23 PM, Arina Yelchiyeva < arina.yelchiy...@gmail.com> wrote: > Hi all, > > The bi-weekly hangout is tomorrow (27/12/16, 10 AM PST). If you have any > suggestions > for topics for tomorrow, please add to this thr

[HANGOUT] Suggestions for topics for 27/12

2016-12-26 Thread Arina Yelchiyeva
Hi all, The bi-weekly hangout is tomorrow (27/12/16, 10 AM PST). If you have any suggestions for topics for tomorrow, please add to this thread. We will also ask for topics at the beginning of the hangout. Hangout link: *https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc

Re: Implicit file columns

2016-12-12 Thread Arina Yelchiyeva
Rahul > > On Mon, Dec 12, 2016 at 7:58 PM, Arina Yelchiyeva < > arina.yelchiy...@gmail.com> wrote: > > > Hi Rahul, > > > > I guess you are querying data using Jdbc plugin, if yes, then it is a bug > > (please see https://issues.apache.org/jira/browse/DRILL

Re: Implicit file columns

2016-12-12 Thread Arina Yelchiyeva
Hi Rahul, I guess you are querying data using Jdbc plugin, if yes, then it is a bug (please see https://issues.apache.org/jira/browse/DRILL-4903). Other than that case, as far as I know, Drill doesn't return implicit columns in select star query. I am not sure if there is a way to disable it

Re: Drill 1.9.0 - Embedded mode doesn't work on Windows

2016-12-05 Thread Arina Yelchiyeva
Well, I would not say it's a exactly a glitch :) If drill.exec.udf.directory.root (not drill.udf.directory.root, exec is missing) is not set, drill creates udf directories (staging, registry, tmp) in user home. Usually user has write permissions in it's home directory (it works fine on my

Re: Need help with UDF/Custom Functions (DRILL-4776)

2016-11-20 Thread Arina Yelchiyeva
nput.start, input.end, input.buffer); > > > >HashCode hashCode = hashFunction.hashString(stringValue, > > StandardCharsets.UTF_8);//hashFunction.hashString(stringValue); > > > >String outputValue = hashCode.toString(); > > > >// put the output value in t

  1   2   >