Re: Does drill support variable arguments in customer UDAF

2020-11-22 Thread Vova Vysotskyi
Hi, Yes, it was implemented for both, UDF and UDAF. Please take a look at these examples of UADF var arg functions: https://github.com/apache/drill/blob/master/exec/java-exec/src/test/java/org/apache/drill/exec/fn/impl/testing/CountArgumentsAggFunctions.java On 2020/10/28 19:34:25, Paul Rogers

Re: drill about hbase 2.x support

2020-05-15 Thread Vova Vysotskyi
Hello, Drill supports HBase 2.X version starting from the 1.15 version. It was updated in the scope of DRILL-6349. Kind regards, Volodymyr Vysotskyi On Fri, May 15, 2020 at 10:09 AM 陈炳新 wrote: > hello: > Apache drill has been used for more than a year, and it is quite > good in our

Re: DRILL-7671: Verify Drill with cdh and hdp profiles

2020-04-03 Thread Vova Vysotskyi
Hi all, Looks like no one found any issues. I'll proceed with creating a pull request in this case. Kind regards, Volodymyr Vysotskyi On Wed, Apr 1, 2020 at 8:35 PM Vova Vysotskyi wrote: > Hi all, > > Some time ago I have noticed that Apache Drill has *cdh* and *hdp* &

DRILL-7671: Verify Drill with cdh and hdp profiles

2020-04-01 Thread Vova Vysotskyi
Hi all, Some time ago I have noticed that Apache Drill has *cdh* and *hdp* profiles, but it is unable to build when any of them is enabled. I have created DRILL-7671 to fix it. One of the major unresolved issues I faced up with is verification

Re: Drill + parquet

2020-02-06 Thread Vova Vysotskyi
Hi Vishal, Pull request with the fix for DRILL-5733 is opened and will be merged soon. Kind regards, Volodymyr Vysotskyi On Tue, Feb 4, 2020 at 11:11 PM Vishal Jadhav (BLOOMBERG/ 731 LEX) < vjad...@bloomberg.net> wrote: > It works fine on my

Re: 1.17.0 updated protobuf but mapr ODBC drivers have not been updated

2020-01-13 Thread Vova Vysotskyi
Hi Bob, Could you please create Jira and share more details on how to reproduce this issue, so QA will be able to verify that it was fixed on a newer version of the Driver. Kind regards, Volodymyr Vysotskyi On Mon, Jan 13, 2020 at 8:16 PM Bob Rudis wrote: > HNY folks, > > This is more of an

Re: Drill Hangout

2020-01-13 Thread Vova Vysotskyi
Hi Charles, I wouldn't be able to join Drill Hangouts during this week. Kind regards, Volodymyr Vysotskyi On Mon, Jan 13, 2020 at 4:26 PM Charles Givre wrote: > Hello Drill Community, > I'd like to propose a reinstitution of Drill Hangouts, perhaps every other > week. Given that the bulk of

Re: Querying CockroachDB from Apache Drill

2020-01-08 Thread Vova Vysotskyi
Hi Marc, I haven't tried querying CockroachDB but if the driver is the same as the Postgres one, or suitable with JDBC spec, Drill should be able to query it. For the instructions on how to configure it, please refer to https://drill.apache.org/docs/rdbms-storage-plugin/. Kind regards, Volodymyr

Re: [ANNOUNCE] New Committer: Denys Ordynskiy

2019-12-30 Thread Vova Vysotskyi
Congrats Denys, well deserved! Kind regards, Volodymyr Vysotskyi On Mon, Dec 30, 2019 at 2:25 PM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Denys > Ordynskiy to become a committer, and we are pleased to announce that he has > accepted. > >

Re: How to force Drill to offload performing LIMIT onto the target storage?

2019-12-18 Thread Vova Vysotskyi
9 at 8:09 PM Andrew Pashkin wrote: > You are right! Group by is being pushed to the storage if I remove > TO_DATE(). Does it happen with all functions or only with some (perhaps > the ones that are not in the SQL standard)? > > On 18.12.19 20:08, Vova Vysotskyi wrote: > > Hi An

Re: How to force Drill to offload performing LIMIT onto the target storage?

2019-12-18 Thread Vova Vysotskyi
Hi Andrew, Drill in general case pushes aggregations into the JDBC storage, but Drill doesn't push functions into JDBC storage since some databases may not have specific function implementations. In the plan, you have provided, the grouping is produced on top of TO_DATE() function call. If it is

Re: Optional fields in Avro files.

2019-10-09 Thread Vova Vysotskyi
Hi Dan, Thanks for bringing up this question. Such behavior was intentional since Avro files already have schema and Drill is able to use it during queries validation. It was done in the scope of DRILL-3810 . We have similar behavior for Hive

Re: java.lang.OutOfMemoryError: GC overhead limit exceeded

2019-09-11 Thread Vova Vysotskyi
Hi Jiang, Thanks for catching this issue. It was caused by the fix for DRILL-6524 , and this additional structure is required to control method execution flow to be able to do some useful things. I have created DRILL-7372

Re: Blocker on drill upgrade path

2019-04-22 Thread Vova Vysotskyi
Hi Nitin, This behavior to allow aliases in a group by clause is driven by Calcite and commonly used in other projects. I think the workaround proposed by Aman is the best solution for this problem, since for example if you have several aggregate functions in the project for the same columns, it

Re: Newbie: problem launching Drill 1.15.0 on Windows

2019-02-05 Thread Vova Vysotskyi
Hi, Please remove *$HOME/sqlline/history* file and try starting Drill again. Kind regards, Volodymyr Vysotskyi On Tue, Feb 5, 2019 at 7:34 PM Leyne, Sean wrote: > All, > > I am getting an error trying to open drill on Windows 10 (from an Admin > instance of CMD.exe) using the instructions

Re: to_date() string to date conversion ERROR

2018-10-03 Thread Vova Vysotskyi
Hello Herman, I tried to reproduce this error, but all queries passed on my machine. Could you please add more details about your env? Which version of Drill is used, which timezone is set? Is it reproduced with UTC timezone? Kind regards, Volodymyr Vysotskyi On Mon, Oct 1, 2018 at 10:58 AM

Re: [ANNOUNCE] New Committer: Chunhui Shi

2018-09-28 Thread Vova Vysotskyi
Congratulations! Well deserved! Kind regards, Volodymyr Vysotskyi On Fri, Sep 28, 2018 at 12:17 PM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Chunhui > Shi to become a committer, and we are pleased to announce that he has > accepted. > >

Re: [IDEAS] Drill start up quotes

2018-09-12 Thread Vova Vysotskyi
Two things are infinite: the universe and drill; and I'm not sure about the universe. (Albert Einstein) If drill hasn't profoundly shocked you, you haven't understood it yet. (Niels Bohr) Drill gives you meaning and purpose, and life is empty without it. (Stephen Hawking) Drill must go on. (Queen)

Re: Apache Drill Automatically Converts Large Numbers to Exponents

2018-05-08 Thread Vova Vysotskyi
Hi Peter, If the problem is only with displaying the numbers, you may convert it to the string with the specified format using TO_CHAR(expression, format) UDF. For more details please see https://drill.apache.org/docs/data-type-conversion/#other-data-type-conversions Kind regards, Volodymyr

Re: Exception While Querying Decimal Fields in Apache Drill

2018-04-30 Thread Vova Vysotskyi
Thanks for the stack trace, it helped to find the root cause of this problem. Decimal values in parquet table are stored using BINARY primitive type, but currently, Drill does not support decimals stored as binary. The good news is that it will be fixed in DRILL-6094. Kind regards, Volodymyr

Re: Exception While Querying Decimal Fields in Apache Drill

2018-04-30 Thread Vova Vysotskyi
MapR][DrillJDBCDriver](500165) Query execution error. Details: SYSTEM > ERROR: ClassCastException: > org.apache.drill.exec.vector.NullableDecimal28SparseVector cannot be cast > to org.apache.drill.exec.vector.VariableWidthVector > Fragment 2:18 > [Error Id: dba9df08-fb1d-4bd2-93e6-d08fb6f79ff1 on > BGDTEST3.INTERSWITCH.COM:3

Re: Exception While Querying Decimal Fields in Apache Drill

2018-04-27 Thread Vova Vysotskyi
Hi Peter, Could you please also share a stacktrace? Does the specified table contain pan, terminal_id, source_node_name, tran_completed, tran_reversed and tran_type columns? If it contains them, which types do they have? Kind regards, Volodymyr Vysotskyi пт, 27 квіт. 2018 о 17:47 Peter Edike

Avro storage format behaviour

2018-02-28 Thread Vova Vysotskyi
Hi all, I am working on DRILL-4120: dir0 does not work when the directory structure contains Avro files. In DRILL-3810 was added validation of query using avro schema before start executing the query. Therefore with these changes Drill throws an exception when the query contains non-existent

Re: Decimal Support Target Date & Workarounds?

2018-02-06 Thread Vova Vysotskyi
we talking about drill-bits actually crashing, or decimal > related queries just throwing normal exceptions/errors? > > -----Original Message- > From: Vova Vysotskyi [mailto:vvo...@gmail.com] > Sent: Tuesday, February 06, 2018 5:24 AM > To: user@drill.apache.org > Subject: Re: D

Re: Decimal Support Target Date & Workarounds?

2018-02-06 Thread Vova Vysotskyi
Hi John, Enabling decimal support does not make drill unstable if decimal types do not process. Problems may appear only when you trying to use decimal columns or some problematic decimal UDFs. Currently, we are actively working on completing decimal support and I suppose it will be available in

Re: Invalid storage plugin name

2018-02-05 Thread Vova Vysotskyi
Hi Flavio, Default identifier quotes[1] should be used to avoid this error: SELECT * from `mysql-test`.mydb.mytable Also, you may configure the type of identifier quotes as described in[1]. [1] https://drill.apache.org/docs/lexical-structure/#identifier-quotes 2018-02-05 11:11 GMT+02:00 Flavio

Re: Issue with time zone

2017-12-14 Thread Vova Vysotskyi
Hi Kostyantyn, I just checked this issue: 1) With timezone America/New_York query fails as it was described: 0: jdbc:drill:zk=local> select to_timestamp('2015-03-08 02:58:51','-MM-dd HH:mm:ss') from sys.version; Error: SYSTEM ERROR: IllegalInstantException: Cannot parse "2015-03-08 02:58:51":

Re: Illegal Argument Exception while convert unix date format to drill timestamp

2017-12-14 Thread Vova Vysotskyi
Hi Divya, Default timestamp format for Drill is '-MM-DD HH:MI:SS'. For the cases, when you want to get a timestamp from a string with another format, date pattern should be specified. Drill allows using both Jodatime patterns (to_date, to_time, to_timestamp functions, see allowed patterns at

Re: Querying Data with period in name

2017-08-11 Thread Vova Vysotskyi
Hi John, Fix for the DRILL-4264 should solve this issue. This error appears when you try to do *select **. But while DRILL-4264 is not fixed, you can try to do *select `**id.orig_h`*. It should