Re: Apache Drill 1.10.0 - Issue with combination of Like operator & newline (\n) character in data

7, 2019 at 5:03 PM Arina Yelchiyeva wrote: > Hi Shankar, > > To verify behavior on the latest Drill version, you can download Drill > from here https://drill.apache.org/download/ < > https://drill.apache.org/download/>. > > Kind regards, > Arina > > >

Apache Drill 1.10.0 - Issue with combination of Like operator & newline (\n) character in data

Hi All, I am facing some issues while using Like operator & newline (\n) character. Below is the in details description : *-- Hive Queries * create table default.withdraw( id string )

Re: QUESTION: Drill Configuration to access S3 buckets

aws new regions uses only signature version 4 protocol for S3. Other regions has both V2 and V4 compatible. Drill works very well if regions has both signature versions. By adding endpoints, same problem persists. May be Drill API doesn't have support to V4 protocol yet. This V4 problems is also

Does s3 plugin support AWS S3 signature version 4 ?

Quick question here: Does s3 plugin support S3 signature version 4 ? FYI: s3 plugin works in case when region has support for both v2 and v4 signature. Whereas it seems problematic, for regions (eg. ap-south-1) which only has v4 signature version support. regards, shankar

Re: Hangout starting at 10am PST

Quick question here: Does s3 plugin support S3 signature version 4 ? FYI: s3 plugin works when region which has support for both v2 and v4 signature. Whereas it seems problematic, when new regions (eg. ap-south-1) which only has v4 signature version. On Tue, Apr 4, 2017 at 10:28 PM, Aman Sinha

Re: [HANGOUT] Topics for 2017-02-21

any plans to support Hive 2.x line? On 21-Feb-2017 12:40 AM, "Paul Rogers" wrote: > Hi All, > > Our bi-weekly hangout is tomorrow (2017-02-21, 10 AM PT). Please respond > with suggested topics. We will also ask for additional topics at the > beginning of the hangout. > > One

RE: Query on performance using Drill and Amazon s3.

1. how much memory have u configured for drill? 2. what about network bandwidth between your s3 and cluster? On 20-Feb-2017 8:14 PM, "Nitin Pawar" wrote: > Hi chetan, > > Projjwal has the issue. Me too asked the same question > > On Feb 20, 2017 7:56 PM, "Chetan

[Drill-Issues] Drill-1.6.0: CTAS - No table found in case select returns empty set.

Is there any configuration to do, To force create table even when SELECT statement return empty data ? 0: jdbc:drill:> create table glv_abcookie_min_newsid as . . . . . . . > select . . . . . . . > app_sessionid, . . . . . . . > new_sessionid, . . . . . . . > min(serverTime) as min_serverTime .

Re: [Drill-Questions] Speed difference between GZ and BZ2

to twelve times > slower than decompressing gzip compressed files. > You can look at the comparison benchmark here for numbers - > http://tukaani.org/lzma/benchmarks.html > > On Thu, Aug 4, 2016 at 5:13 PM, Shankar Mane <shankar.m...@games24x7.com> > wrote: > > > Ple

Re: [Drill-Questions] Speed difference between GZ and BZ2

quot;selectionRoot" : "hdfs://namenode:9000/tmp/stest-bz2/kafka_3_25-Jul-2016-12a.json.bz2", "cost" : 1148224.0 }, { "pop" : "hash-aggregate", "@id" : 196610, "child" : 196611, "cardinality" : 1.0, &

[Drill-Issues] Drill-1.6.0: Drillbit not starting

I am getting this error infrequently. Most of the time drill starts normally and sometimes this gives below error. I am running drill 1.6.0 in cluster mode. ZK has also setup. Could some one please explain where the issue is ? 2016-08-04 03:45:15,870 [main] INFO

Re: Partition reading problem (like operator) while using hive partition table in drill

Excellent.. n thanks !! Yes will try n update here. On 03-Aug-2016 11:08 PM, "rahul challapalli" <challapallira...@gmail.com> wrote: DRILL-4665 has been fixed. Can you try it out with the latest master and see if it works for you now? - Rahul On Wed, Aug 3, 2016 at 10:28

Re: Partition reading problem (like operator) while using hive partition table in drill

laine > > On Tue, May 31, 2016 at 10:33 PM, Shankar Mane <shankar.m...@games24x7.com > > > wrote: > > > I didn't get any response or updates on this jira ticket ( DRILL-4665). > > > > Does anyone looking into this? > > On 11 May 2016 03:31, "Aman S

Re: [Drill-Questions] Speed difference between GZ and BZ2

> What is the data format within those .gz and .bz2 files ? It is parquet or > JSON or plain text (CSV) ? > Also, what was this config parameter `store.parquet.compression` set to, > when ypu ran your test ? > > - Khurram > > On Sun, Jul 31, 2016 at 11:17 PM, Shankar Ma

Re: CHAR data type

It is being supported since 1.7.0. Please check this link https://drill.apache.org/docs/apache-drill-1-7-0-release-notes/ On 04-Jul-2016 8:07 PM, "Santosh Kulkarni" wrote: Hello, While running another simple query for select count(*) from table_name, Drill gave an

Re: Partition reading problem (like operator) while using hive partition table in drill

tables and it works for LIKE conditions. Not sure yet > > about Hive tables. Could you pls file a JIRA and we'll follow up. > > Thanks. > > > > -Aman > > > > On Tue, May 10, 2016 at 1:09 AM, Shankar Mane < > shankar.m...@games24x7.com> > >

Partition reading problem (like operator) while using hive partition table in drill

Problem: 1. In drill, we are using hive partition table. But explain plan (same query) for like and = operator differs and used all partitions in case of like operator. 2. If you see below drill explain plans: Like operator uses *all* partitions where = operator uses *only* partition filtered by

Re: Drill (CTAS) Default hadoop Replication factor on HDFS ?

replication factor setting inside your > > cluster hdfs-site.xml, it might be worth a try to copy this config file > > into your Drill conf directory (on all nodes). While I haven't tried this > > myself, i'm hoping this could help. > > > > -Abhishek > > > > On F

Drill (CTAS) Default hadoop Replication factor on HDFS ?

We have hadoop cluster where default replication factor (dfs.replication) is set to 1 ( this cluster is just plug and play, hence we don't need to store more than 1 copies). When we used drill *CTAS*, it has created table on *HDFS* with their own *replication factor of 3. * *Questions are *- 1.

Questions on Drill custom UDF (getBrowserDetails**) when using external xml files

*Info - * -- ** We have developed custom UDF named *getBrowserDetails *which returns json string. -- We used this UDF to extract *User-Agent* Info like Browser Name, Browser version, OS name, OS version etc. -- And this UDF uses *Wurfl *Java API which can be found @

NullPointerException while reading Hive table data in drill 1.6.0

Need help to solved below issue: *I am using :* hive 1.2.1 drilll 1.6.0 *What i am doing : * 1. table is created in hive and data stored as parquet (this table is partitioned on column "log_date". Data size is around 15GB (parquet-Gzip) 2. And used hive storage plugin in drill to read the data.

Re: Error parsing JSON (drill 1.6.0)

n one instead. And since you mention queries without CTAS works fine, can you create views instead and query that (I tried this and it works fine)? On Fri, Mar 18, 2016 at 1:29 PM, Shankar Mane <shankar.m...@games24x7.com> wrote: > @Abhishek: > > Some events in 150 gb json file

Re: unable to start Drill 1.6.0

ge plugin is to delete the > existing configurations. Deleting /tmp/drill/ should resolve this. > > I know this may not be practical in some cases, and other developers may > give you a better solution. > > On Thu, Mar 17, 2016 at 2:13 PM, Shankar Mane <shankar.m...@games24x7.co

Error parsing JSON (drill 1.6.0)

Guys, 1. I am stuck in the middle of somewhere. Could you please help me to resolve below error. 2. I am running query on drill 1.6.0 in cluster on logs json data (150GB size of log file) ( 1 json / line). I have just extract 3 lines from logs for test purpose. please find those

Re: unable to start Drill 1.6.0

only append your special packages like this: > > drill.classpath.scanning.package+= "com.companynanme.drill" > > -- > Jacques Nadeau > CTO and Co-Founder, Dremio > > On Thu, Ma

unable to start Drill 1.6.0

I am not able to start drill 1.6.0. Please find the attached file for more details.

Re: unable to start Drill 1.6.0

readMapAndClose(ObjectMapper.java:3788) at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:2779) at org.apache.drill.exec.store.StoragePluginRegistryImpl.createPlugins(StoragePluginRegistryImpl.java:144) ... 5 more On Thu, Mar 17, 2016 at 6:38 PM, Shankar Mane <shankar.m...@games24x7.com> wrote: > *drillbit.out =>* > &

Re: Error parsing JSON (drill 1.6.0)

--------+---+---+ > > 3 rows selected (0.36 seconds) > > > Regards, > Abhishek > > On Fri, Mar 18, 2016 at 12:02 PM, Shankar Mane <shankar.m...@games24x7.com > > > wrote: > > > Guys, &g