Re: [ANNOUNCE] New Committer: Denys Ordynskiy

Congratulations, Denys! ~ Kunal On Wed, Jan 1, 2020 at 12:19 AM Pritesh Maker wrote: > Congrats, Denys! > > Pritesh > > > From: Igor Guzenko > Sent: Tuesday, December 31, 2019 2:39 PM > To: dev > Cc: user > Subject: Re: [ANNOUNCE] New Committer: Denys

Re: [ANNOUNCE] New PMC Chair of Apache Drill

Congratulations, Charles!

Re: [ANNOUNCE] New Committer: Anton Gozhyi

Congratulations, Anton!! Very well deserved! On 7/29/2019 9:11:30 AM, Vitalii Diravka wrote: My congratulations Anton! You deserved it! Kind regards Vitalii On Mon, Jul 29, 2019 at 1:13 PM Arina Ielchiieva wrote: > Congratulations Anton! Thanks for your contributions. > > Kind regards, >

Re: [ANNOUNCE] New Committer: Igor Guzenko

Congratulations, Igor! On Tue, Jul 23, 2019, 8:13 AM Aman Sinha wrote: > Congratulations Igor and thanks for your contributions to Drill ! > > On Tue, Jul 23, 2019 at 3:33 AM Anton Gozhiy wrote: > > > Congratulations Igor, well deserved! > > > > On Tue, Jul 23, 2019, 12:31 Volodymyr Vysotskyi

Re: [ANNOUNCE] New Committer: Bohdan Kazydub

Congratulations, Bohdan! On 7/16/2019 2:21:14 PM, Robert Hou wrote: Congratulations, Bohdan. Thanks for contributing to Drill! --Robert On Tue, Jul 16, 2019 at 11:50 AM hanu mapr wrote: > Congratulations Bohdan! > > On Tue, Jul 16, 2019 at 9:30 AM Gautam Parai wrote: > > > Congratulations

Re: Heap memory - leak

Yes. The reason is that "0% of 0GB" basically means 0% of the maximum direct memory claimed so far.  Drill will consume some system memory for use in Direct and can (potentially) return it as well. In your case, the Direct memory appears to be barely used. So, it is very likely that the

Re: Schema support in storage and format plugins

Hi Paul Adding this to the user mailing list as well, to broaden the reach of this thread. ~ Kunal On 5/27/2019 6:23:50 PM, Paul Rogers wrote: Hi All, Drill 1.16 introduced the the "provided schema" mechanism to help you query the kind of messy files found in the real world. Arina and

Re: Superset and Drill

Fantastic work! I'll try to promote this on the twitter handle as well. Thank you!  ~ Kunal On 6/2/2019 7:34:48 AM, Charles Givre wrote: Hello Everyone, I wanted to send this note to the Drill aliases but as of this weekend, the Drill integration with Superset is complete and merged. If you

Drill Meetup @ Santa Clara (Wednesday)

Hi everyone As some of you know, we have a Drill Meetup in MapR's headquarters at Santa Clara, CA. Here is the link to the sign up sheet: https://www.meetup.com/Bay-Area-Apache-Drill-User-Group/events/260840985/ Folks from Alibaba will be presenting how they are leveraging Drill on top of large

Re: image

Hi The mailing list does not allow you to send image attachments. Can you share your issue (preferably) in English? Thanks Kunal On 5/15/2019 10:00:14 PM, 高 wrote: 您好，DRILL团队     我在使用drill发现了两个问题，如下：                    

Re: Serious performance problem in ctas json to parquet writing

Hi Mehran What does the full plan look like?You seem to be missing the SCAN operator. Can you post the plans for 1.13 as well? It isn't clear from the table if there is indeed a problem, since you've not shared the query that created this plan. Also, there have been changes gone in, such as

Re: [VOTE] Apache Drill Release 1.16.0 - RC2

Ran manual tests with random queries, trying out the UI and running joins on small tables.  HOCON export of storage plugins does not actually export in HOCON format, but that is not a blocker. +1 (binding) ~ Kunal  On 4/30/2019 4:53:48 AM, Arina Yelchiyeva wrote: Downloaded binary tarball

Re: Struggling with mssql schema names

Did you try using the accent quotes/back ticks (on the top left neighbouring the TAB key) to enclose the schema and table names?  You might have to experiment with something like `ABC.PQR`.`XYZ` or `ABC`.`PQR.XYZ`. This is how it is done for resolving paths across, so it shoudl work the same

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

eys > > as well) was marked as "interesting"; but this may be "by design", as > > the refresh granularity is the whole column. > > > > Also noticed the sys.version issue (DRILL-7208 > > ) - should be minor as > > only affecting users of t

Re: [VOTE] Apache Drill Release 1.16.0 - RC1

Downloaded the tarball and tried it in embedded mode.  Ran simple join queries and interacted with the WebUI.  Issues confirmed were DRILL-7192 and DRILL-7203.  I'm unable to repro DRILL-7201 and DRILL-7202, though I have a fix for the latter. Will work with Arina to identify repro steps. None

RE: Strange join table criteria in apache drill

(Adding this to the user mailing list for future reference and see if anyone else has alternative solutions) Hi Charles What you pointed out is the same issue as the mail I shared regarding the GROUP BY clause. There seems to be a limitation in the Calcite planner w.r.t. the JDBC storage

Re: Blocker on drill upgrade path

(Replying on the Drill user list)  This is odd. The CP storage plugin is inbuilt with Drill and that hasn't changed. 1.15 by itself works fine.  What is the error you are seeing, Nitin?  On 4/18/2019 10:58:48 PM, Nitin Pawar wrote: Hi, We are trying to upgrade drill from 1.13 to 1.15

Re: Drill for Data Virtualization

! > Best, > Sarnath > > On Fri, Apr 12, 2019, 02:28 Kunal Khatua wrote: > >> On 4/11/2019 12:39:24 PM, Sarnath K wrote: >> Thank you Kunal. >> >> >>>You could try creating views for each source and then doing a group by >> on the union of those

Re: Drill for Data Virtualization

statement for that particular sourceAnd we try to union them and group again...This way, explicitly making up the Query do the pushdown That's the idea you are referring to. Right!?? Kunal Khatua: That is correct. Worth a try. Start with querying the views individually to see if the pushdo

Re: How to store/export personal settings of Drill

That's very simple! You can query the table - "sys.options" and use CTAS command. The simplest approach would be the following steps: 1. Log into a SQLLine session 2. Tinker with all the settings that you are trying, using "ALTER SESSION". This ensures that nothing permanently persists. 3. Run

Re: Drill for Data Virtualization

recent - Dec 2018). Thanks for your time, Best, Sarnath On Thu, Apr 11, 2019 at 1:54 AM Kunal Khatua wrote: > Hi Sarnath > > From what I understand by your description, you are looking to see if > Drill can push down the GROUP BY clause to the underlying JDBC sources A > and B.

Re: Drill for Data Virtualization

Hi Sarnath >From what I understand by your description, you are looking to see if Drill >can push down the GROUP BY clause to the underlying JDBC sources A and B. Unfortunately, Drill does not support pushdown for the JDBC storage plugin as yet. That said, even if the feature existed, by

Re: [ANNOUNCE] New PMC member: Sorabh Hamirwasia

Congratulations! Very well deserved!  On 4/5/2019 11:02:58 AM, Boaz Ben-Zvi wrote: Congratulation Sorabh - welcome to the Project Management Committee !! On Fri, Apr 5, 2019 at 10:58 AM Abhishek Ravi wrote: > Congratulations Sorabh! Well deserved! > > On Fri, Apr 5, 2019 at 10:49 AM hanu mapr

Re: Embeded drill

are not opened. Drill also opening lot of ports during execution. I am not sure what ports are they On Mon, Mar 25, 2019, 22:46 Kunal Khatua wrote: > Hi Praveen > > THe mailing lists dont allow attachments to be sent through. What ports > are you trying to change? > > ~ Kunal > On

Re: Embeded drill

Hi Praveen THe mailing lists dont allow attachments to be sent through. What ports are you trying to change? ~ Kunal On 3/25/2019 9:59:29 AM, PRAVEEN DEVERACHETTY wrote: I have a question regarding the ports used in embeded drill. Is there anyway to disable these ports in embeded drill

Re: Json Complex array issue only on HDF, local storage is fine

Hi Rob This is very weird ! Is that the entire JSON? I'm wondering if the JSON document by any chance has a different end-of-line character that *might* be causing this. Windows uses CarriageReturn+LineFeed, while Linux (HDFS) has only Linefeed and MacOS using CarriageReturn. Linux has a

Re: Update planner/configuration keys

e scripts > only on the drill command prompt right? > > Thanks, > Praveen > > On Tue, Mar 12, 2019 at 1:02 PM Kunal Khatua wrote: > > > Executing an "alter system set param=value" usually persists the value. > > Not sure if that works for an embedded mode. > &

Re: Drill 1.15.0 fails with error while quering Parquet 2.0 file

Hi Denis You seem to be trying to read a Parquet 2.0 format file with a Parquet 1.10 reader that comes with Drill. Is there a specific reason you are using version 2.0 ? ~ Kunal On 3/11/2019 10:13:39 AM, Denis Dudinski wrote: Hello, I have a parquet 2.0 file which contains serialised avro

Re: Update planner/configuration keys

Executing an "alter system set param=value" usually persists the value. Not sure if that works for an embedded mode.  Could you try and let us know if that works? On 3/11/2019 11:19:13 AM, PRAVEEN DEVERACHETTY wrote: I am using apache drill on windows platform. My requirement is to udpate the

Anouncing Powered-By-Drill page

Hi everyone It gives me great pleasure in announcing the launch of the "Powered By Drill" page on the official Apache Drill website : https://drill.apache.org/poweredBy As a start, the page currently has a handful Drill users that shared a short blurb about their usage in production, and one

Re: S3 plugin configuration problem cause wrong constructed hostname

Hi Clark Glad you could resolve the issue. Can you log a JIRA for the issue, and a developer can take a look at it thereafter? Thanks Kunal On 2/14/2019 5:49:58 AM, Updike, Clark wrote: FWIW, this problem was resolved by using the IP address for the S3 target instead of the hostname. No idea

Re: Multiple fragments in apache drill

Hi Hugues The number of fragments is determined by the number of sources (i.e. whether the data can be read in parallel) and the number of estimated rows. CSV and Parquet files are easy to read in parallel, but JSON files are not, because Drill does not know how many JSON documents exist in the

Re: Performace issue

at 11:18 AM Kunal Khatua wrote: > This is a good starting point for understanding LATERAL-UNNEST and how it > compares to the FLATTEN operator. > > https://drill.apache.org/docs/lateral-join/ > > > On 2/11/2019 9:03:42 PM, PRAVEEN DEVERACHETTY wrote: > Thanks Kunal. >

Re: Performace issue

getting FLATTENED. example query: 1)first converted into array of json objects 2) flatten to convert into multiple rows select ems.* from (select flatten(t.jdata) as record from (select convert_from('[{"Location":"100","FirstName":"test1"},{"Location":

Re: Error: SYSTEM ERROR: CompileException: Line 80, Column 24: Assignment conversion not possible from type "java.lang.Object" to type "java.lang.String"

Hi Krishnanand The mailing lists don't allow attachments. Please provide the Drill version, query, data source and a link to where the relevant part of the log can be downloaded.  The message by itself is not useful, especially without a stacktrace.  On 2/9/2019 11:39:49 AM, Krishnanand

Re: Performace issue

The memory (heap) would climb as it tries to flatten the JSON data. Have you tried looking at Drill's LateralJoin-Unnest feature? It was meant to address memory issues for some use cases of the FLATTEN operator. On 2/8/2019 5:17:01 AM, PRAVEEN DEVERACHETTY wrote: I am running a query with

Applications of Apache Drill

Hi everyone As some of you might be aware that the Apache Drill project is into its 5th year of existence and from the rich exchange on the mailing lists, it is clear that it has proven to be of tremendous value to not just enterprise customers using Drill in interesting ways in

Re: ACTION: Please Read: Google Summer of Code

How about a standalone Drill WebServer with support for REST-based Pagination? On 1/29/2019 6:53:43 AM, Charles Givre wrote: Hello all, Although we are experiencing the polar vortex on the East Coast of the US, it’s time to start thinking about the Google Summer of Code. If you have ideas for

Re: Drill connection using jdbc

There must be a stack trace in the logs.could you share that? On Tue, Jan 8, 2019, 11:10 PM Tushar Pathare Hello Team, > > We have installed drill 1.12.0 and trying to connect > using a client to the drill cluster > > Our config for connection is > > > > Drill class is :

Re: Documentation Issue

Very good point on the 'Added in Drill Version 1.XX' , and I think Bridget's already on it ! However, for sys.functions, it doesn't make sense to carry a min version. The Drill server basically scans all the available functions and exposes them in the sys.functions table. If a function has

Re: SQLPad Support for Drill (JDBC)

Hi Charles Can you provide steps of where the JDBC driver needs to be located ? I managed to start up the server but I hit a signin message:  Cannot GET /sqlpad/signin I see the following in the server output: [root@kk127 sqlpad]# npm start > sqlpad@2.8.0 start /root/drill/cgivre/sqlpad >

Re: Drill performance - Waiting time

Hi Matthias The waiting time for a PARQUET_ROW_GROUP_SCAN operator is the total time that all the fragments took to read the parquet data into memory as Drill's Value Vectors. So, 80 seconds would indicate that the bulk of the time is spent in just getting the data.  If you scroll down to the

Re: Status of stored procedure support

Hi Niels There is currently no one I know who is working on stored procedures. Development is primarily driven by the need for features that give the most benefit to the community of users, and there doesn't seem to be that much demand for this feature. That said, if you think it is a real

Re: Fail to read parquet file with nested column

Hi Prisdha What do the logs say? Can you share the stack trace from the logs?? Kunal On 11/6/2018 1:58:42 PM, Prisdha Dharma wrote: Hello, The latest Apache Drill works fine with JDBC, JSON, CSV, and simple parquet files. However it fails to read parquet files with nested columns, such as

Re: Apache Drill Meetup on Nov 14th!

Yes, a link of the recording should be available after the meetup. On 11/4/2018 4:38:51 PM, Divya Gehlot wrote: Hi , Can we have the link of recorded video for the audience who cannot attend in person ? Thanks, Divya On Mon, 5 Nov 2018 at 06:46, Pritesh Maker wrote: > Hello, Drillers! > > We

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

Congratulations, Hanu! On 11/1/2018 11:04:58 AM, Abhishek Girish wrote: Congratulations, Hanu! On Thu, Nov 1, 2018 at 10:56 AM Khurram Faraaz wrote: > Congratulations Hanu! > > On Thu, Nov 1, 2018 at 10:14 AM Gautam Parai wrote: > > > Congratulations Hanumath! Well deserved :) > > > > Gautam >

Re: Query hung in Cancelled_Requested state

What is the Drillbit's JStack? You can try seeing the /threads webpage. On 10/25/2018 8:16:06 PM, Divya Gehlot wrote: Hi, I am using Dril 1.10 and I have query running for days and when I click on cacel the query through Drill Web UI . It hung in Cancellation_Requested state . Is there any way

Re: Apache drill issue - cpu spiking to 100%

find on collection is expected, as it has to capture schema information. But, I see count and find being run 43 times each for one single query in drill. On Sat, 20 Oct 2018 at 00:06, Kunal Khatua mailto:ku...@apache.org]> wrote: Hi Bala Can you share details of the profiles itself? It mi

Re: Apache drill issue - cpu spiking to 100%

Hi Bala Can you share details of the profiles itself? It might be that the MongoDB storage plugin is translating the query into 100 mongo queries because of some (100?) specific filter criteria in the Drill query? JVM Heap usage fluctuation would indicate frequent object creation and garbage

Re: Failed to create schema tree when running Drill View Query

There is another possible explanation of why this is happening.  The `createFullRootSchema` seems to be called as part of the initial schema creation required for a query, and that means initialization of the backend storage plugins for the new nodes. You might need to disable some of the

Re: ERROR is reading parquet data after create table

Hi Herman Assuming that you're doing analytics on your data. If that's the case, parquet format is the way to go.  That said, could you provide some details about the parquet data you've created, like the schema, parquet version and the tool used to generate. Usually, the schema (and meta)

Re: Long running query succeeds but UI times out?

Hi James The problem you're describing could be due to multiple factors. Typically, browsers don't specify a timeout for a request it sends to the server (Amazon, in this case), but it can be safe to assume that it is reasonably long. You said that things work great for small scale data or

Re: CTAS memory leak

Scott  I think I can explain why you are getting the OutOfMemory. Drill essentially has 2 pools of memory... the standard JVM Heap and the Netty-managed Direct memory. When you are reading a JSON document, it needs to be deserialized into Java heap objects because of the JSON parser libraries

Re: java pointer error in drill log

ere is the drillbit.log output -> https://pastebin.com/X44guqiM Thanks, Divya On Wed, 29 Aug 2018 at 07:05, Kunal Khatua wrote: > Is there a stack trace? Does the Drillbit crash, because that might have > generated a log as well (hs_error_ ) ? > > On 8/28/2018 12:47:57 AM,

Re: java pointer error in drill log

Is there a stack trace? Does the Drillbit crash, because that might have generated a log as well (hs_error_ ) ? On 8/28/2018 12:47:57 AM, Divya Gehlot wrote: Hi, I could see java pointer error in drill logs as beow *** Error in

Re: Not Able To Access Drill Web Console In Multiple tabs Using Drill 1.13

L-6693. It is introduced somewhere in Drill 1.13.0. Kunal, could you please take a look? Thanks! On Wed, Jul 18, 2018 at 9:07 AM Kunal Khatua wrote: > Could you share the query details and/or the profile of the query you are > running? There wasn't anything specific in the UI that changed. >

Re: [ANNOUNCE] New PMC member: Boaz Ben-Zvi

Congratulations, Boaz!! On 8/17/2018 10:11:32 AM, Paul Rogers wrote: Congratulations Boaz! - Paul On Friday, August 17, 2018, 2:56:27 AM PDT, Vitalii Diravka wrote: Congrats Boaz! Kind regards Vitalii On Fri, Aug 17, 2018 at 12:51 PM Arina Ielchiieva wrote: > I am pleased to announce that

Re: [DISCUSSION] current project state

I think apart from a lot of the improvements proposed, like metadata store (+1), having support for a materialized view would be especially useful. The reason I am proposing this is that there are some storage plugins, for which Drill cannot pushdown filters, etc. Materialized views would allow

Re: Functions in Drill but not in documentation

I actually have a PR that would work in conjunction with listing for the WebUI's auto-complete feature. I had based it off an original PR meant for providing descriptions to System options, but since that has got stuck in review and rework, I've not made new progress on this.  We'll definitely

Re: Apache Drill Queries Take so Long after which Webconsole dies and I don't see results

Hi Peter >From the logs you shared, the Parquet-related messages are a warning and has >nothing to do with the unresponsiveness and subsequent crash of the Drillbit.  The Zookeeper timeout indicates that either the ZK or your DBit was possibly overloaded. Since th Drillbit is reporting the

Re: New UDF for processing Twitter text

Saw this on Twitter... looked interesting. We've been thinking of revamping the site a bit to help around folks with leveraging Drill in different applications... this could sit nicely in a Cyber-related domain.  As for the Ctrl+Enter / Meta-Enter  ... let's keep that as a separate PR. Always

Re: Google Sheets plugin

Vitalii I think Pedro is referring to this project: https://github.com/bizreach/drill-excel-plugin  It would be worth considering adding this if it is mature enough. Pedro Like Vitalii suggested, please create a JIRA. This helps gain visibility within the community and someone (including

Re: Apache Drill and PostgreSQL

Hi Alex Do you have a lot of files in your 65GB of CSV dump, and are the rows very wide? Is the error instantaneous or does it take a while. The error for your example would typically occur if the Drillbit is very busy doing something, resulting in a timeout or lack of a heartbeat from the

RE: Not Able To Access Drill Web Console In Multiple tabs Using Drill 1.13

of same drillbit as in our cluster we have only one web-console that we can access. Thanks for your suggestion regarding the other tools which is one option that I could try. Please let me know your response. Best regards, _ Tilak -Original Message- From: Kunal Khatua

Re: Not Able To Access Drill Web Console In Multiple tabs Using Drill 1.13

You could try the reverse. Monitor in the initial window, while submitting the query in another window. That said, the reason your console is getting stuck is by design. The browser tab from which you submit the query is the window where you'll receive the results of the query. Hence, the

Re: CT from parquet to CSV seems to not properly encode to UTF8

Hi Carlos It looks similar to an issue reported previously: https://lists.apache.org/thread.html/1f3d4c427690c06f1992bc5070f355689ccc5b1ed8cc3678ad8e9106@   Could you try setting the JVM's file encoding to UTF-8 and retry? If it does not work, please file a JIRA in https://issues.apache.org 

Re: Drill explorer software

Drill Explorer is available with the ODBC driver for Linux, Mac and Windows platform. You should be able to download from links on the Apache Drill Website: https://drill.apache.org/docs/installing-the-odbc-driver/ On 7/13/2018 10:27:50 AM, Kayode Thomas wrote: Hello,   I am interested in

Re: Failure finding Drillbit on host

Hi Divya Did you you manage to resolve this? Since there isn't a stack trace, I'll take a guess. It looks like this might have been occurring during the planning phase, when the Foreman is trying to allocate work on a Drillbit. Is the same host being reported? It might be that the

Re: Web console responsiveness under heavy load

tools like DBeaver (which has a nice feature of automatically downloading the latest JDBC drivers) or Squirrel.  You can then use the WebUI to monitor the queries in flight, etc. On 6/30/2018 12:18:23 AM, Kunal Khatua wrote: Are you running the query through the WebUI? What are the memory

Re: Need help in Apache Drill

Hi  Could you upload the screenshots to a public hosting site and post the links? The Apache mailing list blocks attachments for security reasons. ~ Kunal On 7/1/2018 10:22:00 PM, dony.natra...@ramyamlab.com wrote: Hi there,   Hope you’re doing good.   I need suggestion on performance issues

Re: Web console responsiveness under heavy load

Are you running the query through the WebUI? What are the memory settings of your Drillbit? On 6/26/2018 7:45:30 AM, Dave Challis wrote: Are there any recommended Drill settings to configure in order to ensure that the web console (running on 8047) remains responsive even under heavy load?

Re: CTAS AccessControlException

What is the entire stack trace? I'm wonderinf if there is an internal timeout that is occuring for long running CTAS in a secure setup. On 6/29/2018 3:42:17 AM, Divya Gehlot wrote: Hi, At times I am getting error whlile CTAS and it doesn't happen all the time like next run for 18 hours it will

Re: Question - Drill's support for encryption to plugins/data sources

Hi Daniel I might not be the best person to answer this, but I'd think that for supporting encryption to data sources, both Drill and the data source would need to agree to a common implementation  of such a protocol. I don't know if there is any defacto standard for data sources in general.

Re: Drill error

That could be a possibility. See if you can skip that value in the column... try using a filter condition with a such as  NOT LIKE '%'  On 6/27/2018 11:25:10 PM, Nitin Pawar wrote: Could this cause an issue if one of the field in concat function has large text ? On Thu, Jun 28, 2018 at 11:10

Re: UnsupportedOperationException: Unsupported type LIST

I'm wondering if this JIRA is related the issue you are facing: https://issues.apache.org/jira/browse/DRILL-2241 On 6/11/2018 9:44:32 AM, Kunal Khatua wrote: Can you share the stack trace as well? On 6/11/2018 3:12:07 AM, Divya Gehlot wrote: Hi , I am trying to convert the complex json format

Re: UnsupportedOperationException: Unsupported type LIST

Can you share the stack trace as well? On 6/11/2018 3:12:07 AM, Divya Gehlot wrote: Hi , I am trying to convert the complex json format to Parquet and I am getting below erro : SYSTEM ERROR: UnsupportedOperationException: Unsupported type LIST Fragment 0:0 JSON File format as below : {

Re: Memory Leak in drill 1.13.0

Can you provide more details for a repro? Multiple issues can potentially cause or (incorrectly) report a memory leak. If you notice, the 'Actual' value is zero, so there isn't really a leak, but the resources were not closed properly. What does the stack trace say? On 6/7/2018 11:05:32 PM,

Re: Apache Drill in 10 Minutes - Problems

This is very odd. Out of the box, using Drill in embedded mode (i.e. zk=local)   works for me. I'm testing with Apache Drill 1.13.0 on Windows 10. Nothing fancy in my env var PATH. Everything points to JDK8. You're seeing this with a clean setup as well? (for an existing machine, you should

Re: is there any way to download the data through Drill Web UI?

I've filed https://issues.apache.org/jira/browse/DRILL-6423 and opened a PR for this. (https://github.com/apache/drill/pull/1266) This allows you to export the visible table in the results page as a CSV. That means, you can actually sort or filter the results in the UI and then choose the

Re: Failed to fetch parquet metadata after 15000ms

That doesn't look too big. Are the queries failing during planning or execution phase? Also, you mentioned that you are running this on a machine with 16GB RAM. How much memory have you given to Drill? Typical min config is about 8GB for Drill alone, and with 2-3GB with the OS, not a whole lot

Re: Required help in apache drill

ittling down queries you need to (unless you need to whittle down on the base64 encoded column) then yank the data into R, Python, Go, whatever and do the base 64 decoding there. > On Apr 20, 2018, at 1:47 PM, Kunal Khatua wrote: > > First, you're posting on the wrong mailing list.

Re: Required help in apache drill

First, you're posting on the wrong mailing list. This should be posted in the user mailing list, because this is meant for discussion of development features about Drill. As a result, I'll cc to the dev list (so that you don't miss the reply), but you should carry on the conversation in the

Re: Drill on Windows

I might be wrong, but I think it's partly because of the need for Zookeeper on Windows, which is not commonly done. Other more obvious factors, IMO, are the overhead in creating and maintaining *nix shell scripts in Batch files. Linux (Bash) scripts are much more powerful with a lot of

Re: Source for drill-calcite

Yes, that is correct. On 3/28/2018 3:45:13 AM, Rahul Raj wrote: Is Drill fork of Calcite maintained at https://github.com/mapr/incubator-calcite/? I assume that the required calcite branch for Drill 13.0 is DrillCalcite1.15.0. I would like to test a newer patch

Re: QSQL via jdbc (python3 and JayDeBeApi) wraps with SELECT ... LIMIT 0

t; but can't find anything definitive. On Mon, Mar 19, 2018 at 6:16 PM, Kunal Khatua wrote: > This error looks familiar and might be because of the Python library > wrapping a select * around the original query. > > Using the JDBC driver directly doesn’t seem to show t

Re: question about views

I think Ted's question is 2 fold, with the former being more important. 1. Can we push filters past a union.  2. Will Drill push filters down to the source. For the latter, it depends on the source.  For the former, it depends primarily on whether Calcite supports this. I haven't tried it, so I

Re: Channel closed exception

debug it ? Thanks, Divya On 15 March 2018 at 15:00, Kunal Khatua wrote: > There could be multiple reasons for why the ChannelClosedException is > thrown. What kind of a load are you running on your Drillbits? > > There might be resources in the mailing list archives that have touche

RE: QSQL via jdbc (python3 and JayDeBeApi) wraps with SELECT ... LIMIT 0

:19 PM, Kunal Khatua <kkha...@mapr.com> wrote: This error looks familiar and might be because of the Python library wrapping a select * around the original query. Using the JDBC driver directly doesn’t seem to show this problem. Drill 1.13.0 is out now. Could you give a try with that and c

RE: QSQL via jdbc (python3 and JayDeBeApi) wraps with SELECT ... LIMIT 0

This error looks familiar and might be because of the Python library wrapping a select * around the original query. Using the JDBC driver directly doesn’t seem to show this problem. Drill 1.13.0 is out now. Could you give a try with that and confirm if the behavior is the same? -Original

Re: Storage plugin for GraphQL

What is the data format? If you have a JDBC driver for that, you should be able to query it. On 2/24/2018 9:01:43 PM, Bremner-Stokes, Glen wrote: Hello all, Not sure if I am posting this correctly so please redirect me if necessary. I have a GraphQL server that

Re: How to get mongo data into saiku using apache drill

For security reasons, the user mailing lists don't allow attachments. You could upload the image to some online file sharing services like GoogleDrive/Dropbox and share the link in the mailing list, along with a description of the setup, etc. On Fri, Mar 16, 2018 at 3:10 AM, Sonu Kumawat

Re: Participate in the Apache Drill Poll on Twitter

Nice. We should have some polls conducted for what Drill is being used for by the community as well. On Thu, Mar 15, 2018 at 9:37 PM, Saurabh Mahapatra < saurabhmahapatr...@gmail.com> wrote: > Participate in the Apache Drill Poll and have your voice heard through ONE > vote:

Re: [Drill 1.12.0] : RESOURCE ERROR: Not enough memory for internal partitioning and fallback mechanism for HashAgg to use unbounded memory is disabled

a higher level". > Are you saying to increase this "planner.memory.max_query_memory_per_node" > from > 2GB? If yes then just wanted to mention that i have already set > planner.memory.max_query_memory_per_node = 4G(mentioned in trail mail). > Let me know if i have misinterpreted anything. > >

Re: hive connection as generic jdbc

> > > wrote: > > > > > > > > > Hi Asim, > > > > > > > > > > > > > > > You may try using hive uber jar in case you have not tried it. See > if > > > > > below link helps. > > > > > >

Re: Channel closed exception

There could be multiple reasons for why the ChannelClosedException is thrown. What kind of a load are you running on your Drillbits? There might be resources in the mailing list archives that have touched upon solutions for this, so you could look up there as well. On Wed, Mar 14, 2018 at 11:09

Re: [Drill 1.12.0] : RESOURCE ERROR: Not enough memory for internal partitioning and fallback mechanism for HashAgg to use unbounded memory is disabled

Hi Anup Can you share this as a file ? There seems to be some truncation of the contents. Share it using some online service like Google Drive or Dropbox, since the mailing list might not allow for attachments. Thanks ~ Kunal On Tue, Mar 13, 2018 at 11:44 PM, Anup Tiwari

Re: [Drill 1.10.0/1.12.0] Query Started Taking Time + frequent one or more node lost connectivity error

Hi Anup It helps if you can share the profile (*.sys.drill / *.json files) to help explain. I don't think the user mailing list allows attachments, so you could use an online document sharing service (e.g. Google Drive, etc) to do the same. Coming back to your description, it seems like you are

Re: Single (embedded) drillbit as a service

The trouble with your approach is that making it a background process pauses the process in an interactive mode, until you bring it to the foreground. You cannot use an Embedded Drillbit with Zookeeper. You should start it off as a regular drillbit instance. Zookeeper only serves the purpose of

Re: Different output for the same date field

Hi Jiang Thanks for bringing this to our attention. However, we're not actively developing the Mongo storage plugin at the moment, so it might be a while before this is updated. Do you think you could help with submitting a pull-request against a JIRA filed for this? You already appear to have

Re: [Drill 1.12.0] : RESOURCE ERROR: Not enough memory for internal partitioning and fallback mechanism for HashAgg to use unbounded memory is disabled

> > > On Mon, Mar 12, 2018 1:59 PM, Anup Tiwari anup.tiw...@games24x7.com > wrote: > Hi Kunal, > Thanks for info and i went with option 1 and increased > planner.memory.max_query_memory_per_node and now queries are working > fine. Will > let you in case of any issues. > &g

  1   2   3   >