[jira] [Resolved] (DRILL-7276) xss(bug) in apache drill Web UI latest verion 1.16.0 when authenticated

[ https://issues.apache.org/jira/browse/DRILL-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-7276. --- Resolution: Fixed > xss(bug) in apache drill Web UI latest verion 1.16.0 when authentica

Re: [ANNOUNCE] New Committer: Jyothsna Donapati

Congratulations Jyothsna! On Thu, May 9, 2019 at 2:28 PM Aman Sinha wrote: > The Project Management Committee (PMC) for Apache Drill has invited > Jyothsna > Donapati to become a committer, and we are pleased to announce that she has > accepted. > > Jyothsna has been contributing to Drill for

Re: [ANNOUNCE] New PMC member: Sorabh Hamirwasia

Congrats Sorabh! On Fri, Apr 5, 2019 at 12:26 PM Karthikeyan Manivannan wrote: > Congrats Sorabh! Very well deserved! > > On Fri, Apr 5, 2019, 12:01 PM Kunal Khatua wrote: > > > Congratulations! Very well deserved! > > > > On 4/5/2019 11:02:58 AM, Boaz Ben-Zvi wrote: > > Congratulation Sorabh

[jira] [Created] (DRILL-7101) IllegalArgumentException when reading parquet data

salim achouche created DRILL-7101: - Summary: IllegalArgumentException when reading parquet data Key: DRILL-7101 URL: https://issues.apache.org/jira/browse/DRILL-7101 Project: Apache Drill

Re: Data-source/partition pruning with remotely stored non-parquet files

I'll take a stab at answering your questions. There are multiple strategies that Drill uses to reduce the amount of files to read: Implicit Columns based Pruning - o Drill exposes a set of implicit columns for file based readers (e.g., filename, path, etc) o You could use such columns to prune

[jira] [Created] (DRILL-7018) Drill Query (when store.parquet.reader.int96_as_timestamp=true) on Parquet File fails with Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: 37

salim achouche created DRILL-7018: - Summary: Drill Query (when store.parquet.reader.int96_as_timestamp=true) on Parquet File fails with Error: SYSTEM ERROR: IndexOutOfBoundsException: readerIndex: 0, writerIndex: 372 (expected: 0 <= readerIn

Re: [ANNOUNCE] New Committer: Salim Achouche

:20 AM Vitalii Diravka > > > > >> wrote: > > > >> > > > >>> Congratulations Salim! > > > >>> Well deserved! > > > >>> > > > >>> Kind regards > > > >>> Vit

Re: [ANNOUNCE] New Committer: Karthikeyan Manivannan

Congrats Karthik! On Fri, Dec 7, 2018 at 11:11 AM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited > Karthikeyan > Manivannan to become a committer, and we are pleased to announce that he > has accepted. > > Karthik started contributing to the Drill

Re: Drill support for SQLPad

One benefit of the REST based UI is that it does handle change-of-schema events per dataset (addition / removal of columns) whereas SQLline doesn't. I was wondering if SQLPad can be made to consume Drill's dynamic datasets. On Thu, Nov 29, 2018 at 2:56 PM Kunal Khatua wrote: > I think getting

Re: [ANNOUNCE] New Committer: Hanumath Rao Maduri

Congrats Hanu! On Thu, Nov 1, 2018 at 6:05 AM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited > Hanumath > Rao Maduri to become a committer, and we are pleased to announce that he > has accepted. > > Hanumath became a contributor in 2017, making

Re: [ANNOUNCE] New Committer: Gautam Parai

Congrats Gautam! On Mon, Oct 22, 2018 at 7:25 AM Arina Ielchiieva wrote: > The Project Management Committee (PMC) for Apache Drill has invited Gautam > Parai to become a committer, and we are pleased to announce that he has > accepted. > > Gautam has become a contributor since 2016, making

[jira] [Resolved] (DRILL-6410) Memory leak in Parquet Reader during cancellation

[ https://issues.apache.org/jira/browse/DRILL-6410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-6410. --- Resolution: Fixed Reviewer: Timothy Farkas (was: Parth Chandra) > Memory l

Re: Long running query succeeds but UI times out?

James, - I don't think you've attached the log file - What do you mean by the "UI times out"? does the timeout occur within the JDBC client? Meanwhile, can you check the following timeouts: - drill.exec.rpc.user.timeout (default: 30s); - drill.exec.rpc.bit.timeout (default: is 300s) Make sure

Re: Why Parquet file size is bigger in Linux

Sreekanth, can you indicate how you are creating the Parquet files (using Drill CTAS or another application). FYI - - Parquet files can get larger if: o Multiple row-groups are included per parquet file o Compression is not being used - You can use the Parquet Tools utility here

Re: [ANNOUNCE] New Committer: Weijie Tong

Congrats Weijie! On Fri, Aug 31, 2018 at 10:28 AM Paul Rogers wrote: > Congratulations Weijie, thanks for your contributions to Drill. > Thanks, > - Paul > > > > On Friday, August 31, 2018, 8:51:30 AM PDT, Arina Ielchiieva < > ar...@apache.org> wrote: > > The Project Management Committee

Re: Apache drill High availability

You need to clarify your definition of HA as there can be multiple faults at play: - A Drill cluster can handle nodes going down (and new ones joining the cluster) - Though, running queries (which are executed in a distributed manner) might fail if they had minor-fragments running on a faulty node

Re: [DISCUSS] Deprecation policy in Drill

Drill is a SQL engine, which means the SQL syntax and associated options (runtime configuration and session properties) constitute its user facing APIs (if I may say). When we talk about deprecating and then removing documented session / configuration properties within the same release, then what

Re: [ANNOUNCE] New PMC member: Volodymyr Vysotskyi

Congrats Volodymyr! On Fri, Aug 24, 2018 at 11:32 AM Gautam Parai wrote: > Congratulations Vova! > > Gautam > > On Fri, Aug 24, 2018 at 10:59 AM, Khurram Faraaz wrote: > > > Congratulations Volodymyr! > > > > Regards, > > Khurram > > > > On Fri, Aug 24, 2018 at 10:25 AM, Hanumath Rao Maduri <

Re: [ANNOUNCE] New PMC member: Boaz Ben-Zvi

Congrats Boaz! Regards, Salim > On Aug 17, 2018, at 2:33 PM, Robert Wu wrote: > > Congratulations, Boaz! > > Best regards, > > Rob > > -Original Message- > From: Abhishek Girish > Sent: Friday, August 17, 2018 2:17 PM > To: dev > Subject: Re: [ANNOUNCE] New PMC member: Boaz

[jira] [Created] (DRILL-6664) Parquet reader should not allow batches with more than 64k rows

salim achouche created DRILL-6664: - Summary: Parquet reader should not allow batches with more than 64k rows Key: DRILL-6664 URL: https://issues.apache.org/jira/browse/DRILL-6664 Project: Apache

[jira] [Created] (DRILL-6660) Exchange operators Analysis

salim achouche created DRILL-6660: - Summary: Exchange operators Analysis Key: DRILL-6660 URL: https://issues.apache.org/jira/browse/DRILL-6660 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-6659) Batch sizing functionality for exchange operators

salim achouche created DRILL-6659: - Summary: Batch sizing functionality for exchange operators Key: DRILL-6659 URL: https://issues.apache.org/jira/browse/DRILL-6659 Project: Apache Drill

[jira] [Created] (DRILL-6579) Sanity checks to avoid infinite loops

salim achouche created DRILL-6579: - Summary: Sanity checks to avoid infinite loops Key: DRILL-6579 URL: https://issues.apache.org/jira/browse/DRILL-6579 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-6578) Ensure the Flat Parquet Reader can handle query cancellation

salim achouche created DRILL-6578: - Summary: Ensure the Flat Parquet Reader can handle query cancellation Key: DRILL-6578 URL: https://issues.apache.org/jira/browse/DRILL-6578 Project: Apache Drill

[jira] [Created] (DRILL-6570) IndexOutOfBoundsException when using Flat Parquet Reader

salim achouche created DRILL-6570: - Summary: IndexOutOfBoundsException when using Flat Parquet Reader Key: DRILL-6570 URL: https://issues.apache.org/jira/browse/DRILL-6570 Project: Apache Drill

[jira] [Created] (DRILL-6560) Allow options for controlling the batch size per operator

salim achouche created DRILL-6560: - Summary: Allow options for controlling the batch size per operator Key: DRILL-6560 URL: https://issues.apache.org/jira/browse/DRILL-6560 Project: Apache Drill

[jira] [Created] (DRILL-6528) Planner setting the wrong number of records to read (Parquet Reader)

salim achouche created DRILL-6528: - Summary: Planner setting the wrong number of records to read (Parquet Reader) Key: DRILL-6528 URL: https://issues.apache.org/jira/browse/DRILL-6528 Project: Apache

Re: [ANNOUNCE] New Committer: Padma Penumarthy

Congratulations Padma! Regards, Salim > On Jun 15, 2018, at 9:58 AM, Vitalii Diravka > wrote: > > Congrats Padma! > > Kind regards > Vitalii > > > On Fri, Jun 15, 2018 at 7:40 PM Arina Ielchiieva wrote: > >> Padma, congratulations and welcome! >> >> Kind regards, >> Arina >> >> On Fri,

[jira] [Created] (DRILL-6513) Drill should only allow valid values when users set planner.memory.max_query_memory_per_node

salim achouche created DRILL-6513: - Summary: Drill should only allow valid values when users set planner.memory.max_query_memory_per_node Key: DRILL-6513 URL: https://issues.apache.org/jira/browse/DRILL-6513

Re: Apache Drill Hangout

This week's hangout, May 29th, has been cancelled! Sorry for the late notice! Regards, Salim On Mon, May 21, 2018 at 11:04 AM, salim achouche wrote: > Sorry for the erroneous Hangout date; the Hangout will be held next week > May 29th at 10:00am. > > Regards, > Salim > >

Re: [ANNOUNCE] New Committer: Timothy Farkas

Congrats Tim! On Fri, May 25, 2018 at 11:58 AM, Aman Sinha wrote: > The Project Management Committee (PMC) for Apache Drill has invited Timothy > Farkas to become a committer, and we are pleased to announce that he > has accepted. > > Tim has become an active contributor

[jira] [Created] (DRILL-6447) Unsupported Operation when reading parquet data

salim achouche created DRILL-6447: - Summary: Unsupported Operation when reading parquet data Key: DRILL-6447 URL: https://issues.apache.org/jira/browse/DRILL-6447 Project: Apache Drill Issue

[jira] [Resolved] (DRILL-5847) Flat Parquet Reader Performance Analysis

[ https://issues.apache.org/jira/browse/DRILL-5847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-5847. --- Resolution: Fixed Fix Version/s: 1.14.0 > Flat Parquet Reader Performance Analy

[jira] [Resolved] (DRILL-5848) Implement Parquet Columnar Processing & Use Bulk APIs for processing

[ https://issues.apache.org/jira/browse/DRILL-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-5848. --- Resolution: Fixed Fix Version/s: 1.14.0 > Implement Parquet Columnar Processing &a

Re: Apache Drill Hangout

Sorry for the erroneous Hangout date; the Hangout will be held next week May 29th at 10:00am. Regards, Salim On Mon, May 21, 2018 at 10:50 AM, salim achouche <sachouc...@gmail.com> wrote: > The Apache Drill Hangout will be held tomorrow at 10:00am PST; please let > us know sho

Apache Drill Hangout

The Apache Drill Hangout will be held tomorrow at 10:00am PST; please let us know should you have a topic for tomorrow's hangout. Hangout Link - https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc Regards, Salim

[jira] [Created] (DRILL-6410) Memory leak in Parquet Reader during cancellation

salim achouche created DRILL-6410: - Summary: Memory leak in Parquet Reader during cancellation Key: DRILL-6410 URL: https://issues.apache.org/jira/browse/DRILL-6410 Project: Apache Drill

[jira] [Resolved] (DRILL-6301) Parquet Performance Analysis

[ https://issues.apache.org/jira/browse/DRILL-6301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-6301. --- Resolution: Fixed Reviewer: Pritesh Maker This is an analytical task. > Parq

Re: [ANNOUNCE] New Committer: Sorabh Hamirwasia

Congrats Sorabh! well deserved. Regards, Salim On Mon, Apr 30, 2018 at 3:35 PM, Aman Sinha wrote: > The Project Management Committee (PMC) for Apache Drill has invited Sorabh > Hamirwasia to become a committer, and we are pleased to announce that he > has accepted. > >

Re: [GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

that change of ownership for pass-through remains valid as it doesn't inflate resource allocation for a given time snapshot. On Sat, Apr 28, 2018 at 12:42 AM, salim achouche <sachouc...@gmail.com> wrote: > Another point, I don't see a functional benefit from avoiding a change of > owners

Re: [GitHub] drill issue #1237: DRILL-6348: Fixed code so that Unordered Receiver reports...

: (fragment, opr-1, opr-2) = (8Mb, 8MB, 0) - t2: (fragment, opr-1, opr-2) = (8Mb, 8Mb, 8MB) The key thing is that we clarify our reporting metrics so that users do not make the wrong conclusions. Regards, Salim On Fri, Apr 27, 2018 at 11:47 PM, salim achouche <sachouc...@gmail.com> wrote:

[jira] [Created] (DRILL-6348) Unordered Receiver does not report its memory usage

salim achouche created DRILL-6348: - Summary: Unordered Receiver does not report its memory usage Key: DRILL-6348 URL: https://issues.apache.org/jira/browse/DRILL-6348 Project: Apache Drill

Drill JMH Framework

I have created a new infrastructure to run Drill JMH benchmarks. My goal is to encourage sharing of JMH logic when performance testing the Drill logic. At this time, I have uploaded this framework to a new GIT repository drill-jmh . Regards, Salim

[jira] [Created] (DRILL-6301) Parquet Performance Analysis

salim achouche created DRILL-6301: - Summary: Parquet Performance Analysis Key: DRILL-6301 URL: https://issues.apache.org/jira/browse/DRILL-6301 Project: Apache Drill Issue Type: Task

[jira] [Created] (DRILL-6299) Parquet query returns unexpected results

salim achouche created DRILL-6299: - Summary: Parquet query returns unexpected results Key: DRILL-6299 URL: https://issues.apache.org/jira/browse/DRILL-6299 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-6297) Define the Schema Change support functionality

salim achouche created DRILL-6297: - Summary: Define the Schema Change support functionality Key: DRILL-6297 URL: https://issues.apache.org/jira/browse/DRILL-6297 Project: Apache Drill Issue

Re: Batch Sizing for Parquet Flat Reader

I have updated the document <https://docs.google.com/document/d/1A6zFkjxnC_-9RwG4h0sI81KI5ZEvJ7HzgClCUFpB5WE/edit?ts=5a793606=1#> with more design details. On Thu, Feb 8, 2018 at 5:42 PM, salim achouche <sachouc...@gmail.com> wrote: > The following document > <https://docs.

[jira] [Created] (DRILL-6246) Build Failing in jdbc-all artifact

salim achouche created DRILL-6246: - Summary: Build Failing in jdbc-all artifact Key: DRILL-6246 URL: https://issues.apache.org/jira/browse/DRILL-6246 Project: Apache Drill Issue Type: Bug

[jira] [Created] (DRILL-6223) Drill fails on Schema hanges

salim achouche created DRILL-6223: - Summary: Drill fails on Schema hanges Key: DRILL-6223 URL: https://issues.apache.org/jira/browse/DRILL-6223 Project: Apache Drill Issue Type: Improvement

[jira] [Created] (DRILL-6222) Drill fails on Schema hanges

salim achouche created DRILL-6222: - Summary: Drill fails on Schema hanges Key: DRILL-6222 URL: https://issues.apache.org/jira/browse/DRILL-6222 Project: Apache Drill Issue Type: Improvement

Re: Batch Sizing for Parquet Flat Reader

Paul, I cannot thank you enough for your help and guidance! You are right that columnar readers will have a harder time balancing resource requirements and performance. Nevertheless, DRILL-6147 is a starting point; it should allow us to gain knowledge and accordingly refine our strategy as we

Re: Batch Sizing for Parquet Flat Reader

Thanks Parth for your feedback! I am planning to enhance the document based on the received feedback and the prototype I am currently working on! Regards, Salim On Sun, Feb 11, 2018 at 2:36 PM, salim achouche <sachouc...@gmail.com> wrote: > Thanks Paul for your feedback! let me try

Re: Batch Sizing for Parquet Flat Reader

Thanks Paul for your feedback! let me try to answer some of your questions / comments: Duplicate Implementation - I am not contemplating two different implementations; one for Parquet and another for the rest of the code - Instead, I am reacting to the fact that we have two different processing

Re: Batch Sizing for Parquet Flat Reader

riment - where > does this memory go if it is not released back to the OS? > > > > On Fri, Feb 9, 2018 at 7:12 AM, salim achouche <sachouc...@gmail.com> > wrote: > > > The following document > > <https://docs.google.com/document/d/1A6zFkjxnC_- > > 9Rw

[jira] [Created] (DRILL-6147) Limit batch size for Flat Parquet Reader

salim achouche created DRILL-6147: - Summary: Limit batch size for Flat Parquet Reader Key: DRILL-6147 URL: https://issues.apache.org/jira/browse/DRILL-6147 Project: Apache Drill Issue Type

Batch Sizing for Parquet Flat Reader

The following document describes a proposal for enforcing batch sizing constraints (count and memory) within the Parquet Reader (Flat Schema). Please feel free to take a look and provide feedback.

[jira] [Created] (DRILL-6131) Create SchemaComparator to unify various comparison in a single utility

salim achouche created DRILL-6131: - Summary: Create SchemaComparator to unify various comparison in a single utility Key: DRILL-6131 URL: https://issues.apache.org/jira/browse/DRILL-6131 Project

[jira] [Created] (DRILL-6129) Query fails on nested data type schema change

salim achouche created DRILL-6129: - Summary: Query fails on nested data type schema change Key: DRILL-6129 URL: https://issues.apache.org/jira/browse/DRILL-6129 Project: Apache Drill Issue

Re: [ANNOUNCE] New PMC member: Paul Rogers

Congrats Paul! Regards, Salim > On Jan 30, 2018, at 1:58 PM, Padma Penumarthy wrote: > > Congratulations Paul. > > Thanks > Padma > > >> On Jan 30, 2018, at 1:55 PM, Gautam Parai wrote: >> >> Congratulations Paul! >> >>

[jira] [Created] (DRILL-6101) Optimize Implicit Columns Processing

salim achouche created DRILL-6101: - Summary: Optimize Implicit Columns Processing Key: DRILL-6101 URL: https://issues.apache.org/jira/browse/DRILL-6101 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-6079) Memory leak caused by ParquetRowGroupScan

salim achouche created DRILL-6079: - Summary: Memory leak caused by ParquetRowGroupScan Key: DRILL-6079 URL: https://issues.apache.org/jira/browse/DRILL-6079 Project: Apache Drill Issue Type

Re: Parquet MR version

I don’t think it will be a lot of work to do so as the main changes (from the Parquet branch) is related to passing direct buffers vs using Java heap. FYI - I would also think that we should contribute to the Parquet code base so that an abstraction is used on top of byte arrays (e.g.,

[jira] [Created] (DRILL-6042) Performance measurement

salim achouche created DRILL-6042: - Summary: Performance measurement Key: DRILL-6042 URL: https://issues.apache.org/jira/browse/DRILL-6042 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-6041) Review Pull Request 1072

salim achouche created DRILL-6041: - Summary: Review Pull Request 1072 Key: DRILL-6041 URL: https://issues.apache.org/jira/browse/DRILL-6041 Project: Apache Drill Issue Type: Sub-task

Re: [VOTE] Release Apache Drill 1.12.0 - rc1

For me, it was intermittent; sometimes the test succeeds and would fail at another time. I had to set the maven "-Dmaven.test.failure.ignore=true” to have my build proceed.. then I would check the logs. Regards, Salim > On Dec 13, 2017, at 11:25 AM, Karthikeyan Manivannan

Re: [ANNOUNCE] New Committer: Boaz Ben-Zvi

Congrats Boaz and Vitalii!! > On Dec 13, 2017, at 11:00 AM, Timothy Farkas wrote: > > Congrats! > > > From: Kunal Khatua > Sent: Wednesday, December 13, 2017 10:47:14 AM > To: dev@drill.apache.org > Subject: RE: [ANNOUNCE]

[jira] [Resolved] (DRILL-5890) Tests Leak Many Open File Descriptors

[ https://issues.apache.org/jira/browse/DRILL-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] salim achouche resolved DRILL-5890. --- Resolution: Fixed Reviewer: Parth Chandra Fix Version/s: 1.12.0 The number

[jira] [Created] (DRILL-5879) Optimize "Like" operator

salim achouche created DRILL-5879: - Summary: Optimize "Like" operator Key: DRILL-5879 URL: https://issues.apache.org/jira/browse/DRILL-5879 Project: Apache Drill Issue Type: I

[jira] [Created] (DRILL-5848) Implement Parquet Columnar Processing & Use Bulk APIs for processing

salim achouche created DRILL-5848: - Summary: Implement Parquet Columnar Processing & Use Bulk APIs for processing Key: DRILL-5848 URL: https://issues.apache.org/jira/browse/DRILL-5848 Project: Ap

[jira] [Created] (DRILL-5847) Flat Parquet Reader Performance Analysis

salim achouche created DRILL-5847: - Summary: Flat Parquet Reader Performance Analysis Key: DRILL-5847 URL: https://issues.apache.org/jira/browse/DRILL-5847 Project: Apache Drill Issue Type

[jira] [Created] (DRILL-5846) Improve Parquet Reader Performance for Flat Data types

salim achouche created DRILL-5846: - Summary: Improve Parquet Reader Performance for Flat Data types Key: DRILL-5846 URL: https://issues.apache.org/jira/browse/DRILL-5846 Project: Apache Drill