[GitHub] [drill] KazydubB commented on a change in pull request #1954: DRILL-7509: Incorrect TupleSchema is created for DICT column when querying Parquet files

2020-01-19 Thread GitBox
KazydubB commented on a change in pull request #1954: DRILL-7509: Incorrect TupleSchema is created for DICT column when querying Parquet files URL: https://github.com/apache/drill/pull/1954#discussion_r366847315 ## File path:

Complex data types

2020-01-19 Thread Paul Rogers
Hi All, We've been having a lively discussion about the pros and cons of Arrow. What are people's thoughts about another difficult topic: how we support complex types? Drill is a columnar engine. Columnar works best when data can be split into simple columns. The whole purpose of columnar is

Re: Connection Persistence (Cassandra Storage Plugin)

2020-01-19 Thread Paul Rogers
Hi Charles, Very cool! If you hold onto the Cassandra connection as a static on your storage plugin, you can use it easily enough, but there is no lifecycle management. We can probably invent some mechanism to ensure that the Cassandra connection is properly closed after some time and at

DICT keys in projection

2020-01-19 Thread Paul Rogers
Hi All, What did we decide to do about projecting DICT values? Drill allows us to project specific MAP members: SELECT myMap.x ... And, Drill allows projecting array members: SELECT myArray[3] ... I thought there was discussion of allowing Python-like syntax for projecting DICT values:

Re: Connection Persistence (Cassandra Storage Plugin)

2020-01-19 Thread Charles Givre
Hey Paul, I was messing with the Cassandra plugin last night and moved the connection logic to the actual StoragePlugin class. This, combined with a few null checks seemed to do the trick as queries are now virtually instantaneous! What remains to be done: 1. Filter pushdown not working:

[GitHub] [drill] paul-rogers commented on a change in pull request #1955: DRILL-7491: Incorrect count() returned for complex types in parquet

2020-01-19 Thread GitBox
paul-rogers commented on a change in pull request #1955: DRILL-7491: Incorrect count() returned for complex types in parquet URL: https://github.com/apache/drill/pull/1955#discussion_r368323139 ## File path:

[GitHub] [drill] paul-rogers commented on a change in pull request #1955: DRILL-7491: Incorrect count() returned for complex types in parquet

2020-01-19 Thread GitBox
paul-rogers commented on a change in pull request #1955: DRILL-7491: Incorrect count() returned for complex types in parquet URL: https://github.com/apache/drill/pull/1955#discussion_r368321457 ## File path:

[jira] [Created] (DRILL-7537) Convert Parquet format to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7537: --- Summary: Convert Parquet format to EVF Key: DRILL-7537 URL: https://issues.apache.org/jira/browse/DRILL-7537 Project: Apache Drill Issue Type:

[jira] [Created] (DRILL-7535) Convert Lstv to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7535: --- Summary: Convert Lstv to EVF Key: DRILL-7535 URL: https://issues.apache.org/jira/browse/DRILL-7535 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7538) Convert MaprDB format to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7538: --- Summary: Convert MaprDB format to EVF Key: DRILL-7538 URL: https://issues.apache.org/jira/browse/DRILL-7538 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7536) Convert Image format to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7536: --- Summary: Convert Image format to EVF Key: DRILL-7536 URL: https://issues.apache.org/jira/browse/DRILL-7536 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7534) Convert Httpd to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7534: --- Summary: Convert Httpd to EVF Key: DRILL-7534 URL: https://issues.apache.org/jira/browse/DRILL-7534 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7533) Convert Pcapng to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7533: --- Summary: Convert Pcapng to EVF Key: DRILL-7533 URL: https://issues.apache.org/jira/browse/DRILL-7533 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7532) Convert SysLog to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7532: --- Summary: Convert SysLog to EVF Key: DRILL-7532 URL: https://issues.apache.org/jira/browse/DRILL-7532 Project: Apache Drill Issue Type: Sub-task

[jira] [Created] (DRILL-7531) Move format plugins to EVF

2020-01-19 Thread Arina Ielchiieva (Jira)
Arina Ielchiieva created DRILL-7531: --- Summary: Move format plugins to EVF Key: DRILL-7531 URL: https://issues.apache.org/jira/browse/DRILL-7531 Project: Apache Drill Issue Type: