Steven Phillips created DRILL-3333:
--------------------------------------

             Summary: Add support for auto-partitioning in parquet writer
                 Key: DRILL-3333
                 URL: https://issues.apache.org/jira/browse/DRILL-3333
             Project: Apache Drill
          Issue Type: Bug
            Reporter: Steven Phillips


When a table is created with a partition by clause, the parquet writer will 
create separate files for the different partition values. The data will first 
be sorted by the partition keys, and the parquet writer will create new file 
when it encounters a new value for the partition columns.

When data is queried against the data that was created this way, partition 
pruning will work if the filter contains a partition column. And unlike 
directory based partitioning, no view is required, nor is it necessary to 
reference the dir* column names.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to