Does anyone know how and if the LIMIT push down to Parquet file works?

I have a parquet file with 53K records in 1 row group. When I run a SELECT
* from <table> LIMIT 1, I see the Parquet reader operator process 32768
records. I would have expected either 1 or 53K. So questions;

1) Does the Parquet MR library offer the ability to push down LIMITs to
Parquet files? From the above, the answer looks like yes.
2) If so, how does Drill come up with the magic number 32767? Is there a
way I can make it read just 1 row if the query is a LIMIT 1?

Veera Naranammalpuram
Product Specialist - SQL on Hadoop
*MapR Technologies ( <>)*
*(Email) <>*
*(Mobile) 917 683 8116 - can text *
*Timezone: ET (UTC -5:00 / -4:00)*

Reply via email to