[
https://issues.apache.org/jira/browse/IMPALA-5843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845263#comment-16845263
]
ASF subversion and git services commented on IMPALA-5843:
---------------------------------------------------------
Commit 95be560e0c43a5f8ea7b00f3ba9f83ec3f734ca2 in impala's branch
refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=95be560 ]
IMPALA-7936: Enable better control over Parquet writing
This commit adds two new query options to Impala. One is to disable/
enable parquet page index writing (by default it is enabled), the other
is to set a row count limit per Parquet page (by default there is no
row count limit).
It removes the old command-line flag that controlled the enablement
of page index writing.
Since page index writing is the default since IMPALA-5843, I moved the
tests from the "custom cluster" test suite to the "query test" test
suite. This way the tests run faster because we don't need to restart
the Impala daemons.
Testing:
Added new test cases to test the effect of the query options.
Change-Id: Ib9ec8b16036e1fd35886e887809be8eca52a6982
Reviewed-on: http://gerrit.cloudera.org:8080/13361
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Use page index in Parquet files to skip pages
> ---------------------------------------------
>
> Key: IMPALA-5843
> URL: https://issues.apache.org/jira/browse/IMPALA-5843
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Affects Versions: Impala 2.10.0
> Reporter: Lars Volker
> Assignee: Zoltán Borók-Nagy
> Priority: Critical
> Labels: parquet, performance
> Fix For: Impala 3.3.0
>
>
> Once IMPALA-5842 has been resolved, we should skip pages based on the page
> index in Parquet files.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
