[
https://issues.apache.org/jira/browse/IMPALA-12548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884386#comment-17884386
]
ASF subversion and git services commented on IMPALA-12548:
----------------------------------------------------------
Commit 93c64e7e9a771d72b860d1a6bdccc33d9f46f5ac in impala's branch
refs/heads/master from Riza Suminto
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=93c64e7e9 ]
IMPALA-13376: Add docs for AGG_MEM_CORRELATION_FACTOR etc
This patch adds documentation for AGG_MEM_CORRELATION_FACTOR and
LARGE_AGG_MEM_THRESHOLD option introduced in Apache Impala 4.4.0.
IMPALA-12548 fix behavior of AGG_MEM_CORRELATION_FACTOR. Higher value
will lower memory estimation, while lower value will result in higher
memory estimation. The documentation in ImpalaService.thrift, however,
says the opposite. This patch fix documentation in thrift file as well.
Testing:
- Run "make plain-html" in docs/ dir and confirm the output.
- Manually check with comments in
PlannerTest.testAggNodeMaxMemEstimate()
Change-Id: I00956a50fb7616ca3c3ea2fd75fd11239a6bcd90
Reviewed-on: http://gerrit.cloudera.org:8080/21793
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Michael Smith <[email protected]>
> Clarify the meaning of AGG_MEM_CORRELATION_FACTOR
> -------------------------------------------------
>
> Key: IMPALA-12548
> URL: https://issues.apache.org/jira/browse/IMPALA-12548
> Project: IMPALA
> Issue Type: Bug
> Affects Versions: Impala 4.3.0
> Reporter: Riza Suminto
> Assignee: Riza Suminto
> Priority: Major
> Fix For: Impala 4.4.0
>
>
> AGG_MEM_CORRELATION_FACTOR has valid value between 0.0 to 1.0. This query
> option name can be misinterpreted as high value means highly correlated
> columns, but it is actually the opposite in the code implementation. 1.0 is
> interpreted as no correlation at all in the code, while <1.0 means somewhat
> correlated. Documentation should be clarified about this.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
