[
https://issues.apache.org/jira/browse/IMPALA-13881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17937452#comment-17937452
]
ASF subversion and git services commented on IMPALA-13881:
----------------------------------------------------------
Commit 32836eab4a42541e44d95435f815a5d0cf9d3b24 in impala's branch
refs/heads/master from jasonmfehr
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=32836eab4 ]
IMPALA-13881: Fix Workload Management Statement Expression Limit Exceeded Errors
The workload management code calculates the needed statement
expression limit by multiplying the number of columns in the workload
management completed queries table by the number of rows being
inserted. This calculation was added in case the
default_query_options startup flag sets the default value of the
statement_expression_limit query option to a very low value.
In practice, the calculation has been wrong causing workload
management insert DMLs to fail with:
"AnalysisException: Exceeded the statement expression limit (1024)".
This commit adds a new hidden startup flag query_log_expression_limit
to set the value of the statement_expression_limit query option on
the workload management insert DMLs. If the value of this flag is
less than 0, the query option is not set. Otherwise, the query option
is set to the value of this new flag.
Additionally, the query_log_max_queued startup flag has been reduced
from 5,000 to 3,000. This flag places an upper limit on the completed
queries queue size, and if workload management attempted to insert
5,000 records at once, it would exceed the 250,000 default for the
statement_expression_limit query option.
Testing was accomplished by running all workload management related
custom cluster tests locally.
Change-Id: I999187b33cfab411b62931458f2c4ce3be5ad88d
Reviewed-on: http://gerrit.cloudera.org:8080/22652
Reviewed-by: Impala Public Jenkins <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Workload Management Insert DML Exceeds Statement Expression Limit
> -----------------------------------------------------------------
>
> Key: IMPALA-13881
> URL: https://issues.apache.org/jira/browse/IMPALA-13881
> Project: IMPALA
> Issue Type: Bug
> Reporter: Jason Fehr
> Assignee: Jason Fehr
> Priority: Major
> Labels: workload-management
>
> We have had instances of the below error reportedly occurring when the
> workload management insert into sys.impala_query_log dml executes.
> I0210 17:03:35.554198 952 jni-util.cc:302]
> b4430cffdd42920a:9c1b096b00000000]
> org.apache.impala.common.AnalysisException: Exceeded the statement expression
> limit (1024)
> Statement has 1593 expressions.
> at
> org.apache.impala.analysis.Analyzer.checkStmtExprLimit(Analyzer.java:4073)
> at
> org.apache.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:559)
> at
> org.apache.impala.analysis.AnalysisContext.analyzeAndAuthorize(AnalysisContext.java:498)
> at
> org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:2530)
> at
> org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:2218)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1979)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:175)
> I0210 17:03:35.554225 952 status.cc:129] b4430cffdd42920a:9c1b096b00000000]
> AnalysisException: Exceeded the statement expression limit (1024)
> Statement has 1593 expressions.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
