[ 
https://issues.apache.org/jira/browse/IMPALA-14553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Smith resolved IMPALA-14553.
------------------------------------
    Fix Version/s: Impala 5.0.0
       Resolution: Fixed

> Speed up generate-schema-statements
> -----------------------------------
>
>                 Key: IMPALA-14553
>                 URL: https://issues.apache.org/jira/browse/IMPALA-14553
>             Project: IMPALA
>          Issue Type: Task
>          Components: Infrastructure
>            Reporter: Michael Smith
>            Assignee: Michael Smith
>            Priority: Minor
>             Fix For: Impala 5.0.0
>
>
> Just generating the schemas for functional-query with
> {code}
> ./testdata/bin/generate-schema-statements.py --workload=functional-query
> {code}
> can take over 2 minutes. Most of that time is spent handling eval statements 
> in functional_schema_template.sql (the shell commands that start with {{`}}). 
> {{eval_section}} is called for each row in test_vectors, even though the 
> operations don't change.
> We can speed this up by running {{eval_section}} once for each field, and 
> running them in parallel.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to