Michael Smith created IMPALA-14553:
--------------------------------------
Summary: Speed up generate-schema-statements
Key: IMPALA-14553
URL: https://issues.apache.org/jira/browse/IMPALA-14553
Project: IMPALA
Issue Type: Task
Reporter: Michael Smith
Assignee: Michael Smith
Just generating the schemas for functional-query with
{code}
./testdata/bin/generate-schema-statements.py --workload=functional-query
{code}
can take over 2 minutes. Most of that time is spent handling eval statements in
functional_schema_template.sql (the shell commands that start with {{`}}).
{{eval_section}} is called for each row in test_vectors, even though the
operations don't change.
We can speed this up by running {{eval_section}} once for each field, and
running them in parallel.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
