[
https://issues.apache.org/jira/browse/HIVE-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438428#comment-15438428
]
Matt McCline commented on HIVE-14515:
-------------------------------------
Got rid of the FetchWork Q files. Removed "MapWork" from other Q file names.
Separated ACID update/delete queries into separate files.
I found that the thing that reduced time the most was combining queries.
>From my laptop:
{code}
Done query: schema_evol_orc_acid_part.q elapsedTime=25s
Done query: schema_evol_orc_acid_part_update.q elapsedTime=11s
Done query: schema_evol_orc_acid_table.q elapsedTime=19s
Done query: schema_evol_orc_acid_table_update.q elapsedTime=8s
Done query: schema_evol_orc_acidvec_part.q elapsedTime=23s
Done query: schema_evol_orc_acidvec_part_update.q elapsedTime=10s
Done query: schema_evol_orc_acidvec_table.q elapsedTime=18s
Done query: schema_evol_orc_acidvec_table_update.q elapsedTime=7s
Done query: schema_evol_orc_nonvec_part.q elapsedTime=17s
Done query: schema_evol_orc_nonvec_part_all_complex.q elapsedTime=8s
Done query: schema_evol_orc_nonvec_part_all_primitive.q elapsedTime=15s
Done query: schema_evol_orc_nonvec_table.q elapsedTime=13s
Done query: schema_evol_orc_vec_part.q elapsedTime=16s
Done query: schema_evol_orc_vec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_orc_vec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_orc_vec_table.q elapsedTime=12s
Done query: schema_evol_stats.q elapsedTime=3s
Done query: schema_evol_text_nonvec_part.q elapsedTime=16s
Done query: schema_evol_text_nonvec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_nonvec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_nonvec_table.q elapsedTime=12s
Done query: schema_evol_text_vec_part.q elapsedTime=16s
Done query: schema_evol_text_vec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_vec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_vec_table.q elapsedTime=12s
Done query: schema_evol_text_vecrow_part.q elapsedTime=16s
Done query: schema_evol_text_vecrow_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_vecrow_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_vecrow_table.q elapsedTime=12s
{code}
> Schema evolution uses slow INSERT INTO .. VALUES
> ------------------------------------------------
>
> Key: HIVE-14515
> URL: https://issues.apache.org/jira/browse/HIVE-14515
> Project: Hive
> Issue Type: Sub-task
> Components: Hive
> Reporter: Matt McCline
> Assignee: Matt McCline
> Priority: Critical
> Attachments: HIVE-14515.01.patch
>
>
> Use LOAD DATA LOCAL INPATH and INSERT INTO TABLE ... SELECT * FROM instead.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)