[ 
https://issues.apache.org/jira/browse/HIVE-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15438428#comment-15438428
 ] 

Matt McCline commented on HIVE-14515:
-------------------------------------

Got rid of the FetchWork Q files.  Removed "MapWork" from other Q file names.  
Separated ACID update/delete queries into separate files.

I found that the thing that reduced time the most was combining queries.

>From my laptop:
{code}
Done query: schema_evol_orc_acid_part.q elapsedTime=25s
Done query: schema_evol_orc_acid_part_update.q elapsedTime=11s
Done query: schema_evol_orc_acid_table.q elapsedTime=19s
Done query: schema_evol_orc_acid_table_update.q elapsedTime=8s
Done query: schema_evol_orc_acidvec_part.q elapsedTime=23s
Done query: schema_evol_orc_acidvec_part_update.q elapsedTime=10s
Done query: schema_evol_orc_acidvec_table.q elapsedTime=18s
Done query: schema_evol_orc_acidvec_table_update.q elapsedTime=7s
Done query: schema_evol_orc_nonvec_part.q elapsedTime=17s
Done query: schema_evol_orc_nonvec_part_all_complex.q elapsedTime=8s
Done query: schema_evol_orc_nonvec_part_all_primitive.q elapsedTime=15s
Done query: schema_evol_orc_nonvec_table.q elapsedTime=13s
Done query: schema_evol_orc_vec_part.q elapsedTime=16s
Done query: schema_evol_orc_vec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_orc_vec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_orc_vec_table.q elapsedTime=12s
Done query: schema_evol_stats.q elapsedTime=3s
Done query: schema_evol_text_nonvec_part.q elapsedTime=16s
Done query: schema_evol_text_nonvec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_nonvec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_nonvec_table.q elapsedTime=12s
Done query: schema_evol_text_vec_part.q elapsedTime=16s
Done query: schema_evol_text_vec_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_vec_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_vec_table.q elapsedTime=12s
Done query: schema_evol_text_vecrow_part.q elapsedTime=16s
Done query: schema_evol_text_vecrow_part_all_complex.q elapsedTime=7s
Done query: schema_evol_text_vecrow_part_all_primitive.q elapsedTime=14s
Done query: schema_evol_text_vecrow_table.q elapsedTime=12s
{code}

> Schema evolution uses slow INSERT INTO .. VALUES
> ------------------------------------------------
>
>                 Key: HIVE-14515
>                 URL: https://issues.apache.org/jira/browse/HIVE-14515
>             Project: Hive
>          Issue Type: Sub-task
>          Components: Hive
>            Reporter: Matt McCline
>            Assignee: Matt McCline
>            Priority: Critical
>         Attachments: HIVE-14515.01.patch
>
>
> Use LOAD DATA LOCAL INPATH and INSERT INTO TABLE ... SELECT * FROM instead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to