[ 
https://issues.apache.org/jira/browse/KUDU-1688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15665514#comment-15665514
 ] 

Todd Lipcon commented on KUDU-1688:
-----------------------------------

Also put this in branch-1.1.x prior to 1.1.0 release: 
1e59b599b392e38b9cbb947a4f334b8999f3b5ea

> Impala 'INSERT IGNORE' is slow due to VLOG(1) logging in client
> ---------------------------------------------------------------
>
>                 Key: KUDU-1688
>                 URL: https://issues.apache.org/jira/browse/KUDU-1688
>             Project: Kudu
>          Issue Type: Improvement
>          Components: impala, perf
>    Affects Versions: 1.0.0
>            Reporter: Todd Lipcon
>            Assignee: Alexey Serbin
>             Fix For: 1.1.0
>
>
> Currently Batcher::ProcessWriteResponse will log a VLOG(1) entry for every 
> row error it experiences. When using INSERT IGNORE in Impala, this can yield 
> thousands of logs per second and makes it extremely slow.
> We should consider bumping this to a higher vlog level, or pushing the 
> 'insert ignore' flag into the operations themselves (even before KUDU-1563 is 
> finished we could just drop the errors inside the client side)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to