[ 
https://issues.apache.org/jira/browse/OMID-145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16818132#comment-16818132
 ] 

Lars Hofhansl commented on OMID-145:
------------------------------------

Ah yes. That too. I set it to 100.000. Good catch! Does that mean that any 
transaction over 100k rows would automatically fail?

Interestingly, I did not see any aborts. Even though in the end I UPSERTed 200k 
rows in one transaction.

Thanks for looking at all these issues. I'm not aware of any other pressing 
issues. And in general I'm a fan of frequent, small releases anyway. If you put 
of a 1.0.1 I will do my (non-binding, I'm not a PMC member) vote.

 

> High CPU usage during compactions.
> ----------------------------------
>
>                 Key: OMID-145
>                 URL: https://issues.apache.org/jira/browse/OMID-145
>             Project: Apache Omid
>          Issue Type: Bug
>            Reporter: Lars Hofhansl
>            Priority: Major
>             Fix For: 1.0.1
>
>         Attachments: compactionTiming.png
>
>
> See attached image, almost all (96%!!) of the compaction time is spent in 
> org.apache.hadoop.hbase.regionserver.CompactorScanner.queryCommitTimestamp()
> I guess that's when the shadowCell is not yet present.
> We already have problems with long compactions in HBase, prolonging these 
> potentially by 25x (all the rest of the compaction logic took only 4% of the 
> time), would not be a pleasant idea.
> Perhaps we can do that same caching we do with the commit cache during 
> regular scanning...?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to