[ 
https://issues.apache.org/jira/browse/KNOX-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16650487#comment-16650487
 ] 

Kevin Risden commented on KNOX-1525:
------------------------------------

h2. Test Case Setup

The following results are tested with:
 * a single 4 core 8GB RAM Centos 7 VM on my Macbook Pro laptop
 * openjdk version "1.8.0_181"
 * HBase 2.1.0 single node
 * Knox 1.1.0 without SSL
 * data set - 1 million rows generated
 ** rowkey - 1-1000000
 ** column family:qualifier - a:a
 ** value - hello world
 * scan limit to first 50 thousand, 100 thousand, and 200 thousand rows

Create table
{code:java}
curl -vi -XPUT -H "Accept: text/xml" -H "Content-Type: text/xml" -d '<?xml 
version="1.0" encoding="UTF-8"?><TableSchema name="testdata"><ColumnSchema 
name="a" /></TableSchema>' "http://hbase.vagrant:8080/testdata/schema"{code}
Testing commands
 * HBase shell

 ** 
{code:java}
time echo "scan 'testdata', {'LIMIT' => 100000}" | /opt/hbase-2.1.0/bin/hbase 
shell >/dev/null{code}

 * HBase Rest

 ** 
{code:java}
time curl -u admin:admin-password -s -H "Accept: application/json" 
'http://hbase.vagrant:8080/testdata/*?limit=100000' >/dev/null{code}

 * HBase Rest with Knox

 ** 
{code:java}
time curl -u admin:admin-password -s -H "Accept: application/json" 
'http://hbase.vagrant:8443/gateway/sandbox/hbase/testdata/*?limit=100000' 
>/dev/null{code}

> HBase "scan" performance evaluation
> -----------------------------------
>
>                 Key: KNOX-1525
>                 URL: https://issues.apache.org/jira/browse/KNOX-1525
>             Project: Apache Knox
>          Issue Type: Task
>            Reporter: Kevin Risden
>            Assignee: Kevin Risden
>            Priority: Major
>             Fix For: 1.2.0
>
>
> While looking at WebHDFS performance in KNOX-1221, I decided to look a bit 
> more into performance for common use cases. HBase performance is another area 
> that could use some research.
> Use "scan limit" to get a comparison of raw return speed from HBase Rest. 
> This should show how fast results can be streamed through HBase Rest and 
> Knox. Compare the results to "hbase shell" since this will render the data 
> directly from HBase through the typical HBase shell. This should give 
> comparisons for the difference in overhead between HBase, HBase Rest and 
> HBase Rest with Knox.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to