[
https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13263750#comment-13263750
]
Yuki Morishita commented on CASSANDRA-3668:
-------------------------------------------
Sylvain, thanks for review. I will post updates based on your feedback.
Before that, here is the result of my performance test.
Used 1 node for vanilla C* (0.8.10, 1.1.0, 1.1.0-patched), and 1 node for
sstableloader. Generated sstables to stream(8 files, 1.6GB total) using stress
tool against v0.8.10 cassandra, and performed sstableloader(streaming
throttling is disabled). Same sstable files were used for all tests. Each test
ran twice and took average.
|| test case || time to complete (sec) || avg. bps (MB/S) ||
| v0.8.10 | 52.38(*1) | 53 |
| v1.1.0 | 52.30 | 15 |
| v1.1.0-patched n=1 | 52.61 | 15 |
| v1.1.0-patched n=2 | 32.42 | 27 |
| v1.1.0-patched n=4 | 30.80 | 27 |
| v1.1.0-patched n=8 | 33.88 | 25 |
n value for v1.1.0-patched is number of threads to use.
v0.8.10 sleeps 30 sec to get gossip info, so (*1) is actually 22.38.
It's not as fast as 0.8 with this feature, but can boost loading compared to
current versions.
> Performance of sstableloader is affected in 1.0.x
> -------------------------------------------------
>
> Key: CASSANDRA-3668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
> Project: Cassandra
> Issue Type: Bug
> Components: API
> Affects Versions: 1.0.0
> Reporter: Manish Zope
> Assignee: Yuki Morishita
> Priority: Minor
> Labels: streaming
> Fix For: 1.1.1
>
> Attachments: 0001-Allow-multiple-connection-in-StreamInSession.patch,
> 0002-Allow-concurrent-stream-in-StreamOutSession.patch,
> 0003-Add-threads-option-to-sstableloader.patch,
> 3688-reply_before_closing_writer.txt, sstable-loader performance.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance
> of the sstable generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589
> As stated in above issue generator performance is rectified but performance
> of the sstableloader is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the
> problem with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its
> Working fine.
> Please let us know if you guys require further inputs from our side.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
