[
https://issues.apache.org/jira/browse/CASSANDRA-3668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179591#comment-13179591
]
Manish Zope edited comment on CASSANDRA-3668 at 1/4/12 4:23 PM:
----------------------------------------------------------------
Yuki,
Our test environment consist of cassandra cluster of two nodes and one loader
machine.
Readings of the I/O and CPU usage is mentioned in the attached text file.
Specifically we don't see any spikes in cpu usage either on loader or cassandra
nodes.
During data load with 0.8.7 setup the average load on the cassandra nodes was
higher as compared to 1.0.7.
So I guess cassandra 1.0.7 is not making full use of the resources available on
the cassandra nodes.
1.0.7 used here is with updated patch mentioned in issue - 3589.
I might be wrong giving this advice but is it possible to change the
UnsortedWriter so that we can generate
sstables that are already compressed ? This will also help in making loading
process even faster as the data
that need to be streamed will be very less and save the resources required by
cassandra nodes for compressing.
Thanks
Manish
was (Author: mzope):
Yuki,
Our test environment consist of cassandra cluster of two nodes and one loader
machine.
Readings of the I/O and CPU usage is mentioned in the attached text file.
Specifically we don't see any spikes in cpu usage either on loader or cassandra
nodes.
During data load with 0.8.7 setup the average load on the cassandra nodes was
higher as compared to 1.0.7.
So I guess cassandra 1.0.7 is not making full use of the resources available on
the cassandra nodes.
1.0.7 used here is with updated patch mentioned in issue - 3589.
Thanks
Manish
> Performance of sstableloader is affected in 1.0.x
> -------------------------------------------------
>
> Key: CASSANDRA-3668
> URL: https://issues.apache.org/jira/browse/CASSANDRA-3668
> Project: Cassandra
> Issue Type: Bug
> Components: API
> Affects Versions: 1.0.7
> Reporter: Manish Zope
> Assignee: Yuki Morishita
> Fix For: 1.0.7
>
> Attachments: sstable-loader performance.txt
>
> Original Estimate: 48h
> Remaining Estimate: 48h
>
> One of my colleague had reported the bug regarding the degraded performance
> of the sstable generator and sstable loader.
> ISSUE :- https://issues.apache.org/jira/browse/CASSANDRA-3589
> As stated in above issue generator performance is rectified but performance
> of the sstableloader is still an issue.
> 3589 is marked as duplicate of 3618.Both issues shows resolved status.But the
> problem with sstableloader still exists.
> So opening other issue so that sstbleloader problem should not go unnoticed.
> FYI : We have tested the generator part with the patch given in 3589.Its
> Working fine.
> Please let us know if you guys require further inputs from our side.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
