> Thanks.
> Sean
>
> 2011/3/22 Ryan King
>>
>> On Mon, Mar 21, 2011 at 4:02 AM, pob wrote:
>> > Hi,
>> > I'm inserting data from client node with stress.py to cluster of 6
>> > nodes.
>> > They are all on 1Gbps network, max r
I am just wondering, why the stress test tools (python, java) need more
threads ?
Is the bottleneck of a single thread in the client, or in the server?
Thanks.
Sean
2011/3/22 Ryan King
> On Mon, Mar 21, 2011 at 4:02 AM, pob wrote:
> > Hi,
> > I'm inserting data from client
())+ ' '
+ str(start) + ' ' + str(endtime) + '\n')
You need to understand little bit of python to plug this properly in stress.py.
Above creates lot of log*.txt files. One for each thread.
Each line in these log files have the duration,
thread#,key,timesta
On Mon, Mar 21, 2011 at 9:34 AM, pob wrote:
> You mean,
> more threads in stress.py? The purpose was figure out whats the
> biggest bandwidth that C* can use.
You should try more threads, but at some point you'll hit diminishing
returns there. You many need to drive load from more
You mean,
more threads in stress.py? The purpose was figure out whats the
biggest bandwidth that C* can use.
Peter
2011/3/21 Ryan King
> On Mon, Mar 21, 2011 at 4:02 AM, pob wrote:
> > Hi,
> > I'm inserting data from client node with stress.py to cluster of 6 nodes.
On Mon, Mar 21, 2011 at 4:02 AM, pob wrote:
> Hi,
> I'm inserting data from client node with stress.py to cluster of 6 nodes.
> They are all on 1Gbps network, max real throughput of network is 930Mbps
> (after measurement).
> python stress.py -c 1 -S 17 -d{6n
Hi,
I'm inserting data from client node with stress.py to cluster of 6 nodes.
They are all on 1Gbps network, max real throughput of network is 930Mbps
(after measurement).
python stress.py -c 1 -S 17 -d{6nodes} -l3 -e QUORUM
--operation=insert -i 1 -n 50 -t100
The probl
t 11:33 AM, A J wrote:
> Client side (it is just a 5th instance in the same EC2 zone, having
> stress.py installed on it) gives the following error:
>
> Process Inserter-4:
> Traceback (most recent call last):
> File "/usr/lib64/python2.6/multiprocessing/process.py&quo
Client side (it is just a 5th instance in the same EC2 zone, having
stress.py installed on it) gives the following error:
Process Inserter-4:
Traceback (most recent call last):
File "/usr/lib64/python2.6/multiprocessing/process.py", line 232, in
_bootstrap
self.run()
File
:
>
>
> 2011/3/8 A J
> Trying out stress.py on AWS EC2 environment (4 Large instances. Each
> of 2-cores and 7.5GB RAM. All in the same region/zone.)
>
> python stress.py -o insert -d
> 10.253.203.224,10.220.203.48,10.220.17.84,10.124.89.81 -l 2 -e ALL -t
> 10 -n 500 -S
2011/3/8 A J
> Trying out stress.py on AWS EC2 environment (4 Large instances. Each
> of 2-cores and 7.5GB RAM. All in the same region/zone.)
>
> python stress.py -o insert -d
> 10.253.203.224,10.220.203.48,10.220.17.84,10.124.89.81 -l 2 -e ALL -t
> 10 -n 500 -S 100 -k
Trying out stress.py on AWS EC2 environment (4 Large instances. Each
of 2-cores and 7.5GB RAM. All in the same region/zone.)
python stress.py -o insert -d
10.253.203.224,10.220.203.48,10.220.17.84,10.124.89.81 -l 2 -e ALL -t
10 -n 500 -S 100 -k
(I want to try with column size of about 1MB
thread count down and see what happens to the latency. AaronOn 06 Aug, 2010,at 07:32 AM, SSam wrote:Finally I able to configure and run this program on my 3 node cluster. #python stress.py -n 20 -t 200 -d 172.16.7.76,172.16.7.77,172.16.7.78 -o read
total,interval_op_rate,avg_latency
Finally I able to configure and run this program on my 3 node cluster.
#python stress.py -n 20 -t 200 -d 172.16.7.76,172.16.7.77,172.16.7.78 -o
read
total,interval_op_rate,avg_latency,elapsed_time
83664,8366,0.0278478825376,10
145478,6181,0.0295496694395,20
This url got simple steps to create cluster and stress testing setup also.
http://www.coreyhulen.org/category/cassandra/
From: SSam
To: user@cassandra.apache.org
Sent: Wed, August 4, 2010 7:02:24 PM
Subject: Re: stress.py
Thanks for the reply,
Issue
Thanks for the reply,
Issue resolved, thift site-packages/thrift/transport/TTransport.py not in
proper path.
I have updated Python PATH , stress.py worked without any issues.
From: Peter Schuller
To: user@cassandra.apache.org
Sent: Wed, August 4
> After I add the thift libs to CLASS_PATH , it's failing with following
> error.
>
> /stress.py: line 21: have_multiproc: command not found
> ./stress.py: line 22: try:: command not found
And that sounds like stress.py is being run by a shell rather than by
Python. Not su
(Jonathan Ellis' suggestion to just use 'ant gen-thrift-py' is of
course preferred over my manual approach)
As for this:
> Now it's failing with following error. Do I have put thrift.jar in JAVA
> CLASSPATH.
>
> Traceback (most recent
After I add the thift libs to CLASS_PATH , it's failing with following error.
/stress.py: line 21: have_multiproc: command not found
./stress.py: line 22: try:: command not found
./stress.py: line 23: from: command not found
./stress.py: line 24: from: command not found
./stress.py: li
File "stress.py", line 36, in
from thrift.transport import TTransport
ImportError: No module named thrift.transport
---
Thanks,
SSam
From: Peter Schuller
To: user@cassandra.apache.org
Sent: Wed, August 4,
or just
ant gen-thrift-py
python contrib/py_stress/stress.py
On Wed, Aug 4, 2010 at 5:53 PM, Peter Schuller
wrote:
>> Can somebody please give steps to run cassandra stess.py program.
>
> Assuming you have the thrift compiler installed, something like (from
> memory, not
> Can somebody please give steps to run cassandra stess.py program.
Assuming you have the thrift compiler installed, something like (from
memory, not tested):
cd contrib/py_stress
thrift --gen py:new ../../interface/cassandra.thrift
export PYTHONPATH=$(pwd)/gen-py
python stress.py
--
/ Pe
Can somebody please give steps to run cassandra stess.py program.
23 matches
Mail list logo
