dear adarsh,
in the for loop, all i am trying to check is how many worker threads
might work.
the for loop does not launch the loader with 1176 worker threads, but
instead launches the loader first with 1 worker threads, then 2, and so on..
i am using cloudsuite 3.0, but we do not have docker setup, so i had to
rewrite every script within docker.
either way, the error is was in config.h where the max_num_of_servers
that can be used was set to 4.
so i had to rewrite that option. but that's that.
best,
rajiv nishtala
On 03/06/16 11:43, Arash Pourhabibi Zarandi wrote:
Dear Rajiv,
Thank you for using CloudSuite.
The option -w sets the number of worker threads. In you for loop you
are using$ias the number of worker threads. This means that you are
creating /1+2+3+…48=1176/ worker threads in aggregate. If you want to
have 48 worker threads, you need to pass -w 1 to loader.
By the way, we’ve recently released the new version of Cloudsuite,
which uses Docker to make the installation process easier. The
benchmark set has been updated as well. For more information about it
you can visit our webpage (cloudsuite.ch <http://cloudsuite.ch>).
Regards,
Arash Pourhabibi-Zarandi
School of Computer and Communication Sciences (IC)
École polytechnique fédérale de Lausanne (EPFL)
INJ 215, Station 14
CH-1015 Lausanne
http://arash.pourhabibi.info
On 02 Jun 2016, at 16:28, Rajiv Nishtala <rajiv.nisht...@bsc.es
<mailto:rajiv.nisht...@bsc.es>> wrote:
hi all,
i'm trying to run memcached on the first 48cores; and the request
generator on the remainder 48 cores.
just a note, they are on two different sockets.
i am launching 12 instances of memcached on different ports with 4
threads each on the localhost.
then for scaling the twitter dataset, i could use all 12 instances in
one server file and it works fine.
for warming the server, i had to warm one server at a time, just like
they say here
<https://www.mail-archive.com/cloudsuite@listes.epfl.ch/msg00279.html>.
BUT, when i'm trying to determine the max throughput and use 48
worker threads, it says connection error
with 47 server threads it says: number of worker threads should be
divisible by number of servers.
in my case, that is true with 48 worker threads..am i missing something?
how many worker threads should i use?
END=48
for ((i=1;i<=END;i++)); do
echo $i
taskset -c 0-47 ./loader -a
../twitter_dataset/twitter_dataset_40x -s allserver.txt -g 0.8 -T 1
-c 256 -w $i
done
details of allserver.txt
127.0.0.1, 11211
127.0.0.1, 11212
127.0.0.1, 11213
127.0.0.1, 11214
127.0.0.1, 11215
127.0.0.1, 11216
127.0.0.1, 11217
127.0.0.1, 11218
127.0.0.1, 11219
127.0.0.1, 11220
127.0.0.1, 11221
127.0.0.1, 11222
how i launch memcached instances..
for i in 11211 11212 11213 11214 11215 11216 11217 11218 11219 11220
11221 11222
do
taskset -c 48-95 ./memcached -t 4 -m 4096 -n 550 -p $i &
done
best wishes,
rajiv nishtala
WARNING / LEGAL TEXT: This message is intended only for the use of
the individual or entity to which it is addressed and may contain
information which is privileged, confidential, proprietary, or exempt
from disclosure under applicable law. If you are not the intended
recipient or the person responsible for delivering the message to the
intended recipient, you are strictly prohibited from disclosing,
distributing, copying, or in any way using this message. If you have
received this communication in error, please notify the sender and
destroy and delete any copies you may have received.
http://www.bsc.es/disclaimer
WARNING / LEGAL TEXT: This message is intended only for the use of the
individual or entity to which it is addressed and may contain
information which is privileged, confidential, proprietary, or exempt
from disclosure under applicable law. If you are not the intended
recipient or the person responsible for delivering the message to the
intended recipient, you are strictly prohibited from disclosing,
distributing, copying, or in any way using this message. If you have
received this communication in error, please notify the sender and
destroy and delete any copies you may have received.
http://www.bsc.es/disclaimer
