It's `build-essential`, iirc.
On Sun, 14 Nov 2010, Steven Veneralle wrote:
hey Alex. for some reason Debain doesnt find that package. i am literally
coming off a fresh instal plus Im having to do everything n CLI remotly
On Sun, Nov 14, 2010 at 2:42 PM, Alex Miller
reclaims are good, evictions are bad
On Thu, 4 Nov 2010, Kate Wang wrote:
We are experiencing high reclaims instead of evictions. Could slab
distribution shift cause that as well?
If the slab distribution shifted could cause high eviction rate, what's the
best way to fix it or avoid it?
wrote:
Hi Dormando,
We have tried the setting with 48MB and 64MB, but the same problem
still comes out.
Please kindly help to clarify.
Thank you.
-Yashushi
On 10月18日, 下午4時50分, dormando dorma...@rydia.net wrote:
Hi,
My team try to use memcached to provide PHP caching recently
soon [tm]
On Tue, 19 Oct 2010, Pavel Kushnirchuk wrote:
Folks,
May be anybody know, when will be a next planned release of memcached.
Especially I am interested in a release of Win32 branch.
I think you're supposed to read to the point where it says queues stuff
in memory before sending to the server and extrapolate that writing to
the queue too fast is a bad thing.
On Sun, 17 Oct 2010, Shi Yu wrote:
Kelvin.
This is year 2010 and computer programs should not be that fragile.
And
our 50+ consistent hashing cluster is very reliable on normal
operations, incr/decr, get, set, multiget, etc. is not a problem. If
we have a problem with keys on wrong servers in the continuum, we
should have more problems, which we currently have not.
The cluster is always under relatively
Yeah, right. :-) Restarting all memd instances is not an option. Can
you explain, why it is not possible?
Because we've programmed the commands with the full intent to be atomic.
If it's not, there's a bug... there's an issue with incr/decr that's been
fixed upstream but we've never had a
On 14 Okt., 10:31, dormando dorma...@rydia.net wrote:
Yeah, right. :-) Restarting all memd instances is not an option. Can
you explain, why it is not possible?
Because we've programmed the commands with the full intent to be atomic.
If it's not, there's a bug... there's an issue
well, I just used this tool to force enough requests :)
ok, I extended it a bit, for generating min/max/avg times of the
processes,
and for executing an explicit memcache get.
If you like, You can adopt my patches for redistribution:
http://www.maiers.de/memcache/mc_conn_tester.pl
IIRC
here it is (public domain) along with a wiki page on how to use it.
-Dormando
We took it out for a reason, + if you run with -t 1 you won't really see
contention. 'Cuz it's running single threaded and using futexes under
linux. Those don't have much of a performance hit until you do contend.
I know some paper just came out which showed people using multiple
memcached
own trivial client---in particular, as you
mentioned, I am interested in the scalability of
memcached (-t 4 versus proper singlethreaded/multi-process) with respect to
the key and/or value size.
Regards,
T
On Mon, Oct 4, 2010 at 4:21 PM, dormando dorma...@rydia.net wrote:
We took
I have a memcached server in a production environment that is showing
a strange behavior :
bytes_written grows fast (~1.2Mo per second), but the number of
cmd_set does not change!
How is that possible?
The bytes_* values refer to bytes written/read to the network. fetches/etc
will tick
where to go from there. I'm going to look up
Dormando's suggestions but if anyone else has experience with this and
can point us in the right direction, it would be greatly appreciated.
Thanks,
Jay
On Sep 27, 2:34 pm, dormando dorma...@rydia.net wrote:
We have an 2 x quad core server with 32
We have an 2 x quad core server with 32 gb ram. If many clients
connect to this server (only memcached runs on it) the first core run
to nearly 100 % use by si (software interrups) and so some client
can't reach the server.
Memcached runs currently with 4 threads and with version (1.4.2). All
Uhhhm.
memcached-init is from:
commit 4b1b1ae76ef6e78dd3f1d753931ac8051ae99e9a
Author: Brad Fitzpatrick b...@danga.com
Date: Tue Dec 30 19:56:33 2003 +
I assume brad copied the skeleton files and modified it. IANAL so I'm not
sure how much of it had to be changed to be able to flip the
Upgrade back to 1.4.5 and look for the 'listen_disabled_num' value in the
stats output. If the number is increasing, you're hitting maxconns.
If not, you're probably seeing packet loss, or have a firewall in the way
that's maxing out.
On Tue, 7 Sep 2010, the_fonz wrote:
Guys,
We are seeing
We're still working on merging down 1.6... but if this exists outside as
an engine nothing of us blocks you from using it for now.
I sort of wonder a little about outright pulling it into the tree, since
that implies we have to maintain it.
On Fri, 27 Aug 2010, KaiGai Kohei wrote:
BTW, how
. :-)
Thanks,
On 8月27日, 午後6:02, dormando dorma...@rydia.net wrote:
We're still working on merging down 1.6... but if this exists outside as
an engine nothing of us blocks you from using it for now.
I sort of wonder a little about outright pulling it into the tree, since
that implies we have
Expire time turns into a unixtime date after 30 days. It's in the protocol.txt
but possibly overlooked in the wiki :(
On Aug 26, 2010, at 8:19 PM, kedy211 kedy...@gmail.com wrote:
It's unusually the question I mentioned in the topic. And, I can NOT find the
offical answer from wiki.
entirely, but I think we'll need both
fixes :P
-Dormando
from IRC for posterity): I like shoving an ERROR: Too many
connections down the pipe before closing it. Gives client authors the
chance to throw useful errors for the developer. Otherwise it's likely to
manifest as failed gets/sets with no errors.
-Dormando
sto
On Wed, 18 Aug 2010, Chad wrote:
I am trying to find a way to check if the memcachedclient is still
alive or not but it seems to be there is no public api for me to do
so. Can someone clarify this?
Thanks.
Chad
On Wed, 18 Aug 2010, Matt Ingenthron wrote:
dormando wrote:
sto
I'm pretty sure he sent it only once. I think this is a problem with Google's
SMTP and MTAs if I recall correctly. This happened on a majordomo based list
I
Can you resubmit as a unified diff?
On Tue, 17 Aug 2010, ilnarb wrote:
I suggest you to eliminate taking of the lock on cqi_freelist.
In order to it we should done all work on cqi_freelist by one thread
-- dispatcher thread in memcached.
I made some changes in queue code, including
On Sat, 7 Aug 2010, Dustin wrote:
On Aug 7, 7:52 am, Loganaden Velvindron logana...@gmail.com wrote:
There seems to be a problem when I pasted it in gmail.
Here's a link to the git diff:
http://devio.us/~loganaden/memcached.git.diff
This makes some sense to me. That
On Thu, 29 Jul 2010, j.s. mammen wrote:
Folks, lets not get bogged down by REST defined by Roy Fielding in
2000.
My question was simple.
Here it is again, rephrased.
Do we need to implement a memcached layer whereby we can access the
cached objects by using HTTP protocol. Here is an
On Fri, Jul 23, 2010 at 8:47 AM, dormando dorma...@rydia.net wrote:
I tried.
Try the engine branch?
I guess, I'll have to at some point.
Just wanted to say, that LRU was designed as an algorithm for a uniform cost
model, where all elements are almost equally important (have
On Sun, 25 Jul 2010, Jakub Łopuszański wrote:
Thanks for an explanation.
I see that we have entirely different points of view, probably caused by
totally different identified sets of bottlenecks, different
usage, different configurations etc (I assume that you have greater
experience,
without risking that the
old cluster will run of memory. Again monitoring
evictions can not reliably tell you how many machines can you remove from the
cluster, while monitoring memory gives you perfectly accurate info.
On Fri, Jul 23, 2010 at 12:12 AM, dormando dorma...@rydia.net wrote
http://code.google.com/p/memcached/wiki/NewServerMaint#Looks_Can_be_Deceiving
Think I'll write a separate page about managing memory, based off of the
slides from my mysqlconf presentation about monitoring memcached...
We're not ignoring you, the patch is against what the LRU is designed for.
Huzzah!
On Mon, 19 Jul 2010, Patrick Galbraith wrote:
Hi all!
I'm pleased to announce the release of Cache::Memcached::libmemcached 0.02011
and Memcached::libmemcached 0.4201. Cache::Memcached::libmemcached uses
Memcached::libmemcached, which is a Perl wrapper for libmemcached, which is
with the
protocol. Or the client's just buggy...
Sorry, don't have any ideas about what it could be in particular. make
sure you're sending keys that don't have newlines/spaces/etc in them and
that you're not clobbering the object somehow.
-Dormando
.
//Logan
C-x-C-c
On Tue, Jul 20, 2010 at 2:38 AM, dormando dorma...@rydia.net wrote:
Greetings,
We are a small company who are increasingly relying on
memcached for our big projects. We are very pleased with
its performance.
I've put
to gain the jail benefit ?
//Logan
C-x-C-c
On Tue, Jul 20, 2010 at 10:24 AM, dormando dorma...@rydia.net wrote:
You don't need to run memcached as root to do that, you need to *start*
it
as root.
If you look just under the setrlimit
On Mon, 12 Jul 2010, Snehal Shinde wrote:
I am using the stable 2.x one. I have set the timeout to 3 secs now. Lets see
how that goes
Snehal
You might want to stick with 2 or 4 seconds to test :) putting it right on
the line with the SYN timeout will still give you inconsistent results...
switched to 4 secs now. also if its a packet loss issue will it make sense to
reduce the $retry_interval from the default 15 secs to say 2
secs? http://us2.php.net/manual/en/memcache.setserverparams.php
also the error that i get intermittenly is COULD NOT CONNECT TO SERVE. Is
there a way
On Sun, 11 Jul 2010, Snehal Shinde wrote:
Yes Jay is right. My server and client config are in sync. The problem
is only intermittent and so i felt maybe increasing the default
timeout might help. Any idea how i can increase the default memcache
timeout for the php client Memcache?
I
is otherwise
overloaded. also depending on how you're measuring it your client box/etc
could be slightly broken.
-Dormando
On Thu, Jul 1, 2010 at 12:28 PM, dormando dorma...@rydia.net wrote:
Dormando... Thanks for the response. I've moved one of our servers to
use an upgraded version running 1.4.5. Couple of things:
* I turned on logging last night
* I'm only running -vv at the moment
Here's a more succinct and to the point page:
http://code.google.com/p/memcached/wiki/NewUserInternals
^ If your question isn't answered here ask for clarification and I'll
update the page.
Your problem is about the slab preallocation I guess.
On Tue, 6 Jul 2010, Matt Ingenthron wrote:
Hi
Hi guys,
I was wondering,
If I have an array of 10 machines , 1 instance per machine set up like
this:
instances = array(
server1 = array(host = 111.111.111.111,
port = 11211,
weight = 6),
server2 = array(host =
; I don't really care
for a rebuttal, I'm sure everyone's working on fixing their problems :P
-Dormando
Dormando... Thanks for the response. I've moved one of our servers to use an
upgraded version running 1.4.5. Couple of things:
* I turned on logging last night
* I'm only running -vv at the moment; -vvv generated way more logging than
we could handle. As it stands we've generated ~6GB
anyone
listening to the FUD would be one of them.
-Dormando
requests/second even on higher grade
hardware with multiple interfaces sounds pretty good to me.
For most hardware memcached is limited by the NIC. I'd welcome someone to
prove a simple case showing otherwise, at which time we'd prioritize an
easy fix :)
-Dormando
For most hardware memcached is limited by the NIC. I'd welcome someone to
prove a simple case showing otherwise, at which time we'd prioritize an
easy fix :)
Does that mean you should use multiple NICs on the servers and spread the
clients over different networks?
It means you probably
Any thoughts on what might be going on here?
As for vitals/system config:
Here's a recent stats dump:
STAT pid 19986
STAT uptime 8526687
STAT time 1277416425
STAT version 1.2.8
You should probably upgrade, but I think this version has what you may
need...
If you can reproduce this
This smells like you're configuring your clients wrong... The client list
must be _exactly the same_ on every app server. Don't reorder them or put
localhost in there.
It's also possible that appserv2 can't reach one of the memcached daemons
as well, and is putting keys on the only available
We're building a system with heavy real-time write volume and looking
for a way to decouple db writes from the user request path.
We're exploring the approach of buffering updated entities in
memcached and writing them back to the database asynchronously. The
primary problem that we're
Actually sorry I should've been more descriptive. I plan on using a java
client to get the stats from memcached so that we can eventually pipe the
stats to our monitoring software. What would be the best java client?
Spymemcached?
Probably, yes.
Also, is there any consideration in the
team that explains the monitoring aspects of memcached? Such as
the methods of receiving stats (if there are any aside from getStats())?
-Original Message-
From: memcached@googlegroups.com [mailto:memcac...@googlegroups.com] On
Behalf Of dormando
Sent: Thursday, May 13, 2010 4:57 PM
stats commands. That bug hasn't
existed for three years at least.
-Dormando
Ding. You have access.
On Tue, 20 Apr 2010, Xaprb wrote:
Can someone give me SVN commit rights so I can add a reference to
http://code.google.com/p/mysql-cacti-templates/wiki/MemcachedTemplates
to the wiki? My Google Code username is baron.schwartz.
- Baron
--
Subscription settings:
STAT version 1.2.8
Consider upgrading to 1.4.x ;)
STAT curr_items 25
You have at most 25 items in your cache. that sounds pretty small.
STAT bytes 130845
Yeah, that's 128k. Your app's just not using the cache very much.
-Dormando
--
Subscription settings: http://groups.google.com/group
On Sat, 17 Apr 2010, wminside wrote:
I get memcached from the EPEL repository.
Can I set a higher current items? I mean, is there anything I can do
to get memcached use more memory or it's just how vBulletin works.
Go whine at the vB authors about putting some real shit into the cache. vB
I/we're open to feedback.
if you would like to contribute too, ask for wiki bits. If you're going to
complain, we (or you) might as well fix it.
It's our goal to make this clear and thorough for anyone who wishes to get
started with memcached.
-Dormando
--
To unsubscribe, reply using remove me
(ruby or whatever, just no libmemcached) over
localhost to see if you can reproduce the issue there.
thanks,
-Dormando
On Wed, 7 Apr 2010, Ryan Tomayko wrote:
We have a few memcached machines doing ~1000 ops/s (9:1 get to set)
each. These are fairly beefy, non-virtualized, 8-cpu servers with ~14G
I thought this was a FAQ -- or at least I have memory of this being discussed
here before.
I have one process that uses memcached for throttling by setting a key with a
timeout. If the set fails (NOT_STORED, as the FAQ describes)
then the process waits.
The question came up yesterday at
, and are
stabilizing 1.6.0 for release. More of the rest of the open bugs will be
closed out for 1.4.6.
A number of us will be at MySQLConf (http://en.oreilly.com/mysql2010/)
next week. Speaking, dotorg-boothing, or getting drunk in the lobby. Come
say hi if you're brave enough.
-Dormando
that in a
pinch you could just shut off DB journaling to deal with some overload
scenario.
-Dormando
Hi, I'm getting segfault just after running the memcached n Fedora 8,
runnin in the VMWare.
I just run
# /usr/local/bin/memcached -u gri -m 1 -v
in one console
# telnet localhost 11211
in another, and in the 1st get endless flow of
Catastrophic: event fd doesn't match conn fd! lines.
. Refreshes and able to access the page again (logged in).
On Mar 13, 1:35 pm, dormando dorma...@rydia.net wrote:
Can you telnet to the instances, type stats, stats items, and stats
slabs, then copy/paste all that into pastebin?
echo stats | nc host 11211 stats.txt works too
You
with your backup thing I'd
probably still add an option to allow it to journal to a database, and I
say this knowing how to get every last ounce of efficiency out of
memcached.
-Dormando
We discovered this as well a few months ago... I don't think we found a
workaround :(
Maybe someone else has?
On Fri, 12 Mar 2010, Jonathan Swartz wrote:
We make liberal use of the namespace option to
Cache::Memcached::libmemcached, creating one object for each of our
dozens of namespaces.
Here is our current setup:
webserver1 (also runs session memcache server)
webserver2 (also runs session memcache server)
database (specialized memcache storage for data caching)
We are not really a high loaded site, at peak time only about 1500
users online together. Network is not really
the whole thing.
-Dormando
The memory allocation is a bit more subtle... but it's hard to explain and
doesn't really affect anyone.
Urr... I'll give it a shot.
./memcached -m 128
^ means memcached can use up to 128 megabytes of memory for item storage.
Now lets say you store items that will fit in a slab class of
session again, or did you app log them in again?
-Dormando
On Fri, 12 Mar 2010, TheOnly92 wrote:
I'm retrieving statistics via Memcache::extendedStats function, here
are the basics:
Session Server 1
Version 1.2.2
Uptime398,954 sec
Cache Hits2,065,061
Cache Misses 987,726
Hi,
I do simple benchmark on my web server by issuing 50 queries. I send
10,000 request and it shows by using memcached is slightly slower than
(or almost the same) without memcached. The result shows 216.29
request per second for memcached enabled and 216.51 for memcached
disabled. However,
Hi Guys,
I'm trying to compile memcached-1.4.4 in my IBM P550 machine running
Linux RHE for Power PC64, but I'm getting the error:
memcached-1.4.4]# ./configure
checking build system type... Invalid configuration `powerpc64-unknown-
linux-': machine `powerpc64-unknown-linux' not
Hi there
I am experimenting with using memcache for storing PHP sessions in a
www cluster environment. But due to latency in network, I have noticed
slight performance drop in application as opposed to just direct
access.
Has anyone played with changing MTU on their network card to
: 76982: 2.532011750 0.099864927 poll({9/
POLLIN},1,-1) = 1 (0x1)
On Feb 28, 3:41 am, dormando dorma...@rydia.net wrote:
How are you performing the test? Is memcached over localhost or over the
network?
If you can reproduce this in isolation I'd be curious to see what
memcached
How are you performing the test? Is memcached over localhost or over the
network?
If you can reproduce this in isolation I'd be curious to see what
memcached and/or php are waiting on that takes so long (via strace or
similar).
On Wed, 24 Feb 2010, me from wrote:
Adam we are on freebsd 7.2, as
Hi,
I have huge Vbulletin Forum and i am trying now memcached as i was
using Xcached before.
But i wonder why Memcached using so little memory and CPU. And does
not reduce the load much compare to Xcache?
This is my screenshots showing memcached static:
http://i45.tinypic.com/2eqcqck.png
Er, I'm heading out the door atm, I'll get it when I get back in a few
hours. Thanks for the patch!
On Sat, 20 Feb 2010, Nathan Neulinger wrote:
Haven't heard anything back on this... any chance of getting this
patch applied to the CPAN perl module for memcached? Brad indicates
that he no
.
Don't recall if that was ever fixed or properly tested, but the
complaining user had his performance problems go away when he stopped
using that.
I assume pecl/memcached isn't quite that stupid, but someone might want to
verify for PHP's sake.
-Dormando
perl.
Memcached::libmemcached is the actual libmecached-based library.
Cache::Memcached::libmemcached is a wrapper around the former to be more
compatible with the former-former. Ease migration or whatever.
-Dormando
On Sat, 6 Feb 2010, Brian Moon wrote:
Yeah, I plan to warn them about pecl
How're you serializing the list?
In cases where I've had to work with that, we ensure the value is a flat
list of packed numerics, and run no serialization on them. Then you have
the overhead of a network fetch, but testing values within the list is
nearly free.
-Dormando
On Tue, 19 Jan 2010
being the same prepend operation.
-Dormando
On Tue, 19 Jan 2010, jim wrote:
At least initially we would use normal java serialization. Since we
are talking about using prepend to put the most recent entries in our
list, we cannot use gzip anymore since it would not gel with
prepending bytes
. Most of the core devs are speed freaks, and the intent of
memcached is to supply minimal, if any, access control (or authentication)
for speed. That shouldn't stop you from using it as a proper framework if
you absolutely must. It's become enough of a standard that we can accept
this.
-Dormando
http://github.com/memcached/memcached/tree/engine-pu
Is it correct branch for the discussion base?
http://github.com/trondn/memcached/tree/engine is the tip. engine-pu is
... not quite master yet.
-Dormando
on memory, compared to keeping the number
of users down or even running multiple instances.
-Dormando
It'd be incredibly inefficient on memory, compared to keeping the number
of users down or even running multiple instances.
Only if you were trying to go all the way down to the item level. It's
possible to have groups of slabs that are dedicated to one label/auth or
something like that,
to install Cache::Memcached::GetParserXS?
You probably want one of the libmemcached wrappers instead. It's not
entirely unused but it's essentially abandonware.
-Dormando
Dumping Cache is a feature that is discussed in details. I agree that
dumping cache to keep it warm may not be the best idea. However, I
recently got into the situation where we lost the database and we lost
the backup of the database. So, the only thing we had was running
memcached (please
.
Unless you're bigger than facebook, odds are you'll be fine with libevent
1.4 and the default threadcount with memcached.
-Dormando
in the flags section, otherwise the existence of
the key itself may be enough data for some things you store.
-Dormando
Just to be clear: when you hit max connections, new connections to
memcached can/will lag until connections are accepted again. Existing
connections won't be slow.
On Wed, 2 Dec 2009, head wrote:
ok guys, so I am still having this problem
we are using php client with persistent connections
It's forking and you're not following children.
Just attach to a runing process via strace -p, run it for 5 seconds, ^C,
gzip, put it somewhere
On Wed, 2 Dec 2009, head wrote:
hmm, I started memcached with strace, but the output file is only 6k
in size and is not increasing, I mean no data is
as soon as possible, but we want to not surprise people in the middle of
the 1.4 series as much as posssible.
Thanks to dustin/matt for the work on this release.
-Dormando
.
Thanks,
-Dormando
Rabbits :) (fast, `scalable`, stupid).
On Sat, 7 Nov 2009, Clint Webb wrote:
I like it. I really like the logo, and I like the banner image of the pack
of animals (what are those things?).
On Sat, Nov 7, 2009 at 3:39 PM, dormando dorma...@rydia.net wrote:
Ah, I forgot to note
a refresh over november as
well.
If you have feedback, want to help with documentation, have bugs, etc, you
know what to do :)
have fun,
-Dormando
Ah, I forgot to note.
The users page is open for requests. If you're a bigish/notable site and
would wish to be linked there, let me know by tomorrow! Otherwise I'm
picking a bunch out of a hat.
Thanks,
-Dormando
On Fri, 6 Nov 2009, dormando wrote:
Coinciding with the release of 1.4.3
http://code.google.com/p/memcached/wiki/ReleaseNotes143rc2
Bug reported by Tomash, fixed by trond, reviewed by dustin, and now we
have a new tarball. Thanks, and please continue testing :)
-Dormando
You could put something like varnish inbetween that final step and your
client..
so key is pulled in, file is looked up, then file is fetched *through*
varnish. Of course I don't know offhand how much work it would be to make
your app deal with that fetch-through scenario.
Since these files are
You could also redirect the client to the proxy/cache after computing the
filename, but that exposes the name in a way that might be reusable.
perlbal is great for this... I think nginx might be able to do it too?
Internal reproxy. Server returns headers for where the load balancer is
to
Yo,
I couldn't sleep, so:
http://github.com/dormando/damemtop
(or: http://consoleninja.net/code/memcached/damemtop-0.1.tar.gz)
Early release of a utility I've been working on in the last few days. Yes,
sorry, I'm aware this makes /four/ memcached top programs. So, I had to
make mine awesome
days while
we empty the queue :)
If you have any bugs, requests, etc, now's the time to speak up!
-Dormando
801 - 900 of 993 matches
Mail list logo
