Re: Hi speed java, consume memcached (as queue), please help!

2008-10-02 Thread Dustin
On Oct 1, 9:04 pm, LockeVN [EMAIL PROTECTED] wrote: Hi all, [...] queue [...] Memcached is not a queue. It's a mistake to try to use it as one. I'd recommend beanstalkd or gearman. Please give me some advices:  - A bot need to be good at multi-thread, talk with memcached, talk with

Re: Suggestion: Item expiration signal to client and extension

2008-10-02 Thread Dustin
[sorry for top-posting, in a bit of a hurry] There has been a lot of strategies for managing stampedes. I think the basic idea here makes sense, but I've a couple of comments: 1) Before adopting this strategy, I'd want it to be reversed -- expiration date should be when the object

Re: Zeroconf memcached

2008-10-03 Thread Dustin
On Oct 3, 12:53 pm, Brian Aker [EMAIL PROTECTED] wrote: Hi! On Oct 3, 2008, at 12:40 PM, Dustin wrote: adding a command to get the current known server list.  I'm wondering if its more practical to have another server whose job is to maintain this list and provide hooks for things

Re: Zeroconf memcached

2008-10-03 Thread Dustin
On Oct 3, 1:56 pm, Brad Fitzpatrick [EMAIL PROTECTED] wrote: I'd proposed that each memcached node also listen to all of its peers announcements, but do nothing with that info except When a client wants to use memcached, it does a zeroconf discovery request and find the _first_

Re: MemCache Server clustering

2008-10-06 Thread Dustin
On Oct 6, 9:57 pm, Jigna Joshi [EMAIL PROTECTED] wrote: Hi, Thanx for d quick reply. actually, in our case we want to make entry in all servers b'coz if one of the memcached server is down (server which has entry) then it can get value from another server.. rightnow, if i run Set command

Re: memcached 1.2.6 crash

2008-10-07 Thread Dustin
Er, scratch that -- I think these changes are actually in 1.2.6, but the changesets got rewritten so they have different IDs and authors. (still hates subversion) On Oct 6, 8:40 pm, Dustin [EMAIL PROTECTED] wrote: On Oct 6, 7:15 pm, Chuck Weinstock [EMAIL PROTECTED] wrote: We were

Re: Fix validation so it doesn't read heads[LARGEST_ID]

2008-10-10 Thread Dustin
On Oct 10, 12:41 pm, Mukund Sivaraman [EMAIL PROTECTED] wrote: On Wed, Oct 08, 2008 at 02:00:13PM -0700, Dustin wrote:   This looks good enough.  Is this related to the recently reported crash bug?  Is there a test somewhere that can trigger an out of bounds read or write? Hi Dustin I

Memcached Hackathon Report(s)

2008-10-15 Thread Dustin
The hackathon went well again. Admittedly, I didn't talk to everyone there, but from the corner with the food, there was some additional protocol work and tree merging going on. Please fill in interesting things that happened that I didn't know about or forgot. In particular, Toru implemented

Re: multi-threading support

2008-10-15 Thread Dustin
On Oct 15, 3:37 pm, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: Hi, few weeks ago I've made a small research on available web app caching technologies. Memcached became my favourite, but I was a bit disappointed about the fact that multi thread support was not implemented natively. On the

Re: spy/whalin client compatibility

2008-10-16 Thread Dustin
On Oct 16, 7:25 am, Boris Partensky [EMAIL PROTECTED] wrote:  If you'd like to write a new transcoder, I'd take it.  :) Hi Dustin. Sure, what is the preferred way to submit the diffs? I also made some changes in existing WhalinTranscoder to fix Boolean and Character compatibility. git

Re: I can make memcached work in multi programming platforms environment

2008-10-16 Thread Dustin
On Oct 16, 9:05 pm, LockeVN [EMAIL PROTECTED] wrote: At the end, we found thathttp://bleu.west.spy.net/~dustin/projects/memcached/ Java ClientAPI can work, it can read the value set by PHP. I want to make all programs work all together, talk memcached as common language. But what

Re: Memcached Hackathon Report(s)

2008-10-25 Thread Dustin
there, but do we fix up the tree first? Dustin, if you have a preferred list of author contacts and wouldn't mind me poking you for some hints, could you please send it over? I'll give a shot at rewriting the tree. The easiest way is to probably redo the svn import with an authorfile and replay all

Re: I can make memcached work in multi programming platforms environment

2008-10-27 Thread Dustin
On Oct 27, 1:50 am, Ciaran [EMAIL PROTECTED] wrote: I did try to start pulling together the information (pre-binary protocol) Do note that the binary protocol doesn't change the application- level interoperability issue. Your work in getting this stuff together is the first step, though.

Re: compilation under OpenBSD 4.3 problem (1.2.6)

2008-10-28 Thread Dustin
On Oct 28, 12:52 pm, Tomash Brechko [EMAIL PROTECTED] wrote: Run  ./configure CPPFLAGS=-DAI_ADDRCONFIG=0 AI_ADDRCONFIG is indeed undefined on some BSDs, but it's not a vital flag, zero is a safe value then. It seems like something we should detect. I never got my OpenBSD install

Re: Is memcached the right tool for inter-service synchronization?

2008-10-29 Thread Dustin
On Oct 29, 1:52 pm, outinsun [EMAIL PROTECTED] wrote: How do I make memcached access the data store via SOAP or REST instead of making a database call? You don't. memcached is a place you put stuff. It will only give you what you put into it (and only sometimes). Your app has to do

Re: Memcached Cache Consistency

2008-11-01 Thread Dustin
On Nov 1, 9:53 am, jainy [EMAIL PROTECTED] wrote: Hi I am evaluating memcached for my DB performance / scalability. For my purposes Data Correctness is Key constraint. I have potential problem of Data getting stale ( cache inconsistency coherency ) because I have multiple readers and

Re: Running memcached in a cluster

2008-11-04 Thread Dustin
On Nov 4, 11:07 am, sdeo [EMAIL PROTECTED] wrote: We use  memcached-1.4.jar from (http://bleu.west.spy.net/~dustin/ projects/memcached/downloads.html) which one do you use ?. We can handle stale data, what is important to us is handling server restarts. That's my client, but a *really

Re: Memcached CAS

2008-11-06 Thread Dustin
On Nov 6, 9:39 am, jainy [EMAIL PROTECTED] wrote: What issues can I have while using CAS ? Is it atomic ? I believe its get and check + set Does memcached ensures that value of the object will not be changed after get and before set ? Yes, this is the entire point of a CAS operation

Re: Memcached CAS

2008-11-06 Thread Dustin
On Nov 6, 6:38 pm, Clint Webb [EMAIL PROTECTED] wrote: CAS does not stop the value from changing.  It stops you from setting a value if it has changed since you did a GET.  In which case you would need to handle it in whatever way suits your situation. Yes, this is correct. It's not a

Re: Generic protocol for message queues

2008-11-07 Thread Dustin
On Nov 7, 5:47 pm, Brian Aker [EMAIL PROTECTED] wrote: Just something else to throw into the equation:http://gearmanproject.org/doku.php?id=protocol I like gearman's concept of job sets. Gearman is non-offensive to me (other than the perl thing). Half the reason I picked beanstalkd a

Re: In Stats if we could see queue size that would be such a BIG help

2008-11-13 Thread Dustin
On Nov 13, 5:05 pm, Zer0Frequency [EMAIL PROTECTED] wrote: I think something missing in memcache-q is the queue size feature. I did add it for myself but I think its something that should be part of the standard build. This is the memcached list. Conversation of derived projects is

Re: rewritten binary branch

2008-11-17 Thread Dustin
apologize): 158 Brad Fitzpatrick [EMAIL PROTECTED] 52 Paul Lindner [EMAIL PROTECTED] 45 Dustin Sallings [EMAIL PROTECTED] 44 dormando [EMAIL PROTECTED] 40 Toru Maesaka [EMAIL PROTECTED] 23 Trond Norbye [EMAIL PROTECTED] 17 Steven Grimm [EMAIL PROTECTED] 15 Anatoly

Re: memory efficiency

2008-11-20 Thread Dustin
On Nov 20, 9:26 am, Toru Maesaka [EMAIL PROTECTED] wrote: I'm not sure if we could call it a waste since CAS is a important feature but sure, it would consume a lot of memory in usecases with lots and lots of small objects as you mentioned. I guess the ideal thing is to only consume that 8

Re: rewritten binary branch

2008-11-21 Thread Dustin
On Nov 20, 6:02 pm, Toru Maesaka [EMAIL PROTECTED] wrote: Hi! Sorry it took this long to reply... anyway this is s awesome!! thanks Dustin. From glancing through that tree, there are several commits that shouldn't be credited to me. This happened when I brought over the patches from

Re: order of results from get_multi

2008-12-05 Thread Dustin
On Dec 5, 8:21 pm, ionous [EMAIL PROTECTED] wrote: i poked around on the faq and mail lists, but haven't seen anything definitive; does anyone know whether there is a guaranteed order to the items returned in get_multi? You may observe some pattern to the results, but non is guaranteed.

Re: set() seems to modify what I am trying to store

2008-12-15 Thread Dustin
On Dec 15, 3:50 pm, jtal jta...@gmail.com wrote: I'm storing data structure that includes timestamps in the form of seconds from epoch. When I call set, a number like: 66560 becomes: 66560 Notice it has become double quoted. There is no get() involved- only a set().

Re: facebook memcached on github (redux)

2008-12-19 Thread Dustin
://github.com/dustin/memcached/commit/437beab948aec088dac361f27c8... ) It is at  http://github.com/fbmarc/facebook-memcached Hey, this is a great start. I wrote a tool yesterday to do content- based tree comparisons so we can see where trees diverged regardless of recorded ancestry

Re: facebook memcached on github (redux)

2008-12-19 Thread Dustin
On Dec 19, 9:17 am, Josh Snyder j...@admob.com wrote: First, we wanted to solve the slab-ghetto problem.  That is the situation where one slab is forcing out hot keys for lack of memory while another slab holds onto stale objects. Just wanted to give a +1 that this is an issue for others

Re: memcache error SYSTEM ERROR

2008-12-21 Thread Dustin
On Dec 21, 7:33 pm, Apun Hiran apunhi...@gmail.com wrote: Hello Scott, I am trying to put a binary file in memory across on 2 servers. The size of the file is 400MB. Is 1MB the limitation of memcache? My requirement is to have large files (image) cached into memory for quick access. I have

Re: Dumping out the contents of the cache -- Testing

2008-12-29 Thread Dustin
that you developed a test suite using Python (http://github.com/dustin/ memcached-test/tree/master) -- Are there tests available that are written in Java?  Any other troubleshooting suggestions? My java client has a pretty good test suite: http://github.com/dustin/java-memcached-client

Re: problem of sync

2009-01-05 Thread Dustin
On Jan 5, 2:36 pm, Jumping quzhengp...@gmail.com wrote: I use LVS to build the cluster, and I find some problem about memcached. ... but why do you feel that you need to replicate your cache? What's the problem you're running into? It's likely that an attempt to replicate memcached

Re: Memcached 1.2.6 still crashing

2009-01-15 Thread Dustin
On Jan 15, 6:00 pm, Chuck Weinstock weins...@gmail.com wrote: I admit to not having a clue how to run it within gdb (and still get output that can be analyzed if it crashes). The machine has not rebooted. We do not have automated tools to kill big processes but I have not seen such. Finally

Re: problem of sync

2009-01-23 Thread Dustin
On Jan 23, 8:25 am, Ravi raveendra.yerragun...@gmail.com wrote: Any strategy for using repcached for more than 2 servers. What is your goal when you replicate cache to even one other server?

Re: Soft flushing proposal

2009-01-23 Thread Dustin
On Jan 23, 7:31 am, JC jc.redou...@gmail.com wrote: The main idea is to flush the cache in a smooth way: i.e. you ensure that after this flush operation, no data older than what you defined is in the cache but you didn’t go through the empty cache step. Basically, this can be done with a

Re: problem of sync

2009-01-25 Thread Dustin
On Jan 24, 5:07 am, Ravi raveendra.yerragun...@gmail.com wrote: I have two data centers with 2 hosts on each center. Keeping latest data on memcached cluster across 4 hosts for inserting app. In case of failure of 1 host on either data center, complete data set should be available for query

binary noreply commands

2009-01-25 Thread Dustin
I wrote a bunch of tests for Trond's new basket of quiet commands, verifying that they all work as expected. However, I don't think the semantics are correct. In particular, this seems to behave differently from the getq command already established. getq was defined to not be quiet in

Re: listen on multiple interfaces (-l) but not every IP interface?

2009-01-25 Thread Dustin
On Jan 25, 11:04 am, carlb carlb...@hotmail.com wrote: without leaving memcached exposed to the outside Internet. All of the documentation lists -l with only one interface specified - is it possible to list two? If your goal is enhance security, you're better off keeping the packets from

Re: binary noreply commands

2009-01-25 Thread Dustin
On Jan 25, 10:13 pm, Toru Maesaka tmaes...@gmail.com wrote: I personally think that the behavior of not responding at all is okay since this is for complementing the no-reply I never particularly liked the no-reply mode for roughly the same reason. I think specifically supressing any

Re: binary noreply commands

2009-02-01 Thread Dustin
On Feb 1, 2:16 am, dormando dorma...@rydia.net wrote: Yeah, my main complaint about the original 'noreply' code is that the error handling was completely FUBAR. I'm sure someone somewhere will want a noreply command that never gives them errors, but that's really really broken. +1 to

Re: binary noreply commands

2009-02-01 Thread Dustin
On Feb 1, 9:38 am, Tomash Brechko tomash.brec...@gmail.com wrote: throw it away.  But once the result is being thrown away, why send it in the first place?  This also hurts streaming greatly, as as of now memcached pushes every STORED reply in a separate network packet... I agree with

Re: Soft flushing proposal

2009-02-10 Thread Dustin
On Jan 26, 1:36 am, Jean-Charles Redoutey jc.redou...@gmail.com wrote: On Sat, Jan 24, 2009 at 02:49, Dustin dsalli...@gmail.com wrote:  That is, it feels like it could lead to a lot of confusion when the time ends up overlapping due to values newer than the flush timeline being built

Re: Can anyone give some suggestion for how to install in shared server

2009-02-11 Thread Dustin
On Feb 11, 8:14 am, xhe hexuf...@gmail.com wrote: I want to install memcached in my shared web server which I have no access to the /usr directory. And I want to install it into my personal directory. So can anyone show me some instruction on how to intall memcached and libevent into

Re: Can anyone give some suggestion for how to install in shared server

2009-02-11 Thread Dustin
On Feb 11, 10:47 am, Frank He hexuf...@gmail.com wrote: Sorry, when I build libevent, it said I have no permission to write into /usr/ You can tell it where you want to install at configure time. Install into your home dir.

Re: Can anyone give some suggestion for how to install in shared server

2009-02-11 Thread Dustin
On Feb 11, 1:07 pm, Frank He hexuf...@gmail.com wrote: Question 1: It seemed the memcached can not find the shared libraries, how i can inform memcached the location for the installed libevent library? The easiest way to do that is via the LD_LIBRARY_PATH environment variable.

Re: cas/incr integrity bug?

2009-02-11 Thread Dustin
I've pushed a test that reproduced this issue and a fix for it. Thanks for the report. :) http://github.com/dustin/memcached/commit/bad6c614e58639d0685706f17dc9562323c30f39 On Feb 11, 4:47 pm, Dustin dsalli...@gmail.com wrote:   Hey, that's great.  Bugs are here:   http

Re: memcached on 64bit Centos builds but process terminates on startup

2009-02-19 Thread Dustin
On Feb 19, 9:03 am, ntwrkd ntw...@gmail.com wrote: For some reason, this was failing when running the process as root. I added the argument -u memcache to run as the memcache user, and it started up fine. memcached will not run as uid 0 unless you try really hard (and it's a bad idea, so

Re: Multuthreading with memcached

2009-02-19 Thread Dustin
On Feb 19, 12:47 am, fapre falkpret...@gmx.de wrote: Hi, i want to use memcached for object caching in my webapplication. The problem is, that there are lots of dynamic java object stored in the cache. My question is: Is there a mechanism within memcached, that solves the problem of

Re: Viewing objects in the cache

2009-02-19 Thread Dustin
On Feb 18, 11:06 pm, Tesla ntw...@gmail.com wrote: is there an easy way to monitor or query current objects in the cache using a pre-existing tool? No, there's not a way to do this, and you shouldn't try. There are a couple of debug mechanisms that will let you sample stuff at a

Re: Viewing objects in the cache

2009-02-19 Thread Dustin
On Feb 19, 2:51 pm, ntwrkd ntw...@gmail.com wrote: To measure caching efficiency You don't want to see individual keys for that. Just check out your hit and miss rates. Those, along with evictions, will give you a feel for how you're using the cache at a reasonably high level.

Re: Soft flushing proposal

2009-02-20 Thread Dustin
seconds ago Removes *some* stuff from the cache, and you can't be sure what stuff is removed and what stuff remains, nor what parts of things that were retrieved in the last ten seconds and that were invalidated were used to construct some of the things that still remain. -- Dustin Sallings

Re: Soft flushing proposal

2009-02-23 Thread Dustin
On Feb 22, 5:02 pm, dormando dorma...@rydia.net wrote: It feels excessive if the only real benefit is being able to do a full data flush in less time? Is there anything I'm missing? This is kind of how I see it: Pros: * It's consistent with flush_all [n] for positive values of n if you

Re: cas_multi on keys that don't already exist

2009-02-23 Thread Dustin
On Feb 23, 7:09 am, wsny...@wsnyder.org wsny...@wsnyder.org wrote: What I would really like is a cas_multi that says insert if doesn't exist rather than this more complicated loop that requires me to split the gets_multi results into two separate arrays (those to modify and those to add.)

Re: Inconsistency between the protocol doc and implementation.

2009-02-23 Thread Dustin
On Feb 23, 6:51 pm, Toru Maesaka tmaes...@gmail.com wrote: But in the actual implementation, we're using a period/dot as the separator :) This isn't such a big deal but I'd like to fix it in the 1.3 binary tree. The question is, which is correct? I would suspect that the correct thing in

Re: Multuthreading with memcached

2009-02-23 Thread Dustin
to the cache so that ThreadB gets a actual value?? No, you don't lock it, but CAS will get you there. I created a higher-level CAS abstraction in my java client: http://bleu.west.spy.net/~dustin/projects/memcached/apidocs/net/spy/memcached/CASMutator.html The example

Re: Multuthreading with memcached

2009-03-04 Thread Dustin
On Mar 4, 5:42 am, fapre falkpret...@gmx.de wrote: Thanks for your postings! The CAS feature seems to be a good start! But can you tell me how to use it? At the moment i use the Java memcached client fromhttp://www.whalin.com/memcached . I guess the CAS-feature is not implemented at the

Re: High load on web servers when using consistent hashing enabled with PHP's Memcache module

2009-03-04 Thread Dustin
On Mar 2, 4:03 am, Henrik Schröder skro...@gmail.com wrote: Well, you could store the pre-calculated results in a shared cache.. oh wait.. The original published C ketama code did that -- you would calculate your list once and it'd store it in a shm segment.

Re: Ideas on Concurrency Control Strategy

2009-03-05 Thread Dustin
On Mar 5, 7:11 pm, Toru Maesaka tmaes...@gmail.com wrote: As for the global stats_lock, I think its safe to assume that most of the operations are write related so read-write locking is definitely not the answer here. I think Facebook was dead-on with their solution on scaling this area up

Re: spy client under heavy load

2009-03-06 Thread Dustin
On Mar 6, 1:33 am, Adam Lee a...@fotolog.biz wrote: does my diagnosis of the problem seem right and, if so, any ideas for the best way to deal with this?  obviously adjusting timeouts would probably only exacerbate the problem, so i toyed with the idea of having a pool of clients (though i

Re: What are the memcache control characters?

2009-03-10 Thread Dustin
On Mar 10, 3:11 pm, Patrick May patsp...@gmail.com wrote: I'm writing a filter (appside) to filter out control characters. I've got a feeling that the colon is one (:).  But are there any other control characters?  What's the complete list of memcache control characters which are disallowed

Re: spy memcached client doesn't work in jdk1.4?

2009-03-10 Thread Dustin
On Mar 10, 6:29 pm, roadt roadt...@gmail.com wrote: Spymemcached requires Java 1.5. I believe the Whalin client may still work for 1.4.http://www.whalin.com/memcached/ Thanks your answer Ray. I'll try the Whalin client. Meanwhile, spymemcached is famous java memcached, is any

Re: spy memcached client doesn't work in jdk1.4?

2009-03-11 Thread Dustin
On Mar 11, 4:44 am, roadt roadt...@gmail.com wrote: Sure, it is.  the problem is that upgrade the whole project to jdk1.5 is more crazy idea. We have millions of codes, i think.  I must move forward hardly. :P You're not rewriting anything, just upgrading the compiler and runtime. It'll

Memcached Beta 1.3.2 Released

2009-03-11 Thread Dustin
spymemcached has very good text and binary protocol support over IPv4 and IPv6 with a quite comprehensive test suite. Project page: [http://code.google.com/p/spymemcached/] * Protocol Spec NIH problem? Go write your own client. :) [http://cloud.github.com/downloads/dustin/memcached

Re: anonymous unix sockets

2009-03-11 Thread Dustin
On Mar 11, 4:01 pm, nwp nwpie...@gmail.com wrote: I was kicking around some ideas today, and I think what I want to do is use socketpair() to create an anonymous unix socket, and run memcached as a child process and have it listen on one end.  I might want several instances, so I don't

Re: anonymous unix sockets

2009-03-11 Thread Dustin
On Mar 11, 4:24 pm, nwp nwpie...@gmail.com wrote: I agree.  I may not need the massive memory, so avoiding the network hit until I did sounded like a good idea.  I am shooting for low future maintenance for the next poor sap though, and the unix socket sounded like a fast way to accomplish

Re: memcache based locking

2009-03-12 Thread Dustin
Please don't use the reply button to start a thread. On Mar 12, 11:30 am, Yigit Boyar ybo...@gmail.com wrote: hi all, I'm developing a software where memcached is also used as locking server. The problem is that, i wanna make this fail safe; which basically means if the memcached server

Re: format of log file

2009-03-12 Thread Dustin
On Mar 12, 11:24 am, roobnoob tun...@gmail.com wrote: Hi, so where can i find info as to parsing the log file when i use the -vv option? Ie, what do all the different logged lines mean? Eg,:  add pangaea-staging:session:d9d2dbb372ed5e27a23921e8ab2826ce 0 0 4 I assume we're adding an

Re: Memcached crashing under load

2009-03-12 Thread Dustin
For clarity -- are you saying the server is crashing, or the client? On Mar 12, 6:19 pm, meppum mmep...@gmail.com wrote: I was load testing memcached and have been experiencing consistent crashing when approaching 11k total connections (not concurrent). Below is a sample of some python

Re: Webconsole debugging tool built into memcached

2009-03-13 Thread Dustin
On Mar 13, 3:14 am, Clint Webb webb.cl...@gmail.com wrote: I also thought that it would be nice to have something where I can view cached entries, and even do commands on those cached entries (or even add new entries), to check certain functionality in applications that get data from the

Re: New 1.3 Stats

2009-03-13 Thread Dustin
On Mar 13, 5:44 pm, NICK VERBECK nerdyn...@gmail.com wrote: Thanks, I must have totally missed the release notes. Just checked the change log and notices the comments about new stats. Figured I would get a jump start on getting them into memcached-manager. Great. I did kind of put a lot

Re: memcache based locking

2009-03-14 Thread Dustin
On Mar 14, 5:27 am, Yigit Boyar ybo...@gmail.com wrote: ok, let me more clarify this topic since I got one more email about not using memcache for locking. I do wish you could post your topics and clarifications in a thread that isn't a release announcement since you've removed that topic

Re: For review: Configurable listen backlog

2009-03-16 Thread Dustin
Thanks for all the feedback. I was thinking that a compile-time option might be good to avoid eating up the precious getopt space for things that are rarely used, but this is pretty unanimous. :) On Mar 16, 5:38 am, Trond Norbye trond.nor...@sun.com wrote: Dustin wrote:   Chris Goffinet

Re: For review: issue 28

2009-03-16 Thread Dustin
Who says no to documentation? :) On Mar 16, 11:29 am, Trond Norbye trond.nor...@sun.com wrote: Issue 28: The manpage does not contain a description for all command line options... We need a description for: -C - Disable use of cas -R - Number of requests processed per event Proposed

Re: For review: issue 28

2009-03-16 Thread Dustin
On Mar 16, 12:07 pm, Chris Goffinet goffi...@yahoo-inc.com wrote: Dustin: I can create a patch for docs if your good with my -b patch. That'd be good -- I already pushed the change because it seemed pretty unanimously accepted. I hadn't actually consider the man page because I've never

Re: recommendation for change to getopt() function call

2009-03-17 Thread Dustin
On Mar 17, 12:00 am, Clint Webb webb.cl...@gmail.com wrote: I should have mentioned that the other main advantage is that if you try and merge two branches that have added parameters, the auto-merge doesn't fail. Because it will have differing lines, instead of a change inside a string on

Re: recommendation for change to getopt() function call

2009-03-17 Thread Dustin
On Mar 17, 12:18 am, Toru Maesaka tmaes...@gmail.com wrote: Personally I find this weird but I see your motivation so I have no objections. I think it'd look less weird if every line had a comment. :) If it's going to look like we're going to be adding more options in the future, maybe

Re: Slab allocation algorithm question

2009-03-17 Thread Dustin
On Mar 17, 4:34 am, colin.pit...@gmail.com colin.pit...@gmail.com wrote: Hello, I had a look at slab allocation, and saw two strange things: The first one concern the special value for chunk minimal size when chunk_factor is 2: /* Factor of 2.0 means use the default memcached behavior */

Re: For review: Issue 14

2009-03-17 Thread Dustin
On Mar 17, 4:57 am, Trond Norbye trond.nor...@sun.com wrote: The issue: Memcached eats memory unnecesarily I downgraded the issue from medium to low (and from defect to RFE). For all details, see:http://code.google.com/p/memcached/issues/detail?id=14 Proposed patch with test

Re: For review: Brad's incr work cherry-picked

2009-03-17 Thread Dustin
. Of course, the only thing it breaks is code that relies on kind of dumb buggy behavior, so I wouldn't expect anyone to really be worried about it. On Mar 15, 12:32 am, Dustin dsalli...@gmail.com wrote:   I cherry-picked Brad's work into a branch and got it passing all the tests on all the platforms

Re: memcached not freeing up ram?

2009-03-17 Thread Dustin
On Mar 17, 11:07 am, Roch Delsalle rdelsa...@gmail.com wrote: what happens when it's full ? There's a distinction between the memory it's asked the system for and the memory it's using internally. It will continue to reuse the memory it allocates throughout its lifetime. What it will not

Re: memcached not freeing up ram?

2009-03-17 Thread Dustin
If you would like to start a new topic, use the ``new post'' button. Nothing in your post has anything at all to do with memcached not freeing RAM. On Mar 17, 3:09 pm, Tadeu Alves tadeu...@gmail.com wrote: hello there guys, i was looking for some help to configurate my memcached api into a

For review: issue 29 (slab stats' used_chunks) -- need backport?

2009-03-17 Thread Dustin
I've put together a fix and test here: http://github.com/dustin/memcached/tree/issue_29 In particular, does this test look valid? http://github.com/dustin/memcached/blob/issue_29/t/issue_29.t Should this be backported to 1.2.7? It's mostly test and a small change to how

Re: For review: Issue 14

2009-03-17 Thread Dustin
I pushed this earlier. I like what it does, and the test sold me. :) Once -o works, I want to keep these things tweakable. On Mar 17, 10:35 am, Dustin dsalli...@gmail.com wrote: On Mar 17, 4:57 am, Trond Norbye trond.nor...@sun.com wrote: The issue: Memcached eats memory unnecesarily

Re: SpyMemcached error

2009-03-17 Thread Dustin
On Mar 17, 7:55 pm, Alexander Zaitsev alexander.zait...@webamg.com wrote: Hi all, This is a question to Dustin probably. I am getting strange error that I can not properly diagnose. ERROR StoreOperationImpl:116 - Error:  CLIENT_ERROR bad command line format This error happens both

For review: stats settings (and a bug fix)

2009-03-18 Thread Dustin
://github.com/dustin/memcached/commit/0a83f5235d754543f602bc1aa670c49592bef541 The option tests and fixes are here: http://github.com/dustin/memcached/commit/d038aa38b8bfc4ae5abbe0079293082e5ec9073e In introducing these, I noticed that we are a bit hopeful in buffer sizes when processing

Re: memcached not freeing up ram?

2009-03-18 Thread Dustin
On Mar 18, 10:09 am, Perrin Harkins phark...@gmail.com wrote: On Wed, Mar 18, 2009 at 1:02 PM, Roch Delsalle rdelsa...@gmail.com wrote: yes but if for instance I'm building dynamic SQL queries at somes point the memory usage will keep growing even if the data is released. How would that

Re: memcached not freeing up ram?

2009-03-18 Thread Dustin
On Mar 18, 10:39 am, Perrin Harkins phark...@gmail.com wrote: On Wed, Mar 18, 2009 at 1:26 PM, Dustin dsalli...@gmail.com wrote:  It doesn't try very hard to reuse memory when it hasn't allocated as much as you've given it. Sure, and I'm guessing it's not religious about making sure don't

Re: SpyMemcached error

2009-03-18 Thread Dustin
On Mar 18, 12:57 pm, Alexander Zaitsev alexander.zait...@webamg.com wrote: I have figured out the problem. Error happened when key has been an empty string. However, error message is very strange, it is hard to guess. Oh wow, thanks a lot. I have code to check key validity before

Re: key misses in memcached

2009-03-18 Thread Dustin
On Mar 18, 6:12 pm, Baskaran baskar...@gmail.com wrote: As I understand the -M option is going to ensure that all the values that I store in memcached will be retained, unless I delete them explicitly. -M means objects won't be prematurely removed from memcache -- I'm not completely sure

Re: key misses in memcached

2009-03-18 Thread Dustin
On Mar 18, 6:22 pm, Baskaran Sankaran baskar...@gmail.com wrote: I don't set any time for expiry, so they should never expire. Isn't this true?? Alternately, how can I ensure that my keys and values will be stored forever and *never* be removed? Actually, I need about 2-3 days to get my job

Re: key misses in memcached

2009-03-18 Thread Dustin
, Mar 18, 2009 at 6:22 PM, Dustin dsalli...@gmail.com wrote: On Mar 18, 6:12 pm, Baskaran baskar...@gmail.com wrote: As I understand the -M option is going to ensure that all the values that I store in memcached will be retained, unless I delete them explicitly.  -M means objects

Re: key misses in memcached

2009-03-18 Thread Dustin
On Mar 18, 6:44 pm, Baskaran Sankaran baskar...@gmail.com wrote: If nothing is possible, can someone pls. suggest some alternative for my problem? I don't completely understand your problem, so I wouldn't want to tell you ohw to solve it, but there are *tons* of KV DBs out there these

Re: For review: Brad's incr work cherry-picked

2009-03-18 Thread Dustin
be using the new safe_strtoull(). How does this look? http://github.com/dustin/memcached/commit/d0fee94ed75e304c66ba17fbd47b44aab6a33513 The new internal_test and the build test passes both on Mac OS X and Ubuntu 8.04 64bit. It's really nice how we have a dedicated file for utility functions

Re: For review: Brad's incr work cherry-picked

2009-03-18 Thread Dustin
On Mar 18, 7:16 pm, Dustin dsalli...@gmail.com wrote: On Mar 18, 7:13 pm, Dustin dsalli...@gmail.com wrote:   How does this look?  http://github.com/dustin/memcached/commit/d0fee94ed75e304c66ba17fbd47...   *doh* I looked at that several times before sending it out -- it's obviously

Re: memcached not freeing up ram?

2009-03-18 Thread Dustin
On Mar 18, 8:00 pm, tongueroo tongue...@gmail.com wrote: memcached reads are reported as very slow. 10+ seconds. Are you giving it more RAM than you actually have? I would expect that behavior if it were fetching from swap.

Re: For review: Brad's incr work cherry-picked

2009-03-18 Thread Dustin
On Mar 18, 7:16 pm, Dustin dsalli...@gmail.com wrote: On Mar 18, 7:13 pm, Dustin dsalli...@gmail.com wrote:   How does this look?  http://github.com/dustin/memcached/commit/d0fee94ed75e304c66ba17fbd47...   *doh* I looked at that several times before sending it out -- it's obviously

Re: key misses in memcached

2009-03-18 Thread Dustin
On Mar 18, 8:29 pm, Baskaran Sankaran baskar...@gmail.com wrote: Thats great effort Dustin in removing the redundancy. (sorry, it's a habit) Coming back, my simple test is that the key-miss counts should all be *zero*, because, I've earlier stored objects for all keys in memcache

Re: For review: issue 28

2009-03-19 Thread Dustin
On Mar 19, 1:10 am, Trond Norbye trond.nor...@sun.com wrote: Eric Lambert wrote: Hey Trond: I was a little unclear on the -R text. Here is my attempt at rewording. This option seeks to prevent client starvation by setting a limit to the number of sequential requests the server will

Re: For review: Brad's incr work cherry-picked

2009-03-19 Thread Dustin
On Mar 19, 3:15 am, Toru Maesaka tmaes...@gmail.com wrote: Hi! Just looked through the commits. Yeah, it does make sense to add other strto* functions that we're using in the core like you did in that tree. The test passes in my environment and the tiny issue I pointed out earlier is

Re: For review: issue 33

2009-03-19 Thread Dustin
On Mar 19, 4:25 am, Trond Norbye trond.nor...@sun.com wrote: Issue:http://code.google.com/p/memcached/issues/detail?id=33 Proposed patch:http://github.com/trondn/memcached/commit/41e1b0c47dcaf573e717419f76b... Hey, that's great. I didn't quite understand what that prefix stuff was about

Re: For review: Configurable listen backlog

2009-03-20 Thread Dustin
On Mar 20, 5:59 pm, dormando dorma...@rydia.net wrote: iirc we were looking at using an option like that to pass startup parameters into the storage engine interface. would that be the -o option, then memcached itself takes normal parameters? Or would we have two separate long format

  1   2   3   4   >