Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Galder Zamarreño
On Jan 25, 2013, at 11:37 AM, Sanne Grinovero sa...@infinispan.org wrote: On 25 January 2013 11:11, Galder Zamarreño gal...@redhat.com wrote: On Jan 24, 2013, at 4:26 PM, Sanne Grinovero sa...@infinispan.org wrote: It's important to note that Infinispan's implementation of storing as

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Sanne Grinovero
I remember Manik and me pair-programming on that class to simplify it a bit - especially as there are some performance complexities - but we ended up not touching it as any change would have violated some expectations of one feature or another. Let's put this on the list of cleanups to be

Re: [infinispan-dev] Refactoring Infinispan documentation

2013-01-28 Thread Mircea Markus
On 25 Jan 2013, at 09:15, Galder Zamarreño wrote: On Jan 24, 2013, at 2:51 PM, Manik Surtani ma...@jboss.org wrote: Guys So one of the things coming soon is a revamped documentation site for Infinispan. I am thinking of moving to AsciiDoc [1] in place of our current Confluence [2]

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Mircea Markus
On 28 Jan 2013, at 09:14, Galder Zamarreño wrote: The reason we have storeAsBinary is due to lazyDeserialization. The latter was a solution we designed to get around deserialization issues on app server environments where JGroups would attempt to deserialize data with the wrong

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Manik Surtani
Let me clarify a few things on this thread. THere seems to be a bit of confusion here. :) storeAsBinary in Infinispan was designed with the following purposes in mind, in order of importance: 1) Performance. Prevent serialising/deserializing an entry multiple times (e.g., to write through

Re: [infinispan-dev] Refactoring Infinispan documentation

2013-01-28 Thread Manik Surtani
On 27 Jan 2013, at 21:11, Zdeněk Henek vrab...@gmail.com wrote: Hi, what about reStructuredText? http://en.wikipedia.org/wiki/ReStructuredText Sounds like a valid alternative to AsciiDoc. I have a mild preference for AsciiDoc though because a fair few other JBoss projects have started

Re: [infinispan-dev] Refactoring Infinispan documentation

2013-01-28 Thread Manik Surtani
On 28 Jan 2013, at 11:17, Mircea Markus mmar...@redhat.com wrote: On 25 Jan 2013, at 09:15, Galder Zamarreño wrote: On Jan 24, 2013, at 2:51 PM, Manik Surtani ma...@jboss.org wrote: Guys So one of the things coming soon is a revamped documentation site for Infinispan. I am

Re: [infinispan-dev] Refactoring Infinispan documentation

2013-01-28 Thread Mircea Markus
On 28 Jan 2013, at 12:25, Manik Surtani wrote: The process you defined with GitHub pull requests is correct, for cases where the documentation is enhanced to support a new feature in the code. I wanted to add Disqus as a mechanism for anyone reading the documentation to ask questions

Re: [infinispan-dev] Translating our events to JSR 107 events

2013-01-28 Thread Manik Surtani
On 28 Jan 2013, at 08:11, Dan Berindei dan.berin...@gmail.com wrote: On 25 Jan 2013 23:26, Vladimir Blagojevic vblag...@redhat.com wrote: Hey, I figured out why cache listeners notifications were not fired. We have to add listener *after* cache.start() has been called. If listener

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Manik Surtani
I do like this approach though. Ales - how could we bundle something like this as an AS module and play nice with modular class loading there? - M On 26 Jan 2013, at 21:55, Ales Justin ales.jus...@gmail.com wrote: Would the thread context classloader be the right thing to use? It

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Dan Berindei
On Mon, Jan 28, 2013 at 1:56 PM, Manik Surtani msurt...@redhat.com wrote: Let me clarify a few things on this thread. THere seems to be a bit of confusion here. :) storeAsBinary in Infinispan was designed with the following purposes in mind, in order of importance: 1) Performance.

Re: [infinispan-dev] graceful restart to corrupt CacheStore data

2013-01-28 Thread Manik Surtani
Nice and easy. :) On 26 Jan 2013, at 10:02, Sanne Grinovero sa...@infinispan.org wrote: Mystery resolved : https://issues.jboss.org/browse/ISPN-2763 :-) On 25 January 2013 11:54, Tristan Tarrant ttarr...@redhat.com wrote: On 01/25/2013 12:22 PM, Galder Zamarreño wrote: Not at first

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Manik Surtani
On 28 Jan 2013, at 12:35, Dan Berindei dan.berin...@gmail.com wrote: On Mon, Jan 28, 2013 at 1:56 PM, Manik Surtani msurt...@redhat.com wrote: Let me clarify a few things on this thread. THere seems to be a bit of confusion here. :) storeAsBinary in Infinispan was designed with the

Re: [infinispan-dev] Separate ExecutorService for map/reduce tasks?

2013-01-28 Thread Manik Surtani
Did you create a JIRA for this, BTW? On 5 Dec 2012, at 08:36, Tristan Tarrant ttarr...@redhat.com wrote: In 6.0 I would really like to go away from the current executor configuration (e.g. a specific element for every executor) and allow the creation of named executors (this is how the AS

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Tristan Tarrant
On 01/26/2013 10:55 PM, Ales Justin wrote: What's ScriptEngine? javax.script ? Tristan ___ infinispan-dev mailing list infinispan-dev@lists.jboss.org https://lists.jboss.org/mailman/listinfo/infinispan-dev

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Tristan Tarrant
On 01/26/2013 09:32 PM, Ray Tsang wrote: I just wrote something quick that uses groovy scripts. my hope is to be able to execute any arbitrary scripted mapper/reducer w/o needing to, say, redeploy/restart the node/server. The code is here:

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Manik Surtani
You guys should collaborate on this. :) On 28 Jan 2013, at 13:02, Tristan Tarrant ttarr...@redhat.com wrote: On 01/26/2013 09:32 PM, Ray Tsang wrote: I just wrote something quick that uses groovy scripts. my hope is to be able to execute any arbitrary scripted mapper/reducer w/o needing

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Ales Justin
Ales - how could we bundle something like this as an AS module and play nice with modular class loading there? Well, I would say we're back to that discussion with AdvancedCache::withClassloader. :-) Same thing with M/R -- can it tap into app's CL? Otherwise TCCL should do, in JEE env. Or

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Dan Berindei
On Mon, Jan 28, 2013 at 2:43 PM, Manik Surtani msurt...@redhat.com wrote: On 28 Jan 2013, at 12:35, Dan Berindei dan.berin...@gmail.com wrote: On Mon, Jan 28, 2013 at 1:56 PM, Manik Surtani msurt...@redhat.comwrote: Let me clarify a few things on this thread. THere seems to be a bit of

Re: [infinispan-dev] ApplyDeltaCommand: question about affected keys

2013-01-28 Thread Vladimir Blagojevic
On 13-01-23 2:01 PM, Pedro Ruivo wrote: Hi all, I was looking in the ApplyDeltaCommand code and I found something strange. Why is the method getAffectedKeys() returning a singleton collection with a null key inside? Yes, this is a bug. It should return s single key where delta map is stored.

Re: [infinispan-dev] ApplyDeltaCommand: question about affected keys

2013-01-28 Thread Vladimir Blagojevic
On 13-01-25 6:09 AM, Adrian Nistor wrote: Hi Vladimir, I think Pedro's initial question remained unanswered. Would be good to clarify this so we can fix the TODO in ApplyDeltaCommand constructor. Thanks, Adrian AdrianPedro, Yes, good catch. It should be passed to super as you noted. But

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Ales Justin
M/R classes do have access to the cache so they can get a hold of the app's class loader. But the tricky part is that the M/R tasks themselves need to be loaded from that class loader first… This already seems to work -- as we use tasks extensively in CapeDwarf, and it seems to work OK;

Re: [infinispan-dev] StoreByValueTest tck test

2013-01-28 Thread Vladimir Blagojevic
On 13-01-28 6:56 AM, Manik Surtani wrote: Now lets consider what JSR 107 needs. Similarly named, the feature in JSR 107 serves a completely different purpose, and this is referential integrity. Think database-style isolation (repeatable read, etc) where concurrent threads holding object

Re: [infinispan-dev] Translating our events to JSR 107 events

2013-01-28 Thread Vladimir Blagojevic
On 13-01-28 3:11 AM, Dan Berindei wrote: On 25 Jan 2013 23:26, Vladimir Blagojevic vblag...@redhat.com mailto:vblag...@redhat.com wrote: Hey, I figured out why cache listeners notifications were not fired. We have to add listener *after* cache.start() has been called. If listener is

Re: [infinispan-dev] Translating our events to JSR 107 events

2013-01-28 Thread Vladimir Blagojevic
On 13-01-28 7:31 AM, Manik Surtani wrote: If you're ok with changing the core, you could add a getValue() method to CacheEntryCreatedEvent, and an isCreated() method to CacheEntryModifiedEvent (as I suppose you don't want to call the updates listener when an entry is created). Both changes

Re: [infinispan-dev] Translating our events to JSR 107 events

2013-01-28 Thread Manik Surtani
On 28 Jan 2013, at 15:22, Vladimir Blagojevic vblag...@redhat.com wrote: On 13-01-28 7:31 AM, Manik Surtani wrote: If you're ok with changing the core, you could add a getValue() method to CacheEntryCreatedEvent, and an isCreated() method to CacheEntryModifiedEvent (as I suppose you don't

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Ray Tsang
Hi Guys, I also implemented something w/ JSR 223 - https://github.com/saturnism/infinispan/tree/jsr223-mr/core/src/main/java/org/infinispan/distexec/mapreduce With tests that uses scripts like this: https://github.com/saturnism/infinispan/tree/jsr223-mr/core/src/test/resources/mapreduce On Mon,

Re: [infinispan-dev] Map/Reduce Tasks and classpath

2013-01-28 Thread Ray Tsang
Tristan, After the quick groovy poc, I discovered the design/plan doc for m/r over hotrod that mentioned stored procedure approach. Where will the script be stored and how will the user store it? (Perhaps stored also in a cache?) I just implemented something w/ jsr223 that might be generic

[infinispan-dev] Lucene 4 / Infinispan performance

2013-01-28 Thread Sanne Grinovero
These are preliminary results of our stressor; looks quite promising as I haven't yet looked into profiling / tuning: Stock Lucene RAMDirectory Searches: 14.799.852 Writes: 195.935 Stock Lucene FSDirectory (Memory mapping on SSD) Searches: 9.628.593 Writes: 105.930 Our custom