Whilst I think this is great and def additional features and support for larger files sizes is good that we're looking forward.
I feel some of the more historical issues need to be addressed first to make this a commercial production quality solution, before we expand further. We have a lot of old open jira tickets where time needs to be spent , on really some of the less glamorous tasks. For me those to biggest hold ups for advocating the full use of the project in the systems i work with are the memory fragmentation over time causing usable memory loss and concurrency issues in a highly multithreaded environment. My two cents anyhow. Michael André Pearce On 15 Jun 2012, at 07:25, Simone Tripodi <[email protected]> wrote: > Hi all guys, > > I was recently involved in the realization of a simple prototypal > server based on NIO APIs, so had the chance of thinking more on few > doubts I've had in DM, hopefully sharing my experience will benefit DM > :) > > SO, this a list of thoughts: > > * a single ByteBuffer _could_ be NOT enough to handle a single > object: despite how good the serializer you've chosen is, there'll be > always an object that, once serialized, has a dimension that is bigger > that the ByteBuffer maximum capacity - ByteBuffer size is an int, it > could be a long (and types cast are bad jokes! :P) - my proposal is > that a single DM entry point _could_ be split in a sequence of > ByteBuffers; > > * Objects can be serialized directly to ByteBuffers: ATM we are > wrapping the produced byte[], which still is an object in the Heap, so > we can optimize that step simply by implementing (Input|Output)Streams > wrapping the target sequence of ByteBuffers - Benoit already did some > work on it, but I don't see it committed, please correct me if I am > wrong! > > * We didn't think to apply a GZip compression - it is true that we > are working off-heap, but hopefully the allocated space can handle > more objects by compressing them > > WDYT? does it make sense or there is something we want to speak more > carefully? > > Thanks and best, > -Simo > > http://people.apache.org/~simonetripodi/ > http://simonetripodi.livejournal.com/ > http://twitter.com/simonetripodi > http://www.99soft.org/
