implementing a generic list writable

Hi, I am working on building a map reduce pipeline of jobs(with one MR job's output feeding to another as input). The values being passed around are fairly complex, in that there are lists of different types and hash maps with values as lists. Hadoop api does not seem to have a ListWritable. Am tr

Re: implementing a generic list writable

You could serialise the class name along with the list items in an extra Text writable, and then in the readFields method get it back using Class.forName(textClassName.toString()) In the write method, to avoid having the class as a variable you must pass into the constructor, just get the class ty

RE: User Logs questions

I never saw a response to this request. Is it possible to configure these properties? Thanks, Dave Shine Sr. Software Engineer 321.939.5093 direct | 407.314.0122 mobile CI Boost(tm) Clients Outperform Online(tm) www.ciboost.com From: Dave Shine [mailto:dave.sh...@ch

Null Pointer Excpetion while writing Key on Mapper emit

While emitting a record from my mapper, I am receiving a NullPointerException. The stack trace seems to indicate there is a problem serializing the Key. The key contains a few strings and a few longs. It is a string that it is having trouble serializing. I've checked the contents of the string p

Re: Null Pointer Excpetion while writing Key on Mapper emit

Hi Matt, You StringOne is clearly not null else it would have thrown an exception in the if. You should not be calling equals on String unless you are sure that it is not null; use == instead for nullity checks. This means that one of 'kvbuffer' or 'b' (byte[] argument) to be null. Mind