Hi, I am using hbase to store java objects. The objects implement the Writable interface. The size of objects to be stored in each row ranges from a few kb to ~50 Mb. The strategy that I am planning to use is if object size < 5Mb store it in hbase else store it on hdfs and insert its hdfs location in hbase
While storing the objects I am using WritableUtils.toByteArray(myObject) method. Can I use the WritableUtils.toByteArray(myObject).length to determine if the object should go in hbase or hdfs? Is this an acceptable strategy? Is the 5 MB limit a safe enough threshold? - Rohit Kelkar
