Interesting. That's close to a PB if my math is correct. Is there a write up about this somewhere? Something that we could link from the HBase homepage?
-- Lars ----- Original Message ----- From: Jack Levin <[email protected]> To: [email protected] Cc: Andrew Purtell <[email protected]> Sent: Thursday, January 10, 2013 9:24 AM Subject: Re: Storing images in Hbase We stored about 1 billion images into hbase with file size up to 10MB. Its been running for close to 2 years without issues and serves delivery of images for Yfrog and ImageShack. If you have any questions about the setup, I would be glad to answer them. -Jack On Sun, Jan 6, 2013 at 1:09 PM, Mohit Anchlia <[email protected]> wrote: > I have done extensive testing and have found that blobs don't belong in the > databases but are rather best left out on the file system. Andrew outlined > issues that you'll face and not to mention IO issues when compaction occurs > over large files. > > On Sun, Jan 6, 2013 at 12:52 PM, Andrew Purtell <[email protected]> wrote: > >> I meant this to say "a few really large values" >> >> On Sun, Jan 6, 2013 at 12:49 PM, Andrew Purtell <[email protected]> >> wrote: >> >> > Consider if the split threshold is 2 GB but your one row contains 10 GB >> as >> > really large value. >> >> >> >> >> -- >> Best regards, >> >> - Andy >> >> Problems worthy of attack prove their worth by hitting back. - Piet Hein >> (via Tom White) >>
