At Veoh, I was using 10 machines that were roughly equivalent to the small instances at amazon to crunch really large amounts of data.
Giving up on in-memory computation was a huge win for me. On Sun, Feb 1, 2009 at 2:45 PM, Sean Owen <[email protected]> wrote: > I think it will be interesting to try as a proof of concept. It's a > solution that still doesn't scale to huge data sets, but I think a > 15GB machine would still work for large-ish data sets (~100M ratings) > and its exactly those small- to medium-sized applications for which it > might make sense to outsource this. > -- Ted Dunning, CTO DeepDyve 4600 Bohannon Drive, Suite 220 Menlo Park, CA 94025 www.deepdyve.com 650-324-0110, ext. 738 858-414-0013 (m)
