As far as I know, GPU's are not very optimal for neural net calculation. For some applications, speedup factors come in the 1000 range, but for NN's I have only seen speedups of one order of magnitude (10x).
For example, see attached paper On Thu, Jun 12, 2008 at 4:59 PM, Matt Mahoney <[EMAIL PROTECTED]> wrote: > --- On Wed, 6/11/08, J Storrs Hall, PhD <[EMAIL PROTECTED]> wrote: > > > Hmmph. I offer to build anyone who wants one a > > human-capacity machine for > > $100K, using currently available stock parts, in one rack. > > Approx 10 teraflops, using Teslas. > > (http://www.nvidia.com/object/tesla_c870.html) > > > > The software needs a little work... > > Um, that's 10 petaflops, not 10 teraflops. I'm assuming a neural network > with 10^15 synapses (about 1 or 2 byte each) with 20 to 100 ms resolution, > 10^16 to 10^17 operations per second. One Tesla = 350 GFLOPS, 1.5 GB, 120W, > $1.3K. So maybe $1 billion and 100 MW of power for a few hundred thousand > of these plus glue. > > > -- Matt Mahoney, [EMAIL PROTECTED] > > > > > > ------------------------------------------- > agi > Archives: http://www.listbox.com/member/archive/303/=now > RSS Feed: http://www.listbox.com/member/archive/rss/303/ > Modify Your Subscription: > http://www.listbox.com/member/?&; > Powered by Listbox: http://www.listbox.com > ------------------------------------------- agi Archives: http://www.listbox.com/member/archive/303/=now RSS Feed: http://www.listbox.com/member/archive/rss/303/ Modify Your Subscription: http://www.listbox.com/member/?member_id=8660244&id_secret=103754539-40ed26 Powered by Listbox: http://www.listbox.com
