Re: Hive vs. DryadLINQ

2009-10-15 Thread Jeff Hammerbacher
Hey Qing, You can download Dryad and see for yourself: http://connect.microsoft.com/site/sitehome.aspx?SiteID=891. There's no accompanying distributed file system, unfortunately, and I've never seen a benchmark of Dryad scaling to more than 300 nodes, so it's not clear that it's the "right" model

Hive vs. DryadLINQ

2009-10-15 Thread Qing Yan
Hi, Has anyone looked into the Microsoft Dryad project? Their basic idea is using DAG(connect computational "vertices" with communication "edges") to model distributed computing flows. And they have something called DryadLINQ which seems to be the Hive equivilent. Since the DAG model