Great idea and much needed move ;) Within the Hadoop platform, the MapReduce framework is focused on distributed batch processing. Other frameworks are more focused on streaming… => Have you considered the pros and cons?
FYI, we are using the DBpedia Extraction framework at Yahoo Labs for some projects, and have been thinking about porting it to Hadoop for some time. We may be able to help… -- Nicolas Torzec Yahoo Labs From: Dimitris Kontokostas <[email protected]<mailto:[email protected]>> Date: Thursday, March 6, 2014 at 5:04 AM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, Linked Data community <[email protected]<mailto:[email protected]>>, DBpedia Discussions <[email protected]<mailto:[email protected]>>, DBpediaDevelopers <[email protected]<mailto:[email protected]>>, "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>>, DBpediaSpotlight Developers <[email protected]<mailto:[email protected]>> Subject: [Dbpedia-discussion] MapReduce expert needed to help DBpedia [as GSoC co-mentor] Dear all, We want to adapt the DBpedia extraction framewok to work with a MapReduce framework. [1] We want to implement this idea through GSoC 14 and already got two interested students [2] [3]. Unfortunately we are not experienced in this field and our existing contacts could not join. Thus, we are looking for someone to help us mentor the technical aspects of this project. About GSoC (http://en.wikipedia.org/wiki/GSoC) The Google Summer of Code (GSoC) is an annual program, first held from May to August 2005,[1]<http://en.wikipedia.org/wiki/GSoC#cite_note-LinSOC-1> in which Google awards stipends (of US$5,500, as of 2014) to all students who successfully complete a requested free and open-source software coding project during the summer. See some additional info on our page [4] Best, Dimitris [1] http://wiki.dbpedia.org/gsoc2014/ideas/ExtractionwithMapReduce/ [2] student #1<http://sourceforge.net/mailarchive/forum.php?thread_name=CA%2Bu4%2Ba3g3dSd9L%3DM173hryYPp9HjwtNYgUU6Jcedy9MUAmzMVA%40mail.gmail.com&forum_name=dbpedia-gsoc> [3] student #2<http://sourceforge.net/p/dbpedia/mailman/dbpedia-gsoc/thread/CAOk94WbB7%2BEzaWveP4OWCGeXvKdVUv790wAL%2BuRsoxTb1VEDeQ%40mail.gmail.com/#msg32063932> [4] http://wiki.dbpedia.org/gsoc2014?v=kx0#h358-6 -- Dimitris Kontokostas Department of Computer Science, University of Leipzig Research Group: http://aksw.org Homepage:http://aksw.org/DimitrisKontokostas
