[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[
https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13255845#comment-13255845
]
Eugene Koontz commented on GIRAPH-183:
--
I found that {{mvn clean compile site}} works on trunk (you may also shorten
build time with: {{mvn -DskipTests clean compile site}}).
The key is that the 'compile' phase prevents the default 'compiler:compile'
('compiler' plugin and 'compile' goal) from executing.
{{mvn -PX clean compile site}} also works for {{X}} in {{{hadoop_trunk,
hadoop_facebook*, hadoop_0.23, hadoop_1.0, hadoop_0.20.203,
hadoop_non_secure}}}.
*with {{-Dhadoop.jar.path=$HOME/hadoop-20/build/hadoop-0.20.1-dev-core.jar}}
I think it would be good to get 'mvn site' working on its own, though, which
will work *if* we can get maven to always run the 'compile' phase prior to the
'site' phase, whenever a user runs 'mvn site'.
Add Claudio's FOSDEM presentation (slides and video) to the site
Key: GIRAPH-183
URL: https://issues.apache.org/jira/browse/GIRAPH-183
Project: Giraph
Issue Type: Improvement
Components: site
Reporter: Claudio Martella
Assignee: Claudio Martella
Priority: Trivial
Labels: newbie
Attachments: GIRAPH-183.diff
Presentation:
http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/
Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4,
http://www.youtube.com/watch?v=BmRaejKGeDM
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13255950#comment-13255950 ] Claudio Martella commented on GIRAPH-183: - OK, great, I'll test that. Just one minor thing. We shouldn't use -DskipTests because it creates a site stating no test coverage. Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13254112#comment-13254112 ] Claudio Martella commented on GIRAPH-183: - Ok, thanks for looking into this Eugene. Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Claudio Martella updated GIRAPH-183: Attachment: GIRAPH-183.diff Site update. Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253488#comment-13253488 ] Avery Ching commented on GIRAPH-183: +1. This is great stuff Claudio. Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253498#comment-13253498 ] Hudson commented on GIRAPH-183: --- Integrated in Giraph-trunk-Commit #102 (See [https://builds.apache.org/job/Giraph-trunk-Commit/102/]) GIRAPH-183: Add Claudio's FOSDEM presentation (slides and video) to the site (Revision 1325822) Result = SUCCESS claudio : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1325822 Files : * /incubator/giraph/trunk/CHANGELOG * /incubator/giraph/trunk/src/site/xdoc/index.xml Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253555#comment-13253555 ] Claudio Martella commented on GIRAPH-183: - It's actually quite weird, mvn site:site fails due to some missing symbols from hadoop secure... Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253655#comment-13253655 ] Avery Ching commented on GIRAPH-183: Are the problems related to GIRAPH-168? Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253664#comment-13253664 ] Claudio Martella commented on GIRAPH-183: - To be honest I don't have a clue. The issue is just with site:site, it does compile, package and install otherwise. I tried specifying the hadoop_non_secure profile, but still the same problem. Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[
https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253819#comment-13253819
]
Eugene Koontz commented on GIRAPH-183:
--
GIRAPH-168 is definitely related. I get the same kind of errors with mvn
compiler:compile, which is being invoked by mvn site:site:
{code}
[ec2-user@ip-10-161-115-188 giraph]$ mvn clean compiler:compile
[INFO] Scanning for projects...
[INFO]
[INFO]
[INFO] Building Apache Incubator Giraph 0.2-SNAPSHOT
[INFO]
[INFO]
[INFO] --- maven-clean-plugin:2.4.1:clean (default-clean) @ giraph ---
[INFO] Deleting /home/ec2-user/giraph/target
[INFO]
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-cli) @ giraph ---
[INFO] Compiling 142 source files to /home/ec2-user/giraph/target/classes
[INFO] -
[ERROR] COMPILATION ERROR :
[INFO] -
[ERROR]
/home/ec2-user/giraph/src/main/java/org/apache/giraph/comm/BasicRPCCommunications.java:[66,28]
can\
not find symbol
symbol : class ProtocolSignature
location: package org.apache.hadoop.ipc
{code}
Add Claudio's FOSDEM presentation (slides and video) to the site
Key: GIRAPH-183
URL: https://issues.apache.org/jira/browse/GIRAPH-183
Project: Giraph
Issue Type: Improvement
Components: site
Reporter: Claudio Martella
Assignee: Claudio Martella
Priority: Trivial
Labels: newbie
Attachments: GIRAPH-183.diff
Presentation:
http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/
Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4,
http://www.youtube.com/watch?v=BmRaejKGeDM
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (GIRAPH-183) Add Claudio's FOSDEM presentation (slides and video) to the site
[ https://issues.apache.org/jira/browse/GIRAPH-183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13253899#comment-13253899 ] Eugene Koontz commented on GIRAPH-183: -- Requested help for this on the maven mailing list: http://www.mail-archive.com/users@maven.apache.org/msg124398.html Add Claudio's FOSDEM presentation (slides and video) to the site Key: GIRAPH-183 URL: https://issues.apache.org/jira/browse/GIRAPH-183 Project: Giraph Issue Type: Improvement Components: site Reporter: Claudio Martella Assignee: Claudio Martella Priority: Trivial Labels: newbie Attachments: GIRAPH-183.diff Presentation: http://prezi.com/9ake_klzwrga/apache-giraph-distributed-graph-processing-in-the-cloud/ Video: http://www.youtube.com/watch?v=3ZrqPEIPRe4, http://www.youtube.com/watch?v=BmRaejKGeDM -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Apache Giraph talk @ FOSDEM
Hi devs, FOSDEM has announced a devroom completely dedicated to Graph Processing: https://lists.fosdem.org/pipermail/fosdem/2011-November/001344.html I'm going to submit for a talk there. Here's the draft, feedback is welcome :) Title: Apache Giraph: distributed graph processing in the cloud. Abstract: Web and online social graphs have been rapidly growing in size and scale during the past decade. In 2008, Google estimated that the number of web pages reached over a trillion. Online social networking and email sites, including Yahoo!, Google, Microsoft, Facebook, LinkedIn, and Twitter, have hundreds of millions of users and are expected to grow much more in the future. Processing these graphs plays a big role in relevant and personalized information for users, such as results from a search engine or news in an online social networking site. The Apache Giraph (http://incubator.apache.org/giraph) project is a faul-tolerant in-memory distributed graph processing system which runs on top of a standard Hadoop cluster and is capable of running any standard Bulk Synchronous Parallel (BSP) operation over any large generic data set which can be represented as a graph. Apache Giraph is a loose implementation of Google Pregel. Giraph entered the ASF Incubator in July 2011, where it has enlisted the aid of committers from Yahoo!, Facebook, LinkedIn, and Twitter. The talk will present why running MapReduce jobs for graph processing can be a problem, introducing the reason why Google designed Pregel at first place. Later, the BSP model will be presented focusing on how it can be used to implement a distributed graph processing engine. The last part of the talk will be dedicated to Apache Giraph, with a description of the programming model (i.e. the API, some typical examples such as PageRank and Single Source Shortest Path) along with a technical overview of how the architecture of Giraph works and how it leverages the Hadoop infrastructure. Best, Claudio -- Claudio Martella claudio.marte...@gmail.com
Re: Apache Giraph talk @ FOSDEM
Thanks for volunteering Claudio! It's very nice that Apache Giraph was mentioned in the invite, even though it's a relatively new open-source project. I'll read your draft and send you feedback privately sometime today. Also, if you need slides, please feel free to use anything I've ever posted (http://www.slideshare.net/averyching). I think you can download them natively. Also, if you need feedback for your slides, let me know. Avery On 11/21/11 12:43 PM, Claudio Martella wrote: Hi devs, FOSDEM has announced a devroom completely dedicated to Graph Processing: https://lists.fosdem.org/pipermail/fosdem/2011-November/001344.html I'm going to submit for a talk there. Here's the draft, feedback is welcome :) Title: Apache Giraph: distributed graph processing in the cloud. Abstract: Web and online social graphs have been rapidly growing in size and scale during the past decade. In 2008, Google estimated that the number of web pages reached over a trillion. Online social networking and email sites, including Yahoo!, Google, Microsoft, Facebook, LinkedIn, and Twitter, have hundreds of millions of users and are expected to grow much more in the future. Processing these graphs plays a big role in relevant and personalized information for users, such as results from a search engine or news in an online social networking site. The Apache Giraph (http://incubator.apache.org/giraph) project is a faul-tolerant in-memory distributed graph processing system which runs on top of a standard Hadoop cluster and is capable of running any standard Bulk Synchronous Parallel (BSP) operation over any large generic data set which can be represented as a graph. Apache Giraph is a loose implementation of Google Pregel. Giraph entered the ASF Incubator in July 2011, where it has enlisted the aid of committers from Yahoo!, Facebook, LinkedIn, and Twitter. The talk will present why running MapReduce jobs for graph processing can be a problem, introducing the reason why Google designed Pregel at first place. Later, the BSP model will be presented focusing on how it can be used to implement a distributed graph processing engine. The last part of the talk will be dedicated to Apache Giraph, with a description of the programming model (i.e. the API, some typical examples such as PageRank and Single Source Shortest Path) along with a technical overview of how the architecture of Giraph works and how it leverages the Hadoop infrastructure. Best, Claudio
Re: Apache Giraph talk @ FOSDEM
Very cool! One thing I would update below Claudio is some sort of statement that Giraph is currently Incubating, with appropriate links back to the Incubator website and policies. +1. Cheers, Chris On Nov 21, 2011, at 12:43 PM, Claudio Martella wrote: Hi devs, FOSDEM has announced a devroom completely dedicated to Graph Processing: https://lists.fosdem.org/pipermail/fosdem/2011-November/001344.html I'm going to submit for a talk there. Here's the draft, feedback is welcome :) Title: Apache Giraph: distributed graph processing in the cloud. Abstract: Web and online social graphs have been rapidly growing in size and scale during the past decade. In 2008, Google estimated that the number of web pages reached over a trillion. Online social networking and email sites, including Yahoo!, Google, Microsoft, Facebook, LinkedIn, and Twitter, have hundreds of millions of users and are expected to grow much more in the future. Processing these graphs plays a big role in relevant and personalized information for users, such as results from a search engine or news in an online social networking site. The Apache Giraph (http://incubator.apache.org/giraph) project is a faul-tolerant in-memory distributed graph processing system which runs on top of a standard Hadoop cluster and is capable of running any standard Bulk Synchronous Parallel (BSP) operation over any large generic data set which can be represented as a graph. Apache Giraph is a loose implementation of Google Pregel. Giraph entered the ASF Incubator in July 2011, where it has enlisted the aid of committers from Yahoo!, Facebook, LinkedIn, and Twitter. The talk will present why running MapReduce jobs for graph processing can be a problem, introducing the reason why Google designed Pregel at first place. Later, the BSP model will be presented focusing on how it can be used to implement a distributed graph processing engine. The last part of the talk will be dedicated to Apache Giraph, with a description of the programming model (i.e. the API, some typical examples such as PageRank and Single Source Shortest Path) along with a technical overview of how the architecture of Giraph works and how it leverages the Hadoop infrastructure. Best, Claudio -- Claudio Martella claudio.marte...@gmail.com ++ Chris Mattmann, Ph.D. Senior Computer Scientist NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 171-266B, Mailstop: 171-246 Email: chris.a.mattm...@nasa.gov WWW: http://sunset.usc.edu/~mattmann/ ++ Adjunct Assistant Professor, Computer Science Department University of Southern California, Los Angeles, CA 90089 USA ++
Re: FOSDEM
Sorry Jakob, I'm not familiar with dibs :). You mean I submit to FOSDEM and you submit to Berlin Buzzwords? It sounds good to me, I was at BB two years ago and I doubt my current affiliation would pay my ticket this year. On Mon, Nov 14, 2011 at 8:11 PM, Jakob Homan jgho...@gmail.com wrote: It would be excellent to be at FOSDEM, please do. I'm hoping to submit something for next year's Berlin Buzzwords, so, uhm, dibs? (as much as is reasonably possible and polite, of course). On Mon, Nov 7, 2011 at 12:38 PM, Avery Ching ach...@apache.org wrote: I think it would be great if someone could talk about Giraph at FOSDEM. Thanks for volunteering, Claudio. I'm not planning to be there unfortunately. Avery On 11/7/11 12:33 PM, Claudio Martella wrote: Hello list, I was thinking about submitting for a talk at fosdem with topic Pregel Giraph. Am I overlapping with somebody else? Best, Claudio -- Claudio Martella claudio.marte...@gmail.com
Re: FOSDEM
It would be excellent to be at FOSDEM, please do. I'm hoping to submit something for next year's Berlin Buzzwords, so, uhm, dibs? (as much as is reasonably possible and polite, of course). On Mon, Nov 7, 2011 at 12:38 PM, Avery Ching ach...@apache.org wrote: I think it would be great if someone could talk about Giraph at FOSDEM. Thanks for volunteering, Claudio. I'm not planning to be there unfortunately. Avery On 11/7/11 12:33 PM, Claudio Martella wrote: Hello list, I was thinking about submitting for a talk at fosdem with topic Pregel Giraph. Am I overlapping with somebody else? Best, Claudio
FOSDEM
Hello list, I was thinking about submitting for a talk at fosdem with topic Pregel Giraph. Am I overlapping with somebody else? Best, Claudio -- Claudio Martella claudio.marte...@gmail.com
