Repository: mesos Updated Branches: refs/heads/master 49daa6deb -> 8f4516f05
Added developer tools, updated list of frameworks. Review: https://reviews.apache.org/r/18826 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/8f4516f0 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/8f4516f0 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/8f4516f0 Branch: refs/heads/master Commit: 8f4516f05bcfc54d296a7fa520643a31326c8e6b Parents: 49daa6d Author: Tobi Knaup <[email protected]> Authored: Sun Mar 9 21:09:56 2014 -0700 Committer: Vinod Kone <[email protected]> Committed: Sun Mar 9 21:09:56 2014 -0700 ---------------------------------------------------------------------- docs/home.md | 1 + docs/mesos-frameworks.md | 25 +++++++++++++++++++------ docs/powered-by-mesos.md | 4 +++- docs/tools.md | 14 +++++++++++++- 4 files changed, 36 insertions(+), 8 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/mesos/blob/8f4516f0/docs/home.md ---------------------------------------------------------------------- diff --git a/docs/home.md b/docs/home.md index 84484b4..07c72c1 100644 --- a/docs/home.md +++ b/docs/home.md @@ -22,6 +22,7 @@ layout: documentation * [Mesos Code Internals](mesos-code-internals.md) overview of the codebase and internal organization. * [Framework Development Guide](app-framework-development-guide.md) describes how to build applications on top of Mesos. * [Mesos Command-Line Flags](configuration.md) detailing various flags that can be set. +* [Developer Tools](tools.md) for hacking on Mesos or writing frameworks. ## Contributing to Mesos http://git-wip-us.apache.org/repos/asf/mesos/blob/8f4516f0/docs/mesos-frameworks.md ---------------------------------------------------------------------- diff --git a/docs/mesos-frameworks.md b/docs/mesos-frameworks.md index 62838c9..8f270ab 100644 --- a/docs/mesos-frameworks.md +++ b/docs/mesos-frameworks.md @@ -3,17 +3,30 @@ layout: documentation --- # Software projects built on Mesos +## Long Running Services + * [Aurora](http://aurora.incubator.apache.org) is a service scheduler that runs on top of Mesos, enabling you to run long-running services that take advantage of Mesos' scalability, fault-tolerance, and resource isolation. -* [Cassandra](https://github.com/mesosphere/cassandra-mesos) is a performant and highly available distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make it the perfect platform for mission-critical data. -* [Chronos](https://github.com/airbnb/chronos) is a distributed job scheduler that supports complex job topologies. It can be used as a more fault-tolerant replacement for Cron. +* [Marathon](https://github.com/mesosphere/marathon) is a private PaaS built on Mesos. It automatically handles hardware or software failures and ensures that an app is "always on". +* [SSSP](https://github.com/mesosphere/sssp) is a simple web application that provides a white-label "Megaupload" for storing and sharing files in S3. + +## Big Data Processing + +* [Cray Chapel](https://github.com/nqn/mesos-chapel) is a productive parallel programming language. The Chapel Mesos scheduler lets you run Chapel programs on Mesos. * [Dpark](https://github.com/douban/dpark) is a Python clone of Spark, a MapReduce-like framework written in Python, running on Mesos. * [Exelixi](https://github.com/mesosphere/exelixi) is a distributed framework for running genetic algorithms at scale. * [Hadoop](https://github.com/mesos/hadoop) Running Hadoop on Mesos distributes MapReduce jobs efficiently across an entire cluster. -* [Hypertable](https://code.google.com/p/hypertable/wiki/Mesos) is a high performance, scalable, distributed storage and processing system for structured and unstructured data. -* [Jenkins](https://github.com/jenkinsci/mesos-plugin) is a continuous integration server. The mesos-jenkins plugin allows it to dynamically launch workers on a Mesos cluster depending on the workload. -* [Marathon](https://github.com/mesosphere/marathon) is a private PaaS built on Mesos. It automatically handles hardware or software failures and ensures that an app is "always on". * [MPI](https://github.com/mesosphere/mesos-hydra) is a message-passing system designed to function on a wide variety of parallel computers. * [Spark](http://spark.incubator.apache.org/) is a fast and general-purpose cluster computing system which makes parallel jobs easy to write. -* [SSSP](https://github.com/mesosphere/sssp) is a simple web application that provides a white-label "Megaupload" for storing and sharing files in S3. * [Storm](https://github.com/mesosphere/storm-mesos) is a distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing. + +## Batch Scheduling + +* [Chronos](https://github.com/airbnb/chronos) is a distributed job scheduler that supports complex job topologies. It can be used as a more fault-tolerant replacement for Cron. +* [Jenkins](https://github.com/jenkinsci/mesos-plugin) is a continuous integration server. The mesos-jenkins plugin allows it to dynamically launch workers on a Mesos cluster depending on the workload. * [Torque](http://mesos.apache.org/documentation/latest/running-torque-or-mpi-on-mesos/) is a distributed resource manager providing control over batch jobs and distributed compute nodes. + +## Data Storage + +* [Cassandra](https://github.com/mesosphere/cassandra-mesos) is a performant and highly available distributed database. Linear scalability and proven fault-tolerance on commodity hardware or cloud infrastructure make it the perfect platform for mission-critical data. +* [ElasticSearch](https://github.com/mesosphere/elasticsearch-mesos) is a distributed search engine. Mesos makes it easy to run and scale. +* [Hypertable](https://code.google.com/p/hypertable/wiki/Mesos) is a high performance, scalable, distributed storage and processing system for structured and unstructured data. http://git-wip-us.apache.org/repos/asf/mesos/blob/8f4516f0/docs/powered-by-mesos.md ---------------------------------------------------------------------- diff --git a/docs/powered-by-mesos.md b/docs/powered-by-mesos.md index c09bf55..1d818fc 100644 --- a/docs/powered-by-mesos.md +++ b/docs/powered-by-mesos.md @@ -11,6 +11,7 @@ layout: documentation * [Categorize](http://categorize.co) * [CloudPhysics](http://cloudphysics.com) * [Conviva](http://www.conviva.com) +* [eBay](http://www.ebay.com) * [Devicescape](http://www.devicescape.com) * [DueDil](http://www.duedil.com) * [HubSpot](http://www.hubspot.com) @@ -19,6 +20,7 @@ layout: documentation * [Medidata Solutions](http://www.mdsol.com) * [MediaCrossing](http://www.mediacrossing.com) * [OpenTable](http://www.opentable.com) +* [PayPal](https://www.paypal.com) * [Pinkbike](http://www.pinkbike.com) * [Sharethrough](http://www.sharethrough.com) * [Shopify](http://www.shopify.com) @@ -33,4 +35,4 @@ layout: documentation See the [Mesos frameworks page](mesos-frameworks.md) for a list of apps built on top of Mesos, and instructions on how to use them. -If you're using Mesos, please add yourself to the list above, or email [email protected] and we'll add you! \ No newline at end of file +If you're using Mesos, please add yourself to the list above, or email [email protected] and we'll add you! http://git-wip-us.apache.org/repos/asf/mesos/blob/8f4516f0/docs/tools.md ---------------------------------------------------------------------- diff --git a/docs/tools.md b/docs/tools.md index c71b876..df6c892 100644 --- a/docs/tools.md +++ b/docs/tools.md @@ -4,13 +4,25 @@ layout: documentation # Tools -Tools for setting up and running a Mesos cluster. +## Ops Tools + +These tools make it easy to set up and run a Mesos cluster. * [Deploy scripts](deploy-scripts.md) for launching a Mesos cluster on a set of machines. * [EC2 scripts](ec2-scripts.md) for launching a Mesos cluster on Amazon EC2. * [Chef cookbook by Everpeace](https://github.com/everpeace/cookbook-mesos) Install Mesos and configure master and slave. This cookbook supports installation from source or the Mesosphere packages. * [Chef cookbook by Mdsol](https://github.com/mdsol/mesos_cookbook) Application cookbook for installing the Apache Mesos cluster manager. This cookbook installs Mesos via packages provided by Mesosphere. +* [Puppet Module by Deric](https://github.com/deric/puppet-mesos) This is a Puppet module for managing Mesos nodes in a cluster. * [Vagrant setup by Everpeace](https://github.com/everpeace/vagrant-mesos) Spin up your Mesos Cluster with Vagrant! * [Vagrant setup by Mesosphere](https://github.com/mesosphere/playa-mesos) Quickly build Mesos sandbox environments using Vagrant. +## Developer Tools + +If you want to hack on Mesos or write a new framework, these tools will help. + +* [Go Bindings and Examples](https://github.com/mesosphere/mesos-go) Write a Mesos framework in Go! Comes with an example scheduler and executor. +* [Mesos Framework giter8 Template](https://github.com/mesosphere/scala-sbt-mesos-framework.g8) This is a giter8 template. The result of applying this template is a bare-bones Apache Mesos framework in Scala using SBT for builds and Vagrant for testing on a singleton cluster. +* [Scala Hello World](https://gist.github.com/guenter/7471695) A simple Mesos "Hello World": downloads and starts a web server on every node in the cluster. +* [Xcode Workspace](https://github.com/tillt/xcode-mesos) Hack on Mesos in Xcode. + Can't find yours in the list? Please submit a patch, or email [email protected] and we'll add you!
