Repository: aurora Updated Branches: refs/heads/master 9d780262d -> 88a6f249e
Adding oversubscription summary. Bugs closed: AURORA-1441 Reviewed at https://reviews.apache.org/r/38390/ Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/88a6f249 Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/88a6f249 Diff: http://git-wip-us.apache.org/repos/asf/aurora/diff/88a6f249 Branch: refs/heads/master Commit: 88a6f249e31c31392cabf19c8691be1fd1c40cbb Parents: 9d78026 Author: Maxim Khutornenko <[email protected]> Authored: Mon Sep 21 15:36:46 2015 -0700 Committer: Maxim Khutornenko <[email protected]> Committed: Mon Sep 21 15:36:46 2015 -0700 ---------------------------------------------------------------------- docs/configuration-reference.md | 17 +++++++++++++++++ docs/deploying-aurora-scheduler.md | 16 ++++++++++++++++ 2 files changed, 33 insertions(+) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/configuration-reference.md ---------------------------------------------------------------------- diff --git a/docs/configuration-reference.md b/docs/configuration-reference.md index ad2701c..8d50c45 100644 --- a/docs/configuration-reference.md +++ b/docs/configuration-reference.md @@ -26,6 +26,7 @@ Aurora + Thermos Configuration Reference - [Job Schema](#job-schema) - [Job Objects](#job-objects) - [Services](#services) + - [Revocable Jobs](#revocable-jobs) - [UpdateConfig Objects](#updateconfig-objects) - [HealthCheckConfig Objects](#healthcheckconfig-objects) - [Announcer Objects](#announcer-objects) @@ -328,6 +329,7 @@ Job Schema ```health_check_config``` | ```heath_check_config``` object | Parameters for controlling a task's health checks via HTTP. Only used if a health port was assigned with a command line wildcard. ```container``` | ```Container``` object | An optional container to run all processes inside of. ```lifecycle``` | ```LifecycleConfig``` object | An optional task lifecycle configuration that dictates commands to be executed on startup/teardown. HTTP lifecycle is enabled by default if the "health" port is requested. See [LifecycleConfig Objects](#lifecycleconfig-objects) for more information. + ```tier``` | String | Task tier type. When set to `revocable` requires the task to run with Mesos revocable resources. This is work [in progress](https://issues.apache.org/jira/browse/AURORA-1343) and is currently only supported for the revocable tasks. The ultimate goal is to simplify task configuration by hiding various configuration knobs behind a task tier definition. See AURORA-1343 and AURORA-1443 for more details. ### Services @@ -339,6 +341,21 @@ Jobs without the service bit set only restart up to `max_task_failures` times and only if they terminated unsuccessfully either due to human error or machine failure. +### Revocable Jobs + +**WARNING**: This feature is currently in alpha status. Do not use it in production clusters! + +Mesos [supports a concept of revocable tasks](http://mesos.apache.org/documentation/latest/oversubscription/) +by oversubscribing machine resources by the amount deemed safe to not affect the existing +non-revocable tasks. Aurora now supports revocable jobs via a `tier` setting set to `revocable` +value. + +More implementation details in this [ticket](https://issues.apache.org/jira/browse/AURORA-1343). + +Scheduler must be [configured](deploying-aurora-scheduler.md#configuring-resource-oversubscription) +to receive revocable offers from Mesos and accept revocable jobs. If not configured properly +revocable tasks will never get assigned to hosts and will stay in PENDING. + ### UpdateConfig Objects Parameters for controlling the rate and policy of rolling updates. http://git-wip-us.apache.org/repos/asf/aurora/blob/88a6f249/docs/deploying-aurora-scheduler.md ---------------------------------------------------------------------- diff --git a/docs/deploying-aurora-scheduler.md b/docs/deploying-aurora-scheduler.md index 8db0e61..2a46d2f 100644 --- a/docs/deploying-aurora-scheduler.md +++ b/docs/deploying-aurora-scheduler.md @@ -14,6 +14,7 @@ machines. This guide helps you get the scheduler set up and troubleshoot some c - [Network considerations](#network-considerations) - [Considerations for running jobs in docker](#considerations-for-running-jobs-in-docker) - [Security Considerations](#security-considerations) + - [Configuring Resource Oversubscription](#configuring-resource-oversubscription) - [Running Aurora](#running-aurora) - [Maintaining an Aurora Installation](#maintaining-an-aurora-installation) - [Monitoring](#monitoring) @@ -190,6 +191,21 @@ assuming you set `-http_port=8081`. See [security.md](security.md). +## Configuring Resource Oversubscription + +**WARNING**: This feature is currently in alpha status. Do not use it in production clusters! +See [this document](configuration-reference.md#revocable-jobs) for more feature details. + +Set these scheduler flag to allow receiving revocable Mesos offers: + + -receive_revocable_resources=true + +Specify a tier configuration file path: + + -tier_config=path/to/tiers/config.json + +Example [tier configuration file](../src/test/resources/org/apache/aurora/scheduler/tiers-example.json). + ### Maintaining an Aurora Installation ### Monitoring
