Modified: aurora/site/publish/documentation/latest/reference/client-hooks/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/client-hooks/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/client-hooks/index.html (original) +++ aurora/site/publish/documentation/latest/reference/client-hooks/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/client-hooks/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" >
Modified: aurora/site/publish/documentation/latest/reference/configuration-best-practices/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/configuration-best-practices/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/configuration-best-practices/index.html (original) +++ aurora/site/publish/documentation/latest/reference/configuration-best-practices/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/configuration-best-practices/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > Modified: aurora/site/publish/documentation/latest/reference/configuration-templating/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/configuration-templating/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/configuration-templating/index.html (original) +++ aurora/site/publish/documentation/latest/reference/configuration-templating/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/configuration-templating/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > Modified: aurora/site/publish/documentation/latest/reference/configuration-tutorial/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/configuration-tutorial/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/configuration-tutorial/index.html (original) +++ aurora/site/publish/documentation/latest/reference/configuration-tutorial/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/configuration-tutorial/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > @@ -321,7 +325,7 @@ working directory.</p> <p>Typically, you save this code somewhere. You then need to define a Process in your <code>.aurora</code> configuration file that fetches the code from that somewhere -to where the slave can see it. For a public cloud, that can be anywhere public on +to where the agent can see it. For a public cloud, that can be anywhere public on the Internet, such as S3. For a private cloud internal storage, you need to put in on an accessible HDFS cluster or similar storage.</p> Modified: aurora/site/publish/documentation/latest/reference/configuration/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/configuration/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/configuration/index.html (original) +++ aurora/site/publish/documentation/latest/reference/configuration/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/configuration/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > @@ -545,12 +549,21 @@ resources are allocated.</p> <td style="text-align: center">Integer</td> <td>Bytes of disk required by the task.</td> </tr> +<tr> +<td><code>gpu</code></td> +<td style="text-align: center">Integer</td> +<td>Number of GPU cores required by the task</td> +</tr> </tbody></table> <h1 id="job-schema">Job Schema</h1> <h3 id="job-objects">Job Objects</h3> +<p><em>Note: Specifying a <code>Container</code> object as the value of the <code>container</code> property is + deprecated in favor of setting its value directly to the appropriate <code>Docker</code> or <code>Mesos</code> + container type</em></p> + <table><thead> <tr> <th>name</th> @@ -640,7 +653,7 @@ resources are allocated.</p> </tr> <tr> <td><code>container</code></td> -<td style="text-align: center"><code>Container</code> object</td> +<td style="text-align: center">Choice of <code>Container</code>, <code>Docker</code> or <code>Mesos</code> object</td> <td>An optional container to run all processes inside of.</td> </tr> <tr> @@ -705,8 +718,6 @@ resources are allocated.</p> <h3 id="healthcheckconfig-objects">HealthCheckConfig Objects</h3> -<p><em>Note: <code>endpoint</code>, <code>expected_response</code> and <code>expected_response_code</code> are deprecated from <code>HealthCheckConfig</code> and must be definied in <code>HttpHealthChecker</code>.</em></p> - <p>Parameters for controlling a task’s health checks via HTTP or a shell command.</p> <table><thead> @@ -816,12 +827,12 @@ no announcement will take place. For mo documentation.</p> <p>By default, the hostname in the registered endpoints will be the <code>--hostname</code> parameter -that is passed to the mesos slave. To override the hostname value, the executor can be started +that is passed to the mesos agent. To override the hostname value, the executor can be started with <code>--announcer-hostname=<overriden_value></code>. If you decide to use <code>--announcer-hostname</code> and if the overriden value needs to change for every executor, then the executor has to be started inside a wrapper, see <a href="../../operations/configuration/#thermos-executor-wrapper">Executor Wrapper</a>.</p> <p>For example, if you want the hostname in the endpoint to be an IP address instead of the hostname, -the <code>--hostname</code> parameter to the mesos slave can be set to the machine IP or the executor can +the <code>--hostname</code> parameter to the mesos agent can be set to the machine IP or the executor can be started with <code>--announcer-hostname=<host_ip></code> while wrapping the executor inside a script.</p> <table><thead> @@ -869,17 +880,18 @@ find a static port 80. No port would be <p>Static ports should be used cautiously as Aurora does nothing to prevent two tasks with the same static port allocations from being co-scheduled. -External constraints such as slave attributes should be used to enforce such +External constraints such as agent attributes should be used to enforce such guarantees should they be needed.</p> <h3 id="container-objects">Container Objects</h3> -<p><em>Note: The only container type currently supported is “docker”. Docker support is currently EXPERIMENTAL.</em> +<p><em>Note: Both Docker and Mesos unified-container support are currently EXPERIMENTAL.</em> <em>Note: In order to correctly execute processes inside a job, the Docker container must have python 2.7 installed.</em></p> <p><em>Note: For private docker registry, mesos mandates the docker credential file to be named as <code>.dockercfg</code>, even though docker may create a credential file with a different name on various platforms. Also, the <code>.dockercfg</code> file needs to be copied into the sandbox using the <code>-thermos_executor_resources</code> flag, specified while starting Aurora.</em></p> -<p>Describes the container the job’s processes will run inside.</p> +<p>Describes the container the job’s processes will run inside. If not using Docker or the Mesos +unified-container, the container can be omitted from your job config.</p> <table><thead> <tr> @@ -893,6 +905,11 @@ guarantees should they be needed.</p> <td style="text-align: center">Docker</td> <td>A docker container to use.</td> </tr> +<tr> +<td><code>mesos</code></td> +<td style="text-align: center">Mesos</td> +<td>A mesos container to use.</td> +</tr> </tbody></table> <h3 id="docker-object">Docker Object</h3> @@ -940,6 +957,72 @@ See <a href="https://docs.docker.com/ref </tr> </tbody></table> +<h3 id="mesos-object">Mesos Object</h3> + +<table><thead> +<tr> +<th>param</th> +<th style="text-align: center">type</th> +<th>description</th> +</tr> +</thead><tbody> +<tr> +<td><code>image</code></td> +<td style="text-align: center">Choice(AppcImage, DockerImage)</td> +<td>An optional filesystem image to use within this container.</td> +</tr> +</tbody></table> + +<h3 id="appcimage">AppcImage</h3> + +<p><em>Note: In order to correctly execute processes inside a job, the filesystem image must include python 2.7.</em></p> + +<p>Describes an AppC filesystem image.</p> + +<table><thead> +<tr> +<th>param</th> +<th style="text-align: center">type</th> +<th>description</th> +</tr> +</thead><tbody> +<tr> +<td><code>name</code></td> +<td style="text-align: center">String</td> +<td>The name of the appc image.</td> +</tr> +<tr> +<td><code>image_id</code></td> +<td style="text-align: center">String</td> +<td>The <a href="https://github.com/appc/spec/blob/master/spec/aci.md#image-id";>image id</a> of the appc image.</td> +</tr> +</tbody></table> + +<h3 id="dockerimage">DockerImage</h3> + +<p><em>Note: In order to correctly execute processes inside a job, the filesystem image must include python 2.7.</em></p> + +<p>Describes a Docker filesystem image.</p> + +<table><thead> +<tr> +<th>param</th> +<th style="text-align: center">type</th> +<th>description</th> +</tr> +</thead><tbody> +<tr> +<td><code>name</code></td> +<td style="text-align: center">String</td> +<td>The name of the docker image.</td> +</tr> +<tr> +<td><code>tag</code></td> +<td style="text-align: center">String</td> +<td>The tag that identifies the docker image.</td> +</tr> +</tbody></table> + <h3 id="lifecycleconfig-objects">LifecycleConfig Objects</h3> <p><em>Note: The only lifecycle configuration supported is the HTTP lifecycle via the HttpLifecycleConfig.</em></p> @@ -1037,7 +1120,7 @@ Aurora client or Aurora-provided service <h3 id="mesos-namespace">mesos Namespace</h3> -<p>The <code>mesos</code> namespace contains variables which relate to the <code>mesos</code> slave +<p>The <code>mesos</code> namespace contains variables which relate to the <code>mesos</code> agent which launched the task. The <code>instance</code> variable can be used to distinguish between Task replicas.</p> Modified: aurora/site/publish/documentation/latest/reference/scheduler-configuration/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/scheduler-configuration/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/scheduler-configuration/index.html (original) +++ aurora/site/publish/documentation/latest/reference/scheduler-configuration/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/scheduler-configuration/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > @@ -96,6 +100,10 @@ Required flags: Directory to store backups under. Will be created if it does not exist. -cluster_name [not null] Name to identify the cluster being served. +-db_max_active_connection_count [must be > 0] + Max number of connections to use with database via MyBatis +-db_max_idle_connection_count [must be > 0] + Max number of idle connections to the database via MyBatis -framework_authentication_file Properties file which contains framework credentials to authenticate with Mesosmaster. Must contain the properties 'aurora_authentication_principal' and 'aurora_authentication_secret'. -mesos_master_address [not null] @@ -110,8 +118,6 @@ Required flags: Path to the thermos executor entry point. -tier_config [file must be readable] Configuration file defining supported task tiers, task traits and behaviors. --zk_digest_credentials - user:password to use when authenticating with ZooKeeper. -zk_endpoints [must have at least 1 item] Endpoint specification for the ZooKeeper servers. @@ -163,9 +169,11 @@ Optional flags: -flapping_task_threshold (default (5, mins)) A task that repeatedly runs for less than this time is considered to be flapping. -framework_announce_principal (default false) - When 'framework_authentication_file' flag is set, the FrameworkInfo registered with the mesos master will also contain the principal. This is necessary if you intend to use mesos authorization via mesos ACLs. The default will change in a future release. + When 'framework_authentication_file' flag is set, the FrameworkInfo registered with the mesos master will also contain the principal. This is necessary if you intend to use mesos authorization via mesos ACLs. The default will change in a future release. Changing this value is backwards incompatible. For details, see MESOS-703. -framework_failover_timeout (default (21, days)) Time after which a framework is considered deleted. SHOULD BE VERY HIGH. +-framework_name (default TwitterScheduler) + Name used to register the Aurora framework with Mesos. Changing this value can be backwards incompatible. For details, see MESOS-703. -global_container_mounts (default []) A comma separated list of mount points (in host:container form) to mount into all (non-mesos) containers. -history_max_per_job_threshold (default 100) @@ -234,6 +242,8 @@ Optional flags: The timeout for doing log appends and truncations. -native_log_zk_group_path A zookeeper node for use by the native log to track the master coordinator. +-offer_filter_duration (default (5, secs)) + Duration after which we expect Mesos to re-offer unused resources. A short duration improves scheduling performance in smaller clusters, but might lead to resource starvation for other frameworks if you run many frameworks in your cluster. -offer_hold_jitter_window (default (1, mins)) Maximum amount of random jitter to add to the offer hold time window. -offer_reservation_duration (default (3, mins)) @@ -260,7 +270,7 @@ Optional flags: If false, Docker tasks may run without an executor (EXPERIMENTAL) -shiro_ini_path Path to shiro.ini for authentication and authorization configuration. --shiro_realm_modules (default [org.apache.aurora.scheduler.app.MoreModules$1@2d3379b4]) +-shiro_realm_modules (default [org.apache.aurora.scheduler.app.MoreModules$1@13c9d689]) Guice modules for configuring Shiro Realms. -sla_non_prod_metrics (default []) Metric categories collected for non production tasks. @@ -286,20 +296,24 @@ Optional flags: A comma separated list of additional resources to copy into the sandbox.Note: if thermos_executor_path is not the thermos_executor.pex file itself, this must include it. -thermos_home_in_sandbox (default false) If true, changes HOME to the sandbox before running the executor. This primarily has the effect of causing the executor and runner to extract themselves into the sandbox. --thermos_observer_root (default /var/run/thermos) - Path to the thermos observer root (by default /var/run/thermos.) -transient_task_state_timeout (default (5, mins)) The amount of time after which to treat a task stuck in a transient state as LOST. -use_beta_db_task_store (default false) Whether to use the experimental database-backed task store. -viz_job_url_prefix (default ) URL prefix for job container stats. +-webhook_config [file must be readable] + File to configure a HTTP webhook to receive task state change events. -zk_chroot_path chroot path to use for the ZooKeeper connections +-zk_digest_credentials + user:password to use when authenticating with ZooKeeper. -zk_in_proc (default false) Launches an embedded zookeeper server for local testing causing -zk_endpoints to be ignored if specified. -zk_session_timeout (default (4, secs)) The ZooKeeper session timeout. +-zk_use_curator (default false) + Uses Apache Curator as the zookeeper client; otherwise a copy of Twitter commons/zookeeper (the legacy library) is used. ------------------------------------------------------------------------- </code></pre> Modified: aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html (original) +++ aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/scheduler-endpoints/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > Modified: aurora/site/publish/documentation/latest/reference/task-lifecycle/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/task-lifecycle/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/documentation/latest/reference/task-lifecycle/index.html (original) +++ aurora/site/publish/documentation/latest/reference/task-lifecycle/index.html Tue Jun 14 21:35:25 2016 @@ -41,10 +41,14 @@ <h5 class="page-header text-uppercase">Documentation <select onChange="window.location.href='/documentation/' + this.value + '/reference/task-lifecycle/'" value="latest"> + <option value="0.14.0" + > + 0.14.0 + (latest) + </option> <option value="0.13.0" > 0.13.0 - (latest) </option> <option value="0.12.0" > @@ -108,14 +112,14 @@ particular role” or attribute limi finds a suitable match, it assigns the <code>Task</code> to a machine and puts the <code>Task</code> into the <code>ASSIGNED</code> state.</p> -<p>From the <code>ASSIGNED</code> state, the scheduler sends an RPC to the slave -machine containing <code>Task</code> configuration, which the slave uses to spawn +<p>From the <code>ASSIGNED</code> state, the scheduler sends an RPC to the agent +machine containing <code>Task</code> configuration, which the agent uses to spawn an executor responsible for the <code>Task</code>’s lifecycle. When the scheduler receives an acknowledgment that the machine has accepted the <code>Task</code>, the <code>Task</code> goes into <code>STARTING</code> state.</p> <p><code>STARTING</code> state initializes a <code>Task</code> sandbox. When the sandbox is fully -initialized, Thermos begins to invoke <code>Process</code>es. Also, the slave +initialized, Thermos begins to invoke <code>Process</code>es. Also, the agent machine sends an update to the scheduler that the <code>Task</code> is in <code>RUNNING</code> state.</p> @@ -147,7 +151,7 @@ failure.</p> <h3 id="forceful-termination-killing-restarting">Forceful Termination: KILLING, RESTARTING</h3> <p>You can terminate a <code>Task</code> by issuing an <code>aurora job kill</code> command, which -moves it into <code>KILLING</code> state. The scheduler then sends the slave a +moves it into <code>KILLING</code> state. The scheduler then sends the agent a request to terminate the <code>Task</code>. If the scheduler receives a successful response, it moves the Task into <code>KILLED</code> state and never restarts it.</p> @@ -155,7 +159,7 @@ response, it moves the Task into <code>K command, the scheduler kills the underlying task but in parallel schedules an identical replacement for it.</p> -<p>In any case, the responsible executor on the slave follows an escalation +<p>In any case, the responsible executor on the agent follows an escalation sequence when killing a running task:</p> <ol> @@ -177,9 +181,9 @@ inevitable realities of distributed syst or <code>STARTING</code>), the scheduler forces it into <code>LOST</code> state, creating a new <code>Task</code> in its place that’s sent into <code>PENDING</code> state.</p> -<p>In addition, if the Mesos core tells the scheduler that a slave has +<p>In addition, if the Mesos core tells the scheduler that a agent has become unhealthy (or outright disappeared), the <code>Task</code>s assigned to that -slave go into <code>LOST</code> state and new <code>Task</code>s are created in their place. +agent go into <code>LOST</code> state and new <code>Task</code>s are created in their place. From <code>PENDING</code> state, there is no guarantee a <code>Task</code> will be reassigned to the same machine unless job constraints explicitly force it there.</p> @@ -205,9 +209,9 @@ preempted in favor of production tasks.< <h3 id="making-room-for-maintenance-draining">Making Room for Maintenance: DRAINING</h3> -<p>Cluster operators can set slave into maintenance mode. This will transition -all <code>Task</code> running on this slave into <code>DRAINING</code> and eventually to <code>KILLED</code>. -Drained <code>Task</code>s will be restarted on other slaves for which no maintenance +<p>Cluster operators can set agent into maintenance mode. This will transition +all <code>Task</code> running on this agent into <code>DRAINING</code> and eventually to <code>KILLED</code>. +Drained <code>Task</code>s will be restarted on other agents for which no maintenance has been announced yet.</p> <h2 id="state-reconciliation">State Reconciliation</h2> Modified: aurora/site/publish/downloads/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/downloads/index.html?rev=1748470&r1=1748469&r2=1748470&view=diff ============================================================================== --- aurora/site/publish/downloads/index.html (original) +++ aurora/site/publish/downloads/index.html Tue Jun 14 21:35:25 2016 @@ -60,6 +60,12 @@ <h2 id="source-distributions">Source distributions</h2> +<h4 id="0-14-0"><a href="http://www.apache.org/dyn/closer.cgi?path=/aurora/0.14.0/apache-aurora-0.14.0.tar.gz";>0.14.0</a></h4> + +<p><a href="https://www.apache.org/dist/aurora/0.14.0/";>signatures</a> +| <a href="https://git-wip-us.apache.org/repos/asf?p=aurora.git;a=log;h=refs/tags/rel/0.14.0";>commit log</a> +| <a href="/blog/aurora-0.14.0-released/">release notes</a></p> + <h4 id="0-13-0"><a href="http://www.apache.org/dyn/closer.cgi?path=/aurora/0.13.0/apache-aurora-0.13.0.tar.gz";>0.13.0</a></h4> <p><a href="https://www.apache.org/dist/aurora/0.13.0/";>signatures</a>
