Author: jfarrell
Date: Thu Apr 30 20:41:01 2015
New Revision: 1677065
URL: http://svn.apache.org/r1677065
Log:
Updating Aurora website
Modified:
aurora/site/publish/blog/2015-upcoming-apache-aurora-meetups/index.html
aurora/site/publish/blog/aurora-0-6-0-incubating-released/index.html
aurora/site/publish/blog/aurora-0-7-0-incubating-released/index.html
aurora/site/publish/blog/feed.xml
aurora/site/publish/blog/index.html
aurora/site/publish/community/index.html
aurora/site/publish/developers/index.html
aurora/site/publish/docs/gettingstarted/index.html
aurora/site/publish/docs/howtocontribute/index.html
aurora/site/publish/documentation/latest/client-cluster-configuration/index.html
aurora/site/publish/documentation/latest/client-commands/index.html
aurora/site/publish/documentation/latest/committers/index.html
aurora/site/publish/documentation/latest/configuration-reference/index.html
aurora/site/publish/documentation/latest/configuration-tutorial/index.html
aurora/site/publish/documentation/latest/contributing/index.html
aurora/site/publish/documentation/latest/cron-jobs/index.html
aurora/site/publish/documentation/latest/deploying-aurora-scheduler/index.html
aurora/site/publish/documentation/latest/developing-aurora-client/index.html
aurora/site/publish/documentation/latest/developing-aurora-scheduler/index.html
aurora/site/publish/documentation/latest/hooks/index.html
aurora/site/publish/documentation/latest/index.html
aurora/site/publish/documentation/latest/monitoring/index.html
aurora/site/publish/documentation/latest/resource-isolation/index.html
aurora/site/publish/documentation/latest/scheduler-storage/index.html
aurora/site/publish/documentation/latest/sla/index.html
aurora/site/publish/documentation/latest/storage-config/index.html
aurora/site/publish/documentation/latest/storage/index.html
aurora/site/publish/documentation/latest/test-resource-generation/index.html
aurora/site/publish/documentation/latest/thrift-deprecation/index.html
aurora/site/publish/documentation/latest/tutorial/index.html
aurora/site/publish/documentation/latest/user-guide/index.html
aurora/site/publish/documentation/latest/vagrant/index.html
aurora/site/publish/downloads/index.html
aurora/site/publish/index.html
aurora/site/publish/sitemap.xml
aurora/site/source/documentation/latest/configuration-reference.md
aurora/site/source/documentation/latest/deploying-aurora-scheduler.md
aurora/site/source/documentation/latest/monitoring.md
Modified:
aurora/site/publish/blog/2015-upcoming-apache-aurora-meetups/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/blog/2015-upcoming-apache-aurora-meetups/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/blog/2015-upcoming-apache-aurora-meetups/index.html
(original)
+++ aurora/site/publish/blog/2015-upcoming-apache-aurora-meetups/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -42,6 +43,7 @@
<div class="col-md-3 buffer">
<div class="meta">
<span class="author">
+
<span class="author_contact">
<p><strong>Dave Lester</strong></p>
<p><a
href="http://twitter.com/davelester";>@davelester</a></p>
@@ -99,6 +101,7 @@
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/blog/aurora-0-6-0-incubating-released/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/blog/aurora-0-6-0-incubating-released/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/blog/aurora-0-6-0-incubating-released/index.html
(original)
+++ aurora/site/publish/blog/aurora-0-6-0-incubating-released/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -42,6 +43,7 @@
<div class="col-md-3 buffer">
<div class="meta">
<span class="author">
+
<span class="author_contact">
<p><strong>Bill Farner</strong></p>
<p><a
href="http://twitter.com/wfarner";>@wfarner</a></p>
@@ -125,6 +127,7 @@ responsibility of application update orc
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/blog/aurora-0-7-0-incubating-released/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/blog/aurora-0-7-0-incubating-released/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/blog/aurora-0-7-0-incubating-released/index.html
(original)
+++ aurora/site/publish/blog/aurora-0-7-0-incubating-released/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -42,6 +43,7 @@
<div class="col-md-3 buffer">
<div class="meta">
<span class="author">
+
<span class="author_contact">
<p><strong>Maxim Khutornenko</strong></p>
<p><a
href="http://twitter.com/hutorrr";>@hutorrr</a></p>
@@ -111,6 +113,7 @@
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/blog/feed.xml
URL:
http://svn.apache.org/viewvc/aurora/site/publish/blog/feed.xml?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/blog/feed.xml (original)
+++ aurora/site/publish/blog/feed.xml Thu Apr 30 20:41:01 2015
@@ -5,6 +5,7 @@
<link href="http://aurora.apache.org/blog"; />
<link href="http://aurora.apache.org/blog/feed.xml"; rel="self"/>
<updated>2015-03-18T00:00:00Z</updated>
+
<entry>
<id>http://aurora.apache.org/blog/2015-upcoming-apache-aurora-meetups/</id>
<link href="/blog/2015-upcoming-apache-aurora-meetups/" />
@@ -47,6 +48,7 @@
</content>
</entry>
+
<entry>
<id>http://aurora.apache.org/blog/aurora-0-7-0-incubating-released/</id>
<link href="/blog/aurora-0-7-0-incubating-released/" />
@@ -101,6 +103,7 @@
</content>
</entry>
+
<entry>
<id>http://aurora.apache.org/blog/aurora-0-6-0-incubating-released/</id>
<link href="/blog/aurora-0-6-0-incubating-released/" />
@@ -169,4 +172,5 @@ responsibility of application update orc
</content>
</entry>
+
</feed>
\ No newline at end of file
Modified: aurora/site/publish/blog/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/blog/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/blog/index.html (original)
+++ aurora/site/publish/blog/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -42,22 +43,27 @@
<p>The Aurora blog is a place for release announcements and for
project committers to highlight features of the software.</p>
</div>
<div class="col-md-9">
+
<article>
<h2><a
href="/blog/2015-upcoming-apache-aurora-meetups/">Upcoming Apache Aurora
Meetups in NYC and the Bay Area</a></h2>
<p><em>Posted by Dave Lester, March 18, 2015</em></p>
</article>
+
<article>
<h2><a
href="/blog/aurora-0-7-0-incubating-released/">Aurora 0.7.0-incubating
Released, Adding Support for Docker Containers</a></h2>
<p><em>Posted by Maxim Khutornenko, February 12,
2015</em></p>
</article>
+
<article>
<h2><a
href="/blog/aurora-0-6-0-incubating-released/">Aurora 0.6.0-incubating
Released</a></h2>
<p><em>Posted by Bill Farner, December 8, 2014</em></p>
</article>
+
</div>
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/community/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/community/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/community/index.html (original)
+++ aurora/site/publish/community/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -73,6 +74,7 @@
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/developers/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/developers/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/developers/index.html (original)
+++ aurora/site/publish/developers/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -53,6 +54,7 @@
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/docs/gettingstarted/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/docs/gettingstarted/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/docs/gettingstarted/index.html (original)
+++ aurora/site/publish/docs/gettingstarted/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -44,6 +45,7 @@ while the project moves its documentatio
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/docs/howtocontribute/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/docs/howtocontribute/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/docs/howtocontribute/index.html (original)
+++ aurora/site/publish/docs/howtocontribute/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -84,6 +85,7 @@ git push origin master
</pre>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/client-cluster-configuration/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/client-cluster-configuration/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
---
aurora/site/publish/documentation/latest/client-cluster-configuration/index.html
(original)
+++
aurora/site/publish/documentation/latest/client-cluster-configuration/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -151,11 +152,11 @@ URL of your VIP in a loadbalancer or a r
scheduler. Support for values other than <code>UNAUTHENTICATED</code> is
currently not available, however work
is <a href="https://issues.apache.org/jira/browse/AURORA-720";>in progress</a>
to add federated authentication
to Aurora which will allow for more robust configuration of client/scheduler
authentication.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/client-commands/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/client-commands/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/client-commands/index.html
(original)
+++ aurora/site/publish/documentation/latest/client-commands/index.html Thu Apr
30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -424,18 +425,18 @@ assigned to this machine</li>
<p>For example, the following type of pattern can be a powerful diagnostic
tool:</p>
<pre class="highlight text">aurora task run -t5 cluster1/tyg/devel/seizure -- \
- 'curl -s -m1 localhost:{{thermos.ports[http]}}/vars | grep uptime'
+ 'curl -s -m1 localhost:{{thermos.ports[http]}}/vars | grep uptime'
</pre>
<p>By default, the command runs in the Task’s sandbox. The
<code>-e</code> option can
run the command in the executor’s sandbox. This is mostly useful for
Aurora administrators.</p>
<p>You can parallelize the runs by using the <code>-t</code> option.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/committers/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/committers/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/committers/index.html (original)
+++ aurora/site/publish/documentation/latest/committers/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -109,11 +110,11 @@ automatically clean up the release candi
<li><p>Update the draft email created fom the <code>release</code> script in
step #5 to include the Apache ID’s for
all binding votes and send the [RESULT][VOTE] email to the dev@ and private@
mailing lists.</p></li>
</ol>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/configuration-reference/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/configuration-reference/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/configuration-reference/index.html
(original)
+++ aurora/site/publish/documentation/latest/configuration-reference/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -366,7 +367,7 @@ upon one final Process (“reducer&r
<pre class="highlight text">def make_mapper(id):
return Process(
name = "mapper%03d" % id,
- cmdline = "echo 'scale=50;s(%d\*4\*a(1)/180)' | bc -l >
+ cmdline = "echo 'scale=50;s(%d\*4\*a(1)/180)' | bc -l >
temp.sine_table.%03d" % (id, id))
def make_reducer():
@@ -378,7 +379,7 @@ processes = map(make_mapper, range(180))
task = Task(
name = "mapreduce",
processes = processes + [make\_reducer()],
- constraints = [Constraint(order = [mapper.name(), 'reducer']) for mapper
+ constraints = [Constraint(order = [mapper.name(), 'reducer']) for
mapper
in processes],
max_concurrency = 8)
</pre>
@@ -637,29 +638,14 @@ either due to human error or machine fai
<td>Interval on which to check the task’s health via HTTP. (Default:
10)</td>
</tr>
<tr>
-<td><code>max_consecutive_failures</code></td>
-<td style="text-align: center">Integer</td>
-<td>Maximum number of consecutive failures that tolerated before considering a
task unhealthy (Default: 0)</td>
-</tr>
-<tr>
<td><code>timeout_secs</code></td>
<td style="text-align: center">Integer</td>
<td>HTTP request timeout. (Default: 1)</td>
</tr>
<tr>
-<td><code>endpoint</code></td>
-<td style="text-align: center">String</td>
-<td>HTTP endpoint to check (Default: /health)</td>
-</tr>
-<tr>
-<td><code>expected_response</code></td>
-<td style="text-align: center">String</td>
-<td>If not empty, fail the health check if the response differs. Case
insensitive. (Default: ok)</td>
-</tr>
-<tr>
-<td><code>expected_response_code</code></td>
+<td><code>max_consecutive_failures</code></td>
<td style="text-align: center">Integer</td>
-<td>If not zero, fail the health check if the response code differs. (Default:
0)</td>
+<td>Maximum number of consecutive failures that tolerated before considering a
task unhealthy (Default: 0)</td>
</tr>
</tbody></table>
@@ -792,13 +778,13 @@ constraints</em>.</p>
constraint ensures that no more than two instances of your job may run
on a single host. Think of this as a “group by” limit.</p>
<pre class="highlight text">constraints = {
- 'host': 'limit:2',
+ 'host': 'limit:2',
}
</pre>
<p>Likewise, you can use constraints to control rack diversity, e.g. at
most one task per rack:</p>
<pre class="highlight text">constraints = {
- 'rack': 'limit:1',
+ 'rack': 'limit:1',
}
</pre>
<p>Use these constraints sparingly as they can dramatically reduce Tasks'
schedulability.</p>
@@ -872,15 +858,15 @@ to map <code>http</code> to port 12345 w
<p>Put the following in a file named <code>hello_world.aurora</code>,
substituting your own values
for values such as <code>cluster</code>s.</p>
<pre class="highlight text">import os
-hello_world_process = Process(name = 'hello_world', cmdline = 'echo hello
world')
+hello_world_process = Process(name = 'hello_world', cmdline =
'echo hello world')
hello_world_task = Task(
resources = Resources(cpu = 0.1, ram = 16 * MB, disk = 16 * MB),
processes = [hello_world_process])
hello_world_job = Job(
- cluster = 'cluster1',
- role = os.getenv('USER'),
+ cluster = 'cluster1',
+ role = os.getenv('USER'),
task = hello_world_task)
jobs = [hello_world_job]
@@ -896,7 +882,7 @@ aurora job kill cluster1/$USER/test/hell
<p>Put the following in a file named
<code>hello_world_productionized.aurora</code>, substituting your own values
for values such as <code>cluster</code>s.</p>
-<pre class="highlight text">include('hello_world.aurora')
+<pre class="highlight text">include('hello_world.aurora')
production_resources = Resources(cpu = 1.0, ram = 512 * MB, disk = 2 * GB)
staging_resources = Resources(cpu = 0.1, ram = 32 * MB, disk = 512 * MB)
@@ -906,12 +892,12 @@ hello_world_template = hello_world(
jobs = [
# production jobs
- hello_world_template(cluster = 'cluster1', instances = 25),
- hello_world_template(cluster = 'cluster2', instances = 15),
+ hello_world_template(cluster = 'cluster1', instances = 25),
+ hello_world_template(cluster = 'cluster2', instances = 15),
# staging jobs
hello_world_template(
- cluster = 'local',
+ cluster = 'local',
instances = 1,
task = hello_world(resources=staging_resources)),
]
@@ -920,11 +906,11 @@ jobs = [
<pre class="highlight text">aurora job create
cluster1/$USER/test/hello_world-cluster1 hello_world_productionized.aurora
aurora job kill cluster1/$USER/test/hello_world-cluster1
-</pre>
-</div>
+</pre></div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/configuration-tutorial/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/configuration-tutorial/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/configuration-tutorial/index.html
(original)
+++ aurora/site/publish/documentation/latest/configuration-tutorial/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -184,30 +185,30 @@ curly braces {{}} are template variables
bound values for the variables.</p>
<pre class="highlight text"># --- templates here ---
class Profile(Struct):
- package_version = Default(String, 'live')
- java_binary = Default(String, '/usr/lib/jvm/java-1.7.0-openjdk/bin/java')
- extra_jvm_options = Default(String, '')
- parent_environment = Default(String, 'prod')
+ package_version = Default(String, 'live')
+ java_binary = Default(String,
'/usr/lib/jvm/java-1.7.0-openjdk/bin/java')
+ extra_jvm_options = Default(String, '')
+ parent_environment = Default(String, 'prod')
parent_serverset = Default(String,
-
'/foocorp/service/bird/{{parent_environment}}/bird')
+
'/foocorp/service/bird/{{parent_environment}}/bird')
# --- processes here ---
main = Process(
- name = 'application',
- cmdline = '{{profile.java_binary}} -server -Xmx1792m '
- '{{profile.extra_jvm_options}} '
- '-jar application.jar '
- '-upstreamService {{profile.parent_serverset}}'
+ name = 'application',
+ cmdline = '{{profile.java_binary}} -server -Xmx1792m '
+ '{{profile.extra_jvm_options}} '
+ '-jar application.jar '
+ '-upstreamService {{profile.parent_serverset}}'
)
# --- tasks ---
base_task = SequentialTask(
- name = 'application',
+ name = 'application',
processes = [
Process(
- name = 'fetch',
- cmdline = 'curl -O
-
https://packages.foocorp.com/{{profile.package_version}}/application.jar'),
+ name = 'fetch',
+ cmdline = 'curl -O
+
https://packages.foocorp.com/{{profile.package_version}}/application.jar'),
]
)
@@ -224,9 +225,9 @@ production_task = base_task(resources =
# --- job template ---
job_template = Job(
- name = 'application',
- role = 'myteam',
- contact = '[email protected]',
+ name = 'application',
+ role = 'myteam',
+ contact = '[email protected]',
instances = 20,
service = True,
task = production_task
@@ -235,20 +236,20 @@ job_template = Job(
# -- profile instantiations (if any) ---
PRODUCTION = Profile()
STAGING = Profile(
- extra_jvm_options = '-Xloggc:gc.log',
- parent_environment = 'staging'
+ extra_jvm_options = '-Xloggc:gc.log',
+ parent_environment = 'staging'
)
# -- job instantiations --
jobs = [
- job_template(cluster = 'cluster1', environment = 'prod')
+ job_template(cluster = 'cluster1', environment = 'prod')
.bind(profile = PRODUCTION),
- job_template(cluster = 'cluster2', environment = 'prod')
+ job_template(cluster = 'cluster2', environment = 'prod')
.bind(profile = PRODUCTION),
- job_template(cluster = 'cluster1',
- environment = 'staging',
+ job_template(cluster = 'cluster1',
+ environment = 'staging',
service = False,
task = staging_task,
instances = 2)
@@ -275,20 +276,20 @@ so <code>$*</code> is unspecified.</li>
<p>Many tiny processes make managing configurations more difficult. For
example, the following is a bad way to define processes.</p>
<pre class="highlight text">copy = Process(
- name = 'copy',
- cmdline = 'curl -O https://packages.foocorp.com/app.zip'
+ name = 'copy',
+ cmdline = 'curl -O https://packages.foocorp.com/app.zip'
)
unpack = Process(
- name = 'unpack',
- cmdline = 'unzip app.zip'
+ name = 'unpack',
+ cmdline = 'unzip app.zip'
)
remove = Process(
- name = 'remove',
- cmdline = 'rm -f app.zip'
+ name = 'remove',
+ cmdline = 'rm -f app.zip'
)
run = Process(
- name = 'app',
- cmdline = 'java -jar app.jar'
+ name = 'app',
+ cmdline = 'java -jar app.jar'
)
run_task = Task(
processes = [copy, unpack, remove, run],
@@ -303,11 +304,11 @@ particular order, use <code>SequentialTa
<code>Task</code> <em>Objects</em></a> section. The following simplifies and
combines the
above multiple <code>Process</code> definitions into just two.</p>
<pre class="highlight text">stage = Process(
- name = 'stage',
- cmdline = 'curl -O https://packages.foocorp.com/app.zip && '
- 'unzip app.zip && rm -f app.zip')
+ name = 'stage',
+ cmdline = 'curl -O https://packages.foocorp.com/app.zip && '
+ 'unzip app.zip && rm -f app.zip')
-run = Process(name = 'app', cmdline = 'java -jar app.jar')
+run = Process(name = 'app', cmdline = 'java -jar app.jar')
run_task = SequentialTask(processes = [stage, run])
</pre>
@@ -379,8 +380,8 @@ on an accessible HDFS cluster or similar
<p>The template for this Process is:</p>
<pre class="highlight text"><name> = Process(
- name = '<name>'
- cmdline = '<command to copy and extract code archive into current working
directory>'
+ name = '<name>'
+ cmdline = '<command to copy and extract code archive into current
working directory>'
)
</pre>
<p>Note: Be sure the extracted code archive has an executable.</p>
@@ -424,7 +425,7 @@ the processes run in parallel or sequent
Task’s processes. Currently there is only one type, the
<code>order</code>
constraint. For example the following requires that the processes
run in the order <code>foo</code>, then <code>bar</code>.</p>
-<pre class="highlight text">constraints = [Constraint(order=['foo', 'bar'])]
+<pre class="highlight text">constraints = [Constraint(order=['foo',
'bar'])]
</pre>
<p>There is an <code>order()</code> function that takes
<code>order('foo', 'bar', 'baz')</code>
and converts it into <code>[Constraint(order=['foo', 'bar',
'baz'])]</code>.
@@ -506,7 +507,7 @@ file:</p>
<pre class="highlight text">import os
hello_world_job = Job(
task=SimpleTask(name="hello_world", command="echo hello
world"),
- role=os.getenv('USER'),
+ role=os.getenv('USER'),
cluster="cluster1")
</pre>
<p>When written to <code>hello_world.aurora</code>, you invoke it with a simple
@@ -612,8 +613,8 @@ only run the Job whose job key includes
<p>You usually see a <code>name</code> parameter. By default,
<code>name</code> inherits its
value from the Job’s associated Task object, but you can override this
default. For these four parameters, a Job definition might look like:</p>
-<pre class="highlight text">foo_job = Job( name = 'foo', cluster = 'cluster1',
- role = os.getenv('USER'), environment = 'prod',
+<pre class="highlight text">foo_job = Job( name = 'foo', cluster =
'cluster1',
+ role = os.getenv('USER'), environment = 'prod',
task = foo_task)
</pre>
<p>In addition to the required attributes, there are several optional
@@ -765,16 +766,16 @@ differently:</p>
<pre class="highlight text">>>> Float(1.5)
Float(1.5)
->>> Float('{{x}}.5')
+>>> Float('{{x}}.5')
Float({{x}}.5)
->>> Float('{{x}}.5').bind(x = 1)
+>>> Float('{{x}}.5').bind(x = 1)
Float(1.5)
->>> Float('{{x}}.5').bind(x = 1) == Float(1.5)
+>>> Float('{{x}}.5').bind(x = 1) == Float(1.5)
True
->>> contextual_object = String('{{metavar{{number}}}}').bind(
+>>> contextual_object = String('{{metavar{{number}}}}').bind(
... metavar1 = "first", metavar2 = "second")
>>> contextual_object
@@ -816,20 +817,20 @@ Process(daemon=False, max_failures=1, ep
</pre>
<p>Attribute values can be template variables, which then receive specific
values when creating the object.</p>
-<pre class="highlight text">>>> Process(cmdline = 'echo {{message}}')
+<pre class="highlight text">>>> Process(cmdline = 'echo
{{message}}')
Process(daemon=False, max_failures=1, ephemeral=False, min_duration=5,
cmdline=echo {{message}}, final=False)
->>> Process(cmdline = 'echo {{message}}').bind(message = 'hello
world')
+>>> Process(cmdline = 'echo {{message}}').bind(message =
'hello world')
Process(daemon=False, max_failures=1, ephemeral=False, min_duration=5,
cmdline=echo hello world, final=False)
</pre>
<p>A powerful binding property is that all of an object’s children
inherit its
bindings:</p>
<pre class="highlight text">>>> List(Process)([
-... Process(name = '{{prefix}}_one'),
-... Process(name = '{{prefix}}_two')
-... ]).bind(prefix = 'hello')
+... Process(name = '{{prefix}}_one'),
+... Process(name = '{{prefix}}_two')
+... ]).bind(prefix = 'hello')
ProcessList(
Process(daemon=False, name=hello_one, max_failures=1, ephemeral=False,
min_duration=5, final=False),
Process(daemon=False, name=hello_two, max_failures=1, ephemeral=False,
min_duration=5, final=False)
@@ -865,7 +866,7 @@ Process(daemon=False, max_failures=1, ep
</pre>
<p>The following is also not possible and results in an infinite loop that
attempts to resolve <code>Process.name</code>.</p>
-<pre class="highlight text">>>> Process(name = '{{name}}').bind(name
= 'installer')
+<pre class="highlight text">>>> Process(name =
'{{name}}').bind(name = 'installer')
</pre>
<p>Do not confuse Structural attributes with bound Mustache variables.
Attributes are implicitly converted to Mustache variables but not vice
@@ -896,8 +897,8 @@ Process(daemon=False, name=process_two,
</pre>
<p>Template creation is a common use for this technique:</p>
<pre class="highlight text">>>> Daemon = Process(daemon = True)
->>> logrotate = Daemon(name = 'logrotate', cmdline = './logrotate
conf/logrotate.conf')
->>> mysql = Daemon(name = 'mysql', cmdline = 'bin/mysqld --safe-mode')
+>>> logrotate = Daemon(name = 'logrotate', cmdline =
'./logrotate conf/logrotate.conf')
+>>> mysql = Daemon(name = 'mysql', cmdline = 'bin/mysqld
--safe-mode')
</pre>
<h3 id="advanced-binding">Advanced Binding</h3>
@@ -912,13 +913,13 @@ can also be bound via <code>.bind()</cod
interchangeably (when “<code>kwargs</code>” is in a function
definition, <code>kwargs</code>
receives a Python dictionary containing all keyword arguments after the
formal parameter list).</p>
-<pre class="highlight text">>>> String('{{foo}}').bind(foo = 'bar')
== String('{{foo}}').bind({'foo': 'bar'})
+<pre class="highlight text">>>> String('{{foo}}').bind(foo =
'bar') == String('{{foo}}').bind({'foo': 'bar'})
True
</pre>
<p>Bindings done “closer” to the object in question take
precedence:</p>
-<pre class="highlight text">>>> p = Process(name =
'{{context}}_process')
->>> t = Task().bind(context = 'global')
->>> t(processes = [p, p.bind(context = 'local')])
+<pre class="highlight text">>>> p = Process(name =
'{{context}}_process')
+>>> t = Task().bind(context = 'global')
+>>> t(processes = [p, p.bind(context = 'local')])
Task(processes=ProcessList(
Process(daemon=False, name=global_process, max_failures=1, ephemeral=False,
final=False,
min_duration=5),
@@ -930,16 +931,16 @@ Task(processes=ProcessList(
<h5 id="lists">Lists</h5>
<pre class="highlight text">>>> fibonacci = List(Integer)([1, 1, 2,
3, 5, 8, 13])
->>> String('{{fib[4]}}').bind(fib = fibonacci)
+>>> String('{{fib[4]}}').bind(fib = fibonacci)
String(5)
</pre>
<h5 id="maps">Maps</h5>
-<pre class="highlight text">>>> first_names = Map(String,
String)({'Kent': 'Clark', 'Wayne': 'Bruce', 'Prince': 'Diana'})
->>> String('{{first[Kent]}}').bind(first = first_names)
+<pre class="highlight text">>>> first_names = Map(String,
String)({'Kent': 'Clark', 'Wayne': 'Bruce',
'Prince': 'Diana'})
+>>> String('{{first[Kent]}}').bind(first = first_names)
String(Clark)
</pre>
<h5 id="structurals">Structurals</h5>
-<pre class="highlight text">>>> String('{{p.cmdline}}').bind(p =
Process(cmdline = "echo hello world"))
+<pre class="highlight text">>>>
String('{{p.cmdline}}').bind(p = Process(cmdline = "echo hello
world"))
String(echo hello world)
</pre>
<h3 id="structural-binding">Structural Binding</h3>
@@ -957,25 +958,25 @@ or change the way the dataset is designa
<pre class="highlight text">class Profile(Struct):
version = Required(String)
environment = Required(String)
- dataset = Default(String, hdfs://home/aurora/data/{{environment}}')
+ dataset = Default(String, hdfs://home/aurora/data/{{environment}}')
-PRODUCTION = Profile(version = 'live', environment = 'prod')
-DEVEL = Profile(version = 'latest',
- environment = 'devel',
- dataset = 'hdfs://home/aurora/data/test')
-TEST = Profile(version = 'latest', environment = 'test')
+PRODUCTION = Profile(version = 'live', environment = 'prod')
+DEVEL = Profile(version = 'latest',
+ environment = 'devel',
+ dataset = 'hdfs://home/aurora/data/test')
+TEST = Profile(version = 'latest', environment = 'test')
JOB_TEMPLATE = Job(
- name = 'application',
- role = 'myteam',
- cluster = 'cluster1',
- environment = '{{profile.environment}}',
+ name = 'application',
+ role = 'myteam',
+ cluster = 'cluster1',
+ environment = '{{profile.environment}}',
task = SequentialTask(
- name = 'task',
+ name = 'task',
resources = Resources(cpu = 2, ram = 4*GB, disk = 8*GB),
processes = [
- Process(name = 'main', cmdline = 'java -jar application.jar -hdfsPath
- {{profile.dataset}}')
+ Process(name = 'main', cmdline = 'java -jar application.jar
-hdfsPath
+ {{profile.dataset}}')
]
)
)
@@ -1016,32 +1017,32 @@ example below:</p>
<p><code>redundant.aurora</code> contains:</p>
<pre class="highlight text">download = Process(
- name = 'download',
- cmdline = 'wget http://www.python.org/ftp/python/2.7.3/Python-2.7.3.tar.bz2',
+ name = 'download',
+ cmdline = 'wget
http://www.python.org/ftp/python/2.7.3/Python-2.7.3.tar.bz2',
max_failures = 5,
min_duration = 1)
unpack = Process(
- name = 'unpack',
- cmdline = 'rm -rf Python-2.7.3 && tar xzf Python-2.7.3.tar.bz2',
+ name = 'unpack',
+ cmdline = 'rm -rf Python-2.7.3 && tar xzf
Python-2.7.3.tar.bz2',
max_failures = 5,
min_duration = 1)
build = Process(
- name = 'build',
- cmdline = 'pushd Python-2.7.3 && ./configure && make
&& popd',
+ name = 'build',
+ cmdline = 'pushd Python-2.7.3 && ./configure && make
&& popd',
max_failures = 1)
email = Process(
- name = 'email',
- cmdline = 'echo Success | mail [email protected]',
+ name = 'email',
+ cmdline = 'echo Success | mail [email protected]',
max_failures = 5,
min_duration = 1)
build_python = Task(
- name = 'build_python',
+ name = 'build_python',
processes = [download, unpack, build, email],
- constraints = [Constraint(order = ['download', 'unpack', 'build', 'email'])])
+ constraints = [Constraint(order = ['download', 'unpack',
'build', 'email'])])
</pre>
<p>As you’ll notice, there’s a lot of repetition in the
<code>Process</code>
definitions. For example, almost every process sets a <code>max_failures</code>
@@ -1055,32 +1056,32 @@ section.</p>
<p><code>less_redundant.aurora</code> contains:</p>
<pre class="highlight text">class Python(Struct):
version = Required(String)
- base = Default(String, 'Python-{{version}}')
- package = Default(String, '{{base}}.tar.bz2')
+ base = Default(String, 'Python-{{version}}')
+ package = Default(String, '{{base}}.tar.bz2')
ReliableProcess = Process(
max_failures = 5,
min_duration = 1)
download = ReliableProcess(
- name = 'download',
- cmdline = 'wget
http://www.python.org/ftp/python/{{python.version}}/{{python.package}}')
+ name = 'download',
+ cmdline = 'wget
http://www.python.org/ftp/python/{{python.version}}/{{python.package}}')
unpack = ReliableProcess(
- name = 'unpack',
- cmdline = 'rm -rf {{python.base}} && tar xzf {{python.package}}')
+ name = 'unpack',
+ cmdline = 'rm -rf {{python.base}} && tar xzf
{{python.package}}')
build = ReliableProcess(
- name = 'build',
- cmdline = 'pushd {{python.base}} && ./configure && make
&& popd',
+ name = 'build',
+ cmdline = 'pushd {{python.base}} && ./configure && make
&& popd',
max_failures = 1)
email = ReliableProcess(
- name = 'email',
- cmdline = 'echo Success | mail {{role}}@foocorp.com')
+ name = 'email',
+ cmdline = 'echo Success | mail {{role}}@foocorp.com')
build_python = SequentialTask(
- name = 'build_python',
+ name = 'build_python',
processes = [download, unpack, build, email]).bind(python = Python(version =
"2.7.3"))
</pre>
<h3 id="thermos-uses-bash,-but-thermos-is-not-bash">Thermos Uses bash, But
Thermos Is Not bash</h3>
@@ -1089,23 +1090,23 @@ build_python = SequentialTask(
<p>Many tiny Processes makes for harder to manage configurations.</p>
<pre class="highlight text">copy = Process(
- name = 'copy',
- cmdline = 'rcp user@my_machine:my_application .'
+ name = 'copy',
+ cmdline = 'rcp user@my_machine:my_application .'
)
unpack = Process(
- name = 'unpack',
- cmdline = 'unzip app.zip'
+ name = 'unpack',
+ cmdline = 'unzip app.zip'
)
remove = Process(
- name = 'remove',
- cmdline = 'rm -f app.zip'
+ name = 'remove',
+ cmdline = 'rm -f app.zip'
)
run = Process(
- name = 'app',
- cmdline = 'java -jar app.jar'
+ name = 'app',
+ cmdline = 'java -jar app.jar'
)
run_task = Task(
@@ -1123,10 +1124,10 @@ thing to do.</p>
another, consider using the <code>SequentialTask</code> helper which applies a
linear ordering constraint for you.</p>
<pre class="highlight text">stage = Process(
- name = 'stage',
- cmdline = 'rcp user@my_machine:my_application . && unzip app.zip
&& rm -f app.zip')
+ name = 'stage',
+ cmdline = 'rcp user@my_machine:my_application . && unzip app.zip
&& rm -f app.zip')
-run = Process(name = 'app', cmdline = 'java -jar app.jar')
+run = Process(name = 'app', cmdline = 'java -jar app.jar')
run_task = SequentialTask(processes = [stage, run])
</pre>
@@ -1145,8 +1146,8 @@ probably Doing It Wrong™.</p>
resources = Resources(cpu = cpu, ram = ram, disk = disk)
)
- task_one = get_my_task('task_one', 'feynman', 1.0, 32*MB, 1*GB)
- task_two = get_my_task('task_two', 'feynman', 2.0, 64*MB, 1*GB)
+ task_one = get_my_task('task_one', 'feynman', 1.0, 32*MB,
1*GB)
+ task_two = get_my_task('task_two', 'feynman', 2.0, 64*MB,
1*GB)
</pre>
<h4 id="good">Good</h4>
@@ -1156,23 +1157,23 @@ disk. Less proliferation of task-constru
easier-to-read, quicker-to-understand, and a more composable
configuration.</p>
<pre class="highlight text">TASK_TEMPLATE = SequentialTask(
- user = 'wickman',
+ user = 'wickman',
processes = [STAGE_PROCESS, RUN_PROCESS],
)
task_one = TASK_TEMPLATE(
- name = 'task_one',
+ name = 'task_one',
resources = Resources(cpu = 1.0, ram = 32*MB, disk = 1*GB) )
task_two = TASK_TEMPLATE(
- name = 'task_two',
+ name = 'task_two',
resources = Resources(cpu = 2.0, ram = 64*MB, disk = 1*GB)
)
-</pre>
-</div>
+</pre></div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/contributing/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/contributing/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/contributing/index.html (original)
+++ aurora/site/publish/documentation/latest/contributing/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -111,11 +112,11 @@ git push origin master
<p>Your patch has landed, congratulations! The last thing you’ll want to
do before moving on to your
next fix is to clean up your Jira and Reviewboard. The former of which should
be marked as
“Resolved” while the latter should be marked as
“Submitted”.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/cron-jobs/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/cron-jobs/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/cron-jobs/index.html (original)
+++ aurora/site/publish/documentation/latest/cron-jobs/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -83,14 +84,14 @@ include “every 5 minutes” (<
# A cron job that runs every 5 minutes.
jobs = [
Job(
- cluster = 'devcluster',
- role = 'www-data',
- environment = 'test',
- name = 'cron_hello_world',
- cron_schedule = '*/5 * * * *',
+ cluster = 'devcluster',
+ role = 'www-data',
+ environment = 'test',
+ name = 'cron_hello_world',
+ cron_schedule = '*/5 * * * *',
task = SimpleTask(
- 'cron_hello_world',
- 'echo "Hello world from cron, the time is now $(date
--rfc-822)"'),
+ 'cron_hello_world',
+ 'echo "Hello world from cron, the time is now $(date
--rfc-822)"'),
),
]
</pre>
@@ -183,11 +184,11 @@ attempting to kill the old one (outside
<p>Cron timezone is configured indepdendently of JVM timezone with the
<code>-cron_timezone</code> flag and
defaults to UTC.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/deploying-aurora-scheduler/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/deploying-aurora-scheduler/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
---
aurora/site/publish/documentation/latest/deploying-aurora-scheduler/index.html
(original)
+++
aurora/site/publish/documentation/latest/deploying-aurora-scheduler/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -59,6 +60,7 @@ machines. This guide helps you get the
<li><a href="#storage-performance-considerations">Storage Performance
Considerations</a></li>
<li><a href="#network-considerations">Network considerations</a></li>
<li><a href="#considerations-for-running-jobs-in-docker">Considerations for
running jobs in docker</a></li>
+<li><a href="#security-considerations">Security Considerations</a></li>
</ul></li>
<li><a href="#running-aurora">Running Aurora</a>
@@ -92,7 +94,7 @@ machines. This guide helps you get the
<p>The Aurora scheduler is a standalone Java server. As part of the build
process it creates a bundle
of all its dependencies, with the notable exceptions of the JVM and libmesos.
Each target server
-should have a JVM (Java 7 or higher) and libmesos (0.21.1) installed.</p>
+should have a JVM (Java 7 or higher) and libmesos (0.22.0) installed.</p>
<h3 id="creating-the-distribution-.zip-file-(optional)">Creating the
Distribution .zip File (Optional)</h3>
@@ -258,6 +260,10 @@ restarted.</p>
</pre>
<p>assuming you set <code>-http_port=8081</code>.</p>
+<h2 id="security-considerations">Security Considerations</h2>
+
+<p>See <a href="/documentation/latest/security/">security.md</a>.</p>
+
<h3 id="maintaining-an-aurora-installation">Maintaining an Aurora
Installation</h3>
<h3 id="monitoring">Monitoring</h3>
@@ -295,10 +301,10 @@ enforce this.</p>
</pre>
<p>And this job configuration:</p>
<pre class="highlight text">Service(
- name = 'redis',
- role = 'db_team',
+ name = 'redis',
+ role = 'db_team',
constraints = {
- 'dedicated': 'db_team/redis'
+ 'dedicated': 'db_team/redis'
}
...
)
@@ -362,11 +368,11 @@ slaves are tagged with these two common
such that jobs are resilient to failure.</p>
<p>See our <a href="examples/vagrant/upstart/mesos-slave.conf">vagrant
example</a> for details.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/developing-aurora-client/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/developing-aurora-client/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
---
aurora/site/publish/documentation/latest/developing-aurora-client/index.html
(original)
+++
aurora/site/publish/documentation/latest/developing-aurora-client/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -69,7 +70,7 @@ the aurora workspace. This will create a
of mesos slaves, and an aurora scheduler.</p>
<p>If you have changed you would like to test in your local cluster,
you’ll rebuild the client:</p>
-<pre class="highlight text">vagrant ssh -c 'aurorabuild client'
+<pre class="highlight text">vagrant ssh -c 'aurorabuild client'
</pre>
<p>Once this completes, the <code>aurora</code> command will reflect your
changes.</p>
@@ -86,11 +87,11 @@ directory with PyCharm.
Once the project is loaded:
- open project settings
- - click 'Project Interpreter'
+ - click 'Project Interpreter'
- click the cog in the upper-right corner
- - click 'Add Local'
- - select 'build-support/python/pycharm.venv/bin/python'
- - click 'OK'
+ - click 'Add Local'
+ - select 'build-support/python/pycharm.venv/bin/python'
+ - click 'OK'
</pre>
<h3 id="running/debugging-tests">Running/Debugging Tests</h3>
@@ -125,11 +126,11 @@ is the directory where our example clust
<h1 id="making-thrift-schema-changes">Making thrift schema changes</h1>
<p>See <a href="/documentation/latest/thrift-deprecation/">this document</a>
for any thrift related changes.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/developing-aurora-scheduler/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/developing-aurora-scheduler/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
---
aurora/site/publish/documentation/latest/developing-aurora-scheduler/index.html
(original)
+++
aurora/site/publish/documentation/latest/developing-aurora-scheduler/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -88,7 +89,7 @@ commit to origin/master.</p>
<p>New dependencies can be added from Maven central by adding a
<code>compile</code> dependency to <code>build.gradle</code>.
For example, to add a dependency on <code>com.example</code>’s
<code>example-lib</code> 1.0 add this block:</p>
-<pre class="highlight text">compile 'com.example:example-lib:1.0'
+<pre class="highlight text">compile 'com.example:example-lib:1.0'
</pre>
<p>NOTE: Anyone thinking about adding a new dependency should first
familiarize themself with the
Apache Foundation’s third-party licensing
@@ -135,11 +136,11 @@ repository root and commit the changed f
<h1 id="making-thrift-schema-changes">Making thrift schema changes</h1>
<p>See <a href="/documentation/latest/thrift-deprecation/">this document</a>
for any thrift related changes.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/hooks/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/hooks/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/hooks/index.html (original)
+++ aurora/site/publish/documentation/latest/hooks/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -199,10 +200,10 @@ returning <code>True</code>. For example
<p>Recall that <code>.aurora</code> config files are written in Pystachio. So
the following turns on hooks for production jobs at cluster1 and cluster2, but
leaves them off for similar jobs with a defined user role. Of course, you also
need to list the objects that define the hooks in your config file’s
<code>hooks</code> variable.</p>
<pre class="highlight python"><span class="n">jobs</span> <span
class="o">=</span> <span class="p">[</span>
- <span class="n">Job</span><span class="p">(</span><span
class="n">enable_hooks</span> <span class="o">=</span> <span
class="bp">True</span><span class="p">,</span> <span class="n">cluster</span>
<span class="o">=</span> <span class="n">c</span><span class="p">,</span> <span
class="n">env</span> <span class="o">=</span> <span
class="s">'prod'</span><span class="p">)</span> <span class="k">for</span>
<span class="n">c</span> <span class="ow">in</span> <span
class="p">(</span><span class="s">'cluster1'</span><span class="p">,</span>
<span class="s">'cluster2'</span><span class="p">)</span>
+ <span class="n">Job</span><span class="p">(</span><span
class="n">enable_hooks</span> <span class="o">=</span> <span
class="bp">True</span><span class="p">,</span> <span class="n">cluster</span>
<span class="o">=</span> <span class="n">c</span><span class="p">,</span> <span
class="n">env</span> <span class="o">=</span> <span
class="s">'prod'</span><span class="p">)</span> <span
class="k">for</span> <span class="n">c</span> <span class="ow">in</span> <span
class="p">(</span><span class="s">'cluster1'</span><span
class="p">,</span> <span class="s">'cluster2'</span><span
class="p">)</span>
<span class="p">]</span>
<span class="n">jobs</span><span class="o">.</span><span
class="n">extend</span><span class="p">(</span>
- <span class="n">Job</span><span class="p">(</span><span
class="n">cluster</span> <span class="o">=</span> <span class="n">c</span><span
class="p">,</span> <span class="n">env</span> <span class="o">=</span> <span
class="s">'prod'</span><span class="p">,</span> <span class="n">role</span>
<span class="o">=</span> <span class="n">getpass</span><span
class="o">.</span><span class="n">getuser</span><span class="p">())</span>
<span class="k">for</span> <span class="n">c</span> <span class="ow">in</span>
<span class="p">(</span><span class="s">'cluster1'</span><span
class="p">,</span> <span class="s">'cluster2'</span><span class="p">))</span>
+ <span class="n">Job</span><span class="p">(</span><span
class="n">cluster</span> <span class="o">=</span> <span class="n">c</span><span
class="p">,</span> <span class="n">env</span> <span class="o">=</span> <span
class="s">'prod'</span><span class="p">,</span> <span
class="n">role</span> <span class="o">=</span> <span
class="n">getpass</span><span class="o">.</span><span
class="n">getuser</span><span class="p">())</span> <span class="k">for</span>
<span class="n">c</span> <span class="ow">in</span> <span
class="p">(</span><span class="s">'cluster1'</span><span
class="p">,</span> <span class="s">'cluster2'</span><span
class="p">))</span>
<span class="c"># Hooks disabled for these jobs</span>
</pre>
<h2 id="command-line">Command Line</h2>
@@ -223,17 +224,17 @@ returning <code>True</code>. For example
<pre class="highlight python"><span class="c"># Defines a method
pre_kill_job</span>
<span class="k">class</span> <span class="nc">KillConfirmer</span><span
class="p">(</span><span class="nb">object</span><span class="p">):</span>
<span class="k">def</span> <span class="nf">confirm</span><span
class="p">(</span><span class="bp">self</span><span class="p">,</span> <span
class="n">msg</span><span class="p">):</span>
- <span class="k">return</span> <span class="nb">raw_input</span><span
class="p">(</span><span class="n">msg</span><span class="p">)</span><span
class="o">.</span><span class="n">lower</span><span class="p">()</span> <span
class="o">==</span> <span class="s">'yes'</span>
+ <span class="k">return</span> <span class="nb">raw_input</span><span
class="p">(</span><span class="n">msg</span><span class="p">)</span><span
class="o">.</span><span class="n">lower</span><span class="p">()</span> <span
class="o">==</span> <span class="s">'yes'</span>
<span class="k">def</span> <span class="nf">pre_kill_job</span><span
class="p">(</span><span class="bp">self</span><span class="p">,</span> <span
class="n">job_key</span><span class="p">,</span> <span
class="n">shards</span><span class="o">=</span><span
class="bp">None</span><span class="p">):</span>
- <span class="n">shards</span> <span class="o">=</span> <span
class="p">(</span><span class="s">'shards </span><span class="si">%</span><span
class="s">s'</span> <span class="o">%</span> <span class="n">shards</span><span
class="p">)</span> <span class="k">if</span> <span class="n">shards</span>
<span class="ow">is</span> <span class="ow">not</span> <span
class="bp">None</span> <span class="k">else</span> <span class="s">'all
shards'</span>
- <span class="k">return</span> <span class="bp">self</span><span
class="o">.</span><span class="n">confirm</span><span class="p">(</span><span
class="s">'Are you sure you want to kill </span><span class="si">%</span><span
class="s">s (</span><span class="si">%</span><span class="s">s)? (yes/no):
'</span>
+ <span class="n">shards</span> <span class="o">=</span> <span
class="p">(</span><span class="s">'shards </span><span
class="si">%</span><span class="s">s'</span> <span class="o">%</span> <span
class="n">shards</span><span class="p">)</span> <span class="k">if</span> <span
class="n">shards</span> <span class="ow">is</span> <span class="ow">not</span>
<span class="bp">None</span> <span class="k">else</span> <span
class="s">'all shards'</span>
+ <span class="k">return</span> <span class="bp">self</span><span
class="o">.</span><span class="n">confirm</span><span class="p">(</span><span
class="s">'Are you sure you want to kill </span><span
class="si">%</span><span class="s">s (</span><span class="si">%</span><span
class="s">s)? (yes/no): '</span>
<span class="o">%</span> <span class="p">(</span><span
class="n">job_key</span><span class="p">,</span> <span
class="n">shards</span><span class="p">))</span>
</pre>
<h3 id="pre_-methods">pre_ Methods</h3>
<p><code>pre_</code> methods have the signature:</p>
-<pre class="highlight text">pre_<API method name>(self, <associated
method's signature>)
+<pre class="highlight text">pre_<API method name>(self, <associated
method's signature>)
</pre>
<p><code>pre_</code> methods have the same signature as their associated
method, with the addition of <code>self</code> as the first parameter. See the
<a href="#Chart">chart</a> above for the mapping of parameters to methods. When
writing <code>pre_</code> methods, you can use the <code>*</code> and
<code>**</code> syntax to designate that all unspecified parameters are passed
in a list to the <code>*</code>ed variable and all named parameters with values
are passed as name/value pairs to the <code>**</code>ed variable.</p>
@@ -242,7 +243,7 @@ returning <code>True</code>. For example
<h3 id="err_-methods">err_ Methods</h3>
<p><code>err_</code> methods have the signature:</p>
-<pre class="highlight text">err_<API method name>(self, exc,
<associated method's signature>)
+<pre class="highlight text">err_<API method name>(self, exc,
<associated method's signature>)
</pre>
<p><code>err_</code> methods have the same signature as their associated
method, with the addition of a first parameter <code>self</code> and a second
parameter <code>exc</code>. <code>exc</code> is either a result with
responseCode other than <code>ResponseCode.OK</code> or an
<code>Exception</code>. See the <a href="#Chart">chart</a> above for the
mapping of parameters to methods. When writing <code>err</code>_ methods, you
can use the <code>*</code> and <code>**</code> syntax to designate that all
unspecified parameters are passed in a list to the <code>*</code>ed variable
and all named parameters with values are passed as name/value pairs to the
<code>**</code>ed variable.</p>
@@ -282,9 +283,9 @@ returning <code>True</code>. For example
<pre class="highlight python"><span class="c"># Overrides the standard
do-nothing generic_hook by adding a log writing operation.</span>
<span class="kn">from</span> <span class="nn">twitter.common</span> <span
class="kn">import</span> <span class="n">log</span>
<span class="k">class</span> <span class="nc">Logger</span><span
class="p">(</span><span class="nb">object</span><span class="p">):</span>
- <span class="s">'''Adds to the log every time a hookable API method is
called'''</span>
+ <span class="s">'''Adds to the log every time a hookable API
method is called'''</span>
<span class="k">def</span> <span class="nf">generic_hook</span><span
class="p">(</span><span class="bp">self</span><span class="p">,</span> <span
class="n">hook_config</span><span class="p">,</span> <span
class="n">event</span><span class="p">,</span> <span
class="n">method_name</span><span class="p">,</span> <span
class="n">result_or_err</span><span class="p">,</span> <span
class="o">*</span><span class="n">args</span><span class="p">,</span> <span
class="o">**</span><span class="n">kw</span><span class="p">)</span>
- <span class="n">log</span><span class="o">.</span><span
class="n">info</span><span class="p">(</span><span class="s">'</span><span
class="si">%</span><span class="s">s: </span><span class="si">%</span><span
class="s">s_</span><span class="si">%</span><span class="s">s of </span><span
class="si">%</span><span class="s">s'</span>
+ <span class="n">log</span><span class="o">.</span><span
class="n">info</span><span class="p">(</span><span class="s">'</span><span
class="si">%</span><span class="s">s: </span><span class="si">%</span><span
class="s">s_</span><span class="si">%</span><span class="s">s of </span><span
class="si">%</span><span class="s">s'</span>
<span class="o">%</span> <span class="p">(</span><span
class="bp">self</span><span class="o">.</span><span
class="n">__class__</span><span class="o">.</span><span
class="n">__name__</span><span class="p">,</span> <span
class="n">event</span><span class="p">,</span> <span
class="n">method_name</span><span class="p">,</span> <span
class="n">hook_config</span><span class="o">.</span><span
class="n">job_key</span><span class="p">))</span>
</pre>
<h2 id="hooks-process-checklist">Hooks Process Checklist</h2>
@@ -305,11 +306,11 @@ returning <code>True</code>. For example
<li><p>If desired, write your <code>generic_hook</code> definition as part of
an object definition in your <code>.aurora</code> config file. Remember, the
object must be listed as a member of <code>hooks</code>.</p></li>
<li><p>If your Aurora command line command does not otherwise take an
<code>.aurora</code> config file argument, add the appropriate
<code>.aurora</code> file as an argument in order to define and activate the
configuration’s hooks.</p></li>
</ol>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/index.html (original)
+++ aurora/site/publish/documentation/latest/index.html Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -83,11 +84,11 @@
<li><a href="/documentation/latest/developing-aurora-client/">Developing the
Aurora Client</a></li>
<li><a href="/documentation/latest/committers/">Committers Guide</a></li>
</ul>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/monitoring/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/monitoring/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/monitoring/index.html (original)
+++ aurora/site/publish/documentation/latest/monitoring/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -48,7 +49,7 @@ since it will give you a global view of
<p>The scheduler exposes a <em>lot</em> of instrumentation data via its HTTP
interface. You can get a quick
peek at the first few of these in our vagrant image:</p>
-<pre class="highlight text">$ vagrant ssh -c 'curl -s localhost:8081/vars |
head'
+<pre class="highlight text">$ vagrant ssh -c 'curl -s localhost:8081/vars
| head'
async_tasks_completed 1004
attribute_store_fetch_all_events 15
attribute_store_fetch_all_events_per_sec 0.0
@@ -65,7 +66,7 @@ name and value. Values may be integers,
may be dynamic).</p>
<p>If your monitoring infrastructure prefers JSON, the scheduler exports that
as well:</p>
-<pre class="highlight text">$ vagrant ssh -c 'curl -s localhost:8081/vars.json
| python -mjson.tool | head'
+<pre class="highlight text">$ vagrant ssh -c 'curl -s
localhost:8081/vars.json | python -mjson.tool | head'
{
"async_tasks_completed": 1009,
"attribute_store_fetch_all_events": 15,
@@ -117,177 +118,125 @@ recommend you start with a strict value
adjust thresholds as you see fit. Feel free to ask us if you would like to
validate that your alerts
and thresholds make sense.</p>
-<h4 id="jvm_uptime_secs"><code>jvm_uptime_secs</code></h4>
+<h2 id="important-stats">Important stats</h2>
-<p>Type: integer counter</p>
+<h3 id="jvm_uptime_secs"><code>jvm_uptime_secs</code></h3>
-<h4 id="description">Description</h4>
+<p>Type: integer counter</p>
<p>The number of seconds the JVM process has been running. Comes from
<a
href="http://docs.oracle.com/javase/7/docs/api/java/lang/management/RuntimeMXBean.html#getUptime()">RuntimeMXBean#getUptime()</a></p>
-<h4 id="alerting">Alerting</h4>
-
<p>Detecting resets (decreasing values) on this stat will tell you that the
scheduler is failing to
stay alive.</p>
-<h4 id="triage">Triage</h4>
-
<p>Look at the scheduler logs to identify the reason the scheduler is
exiting.</p>
-<h4 id="system_load_avg"><code>system_load_avg</code></h4>
+<h3 id="system_load_avg"><code>system_load_avg</code></h3>
<p>Type: double gauge</p>
-<h4 id="description">Description</h4>
-
<p>The current load average of the system for the last minute. Comes from
<a
href="http://docs.oracle.com/javase/7/docs/api/java/lang/management/OperatingSystemMXBean.html?is-external=true#getSystemLoadAverage()">OperatingSystemMXBean#getSystemLoadAverage()</a>.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>A high sustained value suggests that the scheduler machine may be
over-utilized.</p>
-<h4 id="triage">Triage</h4>
-
<p>Use standard unix tools like <code>top</code> and <code>ps</code> to track
down the offending process(es).</p>
-<h4
id="process_cpu_cores_utilized"><code>process_cpu_cores_utilized</code></h4>
+<h3
id="process_cpu_cores_utilized"><code>process_cpu_cores_utilized</code></h3>
<p>Type: double gauge</p>
-<h4 id="description">Description</h4>
-
<p>The current number of CPU cores in use by the JVM process. This should not
exceed the number of
logical CPU cores on the machine. Derived from
<a
href="http://docs.oracle.com/javase/7/docs/jre/api/management/extension/com/sun/management/OperatingSystemMXBean.html";>OperatingSystemMXBean#getProcessCpuTime()</a></p>
-<h4 id="alerting">Alerting</h4>
-
<p>A high sustained value indicates that the scheduler is overworked. Due to
current internal design
limitations, if this value is sustained at <code>1</code>, there is a good
chance the scheduler is under water.</p>
-<h4 id="triage">Triage</h4>
-
<p>There are two main inputs that tend to drive this figure: task scheduling
attempts and status
updates from Mesos. You may see activity in the scheduler logs to give an
indication of where
time is being spent. Beyond that, it really takes good familiarity with the
code to effectively
triage this. We suggest engaging with an Aurora developer.</p>
-<h4 id="task_store_lost"><code>task_store_LOST</code></h4>
+<h3 id="task_store_lost"><code>task_store_LOST</code></h3>
<p>Type: integer gauge</p>
-<h4 id="description">Description</h4>
-
<p>The number of tasks stored in the scheduler that are in the
<code>LOST</code> state, and have been rescheduled.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>If this value is increasing at a high rate, it is a sign of trouble.</p>
-<h4 id="triage">Triage</h4>
-
<p>There are many sources of <code>LOST</code> tasks in Mesos: the scheduler,
master, slave, and executor can all
trigger this. The first step is to look in the scheduler logs for
<code>LOST</code> to identify where the
state changes are originating.</p>
-<h4 id="scheduler_resource_offers"><code>scheduler_resource_offers</code></h4>
+<h3 id="scheduler_resource_offers"><code>scheduler_resource_offers</code></h3>
<p>Type: integer counter</p>
-<h4 id="description">Description</h4>
-
<p>The number of resource offers that the scheduler has received.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>For a healthy scheduler, this value must be increasing over time.</p>
-<h5 id="triage">Triage</h5>
-
<p>Assuming the scheduler is up and otherwise healthy, you will want to check
if the master thinks it
is sending offers. You should also look at the master’s web interface to
see if it has a large
number of outstanding offers that it is waiting to be returned.</p>
-<h4 id="framework_registered"><code>framework_registered</code></h4>
+<h3 id="framework_registered"><code>framework_registered</code></h3>
<p>Type: binary integer counter</p>
-<h4 id="description">Description</h4>
-
<p>Will be <code>1</code> for the leading scheduler that is registered with
the Mesos master, <code>0</code> for passive
schedulers,</p>
-<h4 id="alerting">Alerting</h4>
-
<p>A sustained period without a <code>1</code> (or where <code>sum() !=
1</code>) warrants investigation.</p>
-<h4 id="triage">Triage</h4>
-
<p>If there is no leading scheduler, look in the scheduler and master logs for
why. If there are
multiple schedulers claiming leadership, this suggests a split brain and
warrants filing a critical
bug.</p>
-<h4
id="rate(scheduler_log_native_append_nanos_total)/rate(scheduler_log_native_append_events)"><code>rate(scheduler_log_native_append_nanos_total)/rate(scheduler_log_native_append_events)</code></h4>
+<h3
id="rate(scheduler_log_native_append_nanos_total)/rate(scheduler_log_native_append_events)"><code>rate(scheduler_log_native_append_nanos_total)/rate(scheduler_log_native_append_events)</code></h3>
<p>Type: rate ratio of integer counters</p>
-<h4 id="description">Description</h4>
-
<p>This composes two counters to compute a windowed figure for the latency of
replicated log writes.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>A hike in this value suggests disk bandwidth contention.</p>
-<h4 id="triage">Triage</h4>
-
<p>Look in scheduler logs for any reported oddness with saving to the
replicated log. Also use
standard tools like <code>vmstat</code> and <code>iotop</code> to identify
whether the disk has become slow or
over-utilized. We suggest using a dedicated disk for the replicated log to
mitigate this.</p>
-<h4 id="timed_out_tasks"><code>timed_out_tasks</code></h4>
+<h3 id="timed_out_tasks"><code>timed_out_tasks</code></h3>
<p>Type: integer counter</p>
-<h4 id="description">Description</h4>
-
<p>Tracks the number of times the scheduler has given up while waiting
(for <code>-transient_task_state_timeout</code>) to hear back about a task
that is in a transient state
(e.g. <code>ASSIGNED</code>, <code>KILLING</code>), and has moved to
<code>LOST</code> before rescheduling.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>This value is currently known to increase occasionally when the scheduler
fails over
(<a href="https://issues.apache.org/jira/browse/AURORA-740";>AURORA-740</a>).
However, any large spike in this
value warrants investigation.</p>
-<h4 id="triage">Triage</h4>
-
<p>The scheduler will log when it times out a task. You should trace the task
ID of the timed out
task into the master, slave, and/or executors to determine where the message
was dropped.</p>
-<h4 id="http_500_responses_events"><code>http_500_responses_events</code></h4>
+<h3 id="http_500_responses_events"><code>http_500_responses_events</code></h3>
<p>Type: integer counter</p>
-<h4 id="description">Description</h4>
-
<p>The total number of HTTP 500 status responses sent by the scheduler.
Includes API and asset serving.</p>
-<h4 id="alerting">Alerting</h4>
-
<p>An increase warrants investigation.</p>
-<h4 id="triage">Triage</h4>
-
<p>Look in scheduler logs to identify why the scheduler returned a 500, there
should be a stack trace.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/resource-isolation/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/resource-isolation/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/resource-isolation/index.html
(original)
+++ aurora/site/publish/documentation/latest/resource-isolation/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -188,11 +189,11 @@ into the application’s sandbox spa
guarantees. For some resources, such as memory bandwidth, there are no
practical sharing methods so some application combinations collocated on
the same host may cause contention.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/scheduler-storage/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/scheduler-storage/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/scheduler-storage/index.html
(original)
+++ aurora/site/publish/documentation/latest/scheduler-storage/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -85,11 +86,11 @@ the <code>-dlog_snapshot_interval</code>
<p>To disable deduplication, for example to rollback to Aurora, restart all of
the cluster’s
schedulers with <code>-deduplicate_snapshots=false</code> and either wait for
a snapshot or force one
using <code>aurora_admin snapshot</code>.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/sla/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/sla/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/sla/index.html (original)
+++ aurora/site/publish/documentation/latest/sla/index.html Thu Apr 30 20:41:01
2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -233,11 +234,11 @@ unreasonable resource constraints) do no
<li><p>All metrics are calculated at a pre-defined interval (currently set at
1 minute).
Scheduler restarts may result in missed collections.</p></li>
</ul>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/storage-config/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/storage-config/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/storage-config/index.html
(original)
+++ aurora/site/publish/documentation/latest/storage-config/index.html Thu Apr
30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -202,11 +203,11 @@ the provided backup snapshot and initiat
<h3 id="cleanup">Cleanup</h3>
<p>Undo any modification done during <a href="#preparation">Preparation</a>
sequence.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/storage/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/storage/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/storage/index.html (original)
+++ aurora/site/publish/documentation/latest/storage/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -134,11 +135,11 @@ volatile and replicated writes to succee
<p>Any time a scheduler restarts, it restores its volatile state from the most
recent position recorded
in the replicated log by restoring the snapshot and replaying individual log
entries on top to fully
recover the state up to the last write.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified:
aurora/site/publish/documentation/latest/test-resource-generation/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/test-resource-generation/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
---
aurora/site/publish/documentation/latest/test-resource-generation/index.html
(original)
+++
aurora/site/publish/documentation/latest/test-resource-generation/index.html
Thu Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -65,11 +66,11 @@ accomplished by writing and running a
<a href="/documentation/latest/configuration-reference/">job configuration</a>
that exercises the feature, and
copying the checkpoint file from the sandbox directory, by default this is
<code>/var/run/thermos/checkpoints/<aurora task id></code>.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/thrift-deprecation/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/thrift-deprecation/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/thrift-deprecation/index.html
(original)
+++ aurora/site/publish/documentation/latest/thrift-deprecation/index.html Thu
Apr 30 20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -93,11 +94,11 @@ See <a href="../src/main/java/org/apache
confidence that you change is backwards compatible. It’s easy to
simulate different
client/scheduler versions by playing with <code>aurorabuild</code> command.
See <a href="/documentation/latest/vagrant/">this document</a>
for more.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/tutorial/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/tutorial/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/tutorial/index.html (original)
+++ aurora/site/publish/documentation/latest/tutorial/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -111,24 +112,24 @@ code in the file <code>hello_world.auror
<!-- NOTE: If you are changing this file, be sure to also update
examples/vagrant/test_tutorial.sh.
-->
-<pre class="highlight python"><span class="n">pkg_path</span> <span
class="o">=</span> <span class="s">'/vagrant/hello_world.py'</span>
+<pre class="highlight python"><span class="n">pkg_path</span> <span
class="o">=</span> <span class="s">'/vagrant/hello_world.py'</span>
<span class="c"># we use a trick here to make the configuration change
with</span>
<span class="c"># the contents of the file, for simplicity. in a normal
setting, packages would be</span>
<span class="c"># versioned, and the version number would be changed in the
configuration.</span>
<span class="kn">import</span> <span class="nn">hashlib</span>
-<span class="k">with</span> <span class="nb">open</span><span
class="p">(</span><span class="n">pkg_path</span><span class="p">,</span> <span
class="s">'rb'</span><span class="p">)</span> <span class="k">as</span> <span
class="n">f</span><span class="p">:</span>
+<span class="k">with</span> <span class="nb">open</span><span
class="p">(</span><span class="n">pkg_path</span><span class="p">,</span> <span
class="s">'rb'</span><span class="p">)</span> <span class="k">as</span>
<span class="n">f</span><span class="p">:</span>
<span class="n">pkg_checksum</span> <span class="o">=</span> <span
class="nb">hash</span><span class="n">lib</span><span class="o">.</span><span
class="n">md5</span><span class="p">(</span><span class="n">f</span><span
class="o">.</span><span class="n">read</span><span class="p">())</span><span
class="o">.</span><span class="nb">hex</span><span class="n">digest</span><span
class="p">()</span>
<span class="c"># copy hello_world.py into the local sandbox</span>
<span class="n">install</span> <span class="o">=</span> <span
class="n">Process</span><span class="p">(</span>
- <span class="n">name</span> <span class="o">=</span> <span
class="s">'fetch_package'</span><span class="p">,</span>
- <span class="n">cmdline</span> <span class="o">=</span> <span class="s">'cp
</span><span class="si">%</span><span class="s">s . && echo
</span><span class="si">%</span><span class="s">s && chmod +x
hello_world.py'</span> <span class="o">%</span> <span class="p">(</span><span
class="n">pkg_path</span><span class="p">,</span> <span
class="n">pkg_checksum</span><span class="p">))</span>
+ <span class="n">name</span> <span class="o">=</span> <span
class="s">'fetch_package'</span><span class="p">,</span>
+ <span class="n">cmdline</span> <span class="o">=</span> <span
class="s">'cp </span><span class="si">%</span><span class="s">s .
&& echo </span><span class="si">%</span><span class="s">s &&
chmod +x hello_world.py'</span> <span class="o">%</span> <span
class="p">(</span><span class="n">pkg_path</span><span class="p">,</span> <span
class="n">pkg_checksum</span><span class="p">))</span>
<span class="c"># run the script</span>
<span class="n">hello_world</span> <span class="o">=</span> <span
class="n">Process</span><span class="p">(</span>
- <span class="n">name</span> <span class="o">=</span> <span
class="s">'hello_world'</span><span class="p">,</span>
- <span class="n">cmdline</span> <span class="o">=</span> <span
class="s">'python hello_world.py'</span><span class="p">)</span>
+ <span class="n">name</span> <span class="o">=</span> <span
class="s">'hello_world'</span><span class="p">,</span>
+ <span class="n">cmdline</span> <span class="o">=</span> <span
class="s">'python hello_world.py'</span><span class="p">)</span>
<span class="c"># describe the task</span>
<span class="n">hello_world_task</span> <span class="o">=</span> <span
class="n">SequentialTask</span><span class="p">(</span>
@@ -136,10 +137,10 @@ code in the file <code>hello_world.auror
<span class="n">resources</span> <span class="o">=</span> <span
class="n">Resources</span><span class="p">(</span><span class="n">cpu</span>
<span class="o">=</span> <span class="mi">1</span><span class="p">,</span>
<span class="n">ram</span> <span class="o">=</span> <span
class="mi">1</span><span class="o">*</span><span class="n">MB</span><span
class="p">,</span> <span class="n">disk</span><span class="o">=</span><span
class="mi">8</span><span class="o">*</span><span class="n">MB</span><span
class="p">))</span>
<span class="n">jobs</span> <span class="o">=</span> <span class="p">[</span>
- <span class="n">Service</span><span class="p">(</span><span
class="n">cluster</span> <span class="o">=</span> <span
class="s">'devcluster'</span><span class="p">,</span>
- <span class="n">environment</span> <span class="o">=</span> <span
class="s">'devel'</span><span class="p">,</span>
- <span class="n">role</span> <span class="o">=</span> <span
class="s">'www-data'</span><span class="p">,</span>
- <span class="n">name</span> <span class="o">=</span> <span
class="s">'hello_world'</span><span class="p">,</span>
+ <span class="n">Service</span><span class="p">(</span><span
class="n">cluster</span> <span class="o">=</span> <span
class="s">'devcluster'</span><span class="p">,</span>
+ <span class="n">environment</span> <span class="o">=</span> <span
class="s">'devel'</span><span class="p">,</span>
+ <span class="n">role</span> <span class="o">=</span> <span
class="s">'www-data'</span><span class="p">,</span>
+ <span class="n">name</span> <span class="o">=</span> <span
class="s">'hello_world'</span><span class="p">,</span>
<span class="n">task</span> <span class="o">=</span> <span
class="n">hello_world_task</span><span class="p">)</span>
<span class="p">]</span>
</pre>
@@ -295,11 +296,11 @@ Thermos work “under the hood&rdquo
<li>Explore the Aurora Client - use <code>aurora -h</code>, and read the
<a href="/documentation/latest/client-commands/">Aurora Client Commands</a>
document.</li>
</ul>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
Modified: aurora/site/publish/documentation/latest/user-guide/index.html
URL:
http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/user-guide/index.html?rev=1677065&r1=1677064&r2=1677065&view=diff
==============================================================================
--- aurora/site/publish/documentation/latest/user-guide/index.html (original)
+++ aurora/site/publish/documentation/latest/user-guide/index.html Thu Apr 30
20:41:01 2015
@@ -21,6 +21,7 @@
</script>
</head>
<body>
+
<div class="container-fluid section-header">
<div class="container">
<div class="nav nav-bar">
@@ -244,8 +245,8 @@ from the point where the update failed.
<p>The Executor implements a protocol for rudimentary control of a task via
HTTP. Tasks subscribe for
this protocol by declaring a port named <code>health</code>. Take for example
this configuration snippet:</p>
<pre class="highlight text">nginx = Process(
- name = 'nginx',
- cmdline = './run_nginx.sh -port {{thermos.ports[http]}}')
+ name = 'nginx',
+ cmdline = './run_nginx.sh -port {{thermos.ports[http]}}')
</pre>
<p>When this Process is included in a job, the job will be allocated a port,
and the command line
will be replaced with something like:</p>
@@ -422,11 +423,11 @@ about the Aurora Client.</p>
</ul>
<p>See <a href="/documentation/latest/client-commands/">client
commands</a>.</p>
-
</div>
</div>
</div>
+
<div class="container-fluid section-footer buffer">
<div class="container">
<div class="row">
