aurora git commit: Observer task page to load consumption info from history

2017-07-18 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 243d6fa14 -> 908a450f5 Observer task page to load consumption info from history # Observer task page to load consumption info from history Resource consumptions of Thermos Processes are periodically calculated by TaskResourceMonitor

aurora-packaging git commit: Upgrade Mesos version to 1.2.

2017-07-18 Thread santhk
Repository: aurora-packaging Updated Branches: refs/heads/master b904b5f1c -> 102b98ce9 Upgrade Mesos version to 1.2. Reviewed at https://reviews.apache.org/r/60947/ Project: http://git-wip-us.apache.org/repos/asf/aurora-packaging/repo Commit:

svn commit: r19986 - /dev/aurora/0.19.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 01:44:19 2017 New Revision: 19986 Log: Remove wrongly generated 0.19.0-rc0 artifacts. Removed: dev/aurora/0.19.0-rc0/

svn commit: r19984 - /dev/aurora/0.19.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 01:42:42 2017 New Revision: 19984 Log: aurora-0.19.0 release candidate rel/0.19.0-rc0 Added: dev/aurora/0.19.0-rc0/

svn commit: r19985 - in /dev/aurora/0.19.0-rc0: apache-aurora-0.19.0-rc0.tar.gz apache-aurora-0.19.0-rc0.tar.gz.asc apache-aurora-0.19.0-rc0.tar.gz.md5 apache-aurora-0.19.0-rc0.tar.gz.sha

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 01:42:44 2017 New Revision: 19985 Log: aurora-0.19.0 release candidate rel/0.19.0-rc0 Added: dev/aurora/0.19.0-rc0/apache-aurora-0.19.0-rc0.tar.gz (with props) dev/aurora/0.19.0-rc0/apache-aurora-0.19.0-rc0.tar.gz.asc dev/aurora/0.19.0-rc0/apache

svn commit: r19975 - in /dev/aurora/0.18.0-rc0: apache-aurora-0.18.0-rc0.tar.gz apache-aurora-0.18.0-rc0.tar.gz.asc apache-aurora-0.18.0-rc0.tar.gz.md5 apache-aurora-0.18.0-rc0.tar.gz.sha

2017-06-09 Thread santhk
Author: santhk Date: Fri Jun 9 23:16:15 2017 New Revision: 19975 Log: aurora-0.18.0 release candidate rel/0.18.0-rc0 Added: dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz (with props) dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz.asc dev/aurora/0.18.0-rc0/apache

svn commit: r19974 - /dev/aurora/0.18.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Fri Jun 9 23:16:13 2017 New Revision: 19974 Log: aurora-0.18.0 release candidate rel/0.18.0-rc0 Added: dev/aurora/0.18.0-rc0/

svn commit: r19977 - /dev/aurora/0.18.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Fri Jun 9 23:48:41 2017 New Revision: 19977 Log: aurora-0.18.0 release candidate rel/0.18.0-rc0 Added: dev/aurora/0.18.0-rc0/

svn commit: r19978 - in /dev/aurora/0.18.0-rc0: apache-aurora-0.18.0-rc0.tar.gz apache-aurora-0.18.0-rc0.tar.gz.asc apache-aurora-0.18.0-rc0.tar.gz.md5 apache-aurora-0.18.0-rc0.tar.gz.sha

2017-06-09 Thread santhk
Author: santhk Date: Fri Jun 9 23:48:43 2017 New Revision: 19978 Log: aurora-0.18.0 release candidate rel/0.18.0-rc0 Added: dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz (with props) dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz.asc dev/aurora/0.18.0-rc0/apache

svn commit: r19976 - /dev/aurora/0.18.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Fri Jun 9 23:23:40 2017 New Revision: 19976 Log: Removing 0.18.0 release artifacts, due to an error while creating the relase candidate. Removed: dev/aurora/0.18.0-rc0/

[1/3] aurora git commit: Prepare release notes for 0.18.0

2017-06-09 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 6dc3d3760 -> 77a64f789 Prepare release notes for 0.18.0 Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/e84c7c95 Tree:

[2/3] aurora git commit: Updating CHANGELOG for 0.18.0 release.

2017-06-09 Thread santhk
Updating CHANGELOG for 0.18.0 release. Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/f85bec05 Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/f85bec05 Diff:

[3/3] aurora git commit: Incrementing snapshot version to 0.19.0-SNAPSHOT.

2017-06-09 Thread santhk
Incrementing snapshot version to 0.19.0-SNAPSHOT. Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/77a64f78 Tree: http://git-wip-us.apache.org/repos/asf/aurora/tree/77a64f78 Diff:

svn commit: r19981 - in /dev/aurora/0.18.0-rc0: apache-aurora-0.18.0-rc0.tar.gz apache-aurora-0.18.0-rc0.tar.gz.asc apache-aurora-0.18.0-rc0.tar.gz.md5 apache-aurora-0.18.0-rc0.tar.gz.sha

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 00:12:00 2017 New Revision: 19981 Log: aurora-0.18.0 release candidate rel/0.18.0-rc0 Added: dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz (with props) dev/aurora/0.18.0-rc0/apache-aurora-0.18.0-rc0.tar.gz.asc dev/aurora/0.18.0-rc0/apache

[aurora] Git Push Summary

2017-06-09 Thread santhk
Repository: aurora Updated Tags: refs/tags/rel/0.18.0-rc0 [created] 11d2bb833

svn commit: r1799388 [9/9] - in /aurora/site: data/ publish/ publish/blog/ publish/documentation/0.10.0/ publish/documentation/0.10.0/build-system/ publish/documentation/0.10.0/client-cluster-configur

2017-06-21 Thread santhk
Modified: aurora/site/source/documentation/latest/development/db-migration.md URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/latest/development/db-migration.md?rev=1799388=1799387=1799388=diff == ---

svn commit: r1799388 [1/9] - in /aurora/site: data/ publish/ publish/blog/ publish/documentation/0.10.0/ publish/documentation/0.10.0/build-system/ publish/documentation/0.10.0/client-cluster-configur

2017-06-21 Thread santhk
Author: santhk Date: Wed Jun 21 06:28:50 2017 New Revision: 1799388 URL: http://svn.apache.org/viewvc?rev=1799388=rev Log: Update website for Aurora 0.18.0 Modified: aurora/site/data/downloads.yml aurora/site/publish/blog/feed.xml aurora/site/publish/blog/index.html aurora/site

svn commit: r1799388 [7/9] - in /aurora/site: data/ publish/ publish/blog/ publish/documentation/0.10.0/ publish/documentation/0.10.0/build-system/ publish/documentation/0.10.0/client-cluster-configur

2017-06-21 Thread santhk
Modified: aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/latest/reference/scheduler-endpoints/index.html?rev=1799388=1799387=1799388=diff

svn commit: r1799392 [14/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/addit

2017-06-21 Thread santhk
Added: aurora/site/source/documentation/0.18.0/reference/task-lifecycle.md URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/0.18.0/reference/task-lifecycle.md?rev=1799392=auto == ---

svn commit: r1799392 [5/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Propchange: aurora/site/publish/documentation/0.18.0/images/RunningJob.png -- svn:mime-type = application/octet-stream Added: aurora/site/publish/documentation/0.18.0/images/ScheduledJobs.png URL:

svn commit: r1799392 [8/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Added: aurora/site/publish/documentation/0.18.0/reference/configuration-tutorial/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/0.18.0/reference/configuration-tutorial/index.html?rev=1799392=auto

svn commit: r1799392 [11/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/addit

2017-06-21 Thread santhk
Added: aurora/site/source/documentation/0.18.0/features/services.md URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/0.18.0/features/services.md?rev=1799392=auto == ---

svn commit: r1799392 [12/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/addit

2017-06-21 Thread santhk
Added: aurora/site/source/documentation/0.18.0/operations/installation.md URL: http://svn.apache.org/viewvc/aurora/site/source/documentation/0.18.0/operations/installation.md?rev=1799392=auto == ---

svn commit: r1799392 [1/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Author: santhk Date: Wed Jun 21 06:36:21 2017 New Revision: 1799392 URL: http://svn.apache.org/viewvc?rev=1799392=rev Log: Update website for Aurora 0.18.0 - part-2 Added: aurora/site/publish/blog/aurora-0-18-0-released/ aurora/site/publish/blog/aurora-0-18-0-released/index.html

svn commit: r1799392 [6/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Added: aurora/site/publish/documentation/0.18.0/operations/monitoring/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/0.18.0/operations/monitoring/index.html?rev=1799392=auto == ---

svn commit: r1799392 [2/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Added: aurora/site/publish/documentation/0.18.0/development/design-documents/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/0.18.0/development/design-documents/index.html?rev=1799392=auto

svn commit: r1799392 [3/14] - in /aurora/site: publish/blog/aurora-0-18-0-released/ publish/documentation/0.18.0/ publish/documentation/0.18.0/additional-resources/ publish/documentation/0.18.0/additi

2017-06-21 Thread santhk
Added: aurora/site/publish/documentation/0.18.0/features/custom-executors/index.html URL: http://svn.apache.org/viewvc/aurora/site/publish/documentation/0.18.0/features/custom-executors/index.html?rev=1799392=auto == ---

svn commit: r1799394 - in /aurora/site: publish/blog/aurora-0-18-0-released/index.html publish/blog/feed.xml source/blog/2017-06-20-aurora-0-18-0-released.md

2017-06-21 Thread santhk
Author: santhk Date: Wed Jun 21 07:04:55 2017 New Revision: 1799394 URL: http://svn.apache.org/viewvc?rev=1799394=rev Log: Add installation note for 0.18.0 release. Modified: aurora/site/publish/blog/aurora-0-18-0-released/index.html aurora/site/publish/blog/feed.xml aurora/site

aurora git commit: Add missing stats in MesosCallbackHandler

2017-06-22 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 13055df3b -> a922b053e Add missing stats in MesosCallbackHandler *Add missing stats in MesosCallbackHandler. We are thinking about switching to a new driver implementation around V1Mesos (https://reviews.apache.org/r/57061). The V1

svn commit: r19784 - /dev/aurora/KEYS

2017-05-23 Thread santhk
Author: santhk Date: Wed May 24 00:49:01 2017 New Revision: 19784 Log: Adding keys for santhk. Modified: dev/aurora/KEYS Modified: dev/aurora/KEYS == --- dev/aurora/KEYS (original) +++ dev/aurora/KEYS Wed May 24 00

aurora git commit: Added 'aurora task scp' command for copying/retrieving files to the sandbox of a task instance.

2017-05-18 Thread santhk
Repository: aurora Updated Branches: refs/heads/master b00a15e48 -> 4c0974bc4 Added 'aurora task scp' command for copying/retrieving files to the sandbox of a task instance. This command essentially mimics scp but expands task instances into their respective user@host:path For 'aurora task

svn commit: r19988 - /dev/aurora/0.19.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 02:00:26 2017 New Revision: 19988 Log: Remove the empty dir. Removed: dev/aurora/0.19.0-rc0/

svn commit: r19987 - /dev/aurora/0.19.0-rc0/

2017-06-09 Thread santhk
Author: santhk Date: Sat Jun 10 01:52:25 2017 New Revision: 19987 Log: aurora-0.19.0 release candidate rel/0.19.0-rc0 Added: dev/aurora/0.19.0-rc0/

aurora git commit: Set GPG_TTY if not set in the release scripts.

2017-06-11 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 77a64f789 -> 06518c86b Set GPG_TTY if not set in the release scripts. Reviewed at https://reviews.apache.org/r/59966/ Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit:

aurora git commit: Add a whitelist for TaskStateChange events in Webhook.

2017-06-13 Thread santhk
Repository: aurora Updated Branches: refs/heads/master cb86e8358 -> 0001f9091 Add a whitelist for TaskStateChange events in Webhook. Aurora Scheduler has a webhook module that watches all TaskStateChanges and send events to configured endpoint. This will flood the endpoint with a lot of

[aurora] Git Push Summary

2017-06-15 Thread santhk
Repository: aurora Updated Tags: refs/tags/rel/0.18.0 [created] ff342fc7b

aurora git commit: Adding Configurable Wait Period for Graceful Shutdowns

2017-06-13 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 40d9d4dbe -> cb86e8358 Adding Configurable Wait Period for Graceful Shutdowns We have some services that require more than the current 10 seconds given to gracefully shutdown (they need to close resources, finish requests, etc). We would

aurora git commit: Added additional stop() to prevent errors in run() to stop shutdown in SchedulerMain

2017-09-28 Thread santhk
Repository: aurora Updated Branches: refs/heads/master dfd06771a -> 7a803730c Added additional stop() to prevent errors in run() to stop shutdown in SchedulerMain Ensure that `SchedulerMain.run()` calls stop in the case of exceptions. This prevents the Scheduler from being transitioned to

aurora git commit: Fix race condition where rescinds are received but not processed before offer is accepted

2017-08-24 Thread santhk
Repository: aurora Updated Branches: refs/heads/master aae2b0dc7 -> 62e46cdea Fix race condition where rescinds are received but not processed before offer is accepted The current race condition for offers is possible: ``` 1. Scheduler receives an offer and adds it to the executor queue for

aurora git commit: Introduce structs to enable specifying custom SLA.

2018-05-21 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 83025f471 -> 34be63158 Introduce structs to enable specifying custom SLA. Add `SlaPolicy` and `HostMaintenanceRequest` structs to the thrift definition and introduce a new `HostMaintenanceStore` for tracking maintenance requests. These

aurora git commit: Export number of tasks lost per dedicated role.

2018-06-18 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 4719fa730 -> 9c9b592a5 Export number of tasks lost per dedicated role. When there are 100s of dedicated roles in a cluster the task_LOST_ metric is not enough. Introduce per dedicated role metric for easier diagnosis. Testing Done:

aurora git commit: Close AsyncHttpClient on scheduler shutdown.

2018-06-15 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 8383ed511 -> f9a47913a Close AsyncHttpClient on scheduler shutdown. Convert SlaManager into an AbstractIdleService and explicitly close the AsyncHttpClient on scheduler shutdown. Otherwise we run the rise of having a stuck scheduler JVM

aurora git commit: Export count-down to forceful Maintenace as a metric.

2018-06-19 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 9c9b592a5 -> 31404487d Export count-down to forceful Maintenace as a metric. Since the scheduler enforces a maximum timeout on each maintenance request and we now allow CoordinatorSlaPolicy to block maintenance, we need to know which

[3/4] aurora git commit: Enable `Tasks` to specify their own custom maintenance SLA.

2018-06-05 Thread santhk
http://git-wip-us.apache.org/repos/asf/aurora/blob/f2acf53f/src/main/java/org/apache/aurora/scheduler/state/MaintenanceController.java -- diff --git a/src/main/java/org/apache/aurora/scheduler/state/MaintenanceController.java

[2/4] aurora git commit: Enable `Tasks` to specify their own custom maintenance SLA.

2018-06-05 Thread santhk
http://git-wip-us.apache.org/repos/asf/aurora/blob/f2acf53f/src/test/java/org/apache/aurora/scheduler/sla/SlaManagerTest.java -- diff --git a/src/test/java/org/apache/aurora/scheduler/sla/SlaManagerTest.java

[4/4] aurora git commit: Enable `Tasks` to specify their own custom maintenance SLA.

2018-06-05 Thread santhk
Enable `Tasks` to specify their own custom maintenance SLA. `Tasks` can specify custom SLA requirements as part of their `TaskConfig`. One of the new features is the ability to specify an external coordinator that can ACK/NACK maintenance requests for tasks. This will be hugely beneficial for

[1/4] aurora git commit: Enable `Tasks` to specify their own custom maintenance SLA.

2018-06-05 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 34be63158 -> f2acf53ff http://git-wip-us.apache.org/repos/asf/aurora/blob/f2acf53f/src/test/python/apache/aurora/client/cli/test_kill.py -- diff --git

aurora git commit: Remove maintenance request after a host is drained.

2018-06-06 Thread santhk
Repository: aurora Updated Branches: refs/heads/master f2acf53ff -> f8a7676b2 Remove maintenance request after a host is drained. Delete the `HostMaintenaceRequest` once the host has been `DRAINED`. Testing Done: ./build-support/jenkins/build.sh

aurora git commit: Display negation of constraint in TaskConfigSummary.

2018-06-25 Thread santhk
Repository: aurora Updated Branches: refs/heads/master e3ba054eb -> 5e5bcbcbd Display negation of constraint in TaskConfigSummary. Testing Done: ./gradlew test Reviewed at https://reviews.apache.org/r/67734/ Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit:

aurora git commit: Fix style of TaskConfigSummary.

2018-06-22 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 8508aec36 -> e3ba054eb Fix style of TaskConfigSummary. Project: http://git-wip-us.apache.org/repos/asf/aurora/repo Commit: http://git-wip-us.apache.org/repos/asf/aurora/commit/e3ba054e Tree:

aurora git commit: Introduce a `countdown-ms` param in Coordinator request.

2018-06-20 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 31404487d -> 8508aec36 Introduce a `countdown-ms` param in Coordinator request. With the introduction of `timeoutSecs` for HostMaintenanceRequest and the `CoordinatorSlaPolicy`, it will be beneficial to expose the time remaining until

aurora git commit: Unhandled exception should not strand runner in STARTING state.

2018-07-18 Thread santhk
Repository: aurora Updated Branches: refs/heads/master efe865651 -> f054e9b10 Unhandled exception should not strand runner in STARTING state. If the ThermoTaskRunner encounters an Exception when trying to fork the process, it bubbles this up to the Executor which does not handle execptions

aurora git commit: Fix the json endpoints in thermos

2018-04-20 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 38aae0fdc -> 02a685117 Fix the json endpoints in thermos # Fixing the json endpoints in thermos `TaskObserverJSONBindings` is mixin that includes a few routes that serve info about tasks and processes in pure JSON format. The functions

aurora git commit: Add --pid-file flag to `aurora task ssh` to write the PID of the underlying SSH command to a specified file.

2018-04-20 Thread santhk
Repository: aurora Updated Branches: refs/heads/master ad0bc5f9d -> 38aae0fdc Add --pid-file flag to `aurora task ssh` to write the PID of the underlying SSH command to a specified file. My team has some scripts to start devel shards which create tunnels: ``` aurora task ssh -L 8002:http

aurora git commit: Introduce mesos disk collector

2018-03-26 Thread santhk
Repository: aurora Updated Branches: refs/heads/master 03eb33799 -> a3f8aef6b Introduce mesos disk collector When disk isolation is enabled in a Mesos agent it calculates the disk usage for each container. Thermos Observer also monitors disk usage using `twitter.common.dirutil`, essentially