mesos-site git commit: Updated the website built from mesos SHA: a771453.
Repository: mesos-site Updated Branches: refs/heads/asf-site 49c6b2933 -> 049098b13 Updated the website built from mesos SHA: a771453. Project: http://git-wip-us.apache.org/repos/asf/mesos-site/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos-site/commit/049098b1 Tree: http://git-wip-us.apache.org/repos/asf/mesos-site/tree/049098b1 Diff: http://git-wip-us.apache.org/repos/asf/mesos-site/diff/049098b1 Branch: refs/heads/asf-site Commit: 049098b1363eb65f02e6e87f378056e7d65ef270 Parents: 49c6b29 Author: jenkinsAuthored: Wed Feb 14 03:39:44 2018 + Committer: jenkins Committed: Wed Feb 14 03:39:44 2018 + -- content/blog/feed.xml | 2 +- content/blog/performance-working-group-progress-report/index.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/mesos-site/blob/049098b1/content/blog/feed.xml -- diff --git a/content/blog/feed.xml b/content/blog/feed.xml index e2402b8..59d4574 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -295,7 +295,7 @@ To learn more about CSI work in Mesos, you can dig into the design document /ul -pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#x6d;#97;#105;#108;#x74;#x6f;#x3a;#100;#x65;#x76;#64;#x61;#x70;#x61;#99;#104;#101;#x2e;#109;#101;#x73;#x6f;#115;#x2e;#x6f;#114;#x67;#100;#101;#x76;#x40;#x61;#112;#x61;#x63;#x68;#101;#x2e;#x6d;#x65;#115;#x6f;#115;#x2e;#111;#114;#103;/a./p +pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#109;#97;#x69;#x6c;#x74;#x6f;#x3a;#100;#101;#118;#64;#x61;#x70;#97;#x63;#x68;#101;#46;#109;#101;#115;#111;#x73;#46;#111;#x72;#103;#100;#101;#118;#x40;#97;#112;#97;#99;#104;#x65;#x2e;#109;#101;#115;#111;#x73;#x2e;#111;#x72;#103;/a./p http://git-wip-us.apache.org/repos/asf/mesos-site/blob/049098b1/content/blog/performance-working-group-progress-report/index.html -- diff --git a/content/blog/performance-working-group-progress-report/index.html b/content/blog/performance-working-group-progress-report/index.html index 1f3efa0..5b91130 100644 --- a/content/blog/performance-working-group-progress-report/index.html +++ b/content/blog/performance-working-group-progress-report/index.html @@ -248,7 +248,7 @@ -If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing . +If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing .
mesos git commit: Reaped the container process directly in Docker executor.
Repository: mesos Updated Branches: refs/heads/master 709d7a138 -> a7714536f Reaped the container process directly in Docker executor. Due to a Docker issue (https://github.com/moby/moby/issues/33820), Docker daemon can fail to catch a container exit, i.e., the container process has already exited but the command `docker ps` shows the container still running, this will lead to the "docker run" command that we execute in Docker executor never returning, and it will also cause the `docker stop` command takes no effect, i.e., it will return without error but `docker ps` shows the container still running, so the task will stuck in `TASK_KILLING` state. To workaround this Docker issue, in this patch we made Docker executor reaps the container process directly so Docker executor will be notified once the container process exits. Review: https://reviews.apache.org/r/65518 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/a7714536 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/a7714536 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/a7714536 Branch: refs/heads/master Commit: a7714536fad1140fd0c07c47e32b40e9ed00a3c3 Parents: 709d7a1 Author: Qian ZhangAuthored: Mon Feb 5 20:42:07 2018 +0800 Committer: Qian Zhang Committed: Wed Feb 14 11:12:01 2018 +0800 -- src/docker/executor.cpp | 60 1 file changed, 60 insertions(+) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/a7714536/src/docker/executor.cpp -- diff --git a/src/docker/executor.cpp b/src/docker/executor.cpp index e4c53d5..80e2d81 100644 --- a/src/docker/executor.cpp +++ b/src/docker/executor.cpp @@ -270,6 +270,47 @@ public: driver->sendStatusUpdate(status); } +// This is a workaround for the Docker issue below: +// https://github.com/moby/moby/issues/33820 +// Due to this issue, Docker daemon can fail to catch a container exit, +// which will lead to the `docker run` command that we execute in this +// executor never returning although the container has already exited. +// To workaround this issue, here we reap the container process directly +// so we will be notified when the container exits. +if (container.pid.isSome()) { + process::reap(container.pid.get()) +.then(defer(self(), [=](const Option& status) { + // We cannot get the actual exit status of the container + // process since it is not a child process of this executor, + // so here `status` must be `None`. + CHECK_NONE(status); + + // There will be a race between the method `reaped` and this + // lambda; ideally when the Docker issue mentioned above does + // not occur, `reaped` will be invoked (i.e., the `docker run` + // command returns) to get the actual exit status of the + // container, so here we wait a few seconds for `reaped` to be + // invoked. If `reaped` is not invoked within the timeout, that + // means we hit that Docker issue. + delay( + Seconds(3), + self(), + ::reapedContainer, + container.pid.get()); + + return Nothing(); +})); +} else { + // This is the case that the container process has already exited, + // Similar to the above case, let's wait a few seconds for `reaped` + // to be invoked. + delay( + Seconds(3), + self(), + ::reapedContainer, + None()); +} + return Nothing(); })); @@ -485,8 +526,27 @@ private: } } + void reapedContainer(Option pid) + { +// Do nothing if the method `reaped` has already been invoked. +if (terminated) { + return; +} + +// This means the Docker issue mentioned in `launchTask` occurs. +LOG(WARNING) << "The container process" + << (pid.isSome() ? " (pid: " + stringify(pid.get()) + ")" : "") + << " has exited, but Docker daemon failed to catch it."; + +reaped(None()); + } + void reaped(const Future
[1/2] mesos-site git commit: Updated the website built from mesos SHA: 709d7a1.
Repository: mesos-site Updated Branches: refs/heads/asf-site 3270b38c4 -> 49c6b2933 http://git-wip-us.apache.org/repos/asf/mesos-site/blob/49c6b293/content/sitemap.xml -- diff --git a/content/sitemap.xml b/content/sitemap.xml index 0367b23..e141d00 100644 --- a/content/sitemap.xml +++ b/content/sitemap.xml @@ -2,18078 +2,18078 @@ http://www.sitemaps.org/schemas/sitemap/0.9;> http://mesos.apache.org/api/latest/java/overview-tree.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/help-doc.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/constant-values.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/allclasses-frame.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/deprecated-list.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/allclasses-noframe.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.TaskState.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.RateLimit.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.CheckInfo.Http.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.SlaveInfo.CapabilityOrBuilder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.Volume.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.LinuxInfo.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.RLimitInfo.RLimit.Type.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.ResourceProviderInfo.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.ContainerInfoOrBuilder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.ParameterOrBuilder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.CgroupInfo.Blkio.Operation.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.CgroupInfo.Blkio.Throttling.Statistics.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.Flag.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.TimeInfo.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.RLimitInfo.RLimit.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.CgroupInfo.Blkio.CFQ.StatisticsOrBuilder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.TTYInfoOrBuilder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.Ports.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.CommandInfo.URI.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.Offer.Operation.DestroyVolume.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.UdpStatistics.Builder.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00 http://mesos.apache.org/api/latest/java/org/apache/mesos/Protos.Operation.html -2018-02-13T00:00:00+00:00 +2018-02-14T00:00:00+00:00
[2/2] mesos-site git commit: Updated the website built from mesos SHA: 709d7a1.
Updated the website built from mesos SHA: 709d7a1. Project: http://git-wip-us.apache.org/repos/asf/mesos-site/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos-site/commit/49c6b293 Tree: http://git-wip-us.apache.org/repos/asf/mesos-site/tree/49c6b293 Diff: http://git-wip-us.apache.org/repos/asf/mesos-site/diff/49c6b293 Branch: refs/heads/asf-site Commit: 49c6b2933178d83768115bc4dcb1a1af73fb9706 Parents: 3270b38 Author: jenkinsAuthored: Wed Feb 14 02:38:28 2018 + Committer: jenkins Committed: Wed Feb 14 02:38:28 2018 + -- content/blog/feed.xml |2 +- .../index.html |2 +- content/downloads/index.html|9 + content/sitemap.xml | 9038 +- 4 files changed, 4530 insertions(+), 4521 deletions(-) -- http://git-wip-us.apache.org/repos/asf/mesos-site/blob/49c6b293/content/blog/feed.xml -- diff --git a/content/blog/feed.xml b/content/blog/feed.xml index 7785736..e2402b8 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -295,7 +295,7 @@ To learn more about CSI work in Mesos, you can dig into the design document /ul -pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#x6d;#97;#105;#x6c;#x74;#x6f;#58;#x64;#x65;#x76;#x40;#97;#112;#x61;#x63;#104;#x65;#x2e;#109;#x65;#115;#x6f;#x73;#46;#111;#x72;#103;#100;#101;#118;#x40;#x61;#112;#x61;#99;#x68;#101;#46;#109;#101;#x73;#x6f;#115;#46;#x6f;#x72;#103;/a./p +pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#x6d;#97;#105;#108;#x74;#x6f;#x3a;#100;#x65;#x76;#64;#x61;#x70;#x61;#99;#104;#101;#x2e;#109;#101;#x73;#x6f;#115;#x2e;#x6f;#114;#x67;#100;#101;#x76;#x40;#x61;#112;#x61;#x63;#x68;#101;#x2e;#x6d;#x65;#115;#x6f;#115;#x2e;#111;#114;#103;/a./p http://git-wip-us.apache.org/repos/asf/mesos-site/blob/49c6b293/content/blog/performance-working-group-progress-report/index.html -- diff --git a/content/blog/performance-working-group-progress-report/index.html b/content/blog/performance-working-group-progress-report/index.html index f6cfd10..1f3efa0 100644 --- a/content/blog/performance-working-group-progress-report/index.html +++ b/content/blog/performance-working-group-progress-report/index.html @@ -248,7 +248,7 @@ -If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing . +If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing . http://git-wip-us.apache.org/repos/asf/mesos-site/blob/49c6b293/content/downloads/index.html -- diff --git a/content/downloads/index.html b/content/downloads/index.html index 9372875..5165b98 100644 --- a/content/downloads/index.html +++ b/content/downloads/index.html @@ -115,6 +115,15 @@ +http://archive.apache.org/dist/mesos/1.3.2/;> + 1.3.2 + +(https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12311242=12341260;> + Release Notes +) + + + http://archive.apache.org/dist/mesos/1.2.3/;> 1.2.3
mesos git commit: Added the version entry for Mesos 1.3.2 release.
Repository: mesos Updated Branches: refs/heads/master 7af86dd15 -> 709d7a138 Added the version entry for Mesos 1.3.2 release. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/709d7a13 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/709d7a13 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/709d7a13 Branch: refs/heads/master Commit: 709d7a138e1c64b2c30a9168f7c783efdd661e96 Parents: 7af86dd Author: Michael ParkAuthored: Tue Feb 13 18:13:31 2018 -0800 Committer: Michael Park Committed: Tue Feb 13 18:13:31 2018 -0800 -- site/data/releases.yml | 2 ++ 1 file changed, 2 insertions(+) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/709d7a13/site/data/releases.yml -- diff --git a/site/data/releases.yml b/site/data/releases.yml index 56fd0fc..c7259a2 100644 --- a/site/data/releases.yml +++ b/site/data/releases.yml @@ -160,6 +160,8 @@ versions: ## At here, 12335359 is the jira_version of 0.28.1. - version: 1.5.0 jira_version: 12341286 + - version: 1.3.2 +jira_version: 12341260 - version: 1.2.3 jira_version: 12341267 - version: 1.4.1
[2/2] mesos git commit: Renamed fetcher test to trigger the UNZIP filter.
Renamed fetcher test to trigger the UNZIP filter. Renamed the fetcher tests that depend on unzip(1) so that they will trigger the UNZIP test filter and automatically be disabled if unzip(1) is not present. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/3b48fd60 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/3b48fd60 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/3b48fd60 Branch: refs/heads/1.5.x Commit: 3b48fd6074883f50c0d7a37c25cb5a6af50f6418 Parents: 7760e6e Author: James PeachAuthored: Fri Dec 29 22:38:28 2017 -0800 Committer: Michael Park Committed: Tue Feb 13 13:45:06 2018 -0800 -- src/tests/fetcher_tests.cpp | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/3b48fd60/src/tests/fetcher_tests.cpp -- diff --git a/src/tests/fetcher_tests.cpp b/src/tests/fetcher_tests.cpp index bce59d4..1b4ba1d 100644 --- a/src/tests/fetcher_tests.cpp +++ b/src/tests/fetcher_tests.cpp @@ -826,7 +826,7 @@ TEST_F(FetcherTest, ExtractGzipFile) #endif // __WINDOWS__ -TEST_F(FetcherTest, Unzip_ExtractFile) +TEST_F(FetcherTest, UNZIP_ExtractFile) { // Construct a tmp file that can be fetched and archived with zip. string fromDir = path::join(os::getcwd(), "from"); @@ -878,7 +878,7 @@ TEST_F(FetcherTest, Unzip_ExtractFile) } -TEST_F(FetcherTest, Unzip_ExtractInvalidFile) +TEST_F(FetcherTest, UNZIP_ExtractInvalidFile) { // Construct a tmp file that can be filled with broken zip. string fromDir = path::join(os::getcwd(), "from"); @@ -950,7 +950,7 @@ TEST_F(FetcherTest, Unzip_ExtractInvalidFile) } -TEST_F(FetcherTest, Unzip_ExtractFileWithDuplicatedEntries) +TEST_F(FetcherTest, UNZIP_ExtractFileWithDuplicatedEntries) { // Construct a tmp file that can be filled with zip containing // duplicates.
[1/2] mesos git commit: Introduced `mesos-build` along with pre-built docker images.
Repository: mesos Updated Branches: refs/heads/1.5.x f6010e86f -> 3b48fd607 Introduced `mesos-build` along with pre-built docker images. The layout of `mesos-build` is similar to `mesos-tidy`. The `mesos-build.sh` will be the user-facing driver, and `buildbot.sh` invokes `mesos-build.sh` along with the clean-up (`docker rmi`) phase. The `mesos-build` directory contains docker files and a common `entrypoint.sh`. The docker images are built with all of the dependencies required, and the various testing configurations are set within `entrypoint.sh`. Review: https://reviews.apache.org/r/65464 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/7760e6e2 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/7760e6e2 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/7760e6e2 Branch: refs/heads/1.5.x Commit: 7760e6e235ccaa9cb0e8cc05f3c5277b42e80e56 Parents: f6010e8 Author: Michael ParkAuthored: Thu Feb 1 11:14:28 2018 -0800 Committer: Michael Park Committed: Tue Feb 13 13:44:41 2018 -0800 -- support/jenkins/buildbot.sh | 8 ++- support/mesos-build.sh | 45 + support/mesos-build/centos-7.dockerfile | 64 ++ support/mesos-build/enable-devtoolset-4.sh | 2 + support/mesos-build/entrypoint.sh | 83 support/mesos-build/ubuntu-16.04.dockerfile | 56 6 files changed, 257 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/7760e6e2/support/jenkins/buildbot.sh -- diff --git a/support/jenkins/buildbot.sh b/support/jenkins/buildbot.sh index dab4b72..745e404 100755 --- a/support/jenkins/buildbot.sh +++ b/support/jenkins/buildbot.sh @@ -21,4 +21,10 @@ set -o pipefail MESOS_DIR=$(git rev-parse --show-toplevel) -"${MESOS_DIR}"/support/docker-build.sh +function remove_image { + docker rmi $(docker images -q mesos/mesos-build) || true +} + +trap remove_image EXIT + +"${MESOS_DIR}"/support/mesos-build.sh http://git-wip-us.apache.org/repos/asf/mesos/blob/7760e6e2/support/mesos-build.sh -- diff --git a/support/mesos-build.sh b/support/mesos-build.sh new file mode 100755 index 000..d146cc1 --- /dev/null +++ b/support/mesos-build.sh @@ -0,0 +1,45 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at + +# http://www.apache.org/licenses/LICENSE-2.0 + +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +set -e +set -o pipefail + +: "${OS:?"Environment variable 'OS' must be set"}" +: "${BUILDTOOL:?"Environment variable 'BUILDTOOL' must be set"}" +: "${COMPILER:?"Environment variable 'COMPILER' must be set"}" +: "${CONFIGURATION:?"Environment variable 'CONFIGURATION' must be set"}" +: "${ENVIRONMENT:?"Environment variable 'ENVIRONMENT' must be set"}" +: "${JOBS:=$(nproc)}" + +MESOS_DIR=$(git rev-parse --show-toplevel) + +# Check for unstaged or uncommitted changes. +if ! $(git diff-index --quiet HEAD --); then + echo 'Please commit or stash any changes before running `mesos-build`.' + exit 1 +fi + +docker run \ + --rm \ + -v "${MESOS_DIR}":/SRC:Z \ + -e BUILDTOOL="${BUILDTOOL}" \ + -e COMPILER="${COMPILER}" \ + -e CONFIGURATION="${CONFIGURATION}" \ + -e ENVIRONMENT="${ENVIRONMENT}" \ + -e JOBS="${JOBS}" \ + "mesos/mesos-build:${OS//:/-}" http://git-wip-us.apache.org/repos/asf/mesos/blob/7760e6e2/support/mesos-build/centos-7.dockerfile -- diff --git a/support/mesos-build/centos-7.dockerfile b/support/mesos-build/centos-7.dockerfile new file mode 100644 index 000..acdb44d --- /dev/null +++ b/support/mesos-build/centos-7.dockerfile @@ -0,0 +1,64 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +#
[2/2] mesos git commit: Added MESOS-8577 to the 1.5.1 CHANGELOG.
Added MESOS-8577 to the 1.5.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/f6010e86 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/f6010e86 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/f6010e86 Branch: refs/heads/1.5.x Commit: f6010e86faa03a155bd073578ea2b5484d8d4aaf Parents: e5dc6da Author: Greg MannAuthored: Tue Feb 13 12:11:48 2018 -0800 Committer: Greg Mann Committed: Tue Feb 13 12:11:48 2018 -0800 -- CHANGELOG | 1 + 1 file changed, 1 insertion(+) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/f6010e86/CHANGELOG -- diff --git a/CHANGELOG b/CHANGELOG index db1f827..2e682be 100644 --- a/CHANGELOG +++ b/CHANGELOG @@ -8,6 +8,7 @@ Release Notes - Mesos - Version 1.5.1 (WIP) * [MESOS-8411] - Killing a queued task can lead to the command executor never terminating. * [MESOS-8510] - URI disk profile adaptor does not consider plugin type for a profile. * [MESOS-8552] - CGROUPS_ROOT_PidNamespaceForward and CGROUPS_ROOT_PidNamespaceBackward tests fail. + * [MESOS-8577] - Destroy nested container if `LAUNCH_NESTED_CONTAINER_SESSION` fails. Release Notes - Mesos - Version 1.5.0
[1/2] mesos git commit: Destroyed nested container on `attachContainerOutput` failure.
Repository: mesos Updated Branches: refs/heads/1.5.x 547f5ec9a -> f6010e86f Destroyed nested container on `attachContainerOutput` failure. After launching a container, the `LAUNCH_NESTED_CONTAINER_SESSION` handler calls into `attachContainerOutput()`. Previously, if `attachContainerOutput()` returned an HTTP response code other than 200, we didn't destroy the nested container. From the point of view of API users, if `LAUNCH_NESTED_CONTAINER_SESSION` returns an error, then no nested container should be left in the `RUNNING` state. This patch fixes this issue by destroying the nested container when HTTP errors are returned by this call to `attachContainerOutput()`. Review: https://reviews.apache.org/r/65637/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/e5dc6dab Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/e5dc6dab Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/e5dc6dab Branch: refs/heads/1.5.x Commit: e5dc6dabbe736ed0fa3005b61817364ae5f49eef Parents: 547f5ec Author: Andrei BudnikAuthored: Tue Feb 13 10:53:30 2018 -0800 Committer: Greg Mann Committed: Tue Feb 13 12:10:08 2018 -0800 -- src/slave/http.cpp | 5 + 1 file changed, 5 insertions(+) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/e5dc6dab/src/slave/http.cpp -- diff --git a/src/slave/http.cpp b/src/slave/http.cpp index 71e0bbb..a72050d 100644 --- a/src/slave/http.cpp +++ b/src/slave/http.cpp @@ -3558,6 +3558,11 @@ Future Http::launchNestedContainerSession( .then(defer(slave->self(), [=](const Response& response) -> Future { if (response.status != OK().status) { +LOG(WARNING) << "Failed to attach to nested container " + << containerId << ": '" << response.status << "' (" + << response.body << ")"; + +destroy(containerId); return response; }
mesos-site git commit: Updated the website built from mesos SHA: 7af86dd.
Repository: mesos-site Updated Branches: refs/heads/asf-site 902a5eeb8 -> 3270b38c4 Updated the website built from mesos SHA: 7af86dd. Project: http://git-wip-us.apache.org/repos/asf/mesos-site/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos-site/commit/3270b38c Tree: http://git-wip-us.apache.org/repos/asf/mesos-site/tree/3270b38c Diff: http://git-wip-us.apache.org/repos/asf/mesos-site/diff/3270b38c Branch: refs/heads/asf-site Commit: 3270b38c43da6166561972a27014b8588da158ab Parents: 902a5ee Author: jenkinsAuthored: Tue Feb 13 20:59:17 2018 + Committer: jenkins Committed: Tue Feb 13 20:59:17 2018 + -- content/blog/feed.xml | 2 +- content/blog/performance-working-group-progress-report/index.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/mesos-site/blob/3270b38c/content/blog/feed.xml -- diff --git a/content/blog/feed.xml b/content/blog/feed.xml index 0a0168b..7785736 100644 --- a/content/blog/feed.xml +++ b/content/blog/feed.xml @@ -295,7 +295,7 @@ To learn more about CSI work in Mesos, you can dig into the design document /ul -pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#109;#97;#x69;#x6c;#x74;#111;#x3a;#100;#x65;#118;#x40;#x61;#x70;#x61;#99;#104;#x65;#x2e;#109;#101;#x73;#x6f;#x73;#46;#111;#x72;#x67;#100;#101;#x76;#x40;#97;#x70;#x61;#x63;#104;#x65;#x2e;#109;#x65;#x73;#x6f;#115;#46;#111;#114;#x67;/a./p +pIf you are a user and would like to suggest some areas for performance improvement, please let us know by emailing a href=#x6d;#97;#105;#x6c;#x74;#x6f;#58;#x64;#x65;#x76;#x40;#97;#112;#x61;#x63;#104;#x65;#x2e;#109;#x65;#115;#x6f;#x73;#46;#111;#x72;#103;#100;#101;#118;#x40;#x61;#112;#x61;#99;#x68;#101;#46;#109;#101;#x73;#x6f;#115;#46;#x6f;#x72;#103;/a./p http://git-wip-us.apache.org/repos/asf/mesos-site/blob/3270b38c/content/blog/performance-working-group-progress-report/index.html -- diff --git a/content/blog/performance-working-group-progress-report/index.html b/content/blog/performance-working-group-progress-report/index.html index 2b9fc2f..f6cfd10 100644 --- a/content/blog/performance-working-group-progress-report/index.html +++ b/content/blog/performance-working-group-progress-report/index.html @@ -248,7 +248,7 @@ -If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing . +If you are a user and would like to suggest some areas for performance improvement, please let us know by emailing .
mesos git commit: Destroyed nested container on `attachContainerOutput` failure.
Repository: mesos Updated Branches: refs/heads/master bc6b61bca -> 7af86dd15 Destroyed nested container on `attachContainerOutput` failure. After launching a container, the `LAUNCH_NESTED_CONTAINER_SESSION` handler calls into `attachContainerOutput()`. Previously, if `attachContainerOutput()` returned an HTTP response code other than 200, we didn't destroy the nested container. From the point of view of API users, if `LAUNCH_NESTED_CONTAINER_SESSION` returns an error, then no nested container should be left in the `RUNNING` state. This patch fixes this issue by destroying the nested container when HTTP errors are returned by this call to `attachContainerOutput()`. Review: https://reviews.apache.org/r/65637/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/7af86dd1 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/7af86dd1 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/7af86dd1 Branch: refs/heads/master Commit: 7af86dd1569d0ea3fe75f92bcc9b826a46c5968d Parents: bc6b61b Author: Andrei BudnikAuthored: Tue Feb 13 10:53:30 2018 -0800 Committer: Greg Mann Committed: Tue Feb 13 11:57:15 2018 -0800 -- src/slave/http.cpp | 5 + 1 file changed, 5 insertions(+) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/7af86dd1/src/slave/http.cpp -- diff --git a/src/slave/http.cpp b/src/slave/http.cpp index 77e711c..59eef7a 100644 --- a/src/slave/http.cpp +++ b/src/slave/http.cpp @@ -3548,6 +3548,11 @@ Future Http::launchNestedContainerSession( .then(defer(slave->self(), [=](const Response& response) -> Future { if (response.status != OK().status) { +LOG(WARNING) << "Failed to attach to nested container " + << containerId << ": '" << response.status << "' (" + << response.body << ")"; + +destroy(containerId); return response; }
mesos git commit: Introduced `mesos-build` along with pre-built docker images.
Repository: mesos Updated Branches: refs/heads/1.4.x d43478579 -> e41742037 Introduced `mesos-build` along with pre-built docker images. The layout of `mesos-build` is similar to `mesos-tidy`. The `mesos-build.sh` will be the user-facing driver, and `buildbot.sh` invokes `mesos-build.sh` along with the clean-up (`docker rmi`) phase. The `mesos-build` directory contains docker files and a common `entrypoint.sh`. The docker images are built with all of the dependencies required, and the various testing configurations are set within `entrypoint.sh`. Review: https://reviews.apache.org/r/65464 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/e4174203 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/e4174203 Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/e4174203 Branch: refs/heads/1.4.x Commit: e41742037d5807ba436a77b0b38c26160c94d7fc Parents: d434785 Author: Michael ParkAuthored: Thu Feb 1 11:14:28 2018 -0800 Committer: Michael Park Committed: Tue Feb 13 01:30:01 2018 -0800 -- support/jenkins/buildbot.sh | 8 ++- support/mesos-build.sh | 45 + support/mesos-build/centos-7.dockerfile | 64 ++ support/mesos-build/enable-devtoolset-4.sh | 2 + support/mesos-build/entrypoint.sh | 83 support/mesos-build/ubuntu-16.04.dockerfile | 56 6 files changed, 257 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/e4174203/support/jenkins/buildbot.sh -- diff --git a/support/jenkins/buildbot.sh b/support/jenkins/buildbot.sh index dab4b72..745e404 100755 --- a/support/jenkins/buildbot.sh +++ b/support/jenkins/buildbot.sh @@ -21,4 +21,10 @@ set -o pipefail MESOS_DIR=$(git rev-parse --show-toplevel) -"${MESOS_DIR}"/support/docker-build.sh +function remove_image { + docker rmi $(docker images -q mesos/mesos-build) || true +} + +trap remove_image EXIT + +"${MESOS_DIR}"/support/mesos-build.sh http://git-wip-us.apache.org/repos/asf/mesos/blob/e4174203/support/mesos-build.sh -- diff --git a/support/mesos-build.sh b/support/mesos-build.sh new file mode 100755 index 000..d146cc1 --- /dev/null +++ b/support/mesos-build.sh @@ -0,0 +1,45 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at + +# http://www.apache.org/licenses/LICENSE-2.0 + +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +set -e +set -o pipefail + +: "${OS:?"Environment variable 'OS' must be set"}" +: "${BUILDTOOL:?"Environment variable 'BUILDTOOL' must be set"}" +: "${COMPILER:?"Environment variable 'COMPILER' must be set"}" +: "${CONFIGURATION:?"Environment variable 'CONFIGURATION' must be set"}" +: "${ENVIRONMENT:?"Environment variable 'ENVIRONMENT' must be set"}" +: "${JOBS:=$(nproc)}" + +MESOS_DIR=$(git rev-parse --show-toplevel) + +# Check for unstaged or uncommitted changes. +if ! $(git diff-index --quiet HEAD --); then + echo 'Please commit or stash any changes before running `mesos-build`.' + exit 1 +fi + +docker run \ + --rm \ + -v "${MESOS_DIR}":/SRC:Z \ + -e BUILDTOOL="${BUILDTOOL}" \ + -e COMPILER="${COMPILER}" \ + -e CONFIGURATION="${CONFIGURATION}" \ + -e ENVIRONMENT="${ENVIRONMENT}" \ + -e JOBS="${JOBS}" \ + "mesos/mesos-build:${OS//:/-}" http://git-wip-us.apache.org/repos/asf/mesos/blob/e4174203/support/mesos-build/centos-7.dockerfile -- diff --git a/support/mesos-build/centos-7.dockerfile b/support/mesos-build/centos-7.dockerfile new file mode 100644 index 000..acdb44d --- /dev/null +++ b/support/mesos-build/centos-7.dockerfile @@ -0,0 +1,64 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +#
mesos git commit: Introduced `mesos-build` along with pre-built docker images.
Repository: mesos Updated Branches: refs/heads/1.3.x 522896273 -> 699f80dc3 Introduced `mesos-build` along with pre-built docker images. The layout of `mesos-build` is similar to `mesos-tidy`. The `mesos-build.sh` will be the user-facing driver, and `buildbot.sh` invokes `mesos-build.sh` along with the clean-up (`docker rmi`) phase. The `mesos-build` directory contains docker files and a common `entrypoint.sh`. The docker images are built with all of the dependencies required, and the various testing configurations are set within `entrypoint.sh`. Review: https://reviews.apache.org/r/65464 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/699f80dc Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/699f80dc Diff: http://git-wip-us.apache.org/repos/asf/mesos/diff/699f80dc Branch: refs/heads/1.3.x Commit: 699f80dc31d2ac1fe1ac8da3a751a761c85e679f Parents: 5228962 Author: Michael ParkAuthored: Thu Feb 1 11:14:28 2018 -0800 Committer: Michael Park Committed: Mon Feb 12 17:23:54 2018 -0800 -- support/jenkins/buildbot.sh | 8 ++- support/mesos-build.sh | 45 + support/mesos-build/centos-7.dockerfile | 64 ++ support/mesos-build/enable-devtoolset-4.sh | 2 + support/mesos-build/entrypoint.sh | 83 support/mesos-build/ubuntu-16.04.dockerfile | 56 6 files changed, 257 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/mesos/blob/699f80dc/support/jenkins/buildbot.sh -- diff --git a/support/jenkins/buildbot.sh b/support/jenkins/buildbot.sh index dab4b72..745e404 100755 --- a/support/jenkins/buildbot.sh +++ b/support/jenkins/buildbot.sh @@ -21,4 +21,10 @@ set -o pipefail MESOS_DIR=$(git rev-parse --show-toplevel) -"${MESOS_DIR}"/support/docker-build.sh +function remove_image { + docker rmi $(docker images -q mesos/mesos-build) || true +} + +trap remove_image EXIT + +"${MESOS_DIR}"/support/mesos-build.sh http://git-wip-us.apache.org/repos/asf/mesos/blob/699f80dc/support/mesos-build.sh -- diff --git a/support/mesos-build.sh b/support/mesos-build.sh new file mode 100755 index 000..d146cc1 --- /dev/null +++ b/support/mesos-build.sh @@ -0,0 +1,45 @@ +#!/usr/bin/env bash + +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at + +# http://www.apache.org/licenses/LICENSE-2.0 + +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +set -e +set -o pipefail + +: "${OS:?"Environment variable 'OS' must be set"}" +: "${BUILDTOOL:?"Environment variable 'BUILDTOOL' must be set"}" +: "${COMPILER:?"Environment variable 'COMPILER' must be set"}" +: "${CONFIGURATION:?"Environment variable 'CONFIGURATION' must be set"}" +: "${ENVIRONMENT:?"Environment variable 'ENVIRONMENT' must be set"}" +: "${JOBS:=$(nproc)}" + +MESOS_DIR=$(git rev-parse --show-toplevel) + +# Check for unstaged or uncommitted changes. +if ! $(git diff-index --quiet HEAD --); then + echo 'Please commit or stash any changes before running `mesos-build`.' + exit 1 +fi + +docker run \ + --rm \ + -v "${MESOS_DIR}":/SRC:Z \ + -e BUILDTOOL="${BUILDTOOL}" \ + -e COMPILER="${COMPILER}" \ + -e CONFIGURATION="${CONFIGURATION}" \ + -e ENVIRONMENT="${ENVIRONMENT}" \ + -e JOBS="${JOBS}" \ + "mesos/mesos-build:${OS//:/-}" http://git-wip-us.apache.org/repos/asf/mesos/blob/699f80dc/support/mesos-build/centos-7.dockerfile -- diff --git a/support/mesos-build/centos-7.dockerfile b/support/mesos-build/centos-7.dockerfile new file mode 100644 index 000..acdb44d --- /dev/null +++ b/support/mesos-build/centos-7.dockerfile @@ -0,0 +1,64 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +#