[2/2] mesos git commit: Fixed synchronization orders for destructing mock resource providers.

2018-05-04 Thread chhsiao
Fixed synchronization orders for destructing mock resource providers. Review: https://reviews.apache.org/r/66966 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/895f539b Tree:

mesos git commit: Added more logging to agent recovery path.

2018-05-04 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master e54a75229 -> e048e898e Added more logging to agent recovery path. Added logging in some agent recovery continuations to make analyzing agent recovery related issue less painful. Review: https://reviews.apache.org/r/66749/ Project:

mesos git commit: Documented the changes in the agent flags and modules.

2018-05-04 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 895f539b1 -> 7ed073e48 Documented the changes in the agent flags and modules. Review: https://reviews.apache.org/r/66940/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[5/6] mesos git commit: Removed the OpenSSL dependency for building gRPC in Mesos.

2018-05-09 Thread chhsiao
Removed the OpenSSL dependency for building gRPC in Mesos. When the SSL build feature is disabled, Mesos now builds `libgrpc_unsecure` and `libgrpc++_unsecure` instead of `libgrpc` and `libgrpc++`, so the SSL headers and libraries are no longer required. Review:

[6/6] mesos git commit: Fixed the link order for gRPC in CMake.

2018-05-09 Thread chhsiao
(ENABLE_GRPC) add_dependencies(libgrpc++ ${GRPC_TARGET}) add_library(grpc INTERFACE) - target_link_libraries(grpc INTERFACE libgpr libgrpc libgrpc++) + target_link_libraries(grpc INTERFACE libgrpc++ libgrpc libgpr) # TODO(chhsiao): Move grpc so these don't have to be GLOBAL. add_executable(grp

[2/6] mesos git commit: Removed the OpenSSL dependency for building gRPC in libprocess.

2018-05-09 Thread chhsiao
Removed the OpenSSL dependency for building gRPC in libprocess. When the SSL build feature is disabled, libprocess now builds `libgrpc_unsecure` and `libgrpc++_unsecure` instead of `libgrpc` and `libgrpc++`, so the SSL headers and libraries are no longer required. Review:

[3/6] mesos git commit: Removed unnecessary gRPC build flags in Mesos.

2018-05-09 Thread chhsiao
Removed unnecessary gRPC build flags in Mesos. The `-Wno-deprecated-declarations` and `-Wno-unused-function` flags are no longer required to build the bundled gRPC 1.10.0. Review: https://reviews.apache.org/r/67017 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[1/6] mesos git commit: Renamed `GRPC_UNSECURE` to `GRPC_VARIANT` in CMake.

2018-05-09 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 6cf942a3e -> b863f6c78 Renamed `GRPC_UNSECURE` to `GRPC_VARIANT` in CMake. Review: https://reviews.apache.org/r/67024 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[4/6] mesos git commit: Removed unnecessary gRPC build flags in libprocess.

2018-05-09 Thread chhsiao
Removed unnecessary gRPC build flags in libprocess. The `-Wno-deprecated-declarations` and `-Wno-unused-function` flags are no longer required to build the bundled gRPC 1.10.0. Review: https://reviews.apache.org/r/67018 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

mesos git commit: Added MESOS-8906 to the 1.5.2 CHANGELOG.

2018-05-11 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master b5abba4cd -> e181f26b6 Added MESOS-8906 to the 1.5.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/e181f26b Tree:

[1/2] mesos git commit: Made `UriDiskProfileAdaptor` be able to update profile selectors.

2018-05-11 Thread chhsiao
Process::notify( return; } - // Profiles can only be added, so if the parsed data is the same size, - // nothing has changed and no notifications need to be sent. - if (parsed.profile_matrix().size() <= profileMatrix.size()) { -return; - } + // TODO(chhsiao): No need to update the profi

[2/2] mesos git commit: Added MESOS-8906 to the 1.5.2 CHANGELOG.

2018-05-11 Thread chhsiao
Added MESOS-8906 to the 1.5.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/0f426a7a Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/0f426a7a Diff:

mesos git commit: Made `UriDiskProfileAdaptor` be able to update profile selectors.

2018-05-11 Thread chhsiao
+278,8 @@ void UriDiskProfileAdaptorProcess::notify( return; } - // Profiles can only be added, so if the parsed data is the same size, - // nothing has changed and no notifications need to be sent. - if (parsed.profile_matrix().size() <= profileMatrix.size()) { -return; - }

mesos git commit: Added MESOS-8906 to the 1.6.0 CHANGELOG.

2018-05-11 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/1.6.x 89ee7df74 -> 2abd8ee3f Added MESOS-8906 to the 1.6.0 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/2abd8ee3 Tree:

mesos git commit: Removed an unnecessary blank line in the 1.6.1 CHANGELOG.

2018-05-11 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/1.6.x 2abd8ee3f -> d306e9334 Removed an unnecessary blank line in the 1.6.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/d306e933 Tree:

mesos git commit: Added MESOS-8906 to the 1.6.1 CHANGELOG.

2018-05-11 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 5e740063d -> b5abba4cd Added MESOS-8906 to the 1.6.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/b5abba4c Tree:

mesos git commit: Made `UriDiskProfileAdaptor` be able to update profile selectors.

2018-05-11 Thread chhsiao
-278,11 +278,8 @@ void UriDiskProfileAdaptorProcess::notify( return; } - // Profiles can only be added, so if the parsed data is the same size, - // nothing has changed and no notifications need to be sent. - if (parsed.profile_matrix().size() <= profileMatrix.size()) { -return; - }

[5/6] mesos git commit: Renamed `grpc::Channel` to `grpc::client::Connection`.

2018-05-23 Thread chhsiao
ddress.get()) + : client::Connection(server->InProcessChannel(ChannelArguments())); } Try shutdown() @@ -104,7 +103,7 @@ class GRPCClientTest : public TemporaryDirectoryTest { protected: // TODO(chhsiao): Consider removing this once we have a way to get a - // channel before the server star

[6/6] mesos git commit: Replaced `RpcResult` with `Try<Response, StatusError>`.

2018-05-23 Thread chhsiao
he runtime // is shut down before the server responds. TEST_F(GRPCClientTest, ClientShutdown) { @@ -317,7 +318,7 @@ TEST_F(GRPCClientTest, ClientShutdown) client::Runtime runtime; - Future<RpcResult> pong = + Future<Try<Pong, StatusError>> pong = runtime.call(ch

[4/6] mesos git commit: Supported custom error types for the `Future(Try<...>)` constructor.

2018-05-23 Thread chhsiao
ure(const Try<Future, E>& t); ~Future() = default; @@ -1116,23 +1119,27 @@ Future::Future(const ErrnoFailure& failure) template -Future::Future(const Try& t) +template +Future::Future(const Try<T, E>& t) : data(new Data()) { if (t.isSome()){ set(t.ge

[1/6] mesos git commit: Updated the CSI client to use the new libprocess gRPC interface.

2018-05-23 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 21305ab47 -> 3d2a1fd49 Updated the CSI client to use the new libprocess gRPC interface. This patch makes the following changes: 1. Replace `GRPC_RPC` with `GRPC_CLIENT_METHOD`. 2. Replace `process::grpc::Channel` with

[3/6] mesos git commit: Overloaded `stringify` for `Error`s to reduce overheads.

2018-05-23 Thread chhsiao
tringify(const hashmap<K, V>& map) return out.str(); } + +// TODO(chhsiao): This overload returns a non-const rvalue for consistency. +// Consider the following overloads instead for better performance: +// const std::string& stringify(const Error&); +// std::strin

[2/6] mesos git commit: Renamed `GRPC_RPC` and adapted the new gRPC async API.

2018-05-23 Thread chhsiao
ime.call(channel, GRPC_RPC(PingPong, Send), Ping()); +runtime.call(channel, GRPC_CLIENT_METHOD(PingPong, Send), Ping()); runtime.terminate(); AWAIT_ASSERT_READY(runtime.wait()); @@ -381,7 +381,7 @@ TEST_F(GRPCClientTest, ServerTimeout) client::Runtime runtime; Future<Try<Pong, St

[2/2] mesos git commit: Refactored the gRPC client runtime wrapper in libprocess.

2018-06-08 Thread chhsiao
ynchronized (data->lock) { - if (data->terminating) { -return Failure("Runtime has been terminated."); - } - - std::shared_ptr<::grpc::ClientContext> context( - new ::grpc::ClientContext()); - - // TODO(chhsiao): Allow the caller to specify

[1/2] mesos git commit: Used move constructors for making CSI gRPC calls.

2018-06-08 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 4bfe2dbab -> e0a77d826 Used move constructors for making CSI gRPC calls. This patch takes the advantages of the moving constructors of the CSI request protobuf messages to avoid copying the messages. Review:

mesos git commit: Fixed the flakiness in the `NVIDIA_GPU_NvidiaDockerImage` test.

2018-06-15 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 594ddb30c -> 9da882d4d Fixed the flakiness in the `NVIDIA_GPU_NvidiaDockerImage` test. This test is flaky because it tries to download the 1GB 'nvidia/cuda' image from Docker Hub, which might take more than 1 minute and cause the command

mesos git commit: Made `NoopResourceEstimator` return a forever-pending future.

2018-06-12 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master f1c0377a9 -> 8d2cebe5e Made `NoopResourceEstimator` return a forever-pending future. There is no need for the noop resource estimator to return a ready future of empty resource since it is only activated when the user does not want to use

[02/12] mesos git commit: Added tests of resource provider registrar recovery.

2018-05-31 Thread chhsiao
Added tests of resource provider registrar recovery. Review: https://reviews.apache.org/r/67009/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/9c8eee35 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/9c8eee35 Diff:

[05/12] mesos git commit: Added a unit test for SLRP operation state metrics.

2018-05-31 Thread chhsiao
ot.values.at(metricName( + "csi_controller_plugin_terminations"))); + ASSERT_NE(0u, snapshot.values.count(metricName( + "csi_node_plugin_terminations"))); + EXPECT_EQ(1, snapshot.values.at(metricName( + "csi_node_plugin_terminations"))); +} + + +// This t

[09/12] mesos git commit: Added per-CSI-call RPC metrics for SLRP.

2018-05-31 Thread chhsiao
client) { csi::v0::DeleteVolumeRequest request; request.set_volume_id(volumeId); -return client.DeleteVolume(request) +return call(client, std::move(request)) .then([] { return Nothing(); }); })); } @@ -2681,7 +2719,8 @@ Future St

[11/12] mesos git commit: Moved the "Resource Provider" section to `resource-provider.md`.

2018-05-31 Thread chhsiao
Moved the "Resource Provider" section to `resource-provider.md`. The concept of resource providers should have a documentation file separated from `csi.md`. This patch moves the "Resource Provider" section from `csi.md` to `resource-provider.md` as a start, and also for preventing dangling links

[03/12] mesos git commit: Added a unit test for CSI plugin RPC metrics.

2018-05-31 Thread chhsiao
(StorageLocalResourceProviderTest, ROOT_OperationStateMetrics) } +// This test verifies that storage local resource provider properly +// reports metrics related to RPCs to CSI plugins. +// TODO(chhsiao): Currently there is no way to test the `pending` and +// `cancelled` metrics for RPCs since

[06/12] mesos git commit: Combined and renamed `csi_*_plugin_terminations` metrics.

2018-05-31 Thread chhsiao
Combined and renamed `csi_*_plugin_terminations` metrics. To avoid double counting when the operator aggregates the `csi_controller_plugin_terminations` and `csi_node_plugin_terminations`, these two are now merged into `csi_plugin/container_terminations`. Review:

[01/12] mesos git commit: Added operation state metrics in SLRP.

2018-05-31 Thread chhsiao
TE_VOLUME: + operationTypes.push_back(Offer::Operation::CREATE_VOLUME); +case Offer::Operation::DESTROY_VOLUME: + operationTypes.push_back(Offer::Operation::DESTROY_VOLUME); +case Offer::Operation::CREATE_BLOCK: + operationTypes.push_back(Offer::Operation::CREATE_BLOCK); +

[10/12] mesos git commit: Fixed flakiness for some `AgentResourceProviderConfigApiTest` tests.

2018-05-31 Thread chhsiao
Fixed flakiness for some `AgentResourceProviderConfigApiTest` tests. The `ROOT_Add`, `ROOT_Update` and `ROOT_Remove` tests mistakenly use `WillOnce` to declient unwanted offers. This patch changes them to `WillRepeatedly`. Review: https://reviews.apache.org/r/67258 Project:

[08/12] mesos git commit: Added documentation for resource provider and CSI plugin metrics.

2018-05-31 Thread chhsiao
Added documentation for resource provider and CSI plugin metrics. Review: https://reviews.apache.org/r/67303 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/db075fc6 Tree:

[07/12] mesos git commit: Added the `RPC` enum and `RPCTraits` helper.

2018-05-31 Thread chhsiao
Added the `RPC` enum and `RPCTraits` helper. To make it easy to enumerate all types of CSI RPC calls, the `RPC` enum is introduced. The `RPCTraits` helper class can be used to determine the request and response type of a particular RPC. Review: https://reviews.apache.org/r/67375 Project:

[12/12] mesos git commit: Used italic fonts to denote placeholdes in metrics.

2018-05-31 Thread chhsiao
Used italic fonts to denote placeholdes in metrics. Review: https://reviews.apache.org/r/67328 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/318aca91 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/318aca91 Diff:

[04/12] mesos git commit: Fixed filters in test `ROOT_ReconcileDroppedOperation` for consistency.

2018-05-31 Thread chhsiao
Fixed filters in test `ROOT_ReconcileDroppedOperation` for consistency. Review: https://reviews.apache.org/r/67257 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/261fcca2 Tree:

[3/3] mesos git commit: Added MESOS-8830 to the 1.4.2 CHANGELOG.

2018-07-02 Thread chhsiao
Added MESOS-8830 to the 1.4.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/2fc1f5b1 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/2fc1f5b1 Diff:

[1/3] mesos git commit: Added MESOS-8830 to the 1.5.2 CHANGELOG.

2018-07-02 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 173212549 -> 2fc1f5b10 Added MESOS-8830 to the 1.5.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/925c35a6 Tree:

[2/3] mesos git commit: Added MESOS-8830 to the 1.6.1 CHANGELOG.

2018-07-02 Thread chhsiao
Added MESOS-8830 to the 1.6.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/5cce5d47 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/5cce5d47 Diff:

[1/4] mesos git commit: Added MESOS-8830 to the 1.5.2 CHANGELOG.

2018-07-02 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/1.5.x c25ff6494 -> f541ec0ff Added MESOS-8830 to the 1.5.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/f541ec0f Tree:

[3/4] mesos git commit: Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior.

2018-07-02 Thread chhsiao
Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior. The current `ROOT_BusyMountPoint` test would fail because we added support for unmounting dangling mount points in directory to gc. This patch rewrote this test to reflect that after unmounting, the gc succeeded, directory was

[2/4] mesos git commit: Skipped metric for non existing paths in gc.

2018-07-02 Thread chhsiao
Skipped metric for non existing paths in gc. Previously, agent gc would increment the "failed" counter if the path does not exist, but this should not be an issue. This patch skipped such paths in both "failed" and "succeeded" counters. Review: https://reviews.apache.org/r/67423 Project:

[2/3] mesos git commit: Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior.

2018-07-02 Thread chhsiao
Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior. The current `ROOT_BusyMountPoint` test would fail because we added support for unmounting dangling mount points in directory to gc. This patch rewrote this test to reflect that after unmounting, the gc succeeded, directory was

[3/3] mesos git commit: Unmounted any mount points in gc paths.

2018-07-02 Thread chhsiao
Unmounted any mount points in gc paths. In various corner cases, agent may not get chance to properly unmount persistent volumes mounted inside an executor's sandbox. When GC later gets to these sandbox directories, permanent data loss can happen (see MESOS-8830). Currently, the only mounts in

[1/3] mesos git commit: Added MESOS-8830 to the 1.4.2 CHANGELOG.

2018-07-02 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/1.4.x c35e06b58 -> e7b117e0d Added MESOS-8830 to the 1.4.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/e7b117e0 Tree:

[4/4] mesos git commit: Unmounted any mount points in gc paths.

2018-07-02 Thread chhsiao
Unmounted any mount points in gc paths. In various corner cases, agent may not get chance to properly unmount persistent volumes mounted inside an executor's sandbox. When GC later gets to these sandbox directories, permanent data loss can happen (see MESOS-8830). Currently, the only mounts in

[3/4] mesos git commit: Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior.

2018-07-02 Thread chhsiao
Rewrote the `ROOT_BusyMountPoint` test to reflect updated behavior. The current `ROOT_BusyMountPoint` test would fail because we added support for unmounting dangling mount points in directory to gc. This patch rewrote this test to reflect that after unmounting, the gc succeeded, directory was

[1/4] mesos git commit: Added MESOS-8830 to the 1.6.1 CHANGELOG.

2018-07-02 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/1.6.x 131d88788 -> ccc1c128d Added MESOS-8830 to the 1.6.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/ccc1c128 Tree:

[2/4] mesos git commit: Skipped metric for non existing paths in gc.

2018-07-02 Thread chhsiao
Skipped metric for non existing paths in gc. Previously, agent gc would increment the "failed" counter if the path does not exist, but this should not be an issue. This patch skipped such paths in both "failed" and "succeeded" counters. Review: https://reviews.apache.org/r/67423 Project:

[4/4] mesos git commit: Unmounted any mount points in gc paths.

2018-07-02 Thread chhsiao
Unmounted any mount points in gc paths. In various corner cases, agent may not get chance to properly unmount persistent volumes mounted inside an executor's sandbox. When GC later gets to these sandbox directories, permanent data loss can happen (see MESOS-8830). Currently, the only mounts in

[2/2] mesos git commit: Added comments and made some renaming in SLRP.

2018-04-30 Thread chhsiao
Added comments and made some renaming in SLRP. Review: https://reviews.apache.org/r/65974/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/fd49c4a9 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/fd49c4a9 Diff:

[1/2] mesos git commit: Checkpointed profiles in storage local resource provider.

2018-04-30 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master f4345c1f1 -> 7b768a912 Checkpointed profiles in storage local resource provider. SLRP now checkpoints profiles associated with storage pools, and does not depend on the `DiskProfileAdaptor` module to return the set of previously-known

[9/9] mesos git commit: Removed redundant master flags in resource provider tests.

2018-05-01 Thread chhsiao
Removed redundant master flags in resource provider tests. Review: https://reviews.apache.org/r/66780/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/d4a903a4 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/d4a903a4

[5/9] mesos git commit: Set up recovery code paths of resource provider manager.

2018-05-01 Thread chhsiao
Set up recovery code paths of resource provider manager. This patch adjusts the control flow of the resource provider manager so that we can in the future make use of persisted resource provider information. While this patch sets up the needed flow, it does not implement recovery logic, yet.

[7/9] mesos git commit: Added admitted resource providers to the manager's registry.

2018-05-01 Thread chhsiao
strar->apply(Owned( + new AdmitResourceProvider(resourceProvider->info.id(; } else { // TODO(chhsiao): The resource provider is resubscribing after being // restarted or an agent failover. The 'ResourceProviderInfo' might // have been updated, but its type and name should remai

[2/9] mesos git commit: Externalized creation of resource provider manager backing storage.

2018-05-01 Thread chhsiao
Externalized creation of resource provider manager backing storage. This patch changes the way the storage backing an agent's resource provider registrar is created: while before we created it implicitly when constructing the registrar, we now consume storage passed on construction. Being able

[8/9] mesos git commit: Prevent resubscription of resource providers with unknown IDs.

2018-05-01 Thread chhsiao
Prevent resubscription of resource providers with unknown IDs. This patch adds a check to the resource provider manager's subscribe functionality making sure that any ID sent by a resubscribing resource provider corresponds to some previously known resource provider. This not only serves as

[4/9] mesos git commit: Passed on registrar when constructing resource provider manager.

2018-05-01 Thread chhsiao
Passed on registrar when constructing resource provider manager. In order to support recovering resource provider manager information in the future, we need to adjust the construction of the manager to be able to consume a registrar. This patch lays the groundwork by adjusting interfaces and

[3/9] mesos git commit: Renamed resource provider `AgentRegistrar` to `GenericRegistrar`.

2018-05-01 Thread chhsiao
Renamed resource provider `AgentRegistrar` to `GenericRegistrar`. This registrar and its matching process can work on generic storage and it is currently used to work on an agent's persist store. Its name should not be tied to the agent, so we rename the registrar in this patch. Review:

[1/3] mesos git commit: Documented the changes in gRPC and CSI supports.

2018-05-03 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master c12430c8b -> 2402f99ca Documented the changes in gRPC and CSI supports. Review: https://reviews.apache.org/r/66893/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[3/3] mesos git commit: Updated `csi.md`.

2018-05-03 Thread chhsiao
Updated `csi.md`. Review: https://reviews.apache.org/r/66896/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/2402f99c Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/2402f99c Diff:

[01/13] mesos git commit: Ensured that agent does not delete volume upon grow or shrink.

2018-05-03 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 2402f99ca -> a483fb0d0 Ensured that agent does not delete volume upon grow or shrink. Previously, `slave::syncCheckpointedResources` implementation will delete a persistent volume using `Resources::contains` check, which could cause a

[13/13] mesos git commit: Improved tests for resizing persistent volumes.

2018-05-03 Thread chhsiao
Improved tests for resizing persistent volumes. Now the `GrowVolume` and `ShrinkVolume` tests launch tasks after resizing the volumes to ensure that the operations take effect on agents. The `NonSpeculativeGrowAndLaunch` and `NonSpeculativeShrinkAndLaunch` tests launch an additional task to

[03/13] mesos git commit: Added a new `RESIZE_VOLUME` agent capability.

2018-05-03 Thread chhsiao
Added a new `RESIZE_VOLUME` agent capability. This will be used as a feature flag to gate the new volume resize feature. This feature will be turn on by default once released. Review: https://reviews.apache.org/r/66733/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[11/13] mesos git commit: Implemented operator API to grow and shrink persistent volume.

2018-05-03 Thread chhsiao
Implemented operator API to grow and shrink persistent volume. These operator APIs is implemented as speculative for now, but we plan to convert them to non-speculative in the future. Review: https://reviews.apache.org/r/66051/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

[09/13] mesos git commit: Added test for authorization actions for `RESIZE_VOLUME`.

2018-05-03 Thread chhsiao
Added test for authorization actions for `RESIZE_VOLUME`. Review: https://reviews.apache.org/r/66532/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/360ae2f9 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/360ae2f9

[06/13] mesos git commit: Added tests for validation of `GrowVolume` and `ShrinkVolume`.

2018-05-03 Thread chhsiao
Added tests for validation of `GrowVolume` and `ShrinkVolume`. Review: https://reviews.apache.org/r/66858/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/fa1ca073 Tree:

[05/13] mesos git commit: Added helper functions to create grow and shrink volume in test.

2018-05-03 Thread chhsiao
Added helper functions to create grow and shrink volume in test. Review: https://reviews.apache.org/r/66219/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/71057f2c Tree:

[12/13] mesos git commit: Added test for `GROW_VOLUME` and `SHRINK_VOLUME` operator API.

2018-05-03 Thread chhsiao
Added test for `GROW_VOLUME` and `SHRINK_VOLUME` operator API. Review: https://reviews.apache.org/r/66227/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/f8d28f40 Tree:

[10/13] mesos git commit: Added new operator API to grow and shrink persistent volume.

2018-05-03 Thread chhsiao
Added new operator API to grow and shrink persistent volume. The same API could be used in the future to grow or shrink CSI volumes, but currently only persistent volumes are supported. Review: https://reviews.apache.org/r/66052/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo

[04/13] mesos git commit: Implemented grow and shrink of persistent volumes.

2018-05-03 Thread chhsiao
Implemented grow and shrink of persistent volumes. The new offer operations are implemented as speculative operations, but we will use validation to make them non-speculative on API level so that we can transition later without a breaking change. Review: https://reviews.apache.org/r/66050/

[08/13] mesos git commit: Added new authorization for `ResizeVolume`.

2018-05-03 Thread chhsiao
Added new authorization for `ResizeVolume`. The new authorization action is modelled after `CreateVolume`, and will be shared by both `GROW_VOLUME` and `SHRINK_VOLUME` operations and corresponding operator APIs. Review: https://reviews.apache.org/r/66531/ Project:

[07/13] mesos git commit: Added tests for `GROW_VOLUME` and `SHRINK_VOLUME` operations.

2018-05-03 Thread chhsiao
Added tests for `GROW_VOLUME` and `SHRINK_VOLUME` operations. Review: https://reviews.apache.org/r/66220/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/274f2e68 Tree:

[02/13] mesos git commit: Added offer operation to grow and shrink persistent volumes.

2018-05-03 Thread chhsiao
ider/storage/provider.cpp +++ b/src/resource_provider/storage/provider.cpp @@ -2845,6 +2845,12 @@ Future StorageLocalResourceProviderProcess::_applyOperation( break; } +case Offer::Operation::GROW_VOLUME: +case Offer::Operation::SHRINK_VOLUME: { + // TODO(chhsiao): These

[2/3] mesos git commit: Added MESOS-9049 to the 1.5.2 CHANGELOG.

2018-07-03 Thread chhsiao
Added MESOS-9049 to the 1.5.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/92ab6847 Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/92ab6847 Diff:

[3/3] mesos git commit: Added MESOS-9049 to the 1.4.2 CHANGELOG.

2018-07-03 Thread chhsiao
Added MESOS-9049 to the 1.4.2 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/3052d05e Tree: http://git-wip-us.apache.org/repos/asf/mesos/tree/3052d05e Diff:

[1/3] mesos git commit: Added MESOS-9049 to the 1.6.1 CHANGELOG.

2018-07-03 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 35eba3923 -> 3052d05e9 Added MESOS-9049 to the 1.6.1 CHANGELOG. Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/72efed01 Tree:

mesos git commit: Updated documentation for `CREATE_DISK` and `DESTROY_DISK`.

2018-07-26 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master ddd00e54c -> 815b30ce8 Updated documentation for `CREATE_DISK` and `DESTROY_DISK`. Review: https://reviews.apache.org/r/67918 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit:

mesos git commit: Fixed rapidjson cmake compilation.

2018-07-26 Thread chhsiao
Repository: mesos Updated Branches: refs/heads/master 815b30ce8 -> e3f9f3ac9 Fixed rapidjson cmake compilation. Review: https://reviews.apache.org/r/68073 Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/e3f9f3ac Tree:

[mesos] 05/05: Always build gRPC in Mesos.

2018-08-03 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 5bb42453b1bbadf0c51b0965206fe9b4e71a00f5 Author: Chun-Hung Hsiao AuthorDate: Thu Jul 26 16:32:38 2018 -0700 Always

[2/2] mesos git commit: Implemented authorization for agent `GET_RESOURCE_PROVIDER` calls.

2018-08-01 Thread chhsiao
Implemented authorization for agent `GET_RESOURCE_PROVIDER` calls. Review: https://reviews.apache.org/r/68104/ Project: http://git-wip-us.apache.org/repos/asf/mesos/repo Commit: http://git-wip-us.apache.org/repos/asf/mesos/commit/58cd5445 Tree:

[mesos] branch master updated: Updated Git repository URLs.

2018-08-06 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/master by this push: new d96c89e Updated Git repository URLs. d96c89e

[mesos] branch master updated (72878f8 -> 5bb4245)

2018-08-03 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git. from 72878f8 Moved around some functions definitions between files. new 9fb936a Fixed gRPC compilation with Clang

[mesos] 01/05: Fixed gRPC compilation with Clang when building Mesos.

2018-08-03 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 9fb936abdce72e313e77aa15f0b9fc95c7fea512 Author: Chun-Hung Hsiao AuthorDate: Mon Jul 30 16:58:54 2018 -0700 Fixed

[mesos] 04/05: Always build gRPC in libprocess.

2018-08-03 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 200ed1d83c80f2c21ba04e25b2248f40c30b234a Author: Chun-Hung Hsiao AuthorDate: Fri Jul 27 12:00:01 2018 -0700 Always

[mesos] 02/02: Pass compiler/linker flags when building the gRPC bundle in libprocess.

2018-08-07 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 4b9a0d553492731c3529cda1e3938591fbdba9dc Author: Chun-Hung Hsiao AuthorDate: Mon Aug 6 18:28:26 2018 -0700 Pass

[mesos] branch master updated (57f22aa -> 4b9a0d5)

2018-08-07 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git. from 57f22aa Replaced exchange in MpscLinkedQueue::dequeue with load/store. new 1b2e1ad Pass compiler/linker flags

[mesos] 01/02: Pass compiler/linker flags when building the gRPC bundle in Mesos.

2018-08-07 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 1b2e1adfaa763b6326a5c2cd8aef74cfc5461ebc Author: Chun-Hung Hsiao AuthorDate: Mon Aug 6 18:20:36 2018 -0700 Pass

[mesos] branch 1.7.x created (now 33b9f66)

2018-08-13 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a change to branch 1.7.x in repository https://gitbox.apache.org/repos/asf/mesos.git. at 33b9f66 Updated the 1.7.0 CHANGELOG. No new revisions were added by this update.

[mesos] branch master updated: Updated the 1.7.0 CHANGELOG.

2018-08-13 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/master by this push: new 33b9f66 Updated the 1.7.0 CHANGELOG. 33b9f66

[mesos] branch 1.7.x updated: Fixed grpc compilation for directory paths with symlinks.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch 1.7.x in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/1.7.x by this push: new 2aef98a Fixed grpc compilation for directory

[mesos] branch 1.7.x updated: Added MESOS-9160 to the 1.7.0 CHANGELOG.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch 1.7.x in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/1.7.x by this push: new c64b901 Added MESOS-9160 to the 1.7.0 CHANGELOG

[mesos] branch master updated: Fixed grpc compilation for directory paths with symlinks.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/master by this push: new 03a297d Fixed grpc compilation for directory

[mesos] branch master updated: Added MESOS-9160 to the 1.7.0 CHANGELOG.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git The following commit(s) were added to refs/heads/master by this push: new e638a88 Added MESOS-9160 to the 1.7.0

[mesos] 01/02: Properly defer'ed calls to SLRP's `fatal` method.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch 1.7.x in repository https://gitbox.apache.org/repos/asf/mesos.git commit f1fb83083be2f24db182235a87c10c48ab45adee Author: Benjamin Bannier AuthorDate: Thu Aug 16 17:05:23 2018 -0700

[mesos] 02/02: Added MESOS-9156 to the 1.7.0 CHANGELOG.

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git commit 0b5ad3a8fc629588db97bb17d2100699ed47b39d Author: Chun-Hung Hsiao AuthorDate: Thu Aug 16 17:18:41 2018 -0700 Added

[mesos] branch master updated (353e203 -> 0b5ad3a)

2018-08-16 Thread chhsiao
This is an automated email from the ASF dual-hosted git repository. chhsiao pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/mesos.git. from 353e203 Added MESOS-9147 to the 1.4.3 CHANGELOG. new 911a618 Properly defer'ed calls to SLRP's `fatal` method

  1   2   3   4   5   6   7   8   >