Added ASF Source Headers The policy here seems to indicate even the documentation files that are part of the release tar ball needs to include the source headers, either as a header or as footer. http://www.apache.org/legal/src-headers.html#header-text
Included it in the footer of the .md files. This closes: #45 Review: https://github.com/apache/incubator-myriad/pull/45 Project: http://git-wip-us.apache.org/repos/asf/incubator-myriad/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-myriad/commit/fb93291e Tree: http://git-wip-us.apache.org/repos/asf/incubator-myriad/tree/fb93291e Diff: http://git-wip-us.apache.org/repos/asf/incubator-myriad/diff/fb93291e Branch: refs/heads/master Commit: fb93291e9377cccf625bed93a9ad1ae1c4b76529 Parents: 68562ae Author: Santosh Marella <smare...@maprtech.com> Authored: Thu Nov 12 16:35:02 2015 -0800 Committer: smarella <smare...@maprtech.com> Committed: Thu Nov 12 16:35:02 2015 -0800 ---------------------------------------------------------------------- README.md | 21 ++ docker/Dockerfile | 17 ++ docker/README.md | 21 ++ docker/ResourceManager.dockerfile | 17 ++ docker/docker-compose.yml | 17 ++ docs/API.md | 20 ++ docs/cgroups.md | 21 +- docs/config-jobhistoryserver-services.md | 22 ++- docs/control-plane-algorithm.md | 21 ++ docs/getting-started.md | 21 +- docs/ha-config.md | 21 +- docs/how-it-works.md | 21 +- docs/install-overview.md | 20 ++ docs/myriad-configuration.md | 21 ++ docs/myriad-dashboard.md | 20 ++ docs/myriad-dev.md | 21 ++ docs/myriad-fine-grained-scaling.md | 21 ++ docs/myriad-overview.md | 21 ++ .../myriad-remote-distribution-configuration.md | 21 ++ docs/myriad-scheduler-architecture.md | 21 ++ docs/node-manager-profiles.md | 20 ++ docs/sample-yarn-site.md | 19 ++ docs/vagrant.md | 20 ++ gradle.properies | 17 ++ gradle/quality.gradle | 21 +- gradle/spock.gradle | 19 ++ gradle/wrapper/gradle-wrapper.properties | 17 ++ gradlew.bat | 196 ++++++++++--------- .../resources/myriad-config-test-default.yml | 17 ++ settings.gradle | 28 ++- website/README.md | 21 ++ 31 files changed, 695 insertions(+), 106 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/README.md ---------------------------------------------------------------------- diff --git a/README.md b/README.md index d3b5c68..d5e6650 100644 --- a/README.md +++ b/README.md @@ -52,3 +52,24 @@ Please keep checking this section for updates. Apache Myriad is licensed under the [Apache License, Version 2.0](http://www.apache.org/licenses/LICENSE-2.0). For additional information, see the LICENSE and NOTICE files. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docker/Dockerfile ---------------------------------------------------------------------- diff --git a/docker/Dockerfile b/docker/Dockerfile index d927e81..47cc2d2 100644 --- a/docker/Dockerfile +++ b/docker/Dockerfile @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# # Myriad - YARN Resource Manager # # VERSION 0.1.0 http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docker/README.md ---------------------------------------------------------------------- diff --git a/docker/README.md b/docker/README.md index a2ed27e..8f00d64 100644 --- a/docker/README.md +++ b/docker/README.md @@ -30,3 +30,24 @@ docker run --net=host --name='myriad-resourcemanager' -t \ If you already had a working Vagrant instance, you will need to run `vagrant reload` in order to allow zookeeper and hdfs port-forwarding. Still having problems connecting to Zookeeper? Be sure that your zkServer and MesosMaster values are correct in the [myriad-config-default.yml](https://github.com/mesos/myriad/blob/phase1/myriad-scheduler/src/main/resources/myriad-config-default.yml) file. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docker/ResourceManager.dockerfile ---------------------------------------------------------------------- diff --git a/docker/ResourceManager.dockerfile b/docker/ResourceManager.dockerfile index 4744c43..7c3dbef 100644 --- a/docker/ResourceManager.dockerfile +++ b/docker/ResourceManager.dockerfile @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# # Myriad - YARN Resource Manager # # VERSION 0.1.0 http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docker/docker-compose.yml ---------------------------------------------------------------------- diff --git a/docker/docker-compose.yml b/docker/docker-compose.yml index 407f3f3..bec5f1c 100644 --- a/docker/docker-compose.yml +++ b/docker/docker-compose.yml @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + myriad: build: . dockerfile: ResourceManager.dockerfile http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/API.md ---------------------------------------------------------------------- diff --git a/docs/API.md b/docs/API.md index fc2e343..c975e28 100644 --- a/docs/API.md +++ b/docs/API.md @@ -482,3 +482,23 @@ Accept-Language: en-US,en;q=0.8 "stagingTasks": [] } ``` +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/cgroups.md ---------------------------------------------------------------------- diff --git a/docs/cgroups.md b/docs/cgroups.md index 552c4bc..47228bb 100644 --- a/docs/cgroups.md +++ b/docs/cgroups.md @@ -78,5 +78,24 @@ Modify the `$YARN_HOME/etc/hadoop/yarn-site.xml` file by adding the following co <value>${yarn.home}/bin/container-executor</value> </property> ``` - +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/config-jobhistoryserver-services.md ---------------------------------------------------------------------- diff --git a/docs/config-jobhistoryserver-services.md b/docs/config-jobhistoryserver-services.md index f30b858..1e1e8f3 100644 --- a/docs/config-jobhistoryserver-services.md +++ b/docs/config-jobhistoryserver-services.md @@ -43,4 +43,24 @@ services: envSettings: -Dcluster.name.prefix=/mycluster2 taskName: timelineserver -``` \ No newline at end of file +``` +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/control-plane-algorithm.md ---------------------------------------------------------------------- diff --git a/docs/control-plane-algorithm.md b/docs/control-plane-algorithm.md index 18dfa8a..4376ffb 100644 --- a/docs/control-plane-algorithm.md +++ b/docs/control-plane-algorithm.md @@ -8,3 +8,24 @@ Notes: - When making a decision to flex-down NodeManagers, algorithm will take into consideration the kind of containers that are currently running under the chosen NodeManager. - If NodeManager is running a AppMaster container, it will be skipped, as killing it will lead to a killing of all it's child containers. Although, this needs to be reconsidered once [YARN-1489](https://issues.apache.org/jira/browse/YARN-1489) gets resolved. - A NodeManger should be chosen for flex-down, if reconfiguring and restarting it has minimum impact compared to other NodeManagers. This strategy can be reconsidered once [YARN-1336](https://issues.apache.org/jira/browse/YARN-1336) gets resolved. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/getting-started.md ---------------------------------------------------------------------- diff --git a/docs/getting-started.md b/docs/getting-started.md index cda9d25..2272fe1 100644 --- a/docs/getting-started.md +++ b/docs/getting-started.md @@ -168,7 +168,26 @@ PUT /api/cluster/flexup PUT /api/cluster/flexdown ``` - +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/ha-config.md ---------------------------------------------------------------------- diff --git a/docs/ha-config.md b/docs/ha-config.md index 3e0e237..2099a2c 100644 --- a/docs/ha-config.md +++ b/docs/ha-config.md @@ -84,5 +84,24 @@ haEnabled: true **Note:** The Myriad Mesos frameworkFailoverTimeout parameter is specified in milliseconds. This paramenter indicates to Mesos that Myriad will failover within this time interval. - +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/how-it-works.md ---------------------------------------------------------------------- diff --git a/docs/how-it-works.md b/docs/how-it-works.md index be2346f..cdc2d25 100644 --- a/docs/how-it-works.md +++ b/docs/how-it-works.md @@ -46,7 +46,26 @@ The following diagram shows how Myriad launches a YARN Node Manager as a task un  - +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/install-overview.md ---------------------------------------------------------------------- diff --git a/docs/install-overview.md b/docs/install-overview.md index f01c94d..0fb720f 100644 --- a/docs/install-overview.md +++ b/docs/install-overview.md @@ -47,4 +47,24 @@ Install and configure Mesos-DNS for Myriad High Availability (if using HA). * **Myriad Scheduler** - This component plugs into Resource Manager process and negotiates resources from Mesos by implementing Mesos Scheduler and SchedulerDriver interfaces. It is responsible to launch Node Manager processes via Mesos. * **Myriad Executor** - This component plugs into the NodeManager process via the YARN AuxiliaryService interface. +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. The project is a multi-project build using gradle. You can go to the $PROJECT_HOME (which is where you cloned the Git project to) and type `./gradlew build` to build all projects or you can go into each individual project and build them separately. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-configuration.md ---------------------------------------------------------------------- diff --git a/docs/myriad-configuration.md b/docs/myriad-configuration.md index 1aa214a..9fb1136 100644 --- a/docs/myriad-configuration.md +++ b/docs/myriad-configuration.md @@ -69,3 +69,24 @@ mesosAuthenticationPrincipal: some_principal # Authentication secret filename for Myriad's mesos framework mesosAuthenticationSecretFilename: /path/to/secret/filename ``` + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-dashboard.md ---------------------------------------------------------------------- diff --git a/docs/myriad-dashboard.md b/docs/myriad-dashboard.md index 14acfa7..7674f2c 100644 --- a/docs/myriad-dashboard.md +++ b/docs/myriad-dashboard.md @@ -26,3 +26,23 @@ A browser window should open with the site loaded. If not, it uses [port 8888](h It is helpful to have myriad setup in Vagrant locally so the api is available. Default values are coded into the dashboard if Myriad api isn't available. +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-dev.md ---------------------------------------------------------------------- diff --git a/docs/myriad-dev.md b/docs/myriad-dev.md index a69b266..0c18a0c 100644 --- a/docs/myriad-dev.md +++ b/docs/myriad-dev.md @@ -158,3 +158,24 @@ Myriad Scheduler runs inside Resource Manager as a plugin. To start the Resource ## Running Myriad Executor and Node Managers Myriad Executor and Node Managers are launched automatically by Myriad Scheduler as a response to flexup and flex down behavior. See the [Myriad Cluster API](API.md). + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-fine-grained-scaling.md ---------------------------------------------------------------------- diff --git a/docs/myriad-fine-grained-scaling.md b/docs/myriad-fine-grained-scaling.md index f9177b7..0c09fd2 100644 --- a/docs/myriad-fine-grained-scaling.md +++ b/docs/myriad-fine-grained-scaling.md @@ -41,3 +41,24 @@ Note: The zero profile Node Managers advertise zero resources to Resource Manage ### Sample Mesos Tasks Screenshot  + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-overview.md ---------------------------------------------------------------------- diff --git a/docs/myriad-overview.md b/docs/myriad-overview.md index 0f474eb..cf46492 100644 --- a/docs/myriad-overview.md +++ b/docs/myriad-overview.md @@ -38,3 +38,24 @@ As organizations become more reliant on data processing technologies like Hadoop Using Myriad, these organizations can save money and increase agility by provisioning multiple logical Hadoop clusters on a single physical Mesos cluster with either shared or dedicated data services. Each logical cluster can be tailored to the end user, with a custom configuration and security policy, while running a specific version, and with either static or dynamic resources allocated to it. In a multi-tenant environment, this model means that a shared pool of resources can be shared among many data processing frameworks, with each capable of allocating additional resources when needed and releasing them when not. The top-level Mesos scheduler ensures fairness in the case that multiple frameworks are competing for resources. In case of a version migration (for example, upgrading only one of two Hadoop clusters), this model means that logical Hadoop clusters of different versions can be deployed side by side on top of the same shared data. Users can migrate workloads from old versions to new versions gradually, add resources to the new cluster, and take resources away from the old cluster. After all workloads are moved over, the old cluster can be decommissioned. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-remote-distribution-configuration.md ---------------------------------------------------------------------- diff --git a/docs/myriad-remote-distribution-configuration.md b/docs/myriad-remote-distribution-configuration.md index a6ea9e8..4132b76 100644 --- a/docs/myriad-remote-distribution-configuration.md +++ b/docs/myriad-remote-distribution-configuration.md @@ -77,3 +77,24 @@ hadoop fs -put ~/hadoop-2.7.0.tar.gz /dist ## Getting Started ## You can now start the resource manager and attempt to flexup or flexdown the cluster. See [Getting Started](getting-started.md) for information about using Myriad. See the [Myriad Cluster API](API.md) for more information about scaling. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/myriad-scheduler-architecture.md ---------------------------------------------------------------------- diff --git a/docs/myriad-scheduler-architecture.md b/docs/myriad-scheduler-architecture.md index ea2ce53..510388d 100644 --- a/docs/myriad-scheduler-architecture.md +++ b/docs/myriad-scheduler-architecture.md @@ -29,3 +29,24 @@ Class | Description | NM HB Handler | Handles node manager heartbeat and responds to status updates of YARN containers. For running containers, it sends status update to Mesos Executor and for completed containers, it informs Pseudo Task Manager about available resources. | Node Store | Tracks the set of nodes that are part of YARN cluster. | Node | Tracks metadata about a node. | + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/node-manager-profiles.md ---------------------------------------------------------------------- diff --git a/docs/node-manager-profiles.md b/docs/node-manager-profiles.md index 591106d..19e00d6 100644 --- a/docs/node-manager-profiles.md +++ b/docs/node-manager-profiles.md @@ -37,3 +37,23 @@ Default profiles: }, ``` +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/sample-yarn-site.md ---------------------------------------------------------------------- diff --git a/docs/sample-yarn-site.md b/docs/sample-yarn-site.md index 51517ee..630f509 100644 --- a/docs/sample-yarn-site.md +++ b/docs/sample-yarn-site.md @@ -112,6 +112,25 @@ The following is a sample yarn-site.xml file. </configuration> </pre> +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/docs/vagrant.md ---------------------------------------------------------------------- diff --git a/docs/vagrant.md b/docs/vagrant.md index 0c71ea7..2d87036 100644 --- a/docs/vagrant.md +++ b/docs/vagrant.md @@ -190,3 +190,23 @@ exit exit vagrant halt ``` +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/gradle.properies ---------------------------------------------------------------------- diff --git a/gradle.properies b/gradle.properies index 9bd858d..9667034 100644 --- a/gradle.properies +++ b/gradle.properies @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + org.gradle.jvmargs=-Xmx1024m -XX:MaxPermSize=256m -XX:+HeapDumpOnOutOfMemoryError -Dfile.encoding=UTF-8 org.gradle.parallel=true org.gradle.daemon=true http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/gradle/quality.gradle ---------------------------------------------------------------------- diff --git a/gradle/quality.gradle b/gradle/quality.gradle index 67e973f..c013d7d 100644 --- a/gradle/quality.gradle +++ b/gradle/quality.gradle @@ -1,3 +1,22 @@ +/* +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, +* software distributed under the License is distributed on an +* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +* KIND, either express or implied. See the License for the +* specific language governing permissions and limitations +* under the License. +*/ + apply plugin: 'findbugs' apply plugin: 'checkstyle' apply plugin: 'pmd' @@ -35,4 +54,4 @@ pmd { // 'java-unusedcode' ] -} \ No newline at end of file +} http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/gradle/spock.gradle ---------------------------------------------------------------------- diff --git a/gradle/spock.gradle b/gradle/spock.gradle index d171ae6..fc974ec 100644 --- a/gradle/spock.gradle +++ b/gradle/spock.gradle @@ -1,3 +1,22 @@ +/* +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, +* software distributed under the License is distributed on an +* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +* KIND, either express or implied. See the License for the +* specific language governing permissions and limitations +* under the License. +*/ + // used for unit tests apply plugin: 'groovy' http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/gradle/wrapper/gradle-wrapper.properties ---------------------------------------------------------------------- diff --git a/gradle/wrapper/gradle-wrapper.properties b/gradle/wrapper/gradle-wrapper.properties index 4ca5885..020c1bd 100644 --- a/gradle/wrapper/gradle-wrapper.properties +++ b/gradle/wrapper/gradle-wrapper.properties @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + #Wed Jun 10 10:58:12 CDT 2015 distributionBase=GRADLE_USER_HOME distributionPath=wrapper/dists http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/gradlew.bat ---------------------------------------------------------------------- diff --git a/gradlew.bat b/gradlew.bat index aec9973..163987c 100644 --- a/gradlew.bat +++ b/gradlew.bat @@ -1,90 +1,106 @@ -@if "%DEBUG%" == "" @echo off -@rem ########################################################################## -@rem -@rem Gradle startup script for Windows -@rem -@rem ########################################################################## - -@rem Set local scope for the variables with windows NT shell -if "%OS%"=="Windows_NT" setlocal - -@rem Add default JVM options here. You can also use JAVA_OPTS and GRADLE_OPTS to pass JVM options to this script. -set DEFAULT_JVM_OPTS= - -set DIRNAME=%~dp0 -if "%DIRNAME%" == "" set DIRNAME=. -set APP_BASE_NAME=%~n0 -set APP_HOME=%DIRNAME% - -@rem Find java.exe -if defined JAVA_HOME goto findJavaFromJavaHome - -set JAVA_EXE=java.exe -%JAVA_EXE% -version >NUL 2>&1 -if "%ERRORLEVEL%" == "0" goto init - -echo. -echo ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH. -echo. -echo Please set the JAVA_HOME variable in your environment to match the -echo location of your Java installation. - -goto fail - -:findJavaFromJavaHome -set JAVA_HOME=%JAVA_HOME:"=% -set JAVA_EXE=%JAVA_HOME%/bin/java.exe - -if exist "%JAVA_EXE%" goto init - -echo. -echo ERROR: JAVA_HOME is set to an invalid directory: %JAVA_HOME% -echo. -echo Please set the JAVA_HOME variable in your environment to match the -echo location of your Java installation. - -goto fail - -:init -@rem Get command-line arguments, handling Windowz variants - -if not "%OS%" == "Windows_NT" goto win9xME_args -if "%@eval[2+2]" == "4" goto 4NT_args - -:win9xME_args -@rem Slurp the command line arguments. -set CMD_LINE_ARGS= -set _SKIP=2 - -:win9xME_args_slurp -if "x%~1" == "x" goto execute - -set CMD_LINE_ARGS=%* -goto execute - -:4NT_args -@rem Get arguments from the 4NT Shell from JP Software -set CMD_LINE_ARGS=%$ - -:execute -@rem Setup the command line - -set CLASSPATH=%APP_HOME%\gradle\wrapper\gradle-wrapper.jar - -@rem Execute Gradle -"%JAVA_EXE%" %DEFAULT_JVM_OPTS% %JAVA_OPTS% %GRADLE_OPTS% "-Dorg.gradle.appname=%APP_BASE_NAME%" -classpath "%CLASSPATH%" org.gradle.wrapper.GradleWrapperMain %CMD_LINE_ARGS% - -:end -@rem End local scope for the variables with windows NT shell -if "%ERRORLEVEL%"=="0" goto mainEnd - -:fail -rem Set variable GRADLE_EXIT_CONSOLE if you need the _script_ return code instead of -rem the _cmd.exe /c_ return code! -if not "" == "%GRADLE_EXIT_CONSOLE%" exit 1 -exit /b 1 - -:mainEnd -if "%OS%"=="Windows_NT" endlocal - -:omega +rem Licensed to the Apache Software Foundation (ASF) under one +rem or more contributor license agreements. See the NOTICE file +rem distributed with this work for additional information +rem regarding copyright ownership. The ASF licenses this file +rem to you under the Apache License, Version 2.0 (the +rem "License"); you may not use this file except in compliance +rem with the License. You may obtain a copy of the License at +rem +rem http://www.apache.org/licenses/LICENSE-2.0 +rem +rem Unless required by applicable law or agreed to in writing, +rem software distributed under the License is distributed on an +rem "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +rem KIND, either express or implied. See the License for the +rem specific language governing permissions and limitations +rem under the License. +@if "%DEBUG%" == "" @echo off +@rem ########################################################################## +@rem +@rem Gradle startup script for Windows +@rem +@rem ########################################################################## + +@rem Set local scope for the variables with windows NT shell +if "%OS%"=="Windows_NT" setlocal + +@rem Add default JVM options here. You can also use JAVA_OPTS and GRADLE_OPTS to pass JVM options to this script. +set DEFAULT_JVM_OPTS= + +set DIRNAME=%~dp0 +if "%DIRNAME%" == "" set DIRNAME=. +set APP_BASE_NAME=%~n0 +set APP_HOME=%DIRNAME% + +@rem Find java.exe +if defined JAVA_HOME goto findJavaFromJavaHome + +set JAVA_EXE=java.exe +%JAVA_EXE% -version >NUL 2>&1 +if "%ERRORLEVEL%" == "0" goto init + +echo. +echo ERROR: JAVA_HOME is not set and no 'java' command could be found in your PATH. +echo. +echo Please set the JAVA_HOME variable in your environment to match the +echo location of your Java installation. + +goto fail + +:findJavaFromJavaHome +set JAVA_HOME=%JAVA_HOME:"=% +set JAVA_EXE=%JAVA_HOME%/bin/java.exe + +if exist "%JAVA_EXE%" goto init + +echo. +echo ERROR: JAVA_HOME is set to an invalid directory: %JAVA_HOME% +echo. +echo Please set the JAVA_HOME variable in your environment to match the +echo location of your Java installation. + +goto fail + +:init +@rem Get command-line arguments, handling Windowz variants + +if not "%OS%" == "Windows_NT" goto win9xME_args +if "%@eval[2+2]" == "4" goto 4NT_args + +:win9xME_args +@rem Slurp the command line arguments. +set CMD_LINE_ARGS= +set _SKIP=2 + +:win9xME_args_slurp +if "x%~1" == "x" goto execute + +set CMD_LINE_ARGS=%* +goto execute + +:4NT_args +@rem Get arguments from the 4NT Shell from JP Software +set CMD_LINE_ARGS=%$ + +:execute +@rem Setup the command line + +set CLASSPATH=%APP_HOME%\gradle\wrapper\gradle-wrapper.jar + +@rem Execute Gradle +"%JAVA_EXE%" %DEFAULT_JVM_OPTS% %JAVA_OPTS% %GRADLE_OPTS% "-Dorg.gradle.appname=%APP_BASE_NAME%" -classpath "%CLASSPATH%" org.gradle.wrapper.GradleWrapperMain %CMD_LINE_ARGS% + +:end +@rem End local scope for the variables with windows NT shell +if "%ERRORLEVEL%"=="0" goto mainEnd + +:fail +rem Set variable GRADLE_EXIT_CONSOLE if you need the _script_ return code instead of +rem the _cmd.exe /c_ return code! +if not "" == "%GRADLE_EXIT_CONSOLE%" exit 1 +exit /b 1 + +:mainEnd +if "%OS%"=="Windows_NT" endlocal + +:omega http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/myriad-scheduler/src/test/resources/myriad-config-test-default.yml ---------------------------------------------------------------------- diff --git a/myriad-scheduler/src/test/resources/myriad-config-test-default.yml b/myriad-scheduler/src/test/resources/myriad-config-test-default.yml index ab597f6..241aac9 100644 --- a/myriad-scheduler/src/test/resources/myriad-config-test-default.yml +++ b/myriad-scheduler/src/test/resources/myriad-config-test-default.yml @@ -1,3 +1,20 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + mesosMaster: 10.0.2.15:5050 checkpoint: false frameworkFailoverTimeout: 43200000 http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/settings.gradle ---------------------------------------------------------------------- diff --git a/settings.gradle b/settings.gradle index 63108b4..9af746c 100644 --- a/settings.gradle +++ b/settings.gradle @@ -1,13 +1,21 @@ /* - * This settings file was auto generated by the Gradle buildInit task - * by 'mosoni' at '8/30/14 11:10 AM' with Gradle 1.11 - * - * The settings file is used to specify which projects to include in your build. - * In a single project build this file can be empty or even removed. - * - * Detailed information about configuring a multi-project build in Gradle can be found - * in the user guide at http://gradle.org/docs/1.11/userguide/multi_project_builds.html - */ +* Licensed to the Apache Software Foundation (ASF) under one +* or more contributor license agreements. See the NOTICE file +* distributed with this work for additional information +* regarding copyright ownership. The ASF licenses this file +* to you under the Apache License, Version 2.0 (the +* "License"); you may not use this file except in compliance +* with the License. You may obtain a copy of the License at +* +* http://www.apache.org/licenses/LICENSE-2.0 +* +* Unless required by applicable law or agreed to in writing, +* software distributed under the License is distributed on an +* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +* KIND, either express or implied. See the License for the +* specific language governing permissions and limitations +* under the License. +*/ /* // To declare projects as part of a multi-project build use the 'include' method @@ -20,4 +28,4 @@ rootProject.name = 'myriad' include "myriad-commons" include "myriad-scheduler" -include "myriad-executor" \ No newline at end of file +include "myriad-executor" http://git-wip-us.apache.org/repos/asf/incubator-myriad/blob/fb93291e/website/README.md ---------------------------------------------------------------------- diff --git a/website/README.md b/website/README.md index 4e2cba2..c045f0c 100644 --- a/website/README.md +++ b/website/README.md @@ -23,3 +23,24 @@ The Apache infrastructure runs svnpubsub to sync this repo with the webserver se ## Adding content The Jekyll website is a great resource and you should read through it. For the impatient though, create a markdown file in `website/_posts` modeled after one already there. Then `jekyll build` and the new post will be linked on the front page and generated in the news page. + +--- +<sub> +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + +<sub> + http://www.apache.org/licenses/LICENSE-2.0 + +<sub> +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License.
