Repository: bigtop Updated Branches: refs/heads/master 8535f314e -> 8b7971049
BIGTOP-1814. Puppet deployment code needs to work with ignite-hadoop component Signed-off-by: Evans Ye <[email protected]> Project: http://git-wip-us.apache.org/repos/asf/bigtop/repo Commit: http://git-wip-us.apache.org/repos/asf/bigtop/commit/8b797104 Tree: http://git-wip-us.apache.org/repos/asf/bigtop/tree/8b797104 Diff: http://git-wip-us.apache.org/repos/asf/bigtop/diff/8b797104 Branch: refs/heads/master Commit: 8b79710491e48de3ea96121bf59d40c5291b489a Parents: 8535f31 Author: Konstantin Boudnik <[email protected]> Authored: Thu Apr 9 17:47:56 2015 -0700 Committer: Evans Ye <[email protected]> Committed: Sat Apr 25 06:34:51 2015 +0000 ---------------------------------------------------------------------- bigtop-deploy/puppet/README.md | 6 +- bigtop-deploy/puppet/hieradata/site.yaml | 2 +- bigtop-deploy/puppet/manifests/cluster.pp | 4 +- .../modules/gridgain-hadoop/manifests/init.pp | 64 ------------------- .../gridgain-hadoop/templates/core-site.xml | 65 -------------------- .../gridgain-hadoop/templates/gridgain-hadoop | 21 ------- .../gridgain-hadoop/templates/mapred-site.xml | 62 ------------------- .../modules/gridgain-hadoop/tests/init.pp | 16 ----- .../modules/ignite-hadoop/manifests/init.pp | 64 +++++++++++++++++++ .../ignite-hadoop/templates/core-site.xml | 65 ++++++++++++++++++++ .../ignite-hadoop/templates/ignite-hadoop | 21 +++++++ .../ignite-hadoop/templates/mapred-site.xml | 63 +++++++++++++++++++ .../puppet/modules/ignite-hadoop/tests/init.pp | 16 +++++ 13 files changed, 235 insertions(+), 234 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/README.md ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/README.md b/bigtop-deploy/puppet/README.md index c2aec9e..18773f8 100644 --- a/bigtop-deploy/puppet/README.md +++ b/bigtop-deploy/puppet/README.md @@ -134,6 +134,6 @@ And run the following on those nodes: # puppet apply -d --modulepath="bigtop-deploy/puppet/modules:/etc/puppet/modules" bigtop-deploy/puppet/manifests/site.pp </pre> -When gridgain-hadoop accelerator is deployed the client configs are placed under -/etc/hadoop/gridgain.client.conf. All one needs to do to run Mapreduce jobs on gridgain-hadoop grid -is to set HADOOP_CONF_DIR=/etc/hadoop/gridgain.client.conf in the client session. +When ignite-hadoop accelerator is deployed the client configs are placed under +/etc/hadoop/ignite.client.conf. All one needs to do to run Mapreduce jobs on ignite-hadoop grid +is to set HADOOP_CONF_DIR=/etc/hadoop/ignite.client.conf in the client session. http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/hieradata/site.yaml ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/hieradata/site.yaml b/bigtop-deploy/puppet/hieradata/site.yaml index 8662bb4..54060f8 100644 --- a/bigtop-deploy/puppet/hieradata/site.yaml +++ b/bigtop-deploy/puppet/hieradata/site.yaml @@ -15,7 +15,7 @@ hadoop::hadoop_storage_dirs: # - crunch # - flume # - giraph -# - gridgain-hadoop +# - ignite-hadoop # - hbase # - hcat # - hive http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/manifests/cluster.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/manifests/cluster.pp b/bigtop-deploy/puppet/manifests/cluster.pp index 9f835d9..43e090f 100644 --- a/bigtop-deploy/puppet/manifests/cluster.pp +++ b/bigtop-deploy/puppet/manifests/cluster.pp @@ -63,8 +63,8 @@ class hadoop_worker_node ( include hadoop-hbase::server } - if ($all or "gridgain-hadoop" in $components) { - gridgain-hadoop::server { "gridgain-hadoop-node": } + if ($all or "ignite-hadoop" in $components) { + ignite-hadoop::server { "ignite-hadoop-node": } } ### If mapred is not installed, yarn can fail. http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/gridgain-hadoop/manifests/init.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/gridgain-hadoop/manifests/init.pp b/bigtop-deploy/puppet/modules/gridgain-hadoop/manifests/init.pp deleted file mode 100644 index c130832..0000000 --- a/bigtop-deploy/puppet/modules/gridgain-hadoop/manifests/init.pp +++ /dev/null @@ -1,64 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agreements. See the NOTICE file distributed with -# this work for additional information regarding copyright ownership. -# The ASF licenses this file to You under the Apache License, Version 2.0 -# (the "License"); you may not use this file except in compliance with -# the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -class gridgain-hadoop { - define server() { - package { "gridgain-hadoop": - ensure => latest, - } - - package { "gridgain-hadoop-service": - ensure => latest, - } - - file { "/etc/default/gridgain-hadoop": - content => template("gridgain-hadoop/gridgain-hadoop"), - require => Package["gridgain-hadoop"], - } - - file { "/etc/hadoop/gridgain.client.conf": - ensure => directory, - owner => 'root', - group => 'root', - mode => '0755', - require => Package["gridgain-hadoop-service"], - } - file { "/etc/hadoop/gridgain.client.conf/core-site.xml": - content => template('gridgain-hadoop/core-site.xml'), - require => [File["/etc/hadoop/gridgain.client.conf"]], - } - file { - "/etc/hadoop/gridgain.client.conf/mapred-site.xml": - content => template('gridgain-hadoop/mapred-site.xml'), - require => [File["/etc/hadoop/gridgain.client.conf"]], - } -## let's make sure that gridgain-hadoop libs are linked properly - file {'/usr/lib/hadoop/lib/gridgain-core.jar': - ensure => link, - target => '/usr/lib/gridgain-hadoop/libs/gridgain-core.jar', - require => [Package["gridgain-hadoop-service"]], - } - file {'/usr/lib/hadoop/lib/gridgain-hadoop.jar': - ensure => link, - target => '/usr/lib/gridgain-hadoop/libs/gridgain-hadoop/gridgain-hadoop.jar', - require => [Package["gridgain-hadoop-service"]], - } - - service { "gridgain-hadoop": - ensure => running, - require => [ Package["gridgain-hadoop", "gridgain-hadoop-service"], File["/etc/default/gridgain-hadoop"] ], - } - } -} \ No newline at end of file http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/core-site.xml ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/core-site.xml b/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/core-site.xml deleted file mode 100644 index 7e39015..0000000 --- a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/core-site.xml +++ /dev/null @@ -1,65 +0,0 @@ -<?xml version="1.0" encoding="UTF-8"?> -<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> -<!-- - Licensed under the Apache License, Version 2.0 (the "License"); - you may not use this file except in compliance with the License. - You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. See accompanying LICENSE file. ---> - -<!-- - This template file contains settings needed to run Apache Hadoop jobs - with GridGain's distributed in-memory file system GGFS. - - You can replace '$HADOOP_HOME/etc/hadoop/core-site.xml' file with this one - to work with GridGain GGFS nodes running on localhost (these local nodes can be - a part of distributed cluster though). To work with file system on remote - hosts you need to change the host of file system URI to any host running - GridGain's GGFS node. - - Note that GridGain jars must be in Apache Hadoop client classpath to work - with this configuration. - - Run script '$GRIDGAIN_HOME/bin/setup-hadoop.{sh|bat}' for Apache Hadoop client setup. ---> - -<configuration> - <!-- - Set default file system to GGFS instance named "ggfs" configured in GridGain. - --> - <property> - <name>fs.defaultFS</name> - <value>ggfs://ggfs@localhost</value> - </property> - - <!-- - Set Hadoop 1.* file system implementation class for GGFS. - --> - <property> - <name>fs.ggfs.impl</name> - <value>org.gridgain.grid.ggfs.hadoop.v1.GridGgfsHadoopFileSystem</value> - </property> - - <!-- - Set Hadoop 2.* file system implementation class for GGFS. - --> - <property> - <name>fs.AbstractFileSystem.ggfs.impl</name> - <value>org.gridgain.grid.ggfs.hadoop.v2.GridGgfsHadoopFileSystem</value> - </property> - - <!-- - Disallow data node replacement since it does not make sense for GridGain's GGFS nodes. - --> - <property> - <name>dfs.client.block.write.replace-datanode-on-failure.policy</name> - <value>NEVER</value> - </property> -</configuration> http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/gridgain-hadoop ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/gridgain-hadoop b/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/gridgain-hadoop deleted file mode 100644 index 4ab127f..0000000 --- a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/gridgain-hadoop +++ /dev/null @@ -1,21 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agreements. See the NOTICE file distributed with -# this work for additional information regarding copyright ownership. -# The ASF licenses this file to You under the Apache License, Version 2.0 -# (the "License"); you may not use this file except in compliance with -# the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -export HADOOP_PREFIX=/usr -export GRIDGAIN_HOME=/usr/lib/gridgain-hadoop -export GRIDGAIN_LOG_DIR=/var/log/gridgain-hadoop -export GRIDGAIN_PID_DIR=/var/run/gridgain-hadoop -export GRIDGAIN_WORK_DIR="/var/run/gridgain-hadoop/work" -export HADOOP_HOME=${HADOOP_HOME:-/usr/lib/hadoop} http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/mapred-site.xml ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/mapred-site.xml b/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/mapred-site.xml deleted file mode 100644 index d2be8eb..0000000 --- a/bigtop-deploy/puppet/modules/gridgain-hadoop/templates/mapred-site.xml +++ /dev/null @@ -1,62 +0,0 @@ -<?xml version="1.0"?> -<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> -<!-- - Licensed under the Apache License, Version 2.0 (the "License"); - you may not use this file except in compliance with the License. - You may obtain a copy of the License at - - http://www.apache.org/licenses/LICENSE-2.0 - - Unless required by applicable law or agreed to in writing, software - distributed under the License is distributed on an "AS IS" BASIS, - WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. - See the License for the specific language governing permissions and - limitations under the License. See accompanying LICENSE file. ---> - -<!-- - This template file contains settings needed to run Apache Hadoop jobs - with GridGain In-Memory Accelerator. - - You can replace '$HADOOP_HOME/etc/hadoop/mapred-site.xml' file with this one - to run jobs on localhost (local node can be a part of distributed cluster though). - To run jobs on remote host you have to change jobtracker address to the REST address - of any running GridGain node. - - Note that GridGain jars must be in Apache Hadoop client classpath to work - with this configuration. - - Run script '$GRIDGAIN_HOME/bin/setup-hadoop.{sh|bat}' for Apache Hadoop client setup. ---> - -<configuration> - <!-- - Framework name must be set to 'gridgain'. - --> - <property> - <name>mapreduce.framework.name</name> - <value>gridgain</value> - </property> - - <!-- - Job tracker address must be set to the REST address of any running GridGain node. - --> - <property> - <name>mapreduce.jobtracker.address</name> - <value>localhost:11211</value> - </property> - - <!-- Parameters for job tuning. --> - <!-- - <property> - <name>mapreduce.job.reduces</name> - <value>1</value> - </property> - - <property> - <name>mapreduce.job.maps</name> - <value>4</value> - </property> - --> - -</configuration> http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/gridgain-hadoop/tests/init.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/gridgain-hadoop/tests/init.pp b/bigtop-deploy/puppet/modules/gridgain-hadoop/tests/init.pp deleted file mode 100644 index c4536ed..0000000 --- a/bigtop-deploy/puppet/modules/gridgain-hadoop/tests/init.pp +++ /dev/null @@ -1,16 +0,0 @@ -# Licensed to the Apache Software Foundation (ASF) under one or more -# contributor license agreements. See the NOTICE file distributed with -# this work for additional information regarding copyright ownership. -# The ASF licenses this file to You under the Apache License, Version 2.0 -# (the "License"); you may not use this file except in compliance with -# the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, software -# distributed under the License is distributed on an "AS IS" BASIS, -# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. -# See the License for the specific language governing permissions and -# limitations under the License. - -gridgain-hadoop::server { "test-gridgain-hadoop-server": } http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/ignite-hadoop/manifests/init.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/ignite-hadoop/manifests/init.pp b/bigtop-deploy/puppet/modules/ignite-hadoop/manifests/init.pp new file mode 100644 index 0000000..6a967c6 --- /dev/null +++ b/bigtop-deploy/puppet/modules/ignite-hadoop/manifests/init.pp @@ -0,0 +1,64 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +class ignite-hadoop { + define server() { + package { "ignite-hadoop": + ensure => latest, + } + + package { "ignite-hadoop-service": + ensure => latest, + } + + file { "/etc/default/ignite-hadoop": + content => template("ignite-hadoop/ignite-hadoop"), + require => Package["ignite-hadoop"], + } + + file { "/etc/hadoop/ignite.client.conf": + ensure => directory, + owner => 'root', + group => 'root', + mode => '0755', + require => Package["ignite-hadoop-service"], + } + file { "/etc/hadoop/ignite.client.conf/core-site.xml": + content => template('ignite-hadoop/core-site.xml'), + require => [File["/etc/hadoop/ignite.client.conf"]], + } + file { + "/etc/hadoop/ignite.client.conf/mapred-site.xml": + content => template('ignite-hadoop/mapred-site.xml'), + require => [File["/etc/hadoop/ignite.client.conf"]], + } +## let's make sure that ignite-hadoop libs are linked properly + file {'/usr/lib/hadoop/lib/ignite-core.jar': + ensure => link, + target => '/usr/lib/ignite-hadoop/libs/ignite-core.jar', + require => [Package["ignite-hadoop-service"]], + } + file {'/usr/lib/hadoop/lib/ignite-hadoop.jar': + ensure => link, + target => '/usr/lib/ignite-hadoop/libs/ignite-hadoop/ignite-hadoop.jar', + require => [Package["ignite-hadoop-service"]], + } + + service { "ignite-hadoop": + ensure => running, + require => [ Package["ignite-hadoop", "ignite-hadoop-service"], File["/etc/default/ignite-hadoop"] ], + } + } +} http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/ignite-hadoop/templates/core-site.xml ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/ignite-hadoop/templates/core-site.xml b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/core-site.xml new file mode 100644 index 0000000..02d4980 --- /dev/null +++ b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/core-site.xml @@ -0,0 +1,65 @@ +<?xml version="1.0" encoding="UTF-8"?> +<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> +<!-- + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. See accompanying LICENSE file. +--> + +<!-- + This template file contains settings needed to run Apache Hadoop jobs + with Ignite's distributed in-memory file system GGFS. + + You can replace '$HADOOP_HOME/etc/hadoop/core-site.xml' file with this one + to work with Ignite IGFS nodes running on localhost (these local nodes can be + a part of distributed cluster though). To work with file system on remote + hosts you need to change the host of file system URI to any host running + Ignite's IGFS node. + + Note that Ignite jars must be in Apache Hadoop client classpath to work + with this configuration. + + Run script '$IGNITE_HOME/bin/setup-hadoop.{sh|bat}' for Apache Hadoop client setup. +--> + +<configuration> + <!-- + Set default file system to IGFS instance named "igfs" configured in GridGain. + --> + <property> + <name>fs.defaultFS</name> + <value>igfs://igfs@localhost</value> + </property> + + <!-- + Set Hadoop 1.* file system implementation class for GGFS. + --> + <property> + <name>fs.igfs.impl</name> + <value>org.apache.ignite.hadoop.fs.v1.IgniteHadoopFileSystem</value> + </property> + + <!-- + Set Hadoop 2.* file system implementation class for GGFS. + --> + <property> + <name>fs.AbstractFileSystem.igfs.impl</name> + <value>org.apache.ignite.hadoop.fs.v2.IgniteHadoopFileSystem</value> + </property> + + <!-- + Disallow data node replacement since it does not make sense for Ignite's IGFS nodes. + --> + <property> + <name>dfs.client.block.write.replace-datanode-on-failure.policy</name> + <value>NEVER</value> + </property> +</configuration> http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/ignite-hadoop/templates/ignite-hadoop ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/ignite-hadoop/templates/ignite-hadoop b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/ignite-hadoop new file mode 100644 index 0000000..e4530ca --- /dev/null +++ b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/ignite-hadoop @@ -0,0 +1,21 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +export HADOOP_PREFIX=/usr +export IGNITE_HOME=/usr/lib/ignite-hadoop +export IGNITE_LOG_DIR=/var/log/ignite-hadoop +export IGNITE_PID_DIR=/var/run/ignite-hadoop +export IGNITE_WORK_DIR="/var/run/ignite-hadoop/work" +export HADOOP_HOME=${HADOOP_HOME:-/usr/lib/hadoop} http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/ignite-hadoop/templates/mapred-site.xml ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/ignite-hadoop/templates/mapred-site.xml b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/mapred-site.xml new file mode 100644 index 0000000..f2a0ae6 --- /dev/null +++ b/bigtop-deploy/puppet/modules/ignite-hadoop/templates/mapred-site.xml @@ -0,0 +1,63 @@ +<?xml version="1.0"?> +<?xml-stylesheet type="text/xsl" href="configuration.xsl"?> +<!-- + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. See accompanying LICENSE file. +--> + +<!-- + This template file contains settings needed to run Apache Hadoop jobs + with Ignite In-Memory Accelerator. + + You can replace '$HADOOP_HOME/etc/hadoop/mapred-site.xml' file with this one + to run jobs on localhost (local node can be a part of distributed cluster though). + To run jobs on remote host you have to change jobtracker address to the REST address + of any running Ignite node. + + Note that Ignite jars must be in Apache Hadoop client classpath to work + with this configuration. + + Run script '$IGNITE_HOME/bin/setup-hadoop.{sh|bat}' for Apache Hadoop client setup. +--> + +<configuration> + <!-- + Framework name must be set to 'ignite'. + --> + <property> + <name>mapreduce.framework.name</name> + <value>ignite</value> + </property> + + <!-- + Job tracker address must be set to the REST address of any running + Ignite node. + --> + <property> + <name>mapreduce.jobtracker.address</name> + <value>localhost:11211</value> + </property> + + <!-- Parameters for job tuning. --> + <!-- + <property> + <name>mapreduce.job.reduces</name> + <value>1</value> + </property> + + <property> + <name>mapreduce.job.maps</name> + <value>4</value> + </property> + --> + +</configuration> http://git-wip-us.apache.org/repos/asf/bigtop/blob/8b797104/bigtop-deploy/puppet/modules/ignite-hadoop/tests/init.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/modules/ignite-hadoop/tests/init.pp b/bigtop-deploy/puppet/modules/ignite-hadoop/tests/init.pp new file mode 100644 index 0000000..7fa5c77 --- /dev/null +++ b/bigtop-deploy/puppet/modules/ignite-hadoop/tests/init.pp @@ -0,0 +1,16 @@ +# Licensed to the Apache Software Foundation (ASF) under one or more +# contributor license agreements. See the NOTICE file distributed with +# this work for additional information regarding copyright ownership. +# The ASF licenses this file to You under the Apache License, Version 2.0 +# (the "License"); you may not use this file except in compliance with +# the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, software +# distributed under the License is distributed on an "AS IS" BASIS, +# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +# See the License for the specific language governing permissions and +# limitations under the License. + +ignite-hadoop::server { "test-ignite-hadoop-server": }
