Ottomata has uploaded a new change for review. (
https://gerrit.wikimedia.org/r/387680 )
Change subject: Install Spark 2 in Hadoop Cluster
......................................................................
Install Spark 2 in Hadoop Cluster
Bug: T158334
Change-Id: I2bb8a50914543f2359f04fb390588e695b7a523d
---
M modules/role/manifests/analytics_cluster/hadoop/worker.pp
1 file changed, 3 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/operations/puppet
refs/changes/80/387680/1
diff --git a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
index 4471a92..f6ebab8 100644
--- a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
+++ b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
@@ -106,6 +106,9 @@
# in order load Spark Python dependencies.
include ::cdh::spark
+ # Spark 2 is manually packaged by us, it is not part of CDH.
+ require_package('spark2')
+
# sqoop needs to be on worker nodes if Oozie is to
# launch sqoop jobs.
include ::cdh::sqoop
@@ -149,8 +152,6 @@
ensure => 'installed',
require => Package['python3-numpy'],
}
-
-
# This allows Hadoop daemons to talk to each other.
ferm::service{ 'hadoop-access':
--
To view, visit https://gerrit.wikimedia.org/r/387680
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I2bb8a50914543f2359f04fb390588e695b7a523d
Gerrit-PatchSet: 1
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
