Ottomata has submitted this change and it was merged. (
https://gerrit.wikimedia.org/r/387680 )
Change subject: Install Spark 2 for Hadoop clients
......................................................................
Install Spark 2 for Hadoop clients
Bug: T158334
Change-Id: I2bb8a50914543f2359f04fb390588e695b7a523d
---
M modules/role/manifests/analytics_cluster/client.pp
M modules/role/manifests/analytics_cluster/hadoop/worker.pp
2 files changed, 3 insertions(+), 2 deletions(-)
Approvals:
Ottomata: Looks good to me, approved
jenkins-bot: Verified
diff --git a/modules/role/manifests/analytics_cluster/client.pp
b/modules/role/manifests/analytics_cluster/client.pp
index 89ccdbd..4a70eec 100644
--- a/modules/role/manifests/analytics_cluster/client.pp
+++ b/modules/role/manifests/analytics_cluster/client.pp
@@ -19,6 +19,9 @@
require ::cdh::mahout
require ::cdh::spark
+ # Spark 2 is manually packaged by us, it is not part of CDH.
+ require_package('spark2')
+
# Mount HDFS via Fuse on Analytics client nodes.
# This will mount HDFS at /mnt/hdfs read only.
class { '::cdh::hadoop::mount': }
diff --git a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
index 4471a92..feef748 100644
--- a/modules/role/manifests/analytics_cluster/hadoop/worker.pp
+++ b/modules/role/manifests/analytics_cluster/hadoop/worker.pp
@@ -150,8 +150,6 @@
require => Package['python3-numpy'],
}
-
-
# This allows Hadoop daemons to talk to each other.
ferm::service{ 'hadoop-access':
proto => 'tcp',
--
To view, visit https://gerrit.wikimedia.org/r/387680
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: merged
Gerrit-Change-Id: I2bb8a50914543f2359f04fb390588e695b7a523d
Gerrit-PatchSet: 2
Gerrit-Project: operations/puppet
Gerrit-Branch: production
Gerrit-Owner: Ottomata <[email protected]>
Gerrit-Reviewer: Giuseppe Lavagetto <[email protected]>
Gerrit-Reviewer: Ottomata <[email protected]>
Gerrit-Reviewer: jenkins-bot <>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
