[
https://issues.apache.org/jira/browse/BIGTOP-1634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14307429#comment-14307429
]
Michael Weiser commented on BIGTOP-1634:
----------------------------------------
{quote}once you complete the work.{quote}
This patch includes the journalnode class in module hadoop. I've got that
working in our setup and it seems to do all that is necessary. I had planned to
put together an example of how we do node role assignment in our setup and how
cluster.pp could be reorganized to do the same. And I would certainly like to
clean up the identifier mess I've created (dropping hadoop_ prefixes where
they're not necessary). But that's for other JIRAs.
{quote}different array reputation on yamls{quote}
Ah, right, I forgot: site.csv's
{noformat}hadoop_data_dirs,/data/1,/data/2,/data/3{noformat}
can be written as
{noformat}hadoop::common_hdfs::hadoop_data_dirs: [ '/data/1', '/data/2',
'/data/3' ]{noformat}
which would still allow for one-liners in setup scripts. As long as there's no
spaces in the paths even
{noformat}hadoop::common_hdfs::hadoop_data_dirs:
[/data/1,/data/2,/data/3]{noformat}
works which is as site.csvish as it can get.
> Puppet class parameter and hiera conversion
> -------------------------------------------
>
> Key: BIGTOP-1634
> URL: https://issues.apache.org/jira/browse/BIGTOP-1634
> Project: Bigtop
> Issue Type: Improvement
> Components: deployment
> Affects Versions: backlog
> Reporter: Michael Weiser
> Labels: patch
> Attachments:
> 0001-BIGTOP-1634-puppet-Replace-extlookup-with-hiera-use-.patch,
> 0001-BIGTOP-1634-puppet-Replace-extlookup-with-hiera-use-.patch,
> 0002-BIGTOP-1634-Add-enhanced-configuration.patch
>
>
> As discussed on the DEV list:
> Update the puppet code to use self-contained, parametrised classes and proper
> scoping. Replace all extlookup calls bei either explicit or automatic hiera
> parameter lookups. Implement HA/non-HA alternative via hiera lookup
> hierarchy. Replace append_each from bigtop_util by suffix from stdlib. Do
> file imports via puppet:/// scheme. Remove bigtop_util because remaining
> function get_settings is not needed any more.
> Additionally: Add additional configuration options for zookeeper and yarn as
> well as a new class for journalnode configuration.
> I've separated it into two patches of ease of review:
> 0001: actual hiera/class conversion
> 0002: functional enhancements including journalnode configuration on top of
> that. Mainly meant as an example for ease of further expansion and
> containment of changes to single modules.
> This JIRA is meant for the stuff contained in 0001, the actual hiera
> conversion. I can resubmit 0002 as a separate JIRA if desired. Also it should
> be possible to backport 0002 to the current puppet code base without much
> fuss.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
