Allow mdl.xml to be split into multiple files for ease of maintenance
---------------------------------------------------------------------
Key: CHUKWA-490
URL: https://issues.apache.org/jira/browse/CHUKWA-490
Project: Hadoop Chukwa
Issue Type: Improvement
Affects Versions: 0.4.0
Reporter: Kirk True
Attachments: DatabaseConfig.diff
We have nearly two dozen different demux implementations that generate data
that is eventually saved into MySQL. On top of this, each different data type
has about twenty or more columns in its resulting table. Specifying all of
these in a single mdl.xml file has caused us some headaches, so we looked into
how we could split mdl.xml into smaller, more manageable chunks. The patch
(forthcoming) simply iterates over the files in $CHUKWA_CONF_DIR and if the
file name ends with "mdl.xml", it will be added as a resource to the
Configuration object used (mdl.xml is loaded first and the others are loaded
subsequently, ensuring that mdl.xml is not then loaded again).
One likely concern is that this doesn't follow the default/site method of
specifying overrides. Also, the ordering of the configuration files'
inclusionis based on the JVM and/or platform implementation of
java.io.File.listFiles.
Regardless, this made it very simple to isolate the files needed by each data
type and update them as needed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
