Class Discovery (MAHOUT) edited by abdelhakim deneche
Page: http://cwiki.apache.org/confluence/display/MAHOUT/Class+Discovery
Changes:
http://cwiki.apache.org/confluence/pages/diffpagesbyversion.action?pageId=100778&originalVersion=4&revisedVersion=5
Comment:
---------------------------------------------------------------------
Described what the info file means and how to generate it
Change summary:
---------------------------------------------------------------------
Described what the info file means and how to generate it
Change summary:
---------------------------------------------------------------------
Described what the info file means and how to generate it
Change summary:
---------------------------------------------------------------------
Described what the info file means and how to generate it
Change summary:
---------------------------------------------------------------------
Described what the info file means and how to generate it
Content:
---------------------------------------------------------------------
h1. Intro
See http://www.cs.bham.ac.uk/~wbl/biblio/gecco1999/GP-417.pdf
CDGA uses a Genetic Algorithm to discover a classification rule for a given
dataset.
h1. Running the example:
NOTE: Substitute in the appropriate version for the Mahout JOB jar
# cd <MAHOUT_HOME>/examples
# ant job
# {code}<HADOOP_HOME>/bin/hadoop dfs -put
<MAHOUT_HOME>/examples/src/test/resources/wdbc wdbc{code}
# {code}<HADOOP_HOME>/bin/hadoop dfs -put
<MAHOUT_HOME>/examples/src/test/resources/wdbc.infos wdbc.infos{code}
# {code}<HADOOP_HOME>/bin/hadoop jar
<MAHOUT_HOME>/examples/build/apache-mahout-examples-0.1-dev.job
org.apache.mahout.ga.watchmaker.cd.CDGA
<MAHOUT_HOME>/examples/src/test/resources/wdbc 1 0.9 1 0.033 0.1 0 100 10
{code} *TODO*: Fill in what these parameters mean. See the CDGA class
javadocs. Also fill in where to find the output and what it means.
h1. The info file:
To run properly, CDGA needs some informations about the dataset. Each dataset
should be accompanied by an .infos file that contains the needed informations.
for each attribute a corresponding line in the info file describes it, it can
be one of the following:
* IGNORED
if the attribute is ignored
* LABEL, val1, val2,...
if the attribute is the label (class), and its possible values
* CATEGORICAL, val1, val2,...
if the attribute is categorial (nominal), and its possible values
* NUMERICAL, min, max
if the attribute is numerical, and its min and max values
This file can be generated automaticaly using a special tool available with
CDGA.
{code}$ <HADOOP_HOME>/bin/hadoop jar
<MAHOUT_HOME>/examples/build/apache-mahout-examples-0.1-dev.job
org.apache.mahout.ga.watchmaker.cd.tool.CDInfosTool dataset_path{code}
* the tool searches for an existing infos file (*must be filled by the user*),
in the same directory of the dataset with the same name and with the ".infos"
extension, that contain the type of the attributes:
** 'N' numerical attribute
** 'C' categorical attribute
** 'L' label (this also a categorical attribute)
** 'I' to ignore the attribute
each attribute is in a separate
* A Hadoop job is used to parse the dataset and collect the informations. This
means that *the dataset can be distributed over HDFS*.
* the results are written back in the same .info file, with the correct format
needed by CDGA.
---------------------------------------------------------------------
CONFLUENCE INFORMATION
This message is automatically generated by Confluence
Unsubscribe or edit your notifications preferences
http://cwiki.apache.org/confluence/users/viewnotifications.action
If you think it was sent incorrectly contact one of the administrators
http://cwiki.apache.org/confluence/administrators.action
If you want more information on Confluence, or have a bug to report see
http://www.atlassian.com/software/confluence
