to shunkai, I agree. It will make the project more dedicated to ML itself, rather than many tricks on feature preparation/extration/selection.
2008/3/21 shunkai.fu <[EMAIL PROTECTED]>: > > I think what you are discussing is about data transformation or data > preparation. It is not necessary part of the Mahout project, or maybe the > applicants can implement their own InputFormat. > > Best, > > Shunkai to Paul, Combining features into other features involves many tricks. And there is no standards or criterion to follow. Different users may have different requirement. I think such thing will make mahout more complicated. Maybe leaving data preparation to users themselves is a better choice. All that mahout will process are numbers only. On Fri, Mar 21, 2008 at 7:49 PM, Paul Elschot <[EMAIL PROTECTED]> wrote: > For text applications, I think we can leave the basic feature > (ie. term) extraction safely to Lucene, see the > org.apache.lucene.analysis package. Likewise, term vectors > in Lucene are pretty close to general feature vectors. > > Combining features into other features is another thing. > For text this boils down to making queries combining basic terms. > There are quite a few opportunities for parallelism there, so > I'd like this to be part of mahout. > > I wouldn't know whether a similar breakdown into feature extraction > and feature combination also applies to image recognition. > Is there (more or less) general purpose software available for > basic feature extraction from images? > > Regards, > Paul Elschot
