I kind of imagine that we may have some utilities that help with some
of these common tasks, but I don't know what they are at the moment,
since we don't have that much code just yet. I also, agree, though,
that we don't want to be in that biz. too much, at least not yet. As
we grow and attract more people/contributions, it may just happen.
On Mar 21, 2008, at 9:28 AM, Hao Zheng wrote:
to shunkai,
I agree. It will make the project more dedicated to ML itself, rather
than many tricks on feature preparation/extration/selection.
2008/3/21 shunkai.fu <[EMAIL PROTECTED]>:
I think what you are discussing is about data transformation or data
preparation. It is not necessary part of the Mahout project, or
maybe the
applicants can implement their own InputFormat.
Best,
Shunkai
to Paul,
Combining features into other features involves many tricks. And there
is no standards or criterion to follow. Different users may have
different requirement. I think such thing will make mahout more
complicated. Maybe leaving data preparation to users themselves is a
better choice. All that mahout will process are numbers only.
On Fri, Mar 21, 2008 at 7:49 PM, Paul Elschot
<[EMAIL PROTECTED]> wrote:
For text applications, I think we can leave the basic feature
(ie. term) extraction safely to Lucene, see the
org.apache.lucene.analysis package. Likewise, term vectors
in Lucene are pretty close to general feature vectors.
Combining features into other features is another thing.
For text this boils down to making queries combining basic terms.
There are quite a few opportunities for parallelism there, so
I'd like this to be part of mahout.
I wouldn't know whether a similar breakdown into feature extraction
and feature combination also applies to image recognition.
Is there (more or less) general purpose software available for
basic feature extraction from images?
Regards,
Paul Elschot
--------------------------
Grant Ingersoll
http://www.lucenebootcamp.com
Next Training: April 7, 2008 at ApacheCon Europe in Amsterdam
Lucene Helpful Hints:
http://wiki.apache.org/lucene-java/BasicsOfPerformance
http://wiki.apache.org/lucene-java/LuceneFAQ
