On Nov 19, 2010, at 3:48 AM, Jörn Kottmann wrote: > Hi, > > lets vote on the acceptance of the OpenNLP Project for incubation > at the Apache Incubator. > > The proposal is on the wiki > http://wiki.apache.org/incubator/OpenNLPProposal > and a copy is included below. > > The discussion thread can be found here: > http://mail-archives.apache.org/mod_mbox/incubator-general/201011.mbox/%3c4ce4f1f4.3010...@gmail.com%3e > > Please cast your votes: > > [X] +1 Accept OpenNLP for incubation > [ ] +0 Don't care > [ ] -1 Reject for the following reason: >
-Matt > The vote is open for at least 72 hours. > > Thanks! > Jörn > > = OpenNLP Proposal = > The following is a proposal for a new top-level project within the ASF. > > == Abstract == > OpenNLP is a Java machine learning toolkit for natural language processing > (NLP). > > == Proposal == > OpenNLP is a machine learning based toolkit for the processing of natural > language text. It supports the most common NLP tasks, such as tokenization, > sentence segmentation, part-of-speech tagging, named entity extraction, > chunking, parsing, and coreference resolution. These tasks are usually > required to build more advanced text processing services. > > The goal of the OpenNLP project will be to create a mature toolkit for the > abovementioned tasks. An additional goal is to provide a large number of > pre-built models for a variety of languages, as well as the annotated text > resources that those models are derived from. > > == Background == > OpenNLP was started in 2000 by Jason Baldridge and Gann Bierner while they > were graduate students in the Division of Informatics at the University of > Edinburgh. OpenNLP, broadly speaking, was meant to be a high-level > organizational unit for various open source software packages for natural > language processing; more practically, it provided a high-level package name > for various Java packages of the form opennlp.*. The first OpenNLP software > package was the Grok natural language parsing toolkit, which was also the > genesis of what is now called the OpenNLP Toolkit. The software released on > the OpenNLP sourceforge site (started in 2000, along with Grok) was simply a > set of interfaces defined in the package opennlp.common and referred to as > the OpenNLP Java API. The actual implementations of natural language > processing components were provided in Grok, along with code for sentence > parsing with Combinatory Categorial Grammar. This code was used heavily in > both Baldridge's and Biern > er's dissertations. The first paper that used Grok, and especially the > components that would become the OpenNLP Toolkit is > [[http://comp.ling.utexas.edu/jbaldrid/papers/hockenmaier_etal_ESSLLI2000.pdf|Hockenmaier, > Bierner and Baldridge (2000)]] (later updated as the journal article > [[http://comp.ling.utexas.edu/jbaldrid/papers/HockenmaierEtal2004.pdf|Hockenmaier, > Bierner, and Baldridge (2004)]]). > > In 2003, it was decided to remove the NLP infrastructure from Grok as there > was a clear separation between the basic text processing components and the > syntactic and semantic analysis components. At the same time, Grok was > rebranded as OpenCCG (openccg.sf.net). The final release of the OpenNLP Java > API was made in March 2003; the new OpenNLP Toolkit was created from the API > and the Grok text processing components, with version 1.0 being released in > April 2004. The OpenNLP Toolkit and OpenCCG have evolved independently since > then and have mostly independent and active developer and user communities. > OpenCCG is primarily used in the academic community, while OpenNLP has > considerable use in both academia and industry. As in indication of the > academic impact of OpenNLP, a search on Google scholar (done in March 2010) > returned about 650 publications citing the package. Some of these include the > OpenNLP website and a few non-publications plus some self-citations. Based on > a scan of > these results, we estimate that about 500 actual publications have used > OpenNLP in their work, and there are an addition 50 or so quasi-publications > like surveys and instruction manuals. > > The activity level of the OpenNLP project has fluctuated over that past 10+ > years, with a large uptick in the last two years especially. Most recently, > due both to the availability of new documentation and the release of version > 1.5 , there have been many more downloads and page views for the OpenNLP > project. In fact, September 2010 had the most downloads (1,561) and project > web hits (226,391) of any month since the project's beginning in 2000, and > October is keeping pacing with that figure so far. As a result, OpenNLP has > gone from being in the 2000th to 4000th ranked project (between January and > May, 2010) to being ranked 570, 314, 181 and 439 for July, August, September, > and October respectively. Full details are available on the Sourceforge > statistics page for OpenNLP. (There are 240,000 projects hosted on > SourceForge, though this figure includes many, many projects that never > actually get started: it seems that about 7-10% of these are stable, active > projects base > d on a review done in 2007.) > > == Rationale == > OpenNLP fills a significant gap at the ASF in regards to human language > processing tools. While Lucene/Solr, UIMA and Mahout all have some tools in > this area, none of them are solely focused on tools specifically for working > with natural language like OpenNLP. > > == Initial Goals == > The initial goals of the proposed project are: > > * Bring the community together at the ASF and make the development process > transparent for them > * Write user documentation about all major components > * Automated build including train and evaluate regression tests > * Produce an Incubating release > > == Current Status == > === Meritocracy === > Some of the initial committers are familiar with Apache's idea of > meritocracy, others aren't. We will get everybody on the same level as part > of the incubation process. > > === Community === > OpenNLP already has a considerable user base, both in industry and academia. > > === Core Developers === > See the initial committer list. > > === Alignment === > OpenNLP has tie-ins with several existing Apache projects. We have been > distributing wrappers for UIMA for some time now (two UIMA committers also > contribute to OpenNLP). We expect this collaboration to strengthen further > after our move to Apache. > > Another obvious connection exists to some of the projects under the Lucene > umbrella. On the one hand, projects like Solr may benefit from the OpenNLP > analysis capabilities to create specialized search for particular domains. > On the other, OpenNLP may benefit from the machine learning code that is > being developed in Mahout, and maybe get some people from that community to > lend a hand. > > == Known Risks == > === Orphaned products === > The project has been around for quite a number of years already, it has a > well-established user community and a diverse set of committers. > > === Inexperience with Open Source === > OpenNLP has been an open source project for quite some time. Many of the > developers are already familiar with both open source in general and the ASF > in particular. > > === Homogenous Developers === > The current group of developers is very diverse, no two developers work for > the same organization. > > === Reliance on Salaried Developers === > Most of the developers are not paid to work on OpenNLP, so there is little > reliance on salaried developers. > > === Relationships with Other Apache Products === > NLP is often used in search and other algorithms that work with unstructured > data, thus OpenNLP is likely to be useful to the Lucene and Solr communities. > It also aligns nicely with both Mahout and UIMA. > > === A Excessive Fascination with the Apache Brand === > We think the project aligns nicely with the goals of the ASF to disseminate > source code to the public free of charge. NLP has long been the subject of > cutting edge research, but is often lacking in community and shared > knowledge. We believe that by bringing OpenNLP to the ASF, the Apache brand > will help deliver NLP capabilities to a much larger audience and likewise a > cutting edge project like OpenNLP can further the ASF brand by providing > users with tried and true, as well as new, natural language processing > capabilities. > > == Documentation == > *http://opennlp.sourceforge.net/README.html > *http://sourceforge.net/apps/mediawiki/opennlp/index.php?title=Main_Page > > == Initial Source == > The source code is maintained in two CVS repositories on SourceForge. > > OpenNLP Maxent:http://maxent.cvs.sourceforge.net/viewvc/maxent/ > > OpenNLP Tools and OpenNLP > UIMA:http://opennlp.cvs.sourceforge.net/viewvc/opennlp/ > > == Source and Intellectual Property Submission Plan == > The OpenNLP source code is already open source under the AL 2.0. > > == External Dependencies == > ||'''Library''' ||||<style="text-align: center;">'''License''' > ||||<style="text-align: center;">'''Description''' || > ||JWNL ||||<style="text-align: center;">BSD ||||<style="text-align: > center;">Java Wordnet Library || > ||JUnit ||||<style="text-align: center;">CPL ||||<style="text-align: > center;">Unit Testing Framework || > ||UIMA ||||<style="text-align: center;">AL 2.0 ||||<style="text-align: > center;">Unstructured Information Management Architecture || > > > == Cryptography == > OpenNLP neither provides nor uses any cryptography. > > == Required Resources == > === Mailing lists === > * opennlp-dev > * opennlp-private > * opennlp-user > * opennlp-commits > > === Subversion Directory === > https://svn.apache.org/repos/asf/incubator/opennlp > > === Issue Tracking === > Jira: OPENNLP > > === Other Resources === > == Initial Committers == > ||'''Name''' ||||<style="text-align: center;">'''Email''' > ||||<style="text-align: center;">'''CLA''' || > ||Thilo Goetz ||||<style="text-align: center;"> twgo...@apache.org > ||||<style="text-align: center;">yes || > ||Grant Ingersoll ||||<style="text-align: center;"> gsing...@apache.org > ||||<style="text-align: center;">yes || > ||Jörn Kottmann ||||<style="text-align: center;"> jo...@apache.org > ||||<style="text-align: center;">yes || > ||Thomas Morton ||||<style="text-align: center;"> tsmor...@gmail.com > ||||<style="text-align: center;">no || > ||William Silva ||||<style="text-align: center;"> william.co...@gmail.com > ||||<style="text-align: center;">yes || > ||Jason Baldridge ||||<style="text-align: center;"> jasonbaldri...@gmail.com > ||||<style="text-align: center;">yes || > ||James Kosin ||||<style="text-align: center;"> james.ko...@gmail.com > ||||<style="text-align: center;">yes || > > > == Affiliations == > ||'''Name''' ||||<style="text-align: center;">'''Affiliation''' || > ||Thilo Goetz ||||<style="text-align: center;">IBM || > ||Grant Ingersoll ||||<style="text-align: center;">Lucid Imagination || > ||Jörn Kottmann ||||<style="text-align: center;">Infopaq International A/S || > ||Thomas Morton ||||<style="text-align: center;">Comcast Corporation || > ||William Silva ||||<style="text-align: center;">São Paulo University || > ||Jason Baldridge ||||<style="text-align: center;">The University of Texas at > Austin || > ||James Kosin ||||<style="text-align: center;">International Communications > Group, Inc. || > > > == Sponsors == > === Champion === > Grant Ingersoll > > === Nominated Mentors === > Isabel Drost > > Grant Ingersoll > > Benson Margulies > > > > === Sponsoring Entity === > The Apache Incubator > > --------------------------------------------------------------------- To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
