Support Unicode 6.1.0
---------------------

                 Key: LUCENE-3747
                 URL: https://issues.apache.org/jira/browse/LUCENE-3747
             Project: Lucene - Java
          Issue Type: Improvement
          Components: modules/analysis
    Affects Versions: 3.5, 4.0
            Reporter: Steven Rowe
            Priority: Minor


Now that Unicode 6.1.0 has been released, Lucene/Solr should support it.

JFlex trunk now supports Unicode 6.1.0.

Tasks include:

* Upgrade ICU4J to v49 (after it's released, on 2012-03-21, according to 
http://icu-project.org).
* Use {{icu}} module tools to regenerate the supplementary character additions 
to JFlex grammars.
* Version the JFlex grammars: copy the current implementations to 
{{*Impl3<X>}}; cause the versioning tokenizer wrappers to instantiate this 
version when the {{Version}} c-tor param is in the range 3.1 to the version in 
which these changes are released (excluding the range endpoints); then change 
the specified Unicode version in the non-versioned JFlex grammars from 6.0 to 
6.1.
* Regenerate JFlex scanners, including {{StandardTokenizerImpl}}, 
{{UAX29URLEmailTokenizerImpl}}, and {{HTMLStripCharFilter}}.





--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to