[ 
https://issues.apache.org/jira/browse/LANG-288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12830097#action_12830097
 ] 

Chandrashekar M commented on LANG-288:
--------------------------------------

When we Tokenize  "[email protected]"  with ".@" using StrTokenizer  it wont tokenize it 
like StringTokeniZer which supports multiple delimeter tokenizing.

So does that mean we will continue with existing behaviour and only when the 
users call method like lastSeparator() we will simply parse the String and 
return the Delimiters? or we will refactor the API such that it will behavi 
like StringTokeniZer

> StrTokenizer needs to support access to the token separators
> ------------------------------------------------------------
>
>                 Key: LANG-288
>                 URL: https://issues.apache.org/jira/browse/LANG-288
>             Project: Commons Lang
>          Issue Type: Improvement
>          Components: lang.text.*
>            Reporter: Stephen Colebourne
>            Priority: Minor
>             Fix For: 3.1
>
>
> With StrTokenizer at present you cannot extract the separators between the 
> tokens, a feature which is possible with StringTokenizer.
> Thus tokenizing "[email protected]" using ".@" would return a,b,c,d but you wouldn't 
> know where the @ was.
> This could probably best be part of the API as a lastSeparator() method that 
> can only be called after next(), returning the separator(s) between that 
> token and the previous token.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to