[
https://issues.apache.org/jira/browse/TAJO-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14105074#comment-14105074
]
ASF GitHub Bot commented on TAJO-1004:
--------------------------------------
Github user jinossy commented on the pull request:
https://github.com/apache/tajo/pull/116#issuecomment-52880696
Hyunsik,
Could you take a look at this ?
Thanks
Failed tests:
testIncrementOfUnicode(org.apache.tajo.engine.planner.TestUniformRangePartition):
prev=(0=>##??), current=(0=>##??)
Tests in error:
testPartitionForUnicodeDiffLenEndTextAsc(org.apache.tajo.engine.planner.TestUniformRangePartition):
Computed ranges are not totally ordered. Previous key=[(0=>##?), (0=>##??)),
Current Key=[(0=>##??), (0=>##??))
> UniformRangePartition cannot deal with unicode ranges
> -----------------------------------------------------
>
> Key: TAJO-1004
> URL: https://issues.apache.org/jira/browse/TAJO-1004
> Project: Tajo
> Issue Type: Bug
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.9.0
>
>
> UniformRangePartition plays a role to divide a given range into multiple sub
> ranges. It is used for range shuffle.
> When UniformRangePartition divides a range of text fields, it Internally
> transforms arrays of bytes into unsigned integer. But, a byte represent -127
> to 127, and unicode is out of range in byte representation. So, the current
> approach can cause errors in this case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
