[
https://issues.apache.org/jira/browse/TAJO-1004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14096566#comment-14096566
]
ASF GitHub Bot commented on TAJO-1004:
--------------------------------------
GitHub user hyunsik opened a pull request:
https://github.com/apache/tajo/pull/116
TAJO-1004: UniformRangePartition cannot deal with unicode ranges.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/hyunsik/tajo TAJO-1004
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/tajo/pull/116.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #116
----
commit 8efe5597a553eaab4f4ed8724e7fbae820adbb71
Author: Hyunsik Choi <[email protected]>
Date: 2014-08-13T09:38:53Z
initial work.
commit 1a938220a3887ba80031a178d01bf47634cb0339
Author: Hyunsik Choi <[email protected]>
Date: 2014-08-14T01:24:09Z
Changing calculate partition num.
commit 7b5a689036c37633e1a47e0ab3b4aa92305b0d99
Author: Hyunsik Choi <[email protected]>
Date: 2014-08-14T02:33:12Z
Improved unicode partition.
commit 262c88cfe3edd22ef638f7f077f27110cd93d860
Author: Hyunsik Choi <[email protected]>
Date: 2014-08-14T04:21:10Z
Completed and add unit tests.
commit 4239e165315dc375850bc0d445b904aea14f7664
Author: Hyunsik Choi <[email protected]>
Date: 2014-08-14T04:52:52Z
Refactored trivial things.
----
> UniformRangePartition cannot deal with unicode ranges
> -----------------------------------------------------
>
> Key: TAJO-1004
> URL: https://issues.apache.org/jira/browse/TAJO-1004
> Project: Tajo
> Issue Type: Bug
> Reporter: Hyunsik Choi
> Assignee: Hyunsik Choi
> Fix For: 0.9.0
>
>
> UniformRangePartition plays a role to divide a given range into multiple sub
> ranges. It is used for range shuffle.
> When UniformRangePartition divides a range of text fields, it Internally
> transforms arrays of bytes into unsigned integer. But, a byte represent -127
> to 127, and unicode is out of range in byte representation. So, the current
> approach can cause errors in this case.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
