[
https://issues.apache.org/jira/browse/PIG-1745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12966302#action_12966302
]
Daniel Dai commented on PIG-1745:
---------------------------------
Yes, I think it is good, in that we can also allow other caster. But different
from HBaseStorage, I don't want to make UTF8StorageConverter special, we
require full qualified caster class name in the constructor parameter, unless
this class is in org.apache.pig.builtin.
> Disable converting bytes loading from BinStorage
> ------------------------------------------------
>
> Key: PIG-1745
> URL: https://issues.apache.org/jira/browse/PIG-1745
> Project: Pig
> Issue Type: Bug
> Components: impl
> Affects Versions: 0.8.0
> Reporter: Daniel Dai
> Assignee: Daniel Dai
> Fix For: 0.9.0
>
> Attachments: PIG-1745-1.patch, PIG-1745-2.patch
>
>
> If we load bytes from BinStorage, we don't actually know how we get these
> bytes originally, and we will not have a way to cast those bytes. Ideally we
> shall encode caster into BinStorage data file, but we are not there yet.
> Currrently bytesToXXX methods for BinStorage is wrong and it results
> unexpected errors. Eg.
> {code}
> a = load '1.txt' as (a0, a1, a2);
> store a into '1.bin' as BinStorage();
> a = load '1.bin' using BinStorage as (a0, a1, a2);
> b = foreach a generate (long)a0;
> dump b;
> {code}
> The code will run but produce wrong data. It's less confusing if we throw an
> exception in this case.
> Release Notes:
> Pig will throw exception in the case we want to convert bytes loading from
> BinStorage
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
