[
https://issues.apache.org/jira/browse/PIG-482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13130318#comment-13130318
]
Thejas M Nair commented on PIG-482:
-----------------------------------
bq. I don't think this is a duplicate..
I should read more carefully!
Not sure what Olga meant. But one possibility is that she is talking about
bytearray to int/long conversion in Utf8StorageConverter (used by PigStorage
and some other load functions).
It converts bytes to int/long in an inefficient way.
It is the equivalent of -
Integer.valueOf(Double.valueOf(new String(byteArr)).intValue); !
The conversion from bytes to java String is likely to be most expensive part.
> PERFORMANCE: Use hand crafted integer/long conversions
> ------------------------------------------------------
>
> Key: PIG-482
> URL: https://issues.apache.org/jira/browse/PIG-482
> Project: Pig
> Issue Type: Improvement
> Reporter: Olga Natkovich
>
> instead of Integer.valueOf() and Long.valueOf(). Initial tests showed about
> 8x speed up in conversion time.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
