[
https://issues.apache.org/jira/browse/OOZIE-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13715908#comment-13715908
]
Robert Kanter commented on OOZIE-1462:
--------------------------------------
It sounds like compression will help a lot; a few questions:
# As this would require a db change, would we try to do this for 4.0 or wait
for 5.0?
# If a compressed column is a binary lob (byte[]) does that mean you'd no
longer be able to manually go and look in the database to see the data? Or is
there some way to decompress it from a query? (Sorry for the noob question;
I'm not a db guy)
# Have you looked into Derby support for compression? I bet it will have some
shortcommings compared to the other databases that might make things difficult.
> Compress lob columns before storing in database
> -----------------------------------------------
>
> Key: OOZIE-1462
> URL: https://issues.apache.org/jira/browse/OOZIE-1462
> Project: Oozie
> Issue Type: Improvement
> Reporter: Virag Kothari
> Assignee: Virag Kothari
>
> Storing huge data in lobs is very inefficient. Making Oozie compress the data
> before storing will reduce size of data to be stored in lobs and help in
> reducing the time for queries. Also most databases like oracle, mysql support
> storing lob data in tablerow (inline) if the data is of smaller size. Inline
> storage has much better performance compared to outline storage (storage
> outside of tablerow)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
