[
https://issues.apache.org/jira/browse/TRAFODION-3065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16469458#comment-16469458
]
ASF GitHub Bot commented on TRAFODION-3065:
-------------------------------------------
Github user selvaganesang commented on a diff in the pull request:
https://github.com/apache/trafodion/pull/1557#discussion_r187170425
--- Diff: core/sql/comexe/ComTdbFastTransport.h ---
@@ -395,9 +399,10 @@ class ComTdbFastExtract : public ComTdb
UInt16 filler_; // 130 - 131
UInt32 childDataRowLen_; // 132 - 135
Int64 modTSforDir_; // 136 - 143
+ UInt16 hdfsIoByteArraySize_; // 144 - 147
--- End diff --
Let me change it to int. But 64 MB should be good enough because default
block size is 64 MB in Apache hadoop. In Cloudera hadoop is changed 128MB. But,
this allocation needs to be done in Java and hence restricting to less value
than 64 MB would put less burden on the java objects space management in
Trafodion.
> Trafodion to support compressed Hive Text formatted tables
> ----------------------------------------------------------
>
> Key: TRAFODION-3065
> URL: https://issues.apache.org/jira/browse/TRAFODION-3065
> Project: Apache Trafodion
> Issue Type: New Feature
> Components: sql-cmp, sql-exe
> Reporter: Selvaganesan Govindarajan
> Assignee: Selvaganesan Govindarajan
> Priority: Major
> Fix For: 2.3
>
>
> Currently, Trafodion doesn't support Hive text formatted compressed files.
> The compressed file support will be provided with the refactored Hdfs scan
> implementation only.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
