Hyunsik Choi created TAJO-9:
-------------------------------
Summary: Change the default intermediate data file format for hash
repartitioning
Key: TAJO-9
URL: https://issues.apache.org/jira/browse/TAJO-9
Project: Tajo
Issue Type: Improvement
Components: repartitioning
Reporter: Hyunsik Choi
For easy debugging, the hash repartitioning have used CSV as the default
intermediate data format. CSV file format may cause parsing overhead, and it
may cause relatively large intermediate data to be transmitted via networks. We
need to change it to RawFile or another efficient file format.
Digging PartitionedStoredExec class is a good starting point for this issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira