[
https://issues.apache.org/jira/browse/METRON-678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15843663#comment-15843663
]
ASF GitHub Bot commented on METRON-678:
---------------------------------------
Github user cestella commented on the issue:
https://github.com/apache/incubator-metron/pull/428
Note, the batch size is just the split size (number of lines processed in
each split) for the spliterator. The default of 128 is probably pretty good
for almost all cases, I think.
> Multithread the flat file loader
> --------------------------------
>
> Key: METRON-678
> URL: https://issues.apache.org/jira/browse/METRON-678
> Project: Metron
> Issue Type: Improvement
> Reporter: Casey Stella
> Assignee: Casey Stella
>
> Currently the flat file loader is single threaded in its writing to HBase.
> We could make this a lot faster by multithreading the HBase puts.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
