[
https://issues.apache.org/jira/browse/METRON-706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15860084#comment-15860084
]
ASF GitHub Bot commented on METRON-706:
---------------------------------------
Github user mmiklavc commented on the issue:
https://github.com/apache/incubator-metron/pull/445
Adding these timing notes about the import for reference:
**No filter, local load, multiple threads (5), batch 128**
real 10m22.127s
user 11m11.873s
sys 4m23.912s
903392 rows
**With filters, multiple threads (5), batch 128 (1 record less)**
real 10m58.210s
user 11m10.592s
sys 4m16.585s
903391 rows
**MapReduce mode**
real 9m20.566s
user 0m26.853s
sys 0m10.334s
903391 rows
> Add Stellar transformations and filters to enrichment and threat intel loaders
> ------------------------------------------------------------------------------
>
> Key: METRON-706
> URL: https://issues.apache.org/jira/browse/METRON-706
> Project: Metron
> Issue Type: Improvement
> Reporter: Michael Miklavcic
> Assignee: Michael Miklavcic
>
> This Jira tracks work to add the ability to transform and filter data being
> loaded into the enrichment and threatintel HBase tables.
> This effort builds on the work in:
> https://issues.apache.org/jira/browse/METRON-678
> and
> https://issues.apache.org/jira/browse/METRON-682
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
