[
https://issues.apache.org/jira/browse/ATLAS-1060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396128#comment-15396128
]
Sharmadha Sainath commented on ATLAS-1060:
------------------------------------------
Set
1.atlas.notification.hook.numthreads=5
2.ATLAS_HOOK created with 5 partitions
3. enabled only KafkaNotification and KafkaConsumer debug logs and disabled
rest.
With ATLAS-1060.patch,
10,000 hive tables take 15 mins 31 secs 32 ms to be ingested in Atlas. table
creation time in hive : 4 mins 48 secs 727 ms
With ATLAS-1060-all-attributes.patch ,
10,000 hive tables take 15 mins 50 secs 626 ms to be ingested in Atlas. table
creation time in hive : 4 mins 51 secs 518 ms
> Add composite indexes for exact match performance improvements for
> selected/all attributes
> ------------------------------------------------------------------------------------------
>
> Key: ATLAS-1060
> URL: https://issues.apache.org/jira/browse/ATLAS-1060
> Project: Atlas
> Issue Type: Bug
> Affects Versions: 0.7-incubating, 0.8-incubating
> Reporter: Suma Shivaprasad
> Assignee: Suma Shivaprasad
> Fix For: 0.8-incubating
>
> Attachments: ATLAS-1060-all-attributes.patch, ATLAS-1060.patch
>
>
> Proposal is to add a flag for each attribute which is by default 'false' for
> creating exact match indexes (titan composite indexes). By default mixed
> idexes are created but not used for exact matches. The proposal is to add
> them for selected attributes.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
