[
https://issues.apache.org/jira/browse/ATLAS-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16929787#comment-16929787
]
ASF subversion and git services commented on ATLAS-3368:
--------------------------------------------------------
Commit 7a472f704719f0ab762b556f8b701ab4951d38b1 in atlas's branch
refs/heads/branch-2.0 from Bolke de Bruin
[ https://gitbox.apache.org/repos/asf?p=atlas.git;h=7a472f7 ]
ATLAS-3368: log warning for references without relationship-def
Signed-off-by: Madhan Neethiraj <[email protected]>
(cherry picked from commit 3eadf7e875f810713b3a11a8e49ab2054128ac93)
> Very slow creation of entities with referred entities without relationshipDef
> -----------------------------------------------------------------------------
>
> Key: ATLAS-3368
> URL: https://issues.apache.org/jira/browse/ATLAS-3368
> Project: Atlas
> Issue Type: Bug
> Affects Versions: 2.0.0
> Reporter: Bolke de Bruin
> Priority: Major
> Labels: performance
> Attachments:
> 0001-ATLAS-3368-Set-log-level-to-warn-for-relationships-w.patch
>
>
> If an entity is created that has a definition with a reference to a non built
> in type, e.g.
> {code:java}
> ,{
> "name" : "server",
> "typeName" : "server",
> "isOptional" : false,
> "cardinality" : "SINGLE",
> "valuesMinCount" : 1,
> "valuesMaxCount" : 1,
> "isUnique" : false,
> "isIndexable" : true
> }{code}
> It will trigger a legacy code path in EntityGraphMapper. This path can take
> excessive amounts of time:
> {code}2019-08-12 12:10:23,323 DEBUG - [NotificationHookConsumer thread-0:] ~
> No RelationshipDef defined between rokku_client and server on attribute:
> server (EntityGraphMapper:907)
> 2019-08-12 12:10:23,323 DEBUG - [NotificationHookConsumer thread-0:] ~ ==>
> mapObjectIdValue(org.apache.atlas.repository.store.graph.v2.AttributeMutationContext@3f7c5b66)
> (EntityGraphMapper:791)
> 2019-08-12 12:10:28,825 DEBUG - [NotificationHookConsumer thread-0:] ~ ==>
> setProperty(edge[id=v6kwld-biutqg-xel1-x8oqg label=__rokku_client.server from
> vertex[id=696799240 type=rokku_client
> guid=30db90a8-8236-41c6-9438-4fa2ec14f349] -> to vertex[id=55832632
> type=server guid=9144e224-089f-4ae3-83bd-3472175d92a4]], __state, ACTIVE)
> (AtlasGraphUtilsV2:212)
> 2019-08-12 12:10:23,323 DEBUG - [NotificationHookConsumer thread-0:] ~ ==>
> mapObjectIdValue(org.apache.atlas.repository.store.graph.v2.AttributeMutationContext@3f7c5b66)
> (EntityGraphMapper:791)
> 2019-08-12 12:10:28,825 DEBUG - [NotificationHookConsumer thread-0:] ~ ==>
> setProperty(edge[id=v6kwld-biutqg-xel1-x8oqg label=__rokku_client.server from
> vertex[id=696799240 type=rokku_client
> guid=30db90a8-8236-41c6-9438-4fa2ec14f349] -> to vertex[id=55832632
> type=server guid=9144e224-089f-4ae3-83bd-3472175d92a4]], __state, ACTIVE)
> (AtlasGraphUtilsV2:212)
> {code}
> Notice the 5 second(!) jump between the last two log lines. At a minimum the
> log about triggering the legacy code path should be at WARN level and
> extended with a suggestion to update the definition for better performance.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
