[
https://issues.apache.org/jira/browse/RANGER-3163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sailaja Polavarapu updated RANGER-3163:
---------------------------------------
Attachment: 0001-RANGER-3163-Created-individual-DB-transactions-for-e.patch
> Ranger Database deadlock when Service creation and user sync are running
> parallel
> ---------------------------------------------------------------------------------
>
> Key: RANGER-3163
> URL: https://issues.apache.org/jira/browse/RANGER-3163
> Project: Ranger
> Issue Type: Bug
> Components: Ranger
> Reporter: Sailaja Polavarapu
> Assignee: Sailaja Polavarapu
> Priority: Major
> Fix For: 3.0.0, 2.2.0
>
> Attachments:
> 0001-RANGER-3163-Created-individual-DB-transactions-for-e.patch
>
>
> Following is the error and some observations:
> *Error :*
> 2021-01-20 13:00:44,036 ERROR org.apache.ranger.rest.ServiceREST:
> createService(RangerService={id=
> {null}
> guid=\{null} isEnabled=\{true} createdBy=\{null} updatedBy=\{null}
> createTime=\{null} updateTime=\{null} version=\{1} name=\{cm_hdfs}
> displayName=\{cm_hdfs} type=\{hdfs} description=\{Hdfs repo}
> tagService=\{null} configs={tag.download.auth.users=
> {hdfs}
> password=LOG-REDACTED policy.download.auth.users=\{hdfs}
> hadoop.security.authentication=\{kerberos}
> hadoop.rpc.protection=\{authentication}
> [fs.default.name|http://fs.default.name/]=\{hdfs://dy-upg41-3.dy-upg41.root.hwx.site:8020}
> hadoop.security.authorization=\{true} username=\{hdfs} }
> policyVersion=\{null} policyUpdateTime=\{null} tagVersion=\{1}
> tagUpdateTime=\{null} }) failed
> javax.persistence.PersistenceException: Exception [EclipseLink-4002] (Eclipse
> Persistence Services - 2.7.7.v20200504-69f2c2b80d):
> org.eclipse.persistence.exceptions.DatabaseException
> Internal Exception:
> com.mysql.jdbc.exceptions.jdbc4.MySQLTransactionRollbackException: Deadlock
> found when trying to get lock; try restarting transaction
> Error Code: 1213
> Call: INSERT INTO x_portal_user (ADDED_BY_ID, CREATE_TIME, EMAIL, FIRST_NAME,
> LAST_NAME, LOGIN_ID, NOTES, OTHER_ATTRIBUTES, PASSWORD, PUB_SCR_NAME, STATUS,
> UPDATE_TIME, UPD_BY_ID, USER_SRC) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?,
> ?, ?)
>
> *Observation:* 1. ** Service creation and user sync are running parallel, the
> issue is occurring when the number of users are more (around 1000) to sync.
> This issue leads to failure in cm_hdfs service creation along with migration
> failure.
> 2. Everytime issue occurs at the time when user sync
> tries to update admin users in x_portal_user.
> 3. I have tried increasing the
> innodb_lock_wait_timeout time from 50(default) to 120 on the cluster
> dy-upg41-3.dy-upg41.root.hwx.site, then migrated the cluster. Still the same
> issue occurred.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
