Hi Sailaja, I just updated the file and restarted the usersync process, I have the exact same logs and the users are still not created. Is there a case in which the file is printed but not synced ? No error before, except the following warning that's quite usual : 08 Mar 2024 16:48:50 WARN o.a.h.u.NativeCodeLoader [UnixUserSyncThread] - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Still, it's weird that it shows with "UnixUserSyncThread" while it's syncing users from a file, isn't it ? I'm a bit lost on this, because it is clear that the usersync process is able to read the user file and I see it communicating with Ranger Admin to load all the users, but the users in the file are not created. Is there some configuration missing from https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process ? Thanks,
Loïc CHANEL Technical leader Big Data Capgemini (Lyon, France) Le ven. 8 mars 2024 à 16:00, Sailaja Polavarapu <spolavar...@cloudera.com> a écrit : > This is strange as I don't see any logs from updateSink() method > <https://github.com/apache/ranger/blob/master/ugsync/src/main/java/org/apache/ranger/unixusersync/process/FileSourceUserGroupBuilder.java#L145> > . > Can you check the timestamp on the file and try updating the file? and also > check if there are any errors before. Looks like this file is read once > successfully and hence you see the logs from print() method which logs the > data from usersync cache. > > On Fri, Mar 8, 2024 at 4:40 AM Loïc CHANEL <loic.cha...@telecomnancy.net> > wrote: > >> Hi, >> >> Here are the logs on usersync side : >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> PolMgrBaseUrl >> : http://hdp-rec-ranger1-r.l.infra.com:6080 KeyStore File : >> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >> Authentication Type : kerberos >> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >> Initializing for ranger.usersync.mapping.username.regex >> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >> Initializing for ranger.usersync.mapping.groupname.regex >> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >> initializing source: >> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >> Initializing for ranger.usersync.mapping.username.regex >> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] - >> Initializing for ranger.usersync.mapping.groupname.regex >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >> [UnixUserSyncThread] - USER:user_one >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >> [UnixUserSyncThread] - USER:user_two >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >> [UnixUserSyncThread] - GROUP: 900021 >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >> [UnixUserSyncThread] - USER:other_user >> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >> Begin: initial load of user/group from source==>sink >> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >> End: initial load of user/group from source==>sink >> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >> Done initializing user/group source and sink >> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] - >> Sleeping for [300000] milliSeconds >> >> While on the admin side, I only see the following : >> 10.18.1.43 - - [08/Mar/2024:12:26:52 +0000] "GET >> /service/xusers/users/?startIndex=4000&pageSize=1000 HTTP/1.1" 200 1065581 >> 27402 "-" "Java/1.8.0_275" >> 10.18.1.43 - - [08/Mar/2024:12:26:54 +0000] "GET >> /service/xusers/ugsync/groupusers?startIndex=0&pageSize=1000 HTTP/1.1" 200 >> 4429925 2553 "-" "Java/1.8.0_275" >> >> Looks like usersync isn't even trying to create the users. Anything I'm >> missing ? >> Best regards, >> >> >> Loïc CHANEL >> Technical leader Big Data >> Capgemini (Lyon, France) >> >> >> Le ven. 8 mars 2024 à 04:44, Bhavik Patel <bhavikpatel...@gmail.com> a >> écrit : >> >>> Hi, >>> >>> Can you kindly check Ranger admin logs and did you confirmed provided >>> rangeruseraync user password is same at Rangeradmin end. >>> >>> >>> Thanks >>> Bhavik Patel >>> +91-7208744109 >>> >>> >>> On Thu, 7 Mar 2024, 6:39 pm Loïc CHANEL, <loic.cha...@telecomnancy.net> >>> wrote: >>> >>>> Hi guys, >>>> >>>> I'm currently trying to create Ranger users from a text file and >>>> followed this documentation to configure Usersync to work with a text file >>>> as a source : >>>> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process >>>> Still, even if the logs show that the CSV file containing the users is >>>> properly read, nothing happens : I can't see the users in Ranger UI. Here >>>> are the logs : >>>> >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>> [UnixUserSyncThread] - <== >>>> PolicyMgrUserGroupBuilder.buildGroupUserLinkList() >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> PolMgrBaseUrl >>>> : http://hdp-rec-ranger1-r.l.internal.com:6080 KeyStore File : >>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >>>> Authentication Type : kerberos >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.username.regex >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> initializing source: >>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.username.regex >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:user_one >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:user_two >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - GROUP: 900021 >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:other_user >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Begin: initial load of user/group from source==>sink >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> End: initial load of user/group from source==>sink >>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Done initializing user/group source and sink >>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Sleeping for [300000] milliSeconds >>>> >>>> Am I missing something ? >>>> Thanks for your help, >>>> >>>> >>>> Loïc CHANEL >>>> Technical leader Big Data >>>> Capgemini (Lyon, France) >>>> >>>
