I'm using the 2.4.0 release. You will find the ranger-ugsync-site.xml config file in attachment, feel free to let me know if you need more. Best regards,
Loïc CHANEL Technical leader Big Data Capgemini (Lyon, France) Le ven. 8 mars 2024 à 17:24, Sailaja Polavarapu <spolavar...@cloudera.com> a écrit : > Which branch are you using? And can you share the usersync config? > > On Fri, Mar 8, 2024 at 8:10 AM Loïc CHANEL <loic.cha...@telecomnancy.net> > wrote: > >> Hi Sailaja, >> >> I just updated the file and restarted the usersync process, I have the >> exact same logs and the users are still not created. Is there a case in >> which the file is printed but not synced ? >> No error before, except the following warning that's quite usual : >> 08 Mar 2024 16:48:50 WARN o.a.h.u.NativeCodeLoader [UnixUserSyncThread] >> - Unable to load native-hadoop library for your platform... using >> builtin-java classes where applicable >> Still, it's weird that it shows with "UnixUserSyncThread" while it's >> syncing users from a file, isn't it ? >> I'm a bit lost on this, because it is clear that the usersync process is >> able to read the user file and I see it communicating with Ranger Admin to >> load all the users, but the users in the file are not created. Is there >> some configuration missing from >> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process >> ? >> Thanks, >> >> >> Loïc CHANEL >> Technical leader Big Data >> Capgemini (Lyon, France) >> >> >> Le ven. 8 mars 2024 à 16:00, Sailaja Polavarapu <spolavar...@cloudera.com> >> a écrit : >> >>> This is strange as I don't see any logs from updateSink() method >>> <https://github.com/apache/ranger/blob/master/ugsync/src/main/java/org/apache/ranger/unixusersync/process/FileSourceUserGroupBuilder.java#L145> >>> . >>> Can you check the timestamp on the file and try updating the file? and also >>> check if there are any errors before. Looks like this file is read once >>> successfully and hence you see the logs from print() method which logs the >>> data from usersync cache. >>> >>> On Fri, Mar 8, 2024 at 4:40 AM Loïc CHANEL <loic.cha...@telecomnancy.net> >>> wrote: >>> >>>> Hi, >>>> >>>> Here are the logs on usersync side : >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> PolMgrBaseUrl >>>> : http://hdp-rec-ranger1-r.l.infra.com:6080 KeyStore File : >>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >>>> Authentication Type : kerberos >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.username.regex >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> initializing source: >>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.username.regex >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper [UnixUserSyncThread] >>>> - Initializing for ranger.usersync.mapping.groupname.regex >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:user_one >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:user_two >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - GROUP: 900021 >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>> [UnixUserSyncThread] - USER:other_user >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Begin: initial load of user/group from source==>sink >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> End: initial load of user/group from source==>sink >>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Done initializing user/group source and sink >>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] - >>>> Sleeping for [300000] milliSeconds >>>> >>>> While on the admin side, I only see the following : >>>> 10.18.1.43 - - [08/Mar/2024:12:26:52 +0000] "GET >>>> /service/xusers/users/?startIndex=4000&pageSize=1000 HTTP/1.1" 200 1065581 >>>> 27402 "-" "Java/1.8.0_275" >>>> 10.18.1.43 - - [08/Mar/2024:12:26:54 +0000] "GET >>>> /service/xusers/ugsync/groupusers?startIndex=0&pageSize=1000 HTTP/1.1" 200 >>>> 4429925 2553 "-" "Java/1.8.0_275" >>>> >>>> Looks like usersync isn't even trying to create the users. Anything I'm >>>> missing ? >>>> Best regards, >>>> >>>> >>>> Loïc CHANEL >>>> Technical leader Big Data >>>> Capgemini (Lyon, France) >>>> >>>> >>>> Le ven. 8 mars 2024 à 04:44, Bhavik Patel <bhavikpatel...@gmail.com> a >>>> écrit : >>>> >>>>> Hi, >>>>> >>>>> Can you kindly check Ranger admin logs and did you confirmed provided >>>>> rangeruseraync user password is same at Rangeradmin end. >>>>> >>>>> >>>>> Thanks >>>>> Bhavik Patel >>>>> +91-7208744109 >>>>> >>>>> >>>>> On Thu, 7 Mar 2024, 6:39 pm Loïc CHANEL, <loic.cha...@telecomnancy.net> >>>>> wrote: >>>>> >>>>>> Hi guys, >>>>>> >>>>>> I'm currently trying to create Ranger users from a text file and >>>>>> followed this documentation to configure Usersync to work with a text >>>>>> file >>>>>> as a source : >>>>>> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process >>>>>> Still, even if the logs show that the CSV file containing the users >>>>>> is properly read, nothing happens : I can't see the users in Ranger UI. >>>>>> Here are the logs : >>>>>> >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>>>> [UnixUserSyncThread] - <== >>>>>> PolicyMgrUserGroupBuilder.buildGroupUserLinkList() >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder >>>>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==> >>>>>> PolMgrBaseUrl >>>>>> : http://hdp-rec-ranger1-r.l.internal.com:6080 KeyStore File : >>>>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File : >>>>>> Authentication Type : kerberos >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper >>>>>> [UnixUserSyncThread] - Initializing for >>>>>> ranger.usersync.mapping.username.regex >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper >>>>>> [UnixUserSyncThread] - Initializing for >>>>>> ranger.usersync.mapping.groupname.regex >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>>> - initializing source: >>>>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper >>>>>> [UnixUserSyncThread] - Initializing for >>>>>> ranger.usersync.mapping.username.regex >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper >>>>>> [UnixUserSyncThread] - Initializing for >>>>>> ranger.usersync.mapping.groupname.regex >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>>> [UnixUserSyncThread] - USER:user_one >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>>> [UnixUserSyncThread] - USER:user_two >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>>> [UnixUserSyncThread] - GROUP: 900021 >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder >>>>>> [UnixUserSyncThread] - USER:other_user >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>>> - Begin: initial load of user/group from source==>sink >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>>> - End: initial load of user/group from source==>sink >>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>>> - Done initializing user/group source and sink >>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread] >>>>>> - Sleeping for [300000] milliSeconds >>>>>> >>>>>> Am I missing something ? >>>>>> Thanks for your help, >>>>>> >>>>>> >>>>>> Loïc CHANEL >>>>>> Technical leader Big Data >>>>>> Capgemini (Lyon, France) >>>>>> >>>>>
