I see that the below property is set to false. This property is used to
call updateSink() method
<https://github.com/apache/ranger/blob/master/ugsync/src/main/java/org/apache/ranger/usergroupsync/UserGroupSync.java#L114>
<property>
<name>ranger.usersync.enabled</name>
<value>false</value>
</property>
On Fri, Mar 8, 2024 at 8:35 AM Loïc CHANEL <loic.cha...@telecomnancy.net>
wrote:
> Missed the attachment before sending the email ... rookie mistake. Here is
> the actual file (sorry for the spam).
> Best regards,
>
> Loïc CHANEL
> Technical leader Big Data
> Capgemini (Lyon, France)
>
>
> Le ven. 8 mars 2024 à 17:33, Loïc CHANEL <loic.cha...@telecomnancy.net> a
> écrit :
>
>> I'm using the 2.4.0 release. You will find the ranger-ugsync-site.xml config
>> file in attachment, feel free to let me know if you need more.
>> Best regards,
>>
>>
>> Loïc CHANEL
>> Technical leader Big Data
>> Capgemini (Lyon, France)
>>
>>
>> Le ven. 8 mars 2024 à 17:24, Sailaja Polavarapu <spolavar...@cloudera.com>
>> a écrit :
>>
>>> Which branch are you using? And can you share the usersync config?
>>>
>>> On Fri, Mar 8, 2024 at 8:10 AM Loïc CHANEL <loic.cha...@telecomnancy.net>
>>> wrote:
>>>
>>>> Hi Sailaja,
>>>>
>>>> I just updated the file and restarted the usersync process, I have the
>>>> exact same logs and the users are still not created. Is there a case in
>>>> which the file is printed but not synced ?
>>>> No error before, except the following warning that's quite usual :
>>>> 08 Mar 2024 16:48:50 WARN o.a.h.u.NativeCodeLoader
>>>> [UnixUserSyncThread] - Unable to load native-hadoop library for your
>>>> platform... using builtin-java classes where applicable
>>>> Still, it's weird that it shows with "UnixUserSyncThread" while it's
>>>> syncing users from a file, isn't it ?
>>>> I'm a bit lost on this, because it is clear that the usersync process
>>>> is able to read the user file and I see it communicating with Ranger Admin
>>>> to load all the users, but the users in the file are not created. Is there
>>>> some configuration missing from
>>>> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process
>>>> ?
>>>> Thanks,
>>>>
>>>>
>>>> Loïc CHANEL
>>>> Technical leader Big Data
>>>> Capgemini (Lyon, France)
>>>>
>>>>
>>>> Le ven. 8 mars 2024 à 16:00, Sailaja Polavarapu <
>>>> spolavar...@cloudera.com> a écrit :
>>>>
>>>>> This is strange as I don't see any logs from updateSink() method
>>>>> <https://github.com/apache/ranger/blob/master/ugsync/src/main/java/org/apache/ranger/unixusersync/process/FileSourceUserGroupBuilder.java#L145>
>>>>> .
>>>>> Can you check the timestamp on the file and try updating the file? and
>>>>> also
>>>>> check if there are any errors before. Looks like this file is read once
>>>>> successfully and hence you see the logs from print() method which logs the
>>>>> data from usersync cache.
>>>>>
>>>>> On Fri, Mar 8, 2024 at 4:40 AM Loïc CHANEL <
>>>>> loic.cha...@telecomnancy.net> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Here are the logs on usersync side :
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder
>>>>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==>
>>>>>> PolMgrBaseUrl
>>>>>> : http://hdp-rec-ranger1-r.l.infra.com:6080 KeyStore File :
>>>>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File :
>>>>>> Authentication Type : kerberos
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper
>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>> ranger.usersync.mapping.username.regex
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper
>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>> ranger.usersync.mapping.groupname.regex
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread]
>>>>>> - initializing source:
>>>>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper
>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>> ranger.usersync.mapping.username.regex
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.AbstractMapper
>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>> ranger.usersync.mapping.groupname.regex
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>> [UnixUserSyncThread] - USER:user_one
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>> [UnixUserSyncThread] - USER:user_two
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>> [UnixUserSyncThread] - GROUP: 900021
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>> [UnixUserSyncThread] - USER:other_user
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread]
>>>>>> - Begin: initial load of user/group from source==>sink
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread]
>>>>>> - End: initial load of user/group from source==>sink
>>>>>> 08 Mar 2024 12:26:54 INFO o.a.r.u.UserGroupSync [UnixUserSyncThread]
>>>>>> - Done initializing user/group source and sink
>>>>>> 08 Mar 2024 12:26:54 DEBUG o.a.r.u.UserGroupSync [UnixUserSyncThread]
>>>>>> - Sleeping for [300000] milliSeconds
>>>>>>
>>>>>> While on the admin side, I only see the following :
>>>>>> 10.18.1.43 - - [08/Mar/2024:12:26:52 +0000] "GET
>>>>>> /service/xusers/users/?startIndex=4000&pageSize=1000 HTTP/1.1" 200
>>>>>> 1065581
>>>>>> 27402 "-" "Java/1.8.0_275"
>>>>>> 10.18.1.43 - - [08/Mar/2024:12:26:54 +0000] "GET
>>>>>> /service/xusers/ugsync/groupusers?startIndex=0&pageSize=1000 HTTP/1.1"
>>>>>> 200
>>>>>> 4429925 2553 "-" "Java/1.8.0_275"
>>>>>>
>>>>>> Looks like usersync isn't even trying to create the users. Anything
>>>>>> I'm missing ?
>>>>>> Best regards,
>>>>>>
>>>>>>
>>>>>> Loïc CHANEL
>>>>>> Technical leader Big Data
>>>>>> Capgemini (Lyon, France)
>>>>>>
>>>>>>
>>>>>> Le ven. 8 mars 2024 à 04:44, Bhavik Patel <bhavikpatel...@gmail.com>
>>>>>> a écrit :
>>>>>>
>>>>>>> Hi,
>>>>>>>
>>>>>>> Can you kindly check Ranger admin logs and did you confirmed
>>>>>>> provided rangeruseraync user password is same at Rangeradmin end.
>>>>>>>
>>>>>>>
>>>>>>> Thanks
>>>>>>> Bhavik Patel
>>>>>>> +91-7208744109
>>>>>>>
>>>>>>>
>>>>>>> On Thu, 7 Mar 2024, 6:39 pm Loïc CHANEL, <
>>>>>>> loic.cha...@telecomnancy.net> wrote:
>>>>>>>
>>>>>>>> Hi guys,
>>>>>>>>
>>>>>>>> I'm currently trying to create Ranger users from a text file and
>>>>>>>> followed this documentation to configure Usersync to work with a text
>>>>>>>> file
>>>>>>>> as a source :
>>>>>>>> https://cwiki.apache.org/confluence/display/RANGER/File+Source+User+Group+Sync+process
>>>>>>>> Still, even if the logs show that the CSV file containing the users
>>>>>>>> is properly read, nothing happens : I can't see the users in Ranger UI.
>>>>>>>> Here are the logs :
>>>>>>>>
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - <==
>>>>>>>> PolicyMgrUserGroupBuilder.buildGroupUserLinkList()
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.PolicyMgrUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - PolicyMgrUserGroupBuilderOld.init()==>
>>>>>>>> PolMgrBaseUrl
>>>>>>>> : http://hdp-rec-ranger1-r.l.internal.com:6080 KeyStore File :
>>>>>>>> /etc/ranger/usersync/conf/cert/unixauthservice.jks TrustStore File :
>>>>>>>> Authentication Type : kerberos
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper
>>>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>>>> ranger.usersync.mapping.username.regex
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper
>>>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>>>> ranger.usersync.mapping.groupname.regex
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync
>>>>>>>> [UnixUserSyncThread] - initializing source:
>>>>>>>> org.apache.ranger.unixusersync.process.FileSourceUserGroupBuilder
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper
>>>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>>>> ranger.usersync.mapping.username.regex
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.AbstractMapper
>>>>>>>> [UnixUserSyncThread] - Initializing for
>>>>>>>> ranger.usersync.mapping.groupname.regex
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - USER:user_one
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - USER:user_two
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - GROUP: 900021
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.p.FileSourceUserGroupBuilder
>>>>>>>> [UnixUserSyncThread] - USER:other_user
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync
>>>>>>>> [UnixUserSyncThread] - Begin: initial load of user/group from
>>>>>>>> source==>sink
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync
>>>>>>>> [UnixUserSyncThread] - End: initial load of user/group from
>>>>>>>> source==>sink
>>>>>>>> 07 Mar 2024 12:22:13 INFO o.a.r.u.UserGroupSync
>>>>>>>> [UnixUserSyncThread] - Done initializing user/group source and sink
>>>>>>>> 07 Mar 2024 12:22:13 DEBUG o.a.r.u.UserGroupSync
>>>>>>>> [UnixUserSyncThread] - Sleeping for [300000] milliSeconds
>>>>>>>>
>>>>>>>> Am I missing something ?
>>>>>>>> Thanks for your help,
>>>>>>>>
>>>>>>>>
>>>>>>>> Loïc CHANEL
>>>>>>>> Technical leader Big Data
>>>>>>>> Capgemini (Lyon, France)
>>>>>>>>
>>>>>>>
