Beam only uses the InsecureClient and the host and port need to be given in
the command line. The other client type uses "Hadoop token delegation
security". Is that what you mean?

Can you give an example of the URL you're using with curl?

On Wed, Feb 3, 2021 at 11:58 AM Ahmet Altay <[email protected]> wrote:

> /cc +Udi Meiri <[email protected]>
>
> On Wed, Feb 3, 2021 at 9:23 AM Doutre, Mark <[email protected]>
> wrote:
>
>> Hi,
>>   I’m trying to use the python sdk to write data to hdfs. However our
>> cluster is kerberized. Is it possible to do this with the current sdk? If
>> it is, how to you get it to authenticate?
>>
>>   Everything works fine from the command line in the box I am using. Can
>> curl to the webhdfs server and port provided I tell curl to negotiate.
>> Can’t find any way to do that from inside beam.
>>
>> Thanks
>> Mark
>>
>

Attachment: smime.p7s
Description: S/MIME Cryptographic Signature

Reply via email to