Hi all, I would like to send a boto/boto3 library while running pyspark with yarn client mode, how is it possible? I am aware sc.addFile(<path>) can add a .py file, is it the same for a library?
Cheers, Gorka.
Hi all, I would like to send a boto/boto3 library while running pyspark with yarn client mode, how is it possible? I am aware sc.addFile(<path>) can add a .py file, is it the same for a library?
Cheers, Gorka.