I believe you can specify your s3 path for the hfiles directly, as hdfs FileSystem does support s3a scheme, but you would need to add your s3 access and secret key to your completebulkload configuration.
Em qua, 30 de out de 2019 às 19:43, Gautham Acharya < [email protected]> escreveu: > If I have Hfiles stored in S3, can I run CompleteBulkLoad and provide an > S3 Endpoint to run a single command, or do I need to first copy the S3 > Hfiles to HDFS first? The documentation is not very clear. >
