dannycjones commented on code in PR #4140:
URL: https://github.com/apache/hadoop/pull/4140#discussion_r843118842
##########
hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/S3ATestConstants.java:
##########
@@ -108,6 +108,21 @@
*/
String DEFAULT_REQUESTER_PAYS_FILE =
"s3a://usgs-landsat/collection02/catalog.json";
+ /**
+ * Configuration key for an existing bucket with many objects: {@value}.
+ *
+ * This is used for tests depending on buckets with a large number of keys.
+ */
+ String KEY_BUCKET_WITH_MANY_OBJECTS
+ = TEST_FS_S3A + "bucket-with-many-objects";
+
+ /**
+ * Default bucket for when {@value KEY_BUCKET_WITH_MANY_OBJECTS} is not set:
+ * {@value}.
+ */
+ String DEFAULT_BUCKET_MANY_OBJECTS
+ = "s3a://commoncrawl/";
Review Comment:
Need to find an alternative bucket here. `landsat-pds` was funded by AWS, we
should find a bucket that supports requester pays so we are not adding cost to
the bucket owner.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
