bpahuja commented on code in PR #6407:
URL: https://github.com/apache/hadoop/pull/6407#discussion_r1487363104


##########
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java:
##########
@@ -577,6 +583,11 @@ public void initialize(URI name, Configuration 
originalConf)
 
       s3aInternals = createS3AInternals();
 
+      s3ObjectStorageClassFilter = 
Optional.of(conf.getTrimmed(READ_RESTORED_GLACIER_OBJECTS,

Review Comment:
   By Default, we read all objects coming as part of listObjects API call and 
when an engine tries to access the archived file it fails with 
   
   
   software.amazon.awssdk.services.s3.model.InvalidObjectStateException: The 
operation is not valid for the object's storage class (Service: S3, Status 
Code: 403, Request ID: X05JDR633AAK4TBQ, Extended Request ID: 
uOxWdN4giUAuB9a4YWvnyrXPYCi2U35P5BrHhFO3aLSLLe4GtWhXGXCEJ/Ld5EyGr5b6VezTzeI=):InvalidObjectState
        at 
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:243)



##########
hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java:
##########
@@ -577,6 +583,11 @@ public void initialize(URI name, Configuration 
originalConf)
 
       s3aInternals = createS3AInternals();
 
+      s3ObjectStorageClassFilter = 
Optional.of(conf.getTrimmed(READ_RESTORED_GLACIER_OBJECTS,

Review Comment:
   By Default, we read all objects coming as part of listObjects API call and 
when an engine tries to access the archived file it fails with 
   
   ```
   software.amazon.awssdk.services.s3.model.InvalidObjectStateException: The 
operation is not valid for the object's storage class (Service: S3, Status 
Code: 403, Request ID: X05JDR633AAK4TBQ, Extended Request ID: 
uOxWdN4giUAuB9a4YWvnyrXPYCi2U35P5BrHhFO3aLSLLe4GtWhXGXCEJ/Ld5EyGr5b6VezTzeI=):InvalidObjectState
        at 
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:243)
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to