steveloughran commented on issue #1962: HADOOP-16953. tuning s3guard disabled warnings URL: https://github.com/apache/hadoop/pull/1962#issuecomment-615230083 next iteration has storediag fixed to report ExitExceptions without the stack, and S3AInstrumentation to check for null metrics in shutdown ``` 2020-04-17 13:43:39,020 [main] ERROR s3a.S3AFileSystem (S3Guard.java:logS3GuardDisabled(1100)) - S3Guard is disabled on this bucket: stevel-london 2020-04-17 13:43:39,021 [main] DEBUG s3a.S3AFileSystem (HadoopExecutors.java:shutdown(118)) - Gracefully shutting down executor service. Waiting max 30 SECONDS 2020-04-17 13:43:39,021 [main] DEBUG s3a.S3AFileSystem (HadoopExecutors.java:shutdown(129)) - Succesfully shutdown executor service 2020-04-17 13:43:39,021 [main] DEBUG s3a.S3AFileSystem (HadoopExecutors.java:shutdown(118)) - Gracefully shutting down executor service. Waiting max 30 SECONDS 2020-04-17 13:43:39,021 [main] DEBUG s3a.S3AFileSystem (HadoopExecutors.java:shutdown(129)) - Succesfully shutdown executor service 2020-04-17 13:43:39,021 [main] DEBUG s3a.S3AInstrumentation (S3AInstrumentation.java:close(628)) - Shutting down metrics publisher 2020-04-17 13:43:39,021 [main] DEBUG delegation.S3ADelegationTokens (S3ADelegationTokens.java:serviceStop(225)) - Stopping delegation tokens 2020-04-17 13:43:39,023 [main] DEBUG auth.SignerManager (SignerManager.java:close(140)) - Unregistering fs from 0 initializers 2020-04-17 13:43:39,023 [main] DEBUG s3a.S3AFileSystem (S3AUtils.java:closeAutocloseables(1666)) - Closing AWSCredentialProviderList[refcount= 1: [TemporaryAWSCredentialsProvider, SimpleAWSCredentialsProvider, EnvironmentVariableCredentialsProvider, org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider@3d246ea3] 2020-04-17 13:43:39,023 [main] DEBUG s3a.AWSCredentialProviderList (AWSCredentialProviderList.java:close(315)) - Closing AWSCredentialProviderList[refcount= 0: [TemporaryAWSCredentialsProvider, SimpleAWSCredentialsProvider, EnvironmentVariableCredentialsProvider, org.apache.hadoop.fs.s3a.auth.IAMInstanceCredentialsProvider@3d246ea3] 2020-04-17 13:43:39,023 [main] WARN fs.FileSystem (FileSystem.java:createFileSystem(3418)) - Failed to initialize fileystem s3a://stevel-london/: 46: S3Guard is disabled on this bucket: stevel-london 2020-04-17 13:43:39,024 [main] DEBUG s3a.S3AFileSystem (S3AFileSystem.java:close(3269)) - Filesystem s3a://stevel-london is closed 2020-04-17 13:43:39,024 [main] INFO diag.StoreDiag (DurationInfo.java:close(100)) - Creating filesystem s3a://stevel-london/: duration 0:00:914 2020-04-17 13:43:39,025 [main] INFO util.ExitUtil (ExitUtil.java:terminate(210)) - Exiting with status 46: S3Guard is disabled on this bucket: stevel-london ``` No more stack traces
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
