[
https://issues.apache.org/jira/browse/HADOOP-19378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17908954#comment-17908954
]
Steve Loughran commented on HADOOP-19378:
-----------------------------------------
{code}
***********************************************************/
2024-12-30 16:59:31,904 WARN [main] org.apache.hadoop.util.NativeCodeLoader:
Unable to load native-hadoop library for your platform... using builtin-java
classes where applicable
2024-12-30 16:59:31,916 INFO [main] org.apache.hadoop.security.SecurityUtil:
Updating Configuration
2024-12-30 16:59:31,998 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Executing with tokens: [Kind:
YARN_AM_RM_TOKEN, Service: , Ident: (appAttemptId { application_id { id: 2
cluster_timestamp: 1735577949447 } attemptId: 1 } keyId: -759706486)]
2024-12-30 16:59:32,018 INFO [main] org.apache.hadoop.conf.Configuration:
resource-types.xml not found
2024-12-30 16:59:32,018 INFO [main]
org.apache.hadoop.yarn.util.resource.ResourceUtils: Unable to find
'resource-types.xml'.
2024-12-30 16:59:32,024 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Using mapred newApiCommitter.
2024-12-30 16:59:32,025 INFO [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: OutputCommitter set in config
null
2024-12-30 16:59:32,042 INFO [main]
org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory: Using
schema-specific factory for
s3a://stevel-london/job-00/test/terasort-magic-false/sortin
2024-12-30 16:59:32,043 INFO [main]
org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory: Using
OutputCommitter factory class class
org.apache.hadoop.fs.s3a.commit.S3ACommitterFactory from key
mapreduce.outputcommitter.factory.scheme.s3a
2024-12-30 16:59:34,180 WARN [main] org.apache.hadoop.fs.FileSystem: Failed to
initialize filesystem
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
2024-12-30 16:59:34,181 INFO [main] org.apache.hadoop.service.AbstractService:
Service org.apache.hadoop.mapreduce.v2.app.MRAppMaster failed in state INITED
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:553)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:533)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1809)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:533)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:310)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:165)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$6.run(MRAppMaster.java:1767)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1959)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1764)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1685)
Caused by: org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:231)
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:158)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:825)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3615)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:554)
at
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitterFactory.getDestinationFileSystem(AbstractS3ACommitterFactory.java:74)
at
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitterFactory.createOutputCommitter(AbstractS3ACommitterFactory.java:45)
at
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.getOutputCommitter(FileOutputFormat.java:338)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:551)
... 11 more
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Unable to
load region from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111)
at
software.amazon.awssdk.regions.providers.AwsRegionProviderChain.getRegion(AwsRegionProviderChain.java:70)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveRegion(AwsDefaultClientBuilder.java:293)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at
software.amazon.awssdk.utils.AttributeMap$Builder.internalGet(AttributeMap.java:389)
at
software.amazon.awssdk.utils.AttributeMap$Builder.access$1300(AttributeMap.java:201)
at
software.amazon.awssdk.utils.AttributeMap$Builder$1.get(AttributeMap.java:399)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveSigningRegion(AwsDefaultClientBuilder.java:260)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at
software.amazon.awssdk.utils.AttributeMap$Builder.build(AttributeMap.java:362)
at
software.amazon.awssdk.core.client.config.SdkClientConfiguration$Builder.build(SdkClientConfiguration.java:232)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeAwsConfiguration(AwsDefaultClientBuilder.java:184)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeChildConfiguration(AwsDefaultClientBuilder.java:161)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.syncClientConfiguration(SdkDefaultClientBuilder.java:188)
at
software.amazon.awssdk.services.kms.DefaultKmsClientBuilder.buildClient(DefaultKmsClientBuilder.java:36)
at
software.amazon.awssdk.services.kms.DefaultKmsClientBuilder.buildClient(DefaultKmsClientBuilder.java:25)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.build(SdkDefaultClientBuilder.java:155)
at
software.amazon.encryption.s3.materials.KmsKeyring$Builder.<init>(KmsKeyring.java:233)
at
software.amazon.encryption.s3.materials.KmsKeyring$Builder.<init>(KmsKeyring.java:232)
at
software.amazon.encryption.s3.materials.KmsKeyring.builder(KmsKeyring.java:214)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createKmsKeyring(EncryptionS3ClientFactory.java:219)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createS3EncryptionClient(EncryptionS3ClientFactory.java:167)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createS3Client(EncryptionS3ClientFactory.java:119)
at
org.apache.hadoop.fs.s3a.impl.ClientManagerImpl.lambda$createS3Client$0(ClientManagerImpl.java:137)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.invokeTrackingDuration(IOStatisticsBinding.java:547)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:528)
at
org.apache.hadoop.util.functional.LazyAtomicReference.eval(LazyAtomicReference.java:94)
at
org.apache.hadoop.util.functional.LazyAutoCloseableReference.eval(LazyAutoCloseableReference.java:54)
at
org.apache.hadoop.fs.s3a.impl.ClientManagerImpl.getOrCreateS3Client(ClientManagerImpl.java:178)
at
org.apache.hadoop.fs.s3a.impl.S3AStoreImpl.getOrCreateS3Client(S3AStoreImpl.java:298)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:813)
... 17 more
2024-12-30 16:59:34,184 ERROR [main]
org.apache.hadoop.mapreduce.v2.app.MRAppMaster: Error starting MRAppMaster
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:553)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:533)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.callWithJobClassLoader(MRAppMaster.java:1809)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.createOutputCommitter(MRAppMaster.java:533)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.serviceInit(MRAppMaster.java:310)
at
org.apache.hadoop.service.AbstractService.init(AbstractService.java:165)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$6.run(MRAppMaster.java:1767)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1959)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.initAndStartAppMaster(MRAppMaster.java:1764)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster.main(MRAppMaster.java:1685)
Caused by: org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:231)
at
org.apache.hadoop.fs.s3a.S3AUtils.translateException(S3AUtils.java:158)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:825)
at
org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3615)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:554)
at
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitterFactory.getDestinationFileSystem(AbstractS3ACommitterFactory.java:74)
at
org.apache.hadoop.fs.s3a.commit.AbstractS3ACommitterFactory.createOutputCommitter(AbstractS3ACommitterFactory.java:45)
at
org.apache.hadoop.mapreduce.lib.output.FileOutputFormat.getOutputCommitter(FileOutputFormat.java:338)
at
org.apache.hadoop.mapreduce.v2.app.MRAppMaster$3.call(MRAppMaster.java:551)
... 11 more
Caused by: software.amazon.awssdk.core.exception.SdkClientException: Unable to
load region from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
at
software.amazon.awssdk.core.exception.SdkClientException$BuilderImpl.build(SdkClientException.java:111)
at
software.amazon.awssdk.regions.providers.AwsRegionProviderChain.getRegion(AwsRegionProviderChain.java:70)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveRegion(AwsDefaultClientBuilder.java:293)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at
software.amazon.awssdk.utils.AttributeMap$Builder.internalGet(AttributeMap.java:389)
at
software.amazon.awssdk.utils.AttributeMap$Builder.access$1300(AttributeMap.java:201)
at
software.amazon.awssdk.utils.AttributeMap$Builder$1.get(AttributeMap.java:399)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.resolveSigningRegion(AwsDefaultClientBuilder.java:260)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.primeCache(AttributeMap.java:600)
at
software.amazon.awssdk.utils.AttributeMap$DerivedValue.get(AttributeMap.java:589)
at
software.amazon.awssdk.utils.AttributeMap$Builder.resolveValue(AttributeMap.java:396)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at
software.amazon.awssdk.utils.AttributeMap$Builder.build(AttributeMap.java:362)
at
software.amazon.awssdk.core.client.config.SdkClientConfiguration$Builder.build(SdkClientConfiguration.java:232)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeAwsConfiguration(AwsDefaultClientBuilder.java:184)
at
software.amazon.awssdk.awscore.client.builder.AwsDefaultClientBuilder.finalizeChildConfiguration(AwsDefaultClientBuilder.java:161)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.syncClientConfiguration(SdkDefaultClientBuilder.java:188)
at
software.amazon.awssdk.services.kms.DefaultKmsClientBuilder.buildClient(DefaultKmsClientBuilder.java:36)
at
software.amazon.awssdk.services.kms.DefaultKmsClientBuilder.buildClient(DefaultKmsClientBuilder.java:25)
at
software.amazon.awssdk.core.client.builder.SdkDefaultClientBuilder.build(SdkDefaultClientBuilder.java:155)
at
software.amazon.encryption.s3.materials.KmsKeyring$Builder.<init>(KmsKeyring.java:233)
at
software.amazon.encryption.s3.materials.KmsKeyring$Builder.<init>(KmsKeyring.java:232)
at
software.amazon.encryption.s3.materials.KmsKeyring.builder(KmsKeyring.java:214)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createKmsKeyring(EncryptionS3ClientFactory.java:219)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createS3EncryptionClient(EncryptionS3ClientFactory.java:167)
at
org.apache.hadoop.fs.s3a.impl.EncryptionS3ClientFactory.createS3Client(EncryptionS3ClientFactory.java:119)
at
org.apache.hadoop.fs.s3a.impl.ClientManagerImpl.lambda$createS3Client$0(ClientManagerImpl.java:137)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.invokeTrackingDuration(IOStatisticsBinding.java:547)
at
org.apache.hadoop.fs.statistics.impl.IOStatisticsBinding.lambda$trackDurationOfOperation$5(IOStatisticsBinding.java:528)
at
org.apache.hadoop.util.functional.LazyAtomicReference.eval(LazyAtomicReference.java:94)
at
org.apache.hadoop.util.functional.LazyAutoCloseableReference.eval(LazyAutoCloseableReference.java:54)
at
org.apache.hadoop.fs.s3a.impl.ClientManagerImpl.getOrCreateS3Client(ClientManagerImpl.java:178)
at
org.apache.hadoop.fs.s3a.impl.S3AStoreImpl.getOrCreateS3Client(S3AStoreImpl.java:298)
at
org.apache.hadoop.fs.s3a.S3AFileSystem.initialize(S3AFileSystem.java:813)
... 17 more
2024-12-30 16:59:34,185 INFO [main] org.apache.hadoop.util.ExitUtil: Exiting
with status 1: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.fs.s3a.AWSClientIOException: initializing on
s3a://stevel-london/job-00/test/terasort-magic-false/sortin:
software.amazon.awssdk.core.exception.SdkClientException: Unable to load region
from any of the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]: Unable to load region from any of
the providers in the chain
software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain@4912d525:
[software.amazon.awssdk.regions.providers.SystemSettingsRegionProvider@982bb90:
Unable to load region from system settings. Region must be specified either via
environment variable (AWS_REGION) or system property (aws.region).,
software.amazon.awssdk.regions.providers.AwsProfileRegionProvider@4a29f290: No
region provided in profile: default,
software.amazon.awssdk.regions.providers.InstanceProfileRegionProvider@77a281fc:
Unable to contact EC2 metadata service.]
{code}
> S3A: terasort tests fail with CSE-kMS enabled and london region
> ---------------------------------------------------------------
>
> Key: HADOOP-19378
> URL: https://issues.apache.org/jira/browse/HADOOP-19378
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: fs/s3, test
> Affects Versions: 3.4.2
> Environment: test bucket with cse-kms both bucket and kms in
> eu-west-2 region
> Reporter: Steve Loughran
> Assignee: Syed Shameerur Rahman
> Priority: Major
>
> terasort test runs failing; job logs show the process yarn spawns is trying
> to use the default region provider list
> {code}
> Unable to load region from any of the providers in the chain
> software.amazon.awssdk.regions.providers.DefaultAwsRegionProviderChain
> {code}
> these are spawned processes; all login info and encryption secrets are passed
> in the marshalled delegation token {{AbstractS3ATokenIdentifier}}, with the
> encryption stuff in {{EncryptionSecrets}}
> This is probably going to need to be extended with information about the KMS
> region, with this info extracted during instantiation.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
