It seems there is problem with the fat/Uber jar . It might have multiple versions of the classs being overwritten with duplicates . Check this link :
https://stackoverflow.com/questions/57039951/beam-failed-to-serialize-and-deserialize-property-awscredentialsprovider On Sat, 23 Sep 2023 at 9:55 PM, Ramya Prasad via user <user@beam.apache.org> wrote: > Hello, > > I am a developer trying to use Apache Beam, and I'm running into an issue > with trying to provide multiple AWS credentials to the AwsOptions class > within the PipelineOptions class. My use case requires multi-account reads, > and I've tried using the AwsCredentialsProviderChain class within the > options.as(AwsOptions.class).setAwsCredentialsProvider() method, but I > keep getting the error > > Caused by: com.fasterxml.jackson.databind.JsonMappingException: Unexpected > IOException (of type java.io.IOException): Failed to serialize and > deserialize property 'awsCredentialsProvider' with value > 'AwsCredentialsProviderChain. > > Is there anything I'm doing wrong? Any help would be appreciated! > > Thanks and sincerely, > Ramya > ------------------------------ > > The information contained in this e-mail is confidential and/or > proprietary to Capital One and/or its affiliates and may only be used > solely in performance of work or services for Capital One. The information > transmitted herewith is intended only for use by the individual or entity > to which it is addressed. If the reader of this message is not the intended > recipient, you are hereby notified that any review, retransmission, > dissemination, distribution, copying or other use of, or taking of any > action in reliance upon this information is strictly prohibited. If you > have received this communication in error, please contact the sender and > delete the material from your computer. > > > > >
