Re: [I] [Bug] [S3File] [zeta-local] There is an occasional problem with S3File writing. An error was reported [seatunnel]

Mon, 15 Apr 2024 00:40:44 -0700 


LeonYoah commented on issue #6678:
URL: https://github.com/apache/seatunnel/issues/6678#issuecomment-2055915607

   ## s3n is because the S3Conf obtained from AggregatedCommit does not use 
this buildWithConfig method, but uses DEFAULT_SCHEMA. debug finds that it seems 
to be related to dag:
   
   
   ### buildWithConfig method screenshot：
   
![image](https://github.com/apache/seatunnel/assets/95527066/020d7ed9-c0da-4c33-9e7d-47d8b9352203)
   
   ### DAG initialization S3conf screenshot：
   
![image](https://github.com/apache/seatunnel/assets/95527066/d2f52d04-3c2b-4a53-981d-7e13e192361e)
   
   
![image](https://github.com/apache/seatunnel/assets/95527066/921bc56c-1dec-4655-afbc-cc76c9adbcf7)
   ### AggregatedCommit获取的hadoopconf和shema截图：
   
![image](https://github.com/apache/seatunnel/assets/95527066/7d6fe287-f3ff-4145-af0d-6f3b9cbe22b2)
   
   ## So far I have found two solutions:
   ### 1. Change DEFAULT_SCHEMA to s3a：
   
![image](https://github.com/apache/seatunnel/assets/95527066/c2c2b714-db70-4d09-b620-e86060f62e8c)
   
   ### 2. Set up the profile：
   
![image](https://github.com/apache/seatunnel/assets/95527066/db44e658-72dd-4170-8433-97038ba9012c)
   
   
   _ But I am not familiar with the code of dag and AggregatedCommint, I need 
to ask my teacher to help me look at the root cause! _


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to