Re: [I] [Bug] [S3File] [zeta-local] Error writing to S3File in version 2.3.4:: Java lang. An IllegalStateException: Connection pool shut down [seatunnel]

Mon, 15 Apr 2024 21:07:23 -0700 


LeonYoah commented on issue #6678:
URL: https://github.com/apache/seatunnel/issues/6678#issuecomment-2058189999

   > > 我注意到这块代码其实是没问题的，通过执行buildwith方法会赋值shema为s3a，但是关键在于整个sink往下游传递给mutiltable 
sink时，会执行反序列化操作
   > > > > `Sometimes hadoopConf's getSchema method returns s3n instead of s3a, 
resulting in the s3 connector actually being cached` Is this 
reproducible?#00000;是可复制的？
   > > > 
   > > > 
   > > > Can you try use remote debug?你能尝试使用远程调试吗？
   > > 
   > > 
   > > Yes, I discovered through remote debugging that s3n was actually being 
passed <img alt="image" width="54.140625" height="21" 
src="https://private-user-images.githubusercontent.com/95527066/322695614-f0edc7a4-25a3-42d6-86ed-c06332b8fd86.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMyMzk5MjMsIm5iZiI6MTcxMzIzOTYyMywicGF0aCI6Ii85NTUyNzA2Ni8zMjI2OTU2MTQtZjBlZGM3YTQtMjVhMy00MmQ2LTg2ZWQtYzA2MzMyYjhmZDg2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE2VDAzNTM0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWIwMWE1MWI3YTVkMmE0ZTQxNGY5ODIyY2I3ZmE3MTkzMTk0OTQ3ZDIyODAxODIyMzlkZGJkYWNhYzlmZDU4NTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.TtE9gCN9ND-N2d65OutPW5v1iLjo8arHHa4dOCZ9nvI";>是的，我通过远程调试发现s3n�
 �际上正在传递 <img alt="image" width="54.140625" height="21" 
src="https://private-user-images.githubusercontent.com/95527066/322695614-f0edc7a4-25a3-42d6-86ed-c06332b8fd86.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MTMyMzk5MjMsIm5iZiI6MTcxMzIzOTYyMywicGF0aCI6Ii85NTUyNzA2Ni8zMjI2OTU2MTQtZjBlZGM3YTQtMjVhMy00MmQ2LTg2ZWQtYzA2MzMyYjhmZDg2LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA0MTYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwNDE2VDAzNTM0M1omWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWIwMWE1MWI3YTVkMmE0ZTQxNGY5ODIyY2I3ZmE3MTkzMTk0OTQ3ZDIyODAxODIyMzlkZGJkYWNhYzlmZDU4NTUmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.TtE9gCN9ND-N2d65OutPW5v1iLjo8arHHa4dOCZ9nvI";>
   > 
   > I understand now. It's really a matter of serialization and 
deserialization of `static variables`. I don't think we should define `static 
variables` for classes that need to be serialized and deserialized. Can you put 
up a pr to fix this?我现在明白了这实际上是 `static variables` 
的序列化和重复化的问题。我不认为我们应该为需要序列化和非序列化的类定义 `static variables` 。你能做个公关来解决这个问题吗？
   
   Ok, I am willing to submit the PR, I have modified the first version to try 
to remove the [static] changes, but I see that you submitted a change to the s3 
connector, maybe my submission caused a conflict


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to