cuelly3 opened a new issue, #5258:
URL: https://github.com/apache/streampipes/issues/5258

   ### Apache StreamPipes version
   
   dev (current development state)
   
   ### Affected StreamPipes components
   
   Connect
   
   ### What happened?
   
   Design, implement, and validate a new S3 Adapter for Apache StreamPipes 
based on Apache Camel. The adapter shall enable users to ingest data from 
S3-compatible object storage systems and make the data available as StreamPipes 
event streams. Apache Camel shall be used as the integration framework to 
provide a standardized, reusable, and extensible connectivity layer.
   
   ### How to reproduce?
   
   _No response_
   
   ### Expected behavior
   
   Evaluate the Apache Camel AWS2-S3 component for integration with 
StreamPipes. 
   
   Design a reusable adapter architecture based on Apache Camel routes.
   
   Support connectivity to:
   
   - AWS S3
   - SeaweedFS
   
   Provide configurable connection settings:
   
   - Endpoint URL
   - Bucket Name
   - Region
   - Access Key / Secret Key
   - Object Selection Pattern
   - Polling Interval
   - Support ingestion of common file formats:
   - JSON
   - CSV
   
   Automatically map incoming file contents to StreamPipes event schemas.
   
   Implement error handling, retry mechanisms, and connection validation.
   
   <img width="3213" height="3099" alt="Image" 
src="https://github.com/user-attachments/assets/acbbcb0f-8816-4d4e-ad8e-9c5d7db120c4";
 />
   
   ### Additional technical information
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   Yes, I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to