avichaym opened a new issue, #524: URL: https://github.com/apache/flink-agents/issues/524
### Search before asking - [x] I searched in the [issues](https://github.com/apache/flink-agents/issues) and found nothing similar. ### Description ## Motivation Flink Agents currently only supports Elasticsearch and Chroma as vector stores. AWS customers need native integrations for Amazon OpenSearch and Amazon S3 Vectors. ## Proposed Changes Add two new vector store integration modules: - **OpenSearch** (`integrations/vector-stores/opensearch/`) — Supports both OpenSearch Serverless (AOSS) and OpenSearch Service domains, with IAM (SigV4) or basic authentication. Implements `CollectionManageableVectorStore`. ANN search via knn query with `ef_search`, `min_score`, and `filter_query` support. Bulk writes chunked by configurable `max_bulk_mb`. - **S3 Vectors** (`integrations/vector-stores/s3vectors/`) — Uses the S3 Vectors SDK for PutVectors/QueryVectors/GetVectors/DeleteVectors. PutVectors chunked at 500 (API limit). Both override `add()` for batch embedding optimization. Includes unit tests and integration tests (auto-enabled via environment variables). Validated against real AWS services. ### Are you willing to submit a PR? - [x] I'm willing to submit a PR! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
