alisha-1000 commented on issue #40179: URL: https://github.com/apache/beam/issues/40179#issuecomment-6829649124
Hi @damccorm, This is an interesting feature request! I'd love to explore contributing to this. Currently, the ADK Model Handler's reliance on Gemini limits flexibility for users who want to work with locally hosted models. Supporting configurable model backends could make the handler more extensible and enable users to integrate local inference services without being tied to a single provider. I'd like to investigate the existing implementation and explore an approach that: - Decouples model initialization from Gemini-specific logic. - Supports configurable model providers and locally hosted endpoints. - Preserves backward compatibility with existing Gemini-based workflows. - Includes appropriate tests and documentation for the new functionality. I'd be happy to work on this and would appreciate any guidance on the preferred abstraction or design direction before proceeding. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
