Hi all, In Apache Beam 2.50.0 Python SDK, we added MLTransform <https://github.com/apache/beam/blob/c2816c8d9770df3d30eec15a2563c48cb66a66b3/website/www/site/content/en/blog/beam-2.50.0.md?plain=1#L53>, which is used to pre/post process data using common ML operations. Now, we are planning to generate embeddings <https://en.wikipedia.org/wiki/Embedding> with ML models using MLTransform.
I have created a doc <https://docs.google.com/document/d/1En4bfbTu4rvu7LWJIKV3G33jO-xJfTdbaSFSURmQw_s/edit#heading=h.wskna8eurvjv> on how we can do this. Please go through the doc if interested and let me know of any feedback. Thanks, Anand Doc: https://docs.google.com/document/d/1En4bfbTu4rvu7LWJIKV3G33jO-xJfTdbaSFSURmQw_s/edit#heading=h.wskna8eurvjv