Hi, In doing some testing with Flink stateful functions in Python and I’ve gotten a small POC working. One of our key requirements for our stream processors is that they be written in python due to the skillset of our team. Given that the Python DataStreams api seems to be under development in Flink 1.12, we’ve implemented our business logic as a stateful function using the remote pattern. In some testing, it seems the state object is getting serialized and sent along with each HTTP request and given that we’re storing quite a bit of data in this state, this seems to contribute to the latency of the application in a linear fashion. Is there any way around this? Is there a way to store the state local to the python application?
Thanks, Dan This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or his or her authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately.
