Hey everyone, I'm back with a brief design doc discussing ways that users could provide custom inference functions for RunInference model handlers, which is available at https://docs.google.com/document/d/1YYGsF20kminz7j9ifFdCD5WQwVl8aTeCo0cgPjbdFNU/edit?usp=sharing <https://docs.google.com/document/d/1YYGsF20kminz7j9ifFdCD5WQwVl8aTeCo0cgPjbdFNU/edit?usp=sharing> now.
It's not a huge code change or a significantly long doc, but it's establishing a convention for model handlers moving forward and that warrants some discussion. Thanks, Jack McCluskey -- Jack McCluskey SWE - DataPLS PLAT/ Beam Go RDU [email protected]
