Xi Lyu created SPARK-51737:
------------------------------
Summary: Memory based MLCache eviction policy
Key: SPARK-51737
URL: https://issues.apache.org/jira/browse/SPARK-51737
Project: Spark
Issue Type: Improvement
Components: ML
Affects Versions: 4.0.0, 4.1.0
Reporter: Xi Lyu
Currently the ML Cache is limited by the number of cache entries (100 entries
at this time), but it is not ideal. We need to update the eviction policy to be
memory based, i.e. to evict old models if the total size is greater than a
limit.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
