Hi Igniters! I've been working on a prototype of distributed metrics computation for ML-models. Unfortunately, we don't have an ability to compute metrics in a distributed manner, so, it leads to gathering metric statistics to client node via ScanQuery and all flow of vectors from partitions will be sent to a client. I want to avoid such behavior and I propose the framework for metrics computation using MapReduce approach based on an aggregation of statistics for metrics.
I prepared an issue in Apache Jira for this: https://issues.apache.org/jira/browse/IGNITE-12155 Also, I prepared PR for it: https://github.com/apache/ignite/pull/6857 Currently, the work on this framework is still running but I'm going to prepare full PR during this week. By this email, I want to start a discussion about this idea. Best regards, Alexey Platonov
