Nikhil Kak created MADLIB-1416:
----------------------------------

             Summary: DL: Remove final function for fit multiple
                 Key: MADLIB-1416
                 URL: https://issues.apache.org/jira/browse/MADLIB-1416
             Project: Apache MADlib
          Issue Type: Bug
          Components: Deep Learning
            Reporter: Nikhil Kak
             Fix For: v1.17


Based on our experiments, we noticed that at the end of each hop, fit
multiple would start using a lot of memory (from 80 GB to ~ 140 GB on
the master host of our gcp cluster) and we attributed that memory spike
to the final function.

Removing the final function brought down the memory to around 30-40 GB
and also made the places10 query 3 times faster




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to