Stefan Goldener created MAHOUT-2101:

             Summary: Mahout local file distribution
                 Key: MAHOUT-2101
             Project: Mahout
          Issue Type: Improvement
            Reporter: Stefan Goldener

At the moment Mahout is heavily based on HDFS. Although MAHOUT_LOCAL is using 
the local File system it is not possible to use MAHOUT_LOCAL=true and a SPARK 
ONLY Cluster.

My suggestion is to improve the Mahout code to support local files and 
distribute them via SPARK. There are multiple options for that e.g. Spark SQL, 
DataFrames, Datasets or RDD's.

This will also allow Mahout to use the new SPARK Kubernetes features and hence 
be highly scalable.

This message was sent by Atlassian Jira

Reply via email to