[ 
https://issues.apache.org/jira/browse/MAHOUT-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14040380#comment-14040380
 ] 

ASF GitHub Bot commented on MAHOUT-1579:
----------------------------------------

Github user HuangXiaomeng commented on a diff in the pull request:

    https://github.com/apache/mahout/pull/19#discussion_r14059670
  
    --- Diff: mrlegacy/pom.xml ---
    @@ -208,7 +208,35 @@
           <artifactId>solr-commons-csv</artifactId>
           <version>3.5.0</version>
         </dependency>
    -
    +    
    +    <dependency>
    --- End diff --
    
    Hi, sscdotopen
    Thanks for your comment. Your suggestion is very valuable. I have remove 
the dependencies of mini cluster. And refactor the tests to use 
RawLocalFileSystem.


> Implement a datamodel which can load data from hadoop filesystem directly
> -------------------------------------------------------------------------
>
>                 Key: MAHOUT-1579
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1579
>             Project: Mahout
>          Issue Type: Improvement
>            Reporter: Xiaomeng Huang
>            Priority: Minor
>         Attachments: Mahout-1579.000.patch
>
>
> As we all know, FileDataModel can only load data from local filesystem.
> But the big-data are usually stored in hadoop filesystem(e.g. hdfs).
> If we want to deal with the data in hdfs, we must run mapred job. 
> It's necessay to implement a data model which can load data from hadoop 
> filesystem directly.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to