[
https://issues.apache.org/jira/browse/MAHOUT-1568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pat Ferrel resolved MAHOUT-1568.
--------------------------------
Resolution: Implemented
Fix Version/s: 0.10.0
Created IntexedDataset, which has readers and writers for text delimited
formats. Supports reading by row or element and writing by row.
IndexedDataset is a step along the road to DataFrames and so may be refactored
when those are added.
> Build an I/O model that can replace sequence files for import/export
> --------------------------------------------------------------------
>
> Key: MAHOUT-1568
> URL: https://issues.apache.org/jira/browse/MAHOUT-1568
> Project: Mahout
> Issue Type: New Feature
> Components: CLI
> Environment: Scala, Spark
> Reporter: Pat Ferrel
> Assignee: Pat Ferrel
> Labels: scala, spark
> Fix For: 0.10.0
>
>
> Implement mechanisms to read and write data from/to flexible stores. These
> will support tuples streams and drms but with extensions that allow keeping
> user defined values for IDs. The mechanism in some sense can replace Sequence
> Files for import/export and will make the operation much easier for the user.
> In many cases directly consuming their input files.
> Start with text delimited files for input/output in the Spark version of
> ItemSimilarity
> A proposal is running with ItemSimilarity on Spark and is documented on the
> github wiki here: https://github.com/pferrel/harness/wiki
> Comments are appreciated
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
