[ 
https://issues.apache.org/jira/browse/CASSANDRA-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stu Hood updated CASSANDRA-1368:
--------------------------------

    Attachment: 0004-Add-Streaming-example-shell-scripts.patch

0001 - The Hadoop version available directly from Apache is missing some 
streaming patches that allow for binary data (HADOOP-1722)

0002 - Adds implementations of Hadoop Streaming interfaces that parse incoming 
binary data

0003 - Applies the deprecated Hadoop 0.18 'mapred' OutputFormat interface (as 
opposed to 0.20's 'mapreduce') to our OutputFormat, since Streaming has not 
been ported yet

0004 - Adds a word count example in Python using Hadoop Streaming to count 
words in an input text file, and write them to Cassandra

> Add output support for Hadoop Streaming
> ---------------------------------------
>
>                 Key: CASSANDRA-1368
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-1368
>             Project: Cassandra
>          Issue Type: New Feature
>          Components: Hadoop
>            Reporter: Stu Hood
>             Fix For: 0.7.0
>
>         Attachments: 0001-Switch-to-Cloudera-s-Distribution-of-Hadoop.patch, 
> 0002-Add-an-Avro-OutputReader-and-Resolver-for-Hadoop-Str.patch, 
> 0003-Apply-the-deprecated-OutputFormat-interface-to-allow.patch, 
> 0004-Add-Streaming-example-shell-scripts.patch
>
>
> Hadoop Streaming is a framework that allows mapreduce jobs to be written in 
> languages other than Java, by performing simple IPC on stdin/stdout.
> Adding output support for Hadoop Streaming to Cassandra would mean that users 
> could write very simple scripts in dynamic languages to load data into 
> Cassandra. Once our Hadoop OutputFormat has stabilized a bit, we might also 
> be able to this code to provide scalable bulk loading.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to