[
https://issues.apache.org/jira/browse/CRUNCH-474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14161229#comment-14161229
]
Charles Pritchard commented on CRUNCH-474:
------------------------------------------
At present I'm looking into running crunch via stdin (or InputStream) which
is more-or-less agnostic. Java.
Ideally the jar could be picked back up and run on MR. It fits within
prototyping but I'd like to skip over the Hadoop dependency for the
standalone jar.
May be too much of a stretch but I really do like the Crunch decorators and
pattern for processing methods.
-Charles
> Reduce dependencies on MapReduce library in standard MemPipeline
> ----------------------------------------------------------------
>
> Key: CRUNCH-474
> URL: https://issues.apache.org/jira/browse/CRUNCH-474
> Project: Crunch
> Issue Type: Bug
> Reporter: Charles Pritchard
>
> There are currently dependencies on the MapReduce library that could be
> removed or otherwise re-wired in the MemPipeline method.
> Currently MemPipeline relies on setting up tasks to match Hadoop libraries
> without using any of their functionality, beyond the counters. Crunch may be
> useful in areas where data is processed without Hadoop.
> As an aside, the Avro writables have completely unused references to Hadoop
> in their import statements.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
