[
https://issues.apache.org/jira/browse/CRUNCH-54?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rahul Sharma updated CRUNCH-54:
-------------------------------
Attachment: CRUNCH-54-NPE-from-MCSPlanner.patch
The collection gets materialized into a new inputCollection which has outgoing
edges in the graph. So the output target has been changed to contain the input
collection if materialized else the collection itself. Also added a test case
for the same.
> MSCRPlanner throws NPE while writing back a file using a materialized
> Pcollection
> ---------------------------------------------------------------------------------
>
> Key: CRUNCH-54
> URL: https://issues.apache.org/jira/browse/CRUNCH-54
> Project: Crunch
> Issue Type: Bug
> Components: IO
> Reporter: Rahul Sharma
> Attachments: CRUNCH-54-NPE-from-MCSPlanner.patch, MrPipelinetTest.java
>
>
> When we try to write back a materialized collection to a file using the
> To.Text(..) the MCSPlanner throws back a NPE.
> java.lang.NullPointerException
> at
> org.apache.crunch.impl.mr.plan.MSCRPlanner.constructJobPrototypes(MSCRPlanner.java:192)
> at org.apache.crunch.impl.mr.plan.MSCRPlanner.plan(MSCRPlanner.java:98)
> at org.apache.crunch.impl.mr.MRPipeline.run(MRPipeline.java:116)
> at
> org.apache.crunch.MrPipelinetTest.pipelineShouldNotFail(MrPipelinetTest.java:41)
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
