[ 
https://issues.apache.org/jira/browse/CRUNCH-420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14033538#comment-14033538
 ] 

Gabriel Reid commented on CRUNCH-420:
-------------------------------------

I was thinking that this situation can be distinguished by {{breakpoint}} or 
{{materialized}} being set to true on the underlying PCollection where we want 
to force a split to occur, and those flags (or at least one of them I think) 
would be set to false if it's just a side output.

> Breakpoints Not Working
> -----------------------
>
>                 Key: CRUNCH-420
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-420
>             Project: Crunch
>          Issue Type: Bug
>         Environment: Crunch 0.8.2
>            Reporter: Allan Shoup
>            Assignee: Josh Wills
>         Attachments: Breakpoint2IT.java, testBreakpoint_plan.png
>
>
> Reading through CRUNCH-294, it looks like materialize is supposed to function 
> as a breakpoint to the planner. I've seen several plans where it appeared to 
> me a particular DoFn shouldn't have been repeated, but it was.
> I'll attach some supporting material.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to