[ https://issues.apache.org/jira/browse/CRUNCH-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Christian Tzolov updated CRUNCH-438: ------------------------------------ Attachment: CRUNCH-438.6.patch - The dotfile classes are moved to the plan package and the class access of the Edge, Graph, Vertex and NodePath is reverted to package-level - All dotfile boilerplate code in MSCRPlanner#plan() is abstracted in DotfileUtills class (including the PlanDotfile) to improve the separation of concerns ;). Additional exception handling is set to prevent exceptions in the Dotfile generator code impacting the main code. - DotfilesIT integration test validates the enable/disable dofilie generation logic > Visualizations of some important internal/intermediate pipeline planning > states > ------------------------------------------------------------------------------- > > Key: CRUNCH-438 > URL: https://issues.apache.org/jira/browse/CRUNCH-438 > Project: Crunch > Issue Type: Improvement > Components: Core > Affects Versions: 0.10.0, 0.8.3 > Reporter: Christian Tzolov > Assignee: Christian Tzolov > Attachments: CRUNCH-438.2.patch, CRUNCH-438.3.patch, > CRUNCH-438.4.patch, CRUNCH-438.5.patch, CRUNCH-438.6.patch, CRUNCH-438.patch > > > To improve the understability of the pipeline planning stages it would help > to visualize some intermediate planning states like: > - PCollection lineage. (visualizing the output-pcollection-targets structure) > - MSCRPlanner's planning Graphs before and after the split up of dependent > GBK nodes > - RTNode hierarchy along with the Input and Output configurations as > persistent in the Configuration before the execution of the pipeline. > Most of the information can be intercepted in the MSCRPlanner#plan() method. -- This message was sent by Atlassian JIRA (v6.3.4#6332)