[
https://issues.apache.org/jira/browse/PIG-443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Chopra updated PIG-443:
-------------------------------
Attachment: pig_types_23_09.patch
I have modified the code to address these issues.
* I now use the clonePlan method in PigServer to generate the logical plan. I
already had a functional optimiser that puts in the necessary operators to make
the plan functional (Cast and Split operators). Using clonePlan also addresses
the optimisations done by explain since it starts with the initial script.
* I checked with the latest checkout. You get a RuntimeException that says you
need to specify a schema while loading files. I need the schema to be able to
generate synthetic data, since without schema I have no idea how many columns
exist in the data. Can you pls confirm if its a null pointer exception?
* I haven't tested streaming with illustrate. I am just looking at supporting
the basic operators right now. I was hoping to get illustrate into the beta
drop.
> Illustrate for the Types branch
> -------------------------------
>
> Key: PIG-443
> URL: https://issues.apache.org/jira/browse/PIG-443
> Project: Pig
> Issue Type: New Feature
> Affects Versions: types_branch
> Reporter: Shubham Chopra
> Assignee: Shubham Chopra
> Fix For: types_branch
>
> Attachments: pig_types_22_09.patch, pig_types_23_09.patch
>
>
> This implementation of Illustrate uses visitors to traverse the plans.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
