[
https://issues.apache.org/jira/browse/PIG-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13086496#comment-13086496
]
Daniel Dai commented on PIG-2221:
---------------------------------
There are couple of places need to change in
http://pig.apache.org/docs/r0.9.0/perf.html#optimization-rules. Here is the
summary:
1. I'd like to drop mandatory rules (ImplicitSplitInserter, StreamOptimizer,
TypeCastInserter), since user don't have control over it. It also involves lots
of implementation details and hard to explain. Or we can make a separate
section for it. Thoughts?
2. Change name of some rules to match command line switch:
OpLimitOptimizer -> LimitOptimizer
LogicalExpressionSimplifier -> FilterLogicExpressionSimplifier
PushDownExplodes -> PushDownForEachFlatten
3. Change the order of rules to match actual running order
4. Add missing rules: SplitFilter, MergeFilter, ColumnMapKeyPrune, AddForEach,
GroupByConstParallelSetter
5. Minor change in description of FilterLogicExpressionSimplifier to indicate
this only optimize the filter expression
Since there are quite a few change, I put together a wiki page to show how the
section look like after change:
https://cwiki.apache.org/confluence/display/PIG/Optimization+Rules
Also attach a patch to align the help text with the document.
> Couldnt find documentation for ColumnMapKeyPrune optimization rule
> ------------------------------------------------------------------
>
> Key: PIG-2221
> URL: https://issues.apache.org/jira/browse/PIG-2221
> Project: Pig
> Issue Type: Bug
> Components: documentation
> Affects Versions: 0.8.1
> Reporter: Vivek Padmanabhan
> Assignee: Daniel Dai
> Fix For: 0.9.1
>
> Attachments: PIG-2221-help.patch
>
>
> There are no documentations for some of the Optimization Rules,
> For ex; ColumnMapKeyPrune
> in http://pig.apache.org/docs/r0.8.1/piglatin_ref1.html#Optimization+Rules
> And moreover I believe the documentaion should be saying how to disable these
> rules using -t option.
> It would be nice if the documentation could talk of some uses cases where it
> makes sense to disable the optimization rule.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
