Travis Woodruff created PIG-5033:
Summary: MultiQueryOptimizerTez creates bad plan with union, split
and FRJoin
Key: PIG-5033
URL: https://issues.apache.org/jira/browse/PIG-5033
Project: Pig
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5033:
-
Description:
This script produces incorrect results:
{code}
a = load 'file:///tmp/input1' as (x:int
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507768#comment-15507768
]
Travis Woodruff commented on PIG-5033:
--
Here's the DAG plan. I've only started testing
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507776#comment-15507776
]
Travis Woodruff commented on PIG-5033:
--
And here's the plan when I remove the union (wh
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5033:
-
Attachment: input3
input2
input1
> MultiQueryOptimizerTez creates ba
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5033:
-
Attachment: PIG-5033.patch
> MultiQueryOptimizerTez creates bad plan with union, split and FRJoin
>
[
https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5033:
-
Status: Patch Available (was: Open)
Here's an attempt at a fix. I have no confidence that this is t
Travis Woodruff created PIG-5082:
Summary: Tez UnionOptimizer creates vertex group with one member
Key: PIG-5082
URL: https://issues.apache.org/jira/browse/PIG-5082
Project: Pig
Issue Type: B
[
https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5082:
-
Status: Patch Available (was: Open)
> Tez UnionOptimizer creates vertex group with one member
> ---
[
https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5082:
-
Attachment: PIG-5082.patch
Here's a patch that works around the issue. A better fix would probably b
[
https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15803041#comment-15803041
]
Travis Woodruff commented on PIG-5082:
--
Feel free. I haven't had a chance to add a test
[
https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15824102#comment-15824102
]
Travis Woodruff commented on PIG-5082:
--
Bad news, [~rohini]. The patch for PIG-5078 (I
[
https://issues.apache.org/jira/browse/PIG-5082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15826076#comment-15826076
]
Travis Woodruff commented on PIG-5082:
--
Looks good after applying that patch. Thanks. S
Travis Woodruff created PIG-5312:
Summary: Uids not set in inner schemas after UNION ON_SCHEMA
Key: PIG-5312
URL: https://issues.apache.org/jira/browse/PIG-5312
Project: Pig
Issue Type: Bug
[
https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5312:
-
Attachment: PIG-5312.patch
> Uids not set in inner schemas after UNION ON_SCHEMA
> -
[
https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5312:
-
Assignee: (was: Travis Woodruff)
Status: Patch Available (was: Open)
> Uids not set in in
[
https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5312:
-
Description:
Ran into a failure with a script of the form:
{code}
u = union onschema x, y; -- sche
[
https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-5312:
-
Summary: Uids not set in inner schemas after UNION ONSCHEMA (was: Uids not
set in inner schemas aft
Travis Woodruff created PIG-5326:
Summary: Issue with auto parallelism and scalar inputs in Tez
Key: PIG-5326
URL: https://issues.apache.org/jira/browse/PIG-5326
Project: Pig
Issue Type: Bug
Travis Woodruff created PIG-3649:
Summary: POPartialAgg incorrectly calculates size reduction when
multiple values aggregated
Key: PIG-3649
URL: https://issues.apache.org/jira/browse/PIG-3649
Project:
[
https://issues.apache.org/jira/browse/PIG-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3649:
-
Attachment: PIG-3469.patch
Attaching path that updates {{aggregate()}} to count number of result tu
[
https://issues.apache.org/jira/browse/PIG-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3649:
-
Status: Patch Available (was: Open)
> POPartialAgg incorrectly calculates size reduction when mult
Travis Woodruff created PIG-3650:
Summary: Fix for PIG-3100 breaks column pruning
Key: PIG-3650
URL: https://issues.apache.org/jira/browse/PIG-3650
Project: Pig
Issue Type: Bug
Affects Ve
[
https://issues.apache.org/jira/browse/PIG-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3650:
-
Status: Patch Available (was: Open)
> Fix for PIG-3100 breaks column pruning
> ---
[
https://issues.apache.org/jira/browse/PIG-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3650:
-
Attachment: PIG-3650.patch
Adding patch to fix. Iterates over all fieldSchemas (removes the Math.mi
Travis Woodruff created PIG-3653:
Summary: Add support for pre-deployed jars
Key: PIG-3653
URL: https://issues.apache.org/jira/browse/PIG-3653
Project: Pig
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Attachment: PIG-3653.patch
This patch adds a predeployedJars list to PigContext. JarManager skips a
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Release Note: Ability to mark jars as predeployed to the cluster so they
will not be included in th
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Status: Open (was: Patch Available)
Noticed a typo in test class name. Fixing.
> Add support for
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Status: Patch Available (was: Open)
Added new patch with fix to test class name
> Add support for
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Attachment: PIG-3653-2.patch
> Add support for pre-deployed jars
>
Travis Woodruff created PIG-3654:
Summary: Add class cache to PigContext
Key: PIG-3654
URL: https://issues.apache.org/jira/browse/PIG-3654
Project: Pig
Issue Type: Improvement
Affects Ver
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Priority: Minor (was: Major)
> Add class cache to PigContext
> -
>
>
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Attachment: PIG-3654.patch
Patch with class cache and test. This patch has the cache enabled by def
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Release Note: Cache resolved classes in PigContext to improve script
compile performance
[
https://issues.apache.org/jira/browse/PIG-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff reassigned PIG-3649:
Assignee: Travis Woodruff
> POPartialAgg incorrectly calculates size reduction when multiple
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Status: In Progress (was: Patch Available)
> Add support for pre-deployed jars
> -
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Attachment: PIG-3653-3.patch
Good idea. New patch attached that reads a pig.predeployed.jars proper
[
https://issues.apache.org/jira/browse/PIG-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3653:
-
Release Note: Ability to mark jars as predeployed to the cluster so they
will not be included in th
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13865599#comment-13865599
]
Travis Woodruff commented on PIG-3654:
--
Daniel, I can't think of a reason for setting c
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Status: In Progress (was: Patch Available)
> Add class cache to PigContext
> -
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Status: Patch Available (was: In Progress)
> Add class cache to PigContext
> -
[
https://issues.apache.org/jira/browse/PIG-3654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3654:
-
Attachment: PIG-3654-2.patch
New patch that removes enabmement flag (cache is always used) and remo
Travis Woodruff created PIG-3988:
Summary: PigStorage: CommandLineParser is not thread safe
Key: PIG-3988
URL: https://issues.apache.org/jira/browse/PIG-3988
Project: Pig
Issue Type: Bug
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3988:
-
Attachment: PIG-3988-1.patch
> PigStorage: CommandLineParser is not thread safe
> -
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3988:
-
Release Note:
This patch moves the option parsing members to local variables in the
constructor, s
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14020113#comment-14020113
]
Travis Woodruff commented on PIG-3988:
--
This patch moves the option parsing members to
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3988:
-
Release Note: (was: This patch moves the option parsing members to local
variables in the constru
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14021063#comment-14021063
]
Travis Woodruff commented on PIG-3988:
--
0.14 is fine. Thanks.
> PigStorage: CommandLin
[
https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4001:
-
Description:
{{POPartialAgg.aggregateRawRow()}} is counting values in
{{numEntriesInTarget}}, but
Travis Woodruff created PIG-4001:
Summary: POPartialAgg aggregates too aggressively when multiple
values aggregated
Key: PIG-4001
URL: https://issues.apache.org/jira/browse/PIG-4001
Project: Pig
[
https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4001:
-
Description:
{{POPartialAgg.aggregateRawRow()}} is counting values in
{{numEntriesInTarget}}, but
[
https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4001:
-
Attachment: PIG-4001.patch
> POPartialAgg aggregates too aggressively when multiple values aggregat
[
https://issues.apache.org/jira/browse/PIG-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4001:
-
Status: Patch Available (was: Open)
This patch simply changes the value count to a tuple count.
>
Travis Woodruff created PIG-4002:
Summary: Disable combiner when map-side aggregation is used
Key: PIG-4002
URL: https://issues.apache.org/jira/browse/PIG-4002
Project: Pig
Issue Type: Improv
[
https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4002:
-
Attachment: PIG-4002-1.patch
This is an updated version of 2829.separate.options.patch from PIG-282
[
https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025691#comment-14025691
]
Travis Woodruff commented on PIG-4002:
--
The drawback of doing this is that it removes t
[
https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4002:
-
Status: Patch Available (was: Open)
> Disable combiner when map-side aggregation is used
> ---
[
https://issues.apache.org/jira/browse/PIG-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025694#comment-14025694
]
Travis Woodruff commented on PIG-4002:
--
Oops... negative properties strike again. earli
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3988:
-
Status: Patch Available (was: Reopened)
> PigStorage: CommandLineParser is not thread safe
> -
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14028217#comment-14028217
]
Travis Woodruff commented on PIG-3988:
--
Reason behind change is that OptionBuilder is n
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff reopened PIG-3988:
--
> PigStorage: CommandLineParser is not thread safe
>
[
https://issues.apache.org/jira/browse/PIG-3988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-3988:
-
Attachment: PIG-3988-2.patch
Looks like commons-cli 1.0 passes " " instead of null to the Option co
Travis Woodruff created PIG-4018:
Summary: Schema validation fails with UNION ONSCHEMA
Key: PIG-4018
URL: https://issues.apache.org/jira/browse/PIG-4018
Project: Pig
Issue Type: Bug
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Affects Version/s: 0.13.0
> Schema validation fails with UNION ONSCHEMA
> -
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Attachment: PIG-4018.patch
This is an attempt at a patch. It moves UnionOnSchemaSetter above
Impli
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Status: Patch Available (was: Open)
> Schema validation fails with UNION ONSCHEMA
> --
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Description:
When relations with differing schemas are unioned (using UNION ONSCHEMA),
schema vali
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Status: Open (was: Patch Available)
Sorry about that. I completely overlooked that test somehow. N
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Attachment: PIG-4018-2.patch
Looks like TypeCheckingRelVisitor adds type conversion, so my previous
[
https://issues.apache.org/jira/browse/PIG-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-4018:
-
Status: Patch Available (was: Open)
> Schema validation fails with UNION ONSCHEMA
> --
[
https://issues.apache.org/jira/browse/PIG-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff reassigned PIG-2647:
Assignee: Travis Woodruff
> Split Combining drops splits with empty getLocations()
>
[
https://issues.apache.org/jira/browse/PIG-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14231705#comment-14231705
]
Travis Woodruff commented on PIG-2647:
--
Ran into this in a production environment, We l
[
https://issues.apache.org/jira/browse/PIG-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-2647:
-
Attachment: PIG-2647.patch
This patch explicitly checks for the case when no locations are returned
[
https://issues.apache.org/jira/browse/PIG-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-2647:
-
Release Note: Don't ignore unavailable blocks when combining input splits
into PigSplits.
[
https://issues.apache.org/jira/browse/PIG-2647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Travis Woodruff updated PIG-2647:
-
Affects Version/s: 0.13.1
0.14.0
0.13.0
> Split Combin
76 matches
Mail list logo
