[jira] [Commented] (PIG-5041) RoundRobinPartitioner is not deterministic when order of input records change

[ https://issues.apache.org/jira/browse/PIG-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574144#comment-15574144 ] Daniel Dai commented on PIG-5041: - Anyway, the bag as the key is a different issue. Need to

[jira] [Commented] (PIG-5041) RoundRobinPartitioner is not deterministic when order of input records change

[ https://issues.apache.org/jira/browse/PIG-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15574140#comment-15574140 ] Daniel Dai commented on PIG-5041: - I don't mean the fetch, I mean the order of bag.iterator

[jira] [Commented] (PIG-5041) RoundRobinPartitioner is not deterministic when order of input records change

[ https://issues.apache.org/jira/browse/PIG-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573661#comment-15573661 ] Daniel Dai commented on PIG-5041: - Bag can also be a key. This is a problem more than HashVa

[jira] [Commented] (PIG-5040) Order by and CROSS partitioning is not deterministic due to usage of Random

[ https://issues.apache.org/jira/browse/PIG-5040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15573591#comment-15573591 ] Daniel Dai commented on PIG-5040: - Is it possible to reuse PigConstants.TASK_INDEX? > Order

[jira] [Commented] (PIG-5036) Remove biggish from e2e input dataset

[ https://issues.apache.org/jira/browse/PIG-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15559573#comment-15559573 ] Daniel Dai commented on PIG-5036: - Yes, would like to leave it as is so we can compare with

[jira] [Comment Edited] (PIG-5037) Add api getDisplayString to PigStats

[ https://issues.apache.org/jira/browse/PIG-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15559570#comment-15559570 ] Daniel Dai edited comment on PIG-5037 at 10/9/16 8:19 AM: -- +1. Ple

[jira] [Comment Edited] (PIG-5037) Add api getDisplayString to PigStats

[ https://issues.apache.org/jira/browse/PIG-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15559570#comment-15559570 ] Daniel Dai edited comment on PIG-5037 at 10/9/16 8:19 AM: -- +1. Plea

[jira] [Updated] (PIG-5037) Add api getDisplayString to PigStats

[ https://issues.apache.org/jira/browse/PIG-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5037: Fix Version/s: 0.16.1 0.17.0 > Add api getDisplayString to PigStats > -

[jira] [Commented] (PIG-5037) Add api getDisplayString to PigStats

[ https://issues.apache.org/jira/browse/PIG-5037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15559570#comment-15559570 ] Daniel Dai commented on PIG-5037: - +1, please commit to 0.16 branch and trunk. Since 0.16.1

[jira] [Updated] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4951: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Updated] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3087: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Updated] (PIG-5036) Remove biggish from e2e input dataset

[ https://issues.apache.org/jira/browse/PIG-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5036: Status: Patch Available (was: Open) > Remove biggish from e2e input dataset > ---

[jira] [Updated] (PIG-5036) Remove biggish from e2e input dataset

[ https://issues.apache.org/jira/browse/PIG-5036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5036: Attachment: PIG-5036-1.patch Once remove biggish and setting max split size, Rank_4/Rank_5 is meaningless as

[jira] [Created] (PIG-5036) Remove biggish from e2e input dataset

Daniel Dai created PIG-5036: --- Summary: Remove biggish from e2e input dataset Key: PIG-5036 URL: https://issues.apache.org/jira/browse/PIG-5036 Project: Pig Issue Type: Improvement Compone

[jira] [Commented] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552798#comment-15552798 ] Daniel Dai commented on PIG-4951: - +1. Will commit shortly. > Rename PIG_ATS_ENABLED consta

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552793#comment-15552793 ] Daniel Dai commented on PIG-3087: - Another question, why setting "pigServer.setValidateEachS

[jira] [Commented] (PIG-4951) Rename PIG_ATS_ENABLED constant

[ https://issues.apache.org/jira/browse/PIG-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552538#comment-15552538 ] Daniel Dai commented on PIG-4951: - CALLER_ID falls in the same category. However, I am not e

[jira] [Issue Comment Deleted] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-3087: Comment: was deleted (was: I think the original test is intended to test the fail path. It's better to change

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552504#comment-15552504 ] Daniel Dai commented on PIG-3087: - I think the original test is intended to test the fail pa

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15552503#comment-15552503 ] Daniel Dai commented on PIG-3087: - I think the original test is intended to test the fail pa

[jira] [Comment Edited] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550171#comment-15550171 ] Daniel Dai edited comment on PIG-3087 at 10/6/16 4:35 AM: -- The bug

[jira] [Commented] (PIG-3087) Refactor TestLogicalPlanBuilder to be meaningful

[ https://issues.apache.org/jira/browse/PIG-3087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15550171#comment-15550171 ] Daniel Dai commented on PIG-3087: - The bug fix in ForEachUserSchemaVisitor looks good. I hav

[jira] [Commented] (PIG-5033) MultiQueryOptimizerTez creates bad plan with union, split and FRJoin

[ https://issues.apache.org/jira/browse/PIG-5033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543420#comment-15543420 ] Daniel Dai commented on PIG-5033: - scope-61 definitely cause the issue as we cannot have par

[jira] [Commented] (PIG-5020) Give file location for loadcaster related warning and errors

[ https://issues.apache.org/jira/browse/PIG-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543359#comment-15543359 ] Daniel Dai commented on PIG-5020: - +1 > Give file location for loadcaster related warning a

[jira] [Commented] (PIG-4897) Scope of param substitution for run/exec commands

[ https://issues.apache.org/jira/browse/PIG-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543299#comment-15543299 ] Daniel Dai commented on PIG-4897: - +1 for doc addition. > Scope of param substitution for r

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15543280#comment-15543280 ] Daniel Dai commented on PIG-4976: - I do have a "foo" file in my test directory, that's why I

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15494941#comment-15494941 ] Daniel Dai commented on PIG-4976: - TestStreamingLocal pass for me with PIG-4976-2.patch. You

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Attachment: PIG-4976-2.patch Yes, that's doable. At least we can signal error to the pipeline. > streaming jo

[jira] [Commented] (PIG-4897) Scope of param substitution for run/exec commands

[ https://issues.apache.org/jira/browse/PIG-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15492656#comment-15492656 ] Daniel Dai commented on PIG-4897: - +1, the new behavior is more useful. We shall also docume

[jira] [Commented] (PIG-5032) Output record stats in Tez is wrong when there is split followed by union

[ https://issues.apache.org/jira/browse/PIG-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491372#comment-15491372 ] Daniel Dai commented on PIG-5032: - Discussed offline, there is a minor behavior change: In T

[jira] [Commented] (PIG-5032) Output record stats in Tez is wrong when there is split followed by union

[ https://issues.apache.org/jira/browse/PIG-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15491306#comment-15491306 ] Daniel Dai commented on PIG-5032: - Now MULTI_STORE_COUNTER_GROUP is actually STORE_COUNTER_G

[jira] [Created] (PIG-5030) kill command only kill application the session launches in Tez mode

Daniel Dai created PIG-5030: --- Summary: kill command only kill application the session launches in Tez mode Key: PIG-5030 URL: https://issues.apache.org/jira/browse/PIG-5030 Project: Pig Issue Type

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15473036#comment-15473036 ] Daniel Dai commented on PIG-4967: - That's fine for me. Patch committed to branch-0.16 as wel

[jira] [Commented] (PIG-5020) Give file location for loadcaster related warning and errors

[ https://issues.apache.org/jira/browse/PIG-5020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15472894#comment-15472894 ] Daniel Dai commented on PIG-5020: - +1 > Give file location for loadcaster related warning a

[jira] [Updated] (PIG-5019) Pig generates tons of warnings for udf with enabled warnings aggregation

[ https://issues.apache.org/jira/browse/PIG-5019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5019: Assignee: Murshid Chalaev > Pig generates tons of warnings for udf with enabled warnings aggregation > ---

[jira] [Resolved] (PIG-4973) Bigdecimal divison fails

[ https://issues.apache.org/jira/browse/PIG-4973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4973. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 +1, that's useful fix. Patch comm

[jira] [Commented] (PIG-4975) Map schema shows "Type: null Uid: null" in explain

[ https://issues.apache.org/jira/browse/PIG-4975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454629#comment-15454629 ] Daniel Dai commented on PIG-4975: - +1 pending tests. > Map schema shows "Type: null Uid: nu

[jira] [Commented] (PIG-4974) A simple map reference fail to cast

[ https://issues.apache.org/jira/browse/PIG-4974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454570#comment-15454570 ] Daniel Dai commented on PIG-4974: - +1 for (1) for this issue. We can do it later but we need

[jira] [Updated] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4967: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Description: When investigating PIG-4972, I also notice Pig job stuck when the perl script have syntax error.

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Attachment: PIG-4976-1.patch > streaming job with store clause stuck if the script fail >

[jira] [Updated] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4976: Status: Patch Available (was: Open) > streaming job with store clause stuck if the script fail >

[jira] [Commented] (PIG-4976) streaming job with store clause stuck if the script fail

[ https://issues.apache.org/jira/browse/PIG-4976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454501#comment-15454501 ] Daniel Dai commented on PIG-4976: - The reason is, when the process exit, the input/output st

[jira] [Created] (PIG-4976) streaming job with store clause stuck if the script fail

Daniel Dai created PIG-4976: --- Summary: streaming job with store clause stuck if the script fail Key: PIG-4976 URL: https://issues.apache.org/jira/browse/PIG-4976 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15448412#comment-15448412 ] Daniel Dai commented on PIG-4967: - I am fine with the fix. The line "Because MAPREDUCE-6762

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Status: Patch Available (was: Open) > StreamingIO_1 fail on perl 5.22 > --- > >

[jira] [Updated] (PIG-4972) StreamingIO_1 fail on perl 5.22

[ https://issues.apache.org/jira/browse/PIG-4972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4972: Attachment: PIG-4972-1.patch > StreamingIO_1 fail on perl 5.22 > --- > >

[jira] [Created] (PIG-4972) StreamingIO_1 fail on perl 5.22

Daniel Dai created PIG-4972: --- Summary: StreamingIO_1 fail on perl 5.22 Key: PIG-4972 URL: https://issues.apache.org/jira/browse/PIG-4972 Project: Pig Issue Type: Bug Components: e2e harne

[jira] [Comment Edited] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437217#comment-15437217 ] Daniel Dai edited comment on PIG-4967 at 8/25/16 4:58 PM: -- Sorry fo

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15437217#comment-15437217 ] Daniel Dai commented on PIG-4967: - Sorry for confusion. When I say clone ControlledJob#toStr

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15433214#comment-15433214 ] Daniel Dai commented on PIG-4967: - I assume by doing " j.getJob().getStatus()==null", we don

[jira] [Commented] (PIG-2125) Make Pig work with hadoop .NEXT

[ https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15432147#comment-15432147 ] Daniel Dai commented on PIG-2125: - If something went wrong, I believe any MiniCluster or loc

[jira] [Commented] (PIG-2125) Make Pig work with hadoop .NEXT

[ https://issues.apache.org/jira/browse/PIG-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431871#comment-15431871 ] Daniel Dai commented on PIG-2125: - org.apache.pig.ExecType is required, Pig use this to enum

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431866#comment-15431866 ] Daniel Dai commented on PIG-4967: - Thank for your patch, but it is longer than I expected. C

[jira] [Commented] (PIG-4971) Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' should be set to 23

[ https://issues.apache.org/jira/browse/PIG-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431851#comment-15431851 ] Daniel Dai commented on PIG-4971: - That's true. We break compatibility of Hadoop 1 with ackn

[jira] [Resolved] (PIG-4971) Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' should be set to 23

[ https://issues.apache.org/jira/browse/PIG-4971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4971. - Resolution: Not A Problem > Non Hadoop23 builds are broken. Perhaps, default value for 'hadoopversion' > s

[jira] [Commented] (PIG-4912) Tez code does not differentiate between cache archives and files

[ https://issues.apache.org/jira/browse/PIG-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15431846#comment-15431846 ] Daniel Dai commented on PIG-4912: - We only need to fix on Tez side. MR side is good. We don'

[jira] [Commented] (PIG-4912) Tez code does not differentiate between cache archives and files

[ https://issues.apache.org/jira/browse/PIG-4912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15421898#comment-15421898 ] Daniel Dai commented on PIG-4912: - Can you attach a patch without the space changes? > Tez

[jira] [Resolved] (PIG-1183) Minor nits on pig trunk code

[ https://issues.apache.org/jira/browse/PIG-1183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-1183. - Resolution: Invalid Yes, those are no longer valid. Thanks for pointing out. > Minor nits on pig trunk code

[jira] [Commented] (PIG-4933) TestDataBagAccess.testBagConstantFlatten1/TestLogicalPlanBuilder.testQuery90 broken after PIG-2315

[ https://issues.apache.org/jira/browse/PIG-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15416472#comment-15416472 ] Daniel Dai commented on PIG-4933: - Thanks for dealing with nested schema. Though the code is

[jira] [Resolved] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4931. - Resolution: Fixed Hadoop Flags: Reviewed Patch committed to trunk. Thanks Artem! > Document IN operat

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414793#comment-15414793 ] Daniel Dai commented on PIG-4931: - There are extra spaces, such as "IN (expression)        "

[jira] [Commented] (PIG-4968) Fix unit test failure of TestLogicalPlanBuilder#testQuery90

[ https://issues.apache.org/jira/browse/PIG-4968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414418#comment-15414418 ] Daniel Dai commented on PIG-4968: - I don't think build.xml changes are related, right? > Fi

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15414269#comment-15414269 ] Daniel Dai commented on PIG-4931: - There is a typo in "IN operator) allows", the right paren

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15413061#comment-15413061 ] Daniel Dai commented on PIG-4931: - The patch is way too big than it should be. The format ch

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412955#comment-15412955 ] Daniel Dai commented on PIG-4967: - Decompose means instead of invoking j.toString, you can c

[jira] [Updated] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4931: Assignee: Artem Ervits > Document IN operator > > > Key: PIG-4931 >

[jira] [Commented] (PIG-4931) Document IN operator

[ https://issues.apache.org/jira/browse/PIG-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412508#comment-15412508 ] Daniel Dai commented on PIG-4931: - [~dbist13], can you try if you can attach patch now? > D

[jira] [Updated] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4967: Assignee: Xiang Li > NPE in PigJobControl.run() when job status is null >

[jira] [Commented] (PIG-4967) NPE in PigJobControl.run() when job status is null

[ https://issues.apache.org/jira/browse/PIG-4967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15412351#comment-15412351 ] Daniel Dai commented on PIG-4967: - Sure, you can decompose ControlledJob and do null check o

[jira] [Resolved] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4965. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 spark-branch P

[jira] [Commented] (PIG-4966) Fix Pig compatibility with Hive 2.1.0

[ https://issues.apache.org/jira/browse/PIG-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411396#comment-15411396 ] Daniel Dai commented on PIG-4966: - There are incompatible changes between Hive 2 and Hive 1.

[jira] [Commented] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15411389#comment-15411389 ] Daniel Dai commented on PIG-4965: - The suggested code makes sense to me. Remove a non-exist

[jira] [Commented] (PIG-4897) Scope of param substitution for run/exec commands

[ https://issues.apache.org/jira/browse/PIG-4897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410510#comment-15410510 ] Daniel Dai commented on PIG-4897: - bq. can correct me if I'm mistaken, but to correct the Pi

[jira] [Commented] (PIG-4964) Pig code when executed on Tez fails with and error 'Schema cannot be determined'. Pig version we use is 0.15

[ https://issues.apache.org/jira/browse/PIG-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410506#comment-15410506 ] Daniel Dai commented on PIG-4964: - Can you find the complete exception stack from pig.log an

[jira] [Commented] (PIG-259) allow store to overwrite existing directroy

[ https://issues.apache.org/jira/browse/PIG-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410505#comment-15410505 ] Daniel Dai commented on PIG-259: [~pritish_sa...@yahoo.com], it is only applicable to customi

[jira] [Updated] (PIG-4966) Fix Pig compatibility with Hive 2.1.0

[ https://issues.apache.org/jira/browse/PIG-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4966: Resolution: Fixed Assignee: Zach York Hadoop Flags: Reviewed Fix Version/s: 0.17.0

[jira] [Commented] (PIG-4958) Tez autoparallelism estimation for order by is higher than mapreduce

[ https://issues.apache.org/jira/browse/PIG-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410497#comment-15410497 ] Daniel Dai commented on PIG-4958: - If we want to use counter, why not get NUM_RECORDS as wel

[jira] [Commented] (PIG-4965) Refactor test/perf/pigmix/bin/runpigmix.pl to delete the output of single test case if we enable cleanup_after_test

[ https://issues.apache.org/jira/browse/PIG-4965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15410180#comment-15410180 ] Daniel Dai commented on PIG-4965: - Remove a file does not exist clearly a bug. I think you c

[jira] [Commented] (PIG-4935) TEZ_USE_CLUSTER_HADOOP_LIBS is always set to true

[ https://issues.apache.org/jira/browse/PIG-4935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15394578#comment-15394578 ] Daniel Dai commented on PIG-4935: - +1 > TEZ_USE_CLUSTER_HADOOP_LIBS is always set to true >

[jira] [Commented] (PIG-4960) Split followed by order by/skewed join is skewed

[ https://issues.apache.org/jira/browse/PIG-4960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393277#comment-15393277 ] Daniel Dai commented on PIG-4960: - +1 > Split followed by order by/skewed join is skewed >

[jira] [Commented] (PIG-4961) CROSS followed by LIMIT inside nested foreach drop data from result

[ https://issues.apache.org/jira/browse/PIG-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15393274#comment-15393274 ] Daniel Dai commented on PIG-4961: - +1 > CROSS followed by LIMIT inside nested foreach drop

[jira] [Resolved] (PIG-4852) Add accumulator implementation for MaxTupleBy1stField

[ https://issues.apache.org/jira/browse/PIG-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4852. - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Patch committed to trunk. Thanks

[jira] [Commented] (PIG-4961) LIMIT operation drop data from result

[ https://issues.apache.org/jira/browse/PIG-4961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392544#comment-15392544 ] Daniel Dai commented on PIG-4961: - Yes, I can reproduce. [~rohini], I don't feel the POLimit

[jira] [Commented] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15392533#comment-15392533 ] Daniel Dai commented on PIG-4957: - +1 > See "Received kill signal" message for a normal run

[jira] [Commented] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390402#comment-15390402 ] Daniel Dai commented on PIG-4957: - It happens in MR job, does not sound like PIG-4928. > Se

[jira] [Commented] (PIG-4921) Kill running jobs on InterruptedException

[ https://issues.apache.org/jira/browse/PIG-4921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15390244#comment-15390244 ] Daniel Dai commented on PIG-4921: - See lots of "Received kill signal" message after the patc

[jira] [Updated] (PIG-4957) See "Received kill signal" message for a normal run after PIG-4921

[ https://issues.apache.org/jira/browse/PIG-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4957: Summary: See "Received kill signal" message for a normal run after PIG-4921 (was: See "Received kill signal"

[jira] [Created] (PIG-4957) See "Received kill signal" message for a normal run after pig-4921

Daniel Dai created PIG-4957: --- Summary: See "Received kill signal" message for a normal run after pig-4921 Key: PIG-4957 URL: https://issues.apache.org/jira/browse/PIG-4957 Project: Pig Issue Type:

[jira] [Resolved] (PIG-4955) Difference in record counts for same pig script on same data

[ https://issues.apache.org/jira/browse/PIG-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4955. - Resolution: Duplicate Fix Version/s: 0.16.0 It is PIG-4683. > Difference in record counts for same p

[jira] [Commented] (PIG-4852) Add accumulator implementation for MaxTupleBy1stField

[ https://issues.apache.org/jira/browse/PIG-4852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15388945#comment-15388945 ] Daniel Dai commented on PIG-4852: - You also need to change javac.version to 1.7 in contrib/

[jira] [Commented] (PIG-4955) Difference in record counts for same pig script on same data

[ https://issues.apache.org/jira/browse/PIG-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15388941#comment-15388941 ] Daniel Dai commented on PIG-4955: - The issue is fixed in 0.16. I haven't pin down which patc

[jira] [Updated] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4953: Attachment: PIG-4953.3.patch The import statement in TestNewPartitionFilterPushDown is unnecessary. Also adde

[jira] [Updated] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4953: Fix Version/s: 0.17.0 > Predicate push-down will not run filters for single unary expressions > --

[jira] [Updated] (PIG-4947) LOAD with HBaseStorage using a mix of pure wildcards and prefixed wildcards results in empty maps for the pure wildcarded column families.

[ https://issues.apache.org/jira/browse/PIG-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4947: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Patch commit

[jira] [Commented] (PIG-4092) Predicate pushdown for Parquet

[ https://issues.apache.org/jira/browse/PIG-4092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387189#comment-15387189 ] Daniel Dai commented on PIG-4092: - Pig's ParquetLoader is a wrapper. It's true PARQUET-397 i

[jira] [Updated] (PIG-4947) LOAD with HBaseStorage using a mix of pure wildcards and prefixed wildcards results in empty maps for the pure wildcarded column families.

[ https://issues.apache.org/jira/browse/PIG-4947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-4947: Fix Version/s: 0.16.1 0.17.0 > LOAD with HBaseStorage using a mix of pure wildcards and pre

[jira] [Commented] (PIG-4953) Predicate push-down will not run filters for single unary expressions

[ https://issues.apache.org/jira/browse/PIG-4953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15385296#comment-15385296 ] Daniel Dai commented on PIG-4953: - Seems you miss something in the test, I only see you chan

[jira] [Resolved] (PIG-4954) Pig ToDate() exception with hive partition table ,partitioned by column of DATE datatype

[ https://issues.apache.org/jira/browse/PIG-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-4954. - Resolution: Invalid > Pig ToDate() exception with hive partition table ,partitioned by column of > DATE dat

<    1   2   3   4   5   6   7   8   9   10   >