[jira] [Resolved] (PIG-4767) Partition filter not pushed down when filter clause references variable from another load path

2017-07-13 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi resolved PIG-4767. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review Daniel! Committed it to trunk. >

[jira] [Commented] (PIG-4767) Partition filter not pushed down when filter clause references variable from another load path

2017-07-13 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16086170#comment-16086170 ] Koji Noguchi commented on PIG-4767: --- Forgot to mention, Anthony, sorry for taking this lon

[jira] [Created] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-07-13 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-5271: - Summary: StackOverflowError when compiling in Tez mode (with union and replicated join) Key: PIG-5271 URL: https://issues.apache.org/jira/browse/PIG-5271 Project: Pig

[jira] [Updated] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-07-13 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5271: -- Attachment: pig-5271-v01.patch First time touching a Tez compiler. Attaching a patch that would give up

[jira] [Updated] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-07-14 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5271: -- Attachment: pig-5271-v02.patch Only updating a comment in the test from the previous patch. > StackOverfl

[jira] [Commented] (PIG-5273) _SUCCESS file should be created at the end of the job

2017-07-17 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16089886#comment-16089886 ] Koji Noguchi commented on PIG-5273: --- I like (1) + (2). (3) isn't really fixing the issue b

[jira] [Commented] (PIG-4767) Partition filter not pushed down when filter clause references variable from another load path

2017-07-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16093482#comment-16093482 ] Koji Noguchi commented on PIG-4767: --- Can we push this to 0.17 branch? > Partition filter

[jira] [Created] (PIG-5276) building "jar" should not call "clean"

2017-07-27 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-5276: - Summary: building "jar" should not call "clean" Key: PIG-5276 URL: https://issues.apache.org/jira/browse/PIG-5276 Project: Pig Issue Type: Bug Components

[jira] [Commented] (PIG-5276) building "jar" should not call "clean"

2017-07-31 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16108386#comment-16108386 ] Koji Noguchi commented on PIG-5276: --- Sorry for the late update. I didn't have time to thi

[jira] [Commented] (PIG-5286) Run verify_pig in e2e with old version of Pig

2017-08-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117074#comment-16117074 ] Koji Noguchi commented on PIG-5286: --- We already run with old pig when separate script is n

[jira] [Commented] (PIG-5286) Run verify_pig in e2e with old version of Pig

2017-08-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117117#comment-16117117 ] Koji Noguchi commented on PIG-5286: --- Then we need separate e2e test that simply run old-pi

[jira] [Commented] (PIG-5256) Bytecode generation for POFilter and POForeach

2017-08-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16117257#comment-16117257 ] Koji Noguchi commented on PIG-5256: --- bq. License: The newly added fernflower.jar used for

[jira] [Commented] (PIG-5201) Null handling on FLATTEN

2017-08-09 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120468#comment-16120468 ] Koji Noguchi commented on PIG-5201: --- [~daijy], as I wrote above, are you ok with FLATTEN(n

[jira] [Commented] (PIG-5201) Null handling on FLATTEN

2017-08-09 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16120561#comment-16120561 ] Koji Noguchi commented on PIG-5201: --- bq. Shall we produce the same number of nulls columns

[jira] [Commented] (PIG-5201) Null handling on FLATTEN

2017-08-10 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16122081#comment-16122081 ] Koji Noguchi commented on PIG-5201: --- bq. What's your idea for the column padding? I don't

[jira] [Created] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-07 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-5299: - Summary: PartitionFilterOptimizer failing at compile time Key: PIG-5299 URL: https://issues.apache.org/jira/browse/PIG-5299 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157650#comment-16157650 ] Koji Noguchi commented on PIG-5299: --- Log file showing the trace. {noformat} Pig Stack Trac

[jira] [Commented] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157678#comment-16157678 ] Koji Noguchi commented on PIG-5299: --- Pasting filter plan with hashcode (to check the uniqu

[jira] [Commented] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16157747#comment-16157747 ] Koji Noguchi commented on PIG-5299: --- Two ways of handling this. (1) Deepcopy the expressio

[jira] [Updated] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-08 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5299: -- Attachment: pig-5299-delayremoval-v1.patch bq. (2) Delay the removal for expression that is used elsewhere

[jira] [Created] (PIG-5300) hashCode for Bag needs to be order independent

2017-09-12 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-5300: - Summary: hashCode for Bag needs to be order independent Key: PIG-5300 URL: https://issues.apache.org/jira/browse/PIG-5300 Project: Pig Issue Type: Bug

[jira] [Updated] (PIG-5300) hashCode for Bag needs to be order independent

2017-09-13 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5300: -- Attachment: pig-5300-v01.patch Attaching my first try, {{pig-5300-v01.patch}}. This change will update {

[jira] [Updated] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5299: -- Status: Patch Available (was: Open) bq. Attaching a patch and running a full test now. Tests look good.

[jira] [Updated] (PIG-5300) hashCode for Bag needs to be order independent

2017-09-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5300: -- Status: Patch Available (was: Open) Tests passed. Making it patch available. [~daijy], appreciate if y

[jira] [Updated] (PIG-5299) PartitionFilterOptimizer failing at compile time

2017-09-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5299: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.1 Status: Resolved (wa

[jira] [Updated] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-09-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5271: -- Attachment: pig-5271-v03.patch Thanks for the review Daniel, Rohini! Attaching {{pig-5271-v03.patch}} fi

[jira] [Updated] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-09-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5271: -- Status: Patch Available (was: Open) > StackOverflowError when compiling in Tez mode (with union and repli

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-09-20 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v04.patch Uploading a patch that now expands FLATTEN(null-bag) to null * num_fields a

[jira] [Updated] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-09-20 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5271: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.18.0 Status: Resolved (wa

[jira] [Commented] (PIG-5271) StackOverflowError when compiling in Tez mode (with union and replicated join)

2017-09-22 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16176391#comment-16176391 ] Koji Noguchi commented on PIG-5271: --- bq. Koji Noguchi I think you forgot to commit TEZC-Un

[jira] [Commented] (PIG-2537) Output from flatten with a null tuple input generating data inconsistent with the schema

2017-10-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217406#comment-16217406 ] Koji Noguchi commented on PIG-2537: --- [~daijy], since patch doesn't apply cleanly anymore,

[jira] [Commented] (PIG-5300) hashCode for Bag needs to be order independent

2017-10-24 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16217487#comment-16217487 ] Koji Noguchi commented on PIG-5300: --- bq. +1. Daniel Dai, can you please take a look as wel

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-10-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v05.patch Thanks for the review Rohini! bq. 1) Can we rename flattenNumFieldsForNul

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-11-01 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v06.patch {quote} bq. Took a look but I'm already afraid of introducing a regression

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-11-04 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v07.patch With {{pig-5201-v06.patch}}, saw a couple of unit test failures. Turns out

[jira] [Commented] (PIG-5312) Uids not set in inner schemas after UNION ONSCHEMA

2017-11-14 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16253067#comment-16253067 ] Koji Noguchi commented on PIG-5312: --- On parental leave but I'll see if I can review it nex

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-11-22 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v08.patch Sorry for taking this long to commit. Two more issues. (a) My last patch h

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

2017-11-22 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v09-with-testUtilchange.patch bq. We can go one step further and make checkQueryOutpu

[jira] [Commented] (PIG-5201) Null handling on FLATTEN

2017-11-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268004#comment-16268004 ] Koji Noguchi commented on PIG-5201: --- bq. Why do you have to change checkQueryOutputsAfter

[jira] [Resolved] (PIG-5201) Null handling on FLATTEN

2017-12-08 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi resolved PIG-5201. --- Resolution: Fixed Hadoop Flags: Reviewed Thanks for the review Rohini! Also, Daniel, thank you fo

[jira] [Resolved] (PIG-2537) Output from flatten with a null tuple input generating data inconsistent with the schema

2017-12-08 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi resolved PIG-2537. --- Resolution: Duplicate Fix Version/s: (was: 0.18.0) Closing this jira as a duplicate of PIG-52

[jira] [Updated] (PIG-5289) update .eclipse.templates/.classpath with latest jars

2017-12-08 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5289: -- Fix Version/s: (was: trunk) 0.18.0 [~dbist13], do you want to work on this jira and

[jira] [Assigned] (PIG-5312) Uids not set in inner schemas after UNION ONSCHEMA

2017-12-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi reassigned PIG-5312: - Assignee: Travis Woodruff > Uids not set in inner schemas after UNION ONSCHEMA > --

[jira] [Commented] (PIG-5312) Uids not set in inner schemas after UNION ONSCHEMA

2017-12-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16300541#comment-16300541 ] Koji Noguchi commented on PIG-5312: --- Sorry for such a delay in review. Took me time to un

[jira] [Updated] (PIG-5300) hashCode for Bag needs to be order independent

2017-12-21 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5300: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.18.0 Status: Resolved (wa

[jira] [Updated] (PIG-5312) Uids not set in inner schemas after UNION ONSCHEMA

2017-12-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5312: -- Attachment: PIG-5312_fixedspace.patch Committing to trunk now. Took out the empty spaces in the original

[jira] [Updated] (PIG-5312) Uids not set in inner schemas after UNION ONSCHEMA

2017-12-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5312: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.18.0 Status: Resolved (wa

[jira] [Commented] (PIG-5311) POReservoirSample fails for more than Integer.MAX_VALUE records

2017-12-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304806#comment-16304806 ] Koji Noguchi commented on PIG-5311: --- First time looking at sampling. I need to test it m

[jira] [Commented] (PIG-5322) ConstantCalculator optimizer is not applied for split

2017-12-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16304813#comment-16304813 ] Koji Noguchi commented on PIG-5322: --- +1 > ConstantCalculator optimizer is not applied for

[jira] [Commented] (PIG-5322) ConstantCalculator optimizer is not applied for split

2017-12-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305024#comment-16305024 ] Koji Noguchi commented on PIG-5322: --- {{SplitConstantCalculator.java}} was missed in the la

[jira] [Commented] (PIG-5311) POReservoirSample fails for more than Integer.MAX_VALUE records

2017-12-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305556#comment-16305556 ] Koji Noguchi commented on PIG-5311: --- Thanks Rohini. For readability, I'm not sure if ha

[jira] [Commented] (PIG-5311) POReservoirSample fails for more than Integer.MAX_VALUE records

2017-12-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16305912#comment-16305912 ] Koji Noguchi commented on PIG-5311: --- {{PIG-5311-3.patch}} looks good. +1 Thanks for being

[jira] [Commented] (PIG-5327) Check for DAG status before trying to kill

2018-01-08 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16317121#comment-16317121 ] Koji Noguchi commented on PIG-5327: --- Looks good to me. +1 But can you share some backgro

[jira] [Commented] (PIG-4608) FOREACH ... UPDATE

2018-01-16 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16327686#comment-16327686 ] Koji Noguchi commented on PIG-4608: --- For now, can we just require separate statements for

[jira] [Commented] (PIG-5328) expressionOperator Divide.equalsZero(DataType.BIGDECIMAL) is invalid

2018-01-17 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16329551#comment-16329551 ] Koji Noguchi commented on PIG-5328: --- Thanks for your feedback  [~michaelthoward]!  Please

[jira] [Assigned] (PIG-5328) expressionOperator Divide.equalsZero(DataType.BIGDECIMAL) is invalid

2018-01-17 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi reassigned PIG-5328: - Assignee: Michael Howard Thanks again Michael. Assigning the jira to you. Let us know if you need

[jira] [Commented] (PIG-5328) expressionOperator Divide.equalsZero(DataType.BIGDECIMAL) is invalid

2018-01-25 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340497#comment-16340497 ] Koji Noguchi commented on PIG-5328: --- Thanks Michael! +1 on the patch. Confirmed your test

[jira] [Commented] (PIG-4608) FOREACH ... UPDATE

2018-01-25 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16340555#comment-16340555 ] Koji Noguchi commented on PIG-4608: --- {quote}I didn't see UPDATE/DROP in a single statement

[jira] [Updated] (PIG-5328) expressionOperator Divide.equalsZero(DataType.BIGDECIMAL) is invalid

2018-01-26 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5328: -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.18.0 Status: Resolved (wa

[jira] [Commented] (PIG-5330) DUMP throws IOException but it DESCRIBE's the schema

2018-02-02 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16350502#comment-16350502 ] Koji Noguchi commented on PIG-5330: --- bq. i had to modify the line to (long) memberId AS Me

[jira] [Commented] (PIG-4608) FOREACH ... UPDATE

2018-02-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366197#comment-16366197 ] Koji Noguchi commented on PIG-4608: --- {quote}The idea is to make ".." syntax more flexible,

[jira] [Commented] (PIG-4608) FOREACH ... UPDATE

2018-02-15 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16366248#comment-16366248 ] Koji Noguchi commented on PIG-4608: --- bq. To me, UPDATE $1 with r+$2 means update the first

[jira] [Created] (PIG-3641) Split "otherwise" producing incorrect output when combined with ColumnPruning

2013-12-23 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3641: - Summary: Split "otherwise" producing incorrect output when combined with ColumnPruning Key: PIG-3641 URL: https://issues.apache.org/jira/browse/PIG-3641 Project: Pig

[jira] [Updated] (PIG-3641) Split "otherwise" producing incorrect output when combined with ColumnPruning

2013-12-23 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3641: -- Attachment: pig-3641_v01.patch This issue is similar to PIG-3051 where projection expression was pointing

[jira] [Commented] (PIG-3511) Security: Pig temporary directories might have world readable permissions

2014-01-10 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13868250#comment-13868250 ] Koji Noguchi commented on PIG-3511: --- Hadoop/Yarn should do a better job in handling of the

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-23 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13879989#comment-13879989 ] Koji Noguchi commented on PIG-2672: --- Thanks Aniket! I like the non-share approach. bq. (

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-23 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13880071#comment-13880071 ] Koji Noguchi commented on PIG-2672: --- bq. The cache will be reused by other pig jobs during

[jira] [Commented] (PIG-2672) Optimize the use of DistributedCache

2014-01-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13883490#comment-13883490 ] Koji Noguchi commented on PIG-2672: --- bq. Koji Noguchi in the spirit of keeping things movi

[jira] [Updated] (PIG-3641) Split "otherwise" producing incorrect output when combined with ColumnPruning

2014-01-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3641: -- Status: Patch Available (was: Open) > Split "otherwise" producing incorrect output when combined with Co

[jira] [Updated] (PIG-3641) Split "otherwise" producing incorrect output when combined with ColumnPruning

2014-01-28 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3641: -- Attachment: pig-3641_v02_withe2etest.patch Added an e2e testcase that shows how the output differs betwee

[jira] [Updated] (PIG-3641) Split "otherwise" producing incorrect output when combined with ColumnPruning

2014-01-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3641: -- Resolution: Fixed Fix Version/s: 0.12.1 Status: Resolved (was: Patch Available) Thanks

[jira] [Updated] (PIG-3347) Store invocation brings side effect

2014-01-31 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3347: -- Attachment: PIG-3347-2-testonly.patch [~daijy], I think your testcase in the patch succeeds even without

[jira] [Updated] (PIG-3347) Store invocation brings side effect

2014-02-04 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3347: -- Attachment: PIG-3347-4-testonly.patch Thanks [~daijy]. Adding one more testcase that I believe should p

[jira] [Commented] (PIG-3347) Store invocation brings side effect

2014-02-04 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890942#comment-13890942 ] Koji Noguchi commented on PIG-3347: --- bq. UID is to track column lineage so in logical opti

[jira] [Commented] (PIG-3347) Store invocation brings side effect

2014-02-04 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891127#comment-13891127 ] Koji Noguchi commented on PIG-3347: --- bq. we will need to generate a new uid for col2 to av

[jira] [Resolved] (PIG-3720) Nested concats of binary conditionals take 1/2 hour to parse

2014-02-05 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi resolved PIG-3720. --- Resolution: Duplicate I believe this is fixed in PIG-2769 for version 11.2 and later. Steve can you t

[jira] [Commented] (PIG-3347) Store invocation brings side effect

2014-02-07 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13895148#comment-13895148 ] Koji Noguchi commented on PIG-3347: --- bq. It could but introduce a lot of complications. Cu

[jira] [Created] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-02-27 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3782: - Summary: PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment Key: PIG-3782 URL: https://issues.apache.org/jira/browse/PIG-3782

[jira] [Commented] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-02-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914749#comment-13914749 ] Koji Noguchi commented on PIG-3782: --- This error is happening when PushDownForEachFlatten i

[jira] [Commented] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-02-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914774#comment-13914774 ] Koji Noguchi commented on PIG-3782: --- PushDownForEachFlatten is properly copying the UserDe

[jira] [Updated] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-02-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3782: -- Attachment: pig-3782-v01.patch I lack the understanding of why we need the copying of userDefinedSchema.

[jira] [Updated] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-02-27 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3782: -- Affects Version/s: 0.10.1 0.12.0 0.11.1 Statu

[jira] [Commented] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-03-10 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13925947#comment-13925947 ] Koji Noguchi commented on PIG-3782: --- bq. I attach another patch only fix PushDownForEachFl

[jira] [Commented] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-03-12 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13931818#comment-13931818 ] Koji Noguchi commented on PIG-3782: --- bq. The uid field of mUserDefinedSchema is considered

[jira] [Updated] (PIG-3782) PushDownForEachFlatten + ColumnMapKeyPrune with user defined schema failing due to incorrect UID assignment

2014-03-13 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3782: -- Assignee: Daniel Dai (was: Koji Noguchi) > PushDownForEachFlatten + ColumnMapKeyPrune with user defined

[jira] [Commented] (PIG-2970) Nested foreach getting incorrect schema when having unrelated inner query

2014-03-19 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13940661#comment-13940661 ] Koji Noguchi commented on PIG-2970: --- bq. Koji Horaguchi is right, we shall iterate inner p

[jira] [Created] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-05-30 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-3975: - Summary: Multiple Scalar reference calls leading to missing records Key: PIG-3975 URL: https://issues.apache.org/jira/browse/PIG-3975 Project: Pig Issue Type: Bug

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-05-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014254#comment-14014254 ] Koji Noguchi commented on PIG-3975: --- With the script from the description, job DAG looked

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-05-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014264#comment-14014264 ] Koji Noguchi commented on PIG-3975: --- Due to the missing dependency, job_1399356417814_1891

[jira] [Updated] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-05-30 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3975: -- Attachment: pig-3975-v01_withouttest.patch Attaching a preliminary patch. I believe what's happening is,

[jira] [Updated] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-12 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-3975: -- Attachment: pig-3975-v02_withtests.patch Attaching a patch with added testcases. One for the missing depe

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-12 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14029883#comment-14029883 ] Koji Noguchi commented on PIG-3975: --- ReviewBoard: https://reviews.apache.org/r/22535/ > M

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-16 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14032546#comment-14032546 ] Koji Noguchi commented on PIG-3975: --- bq. Koji Noguchi Patch looks good to me. However this

[jira] [Commented] (PIG-3975) Multiple Scalar reference calls leading to missing records

2014-06-20 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-3975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14039348#comment-14039348 ] Koji Noguchi commented on PIG-3975: --- Had a loong chat with Rohini on learning what is happ

[jira] [Created] (PIG-4055) Build broke after TEZ-1130 API rename

2014-07-11 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-4055: - Summary: Build broke after TEZ-1130 API rename Key: PIG-4055 URL: https://issues.apache.org/jira/browse/PIG-4055 Project: Pig Issue Type: Bug Reporter:

[jira] [Updated] (PIG-4055) Build broke after TEZ-1130 API rename

2014-07-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4055: -- Attachment: pig-4055-v01.patch A simple patch renaming the following * vertex.setTaskLocalResources -> ve

[jira] [Updated] (PIG-4055) Build broke after TEZ-1130 API rename

2014-07-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4055: -- Status: Patch Available (was: Open) > Build broke after TEZ-1130 API rename > --

[jira] [Updated] (PIG-4055) Build broke after TEZ-1130 API rename

2014-07-11 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4055: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to trunk. Thanks Rohini and

[jira] [Updated] (PIG-4081) SVNException: svn: E155005: Directory './buildroot/lib/.svn' containing working copy admin area is missing

2014-07-29 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-4081: -- Summary: SVNException: svn: E155005: Directory './buildroot/lib/.svn' containing working copy admin area

[jira] [Created] (PIG-4081) org.tmatesoft.svn.core.SVNException: svn: E155005: Directory './buildroot/lib/.svn' containing working copy admin area is missing

2014-07-29 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-4081: - Summary: org.tmatesoft.svn.core.SVNException: svn: E155005: Directory './buildroot/lib/.svn' containing working copy admin area is missing Key: PIG-4081 URL: https://issues.apache.org/j

<    1   2   3   4   5   6   7   8   9   10   >