[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_6.patch 1. resovle merge conflicts, and some minor import statements change. 2. enable UT c

[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_7.patch minor change: enable UT case for spark engine. [~kellyzly], please help review. >

[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_8.patch refine the code in SparkCompiler. Use getSkewedJoinSampleJob() [~kellyzly], pleas

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950552#comment-15950552 ] liyunzhang_intel commented on PIG-4858: --- [~kexianda]: LGTM for PIG-4858_8.patch , comm

[jira] [Resolved] (PIG-4858) Implement Skewed join for spark engine

[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-4858. --- Resolution: Fixed > Implement Skewed join for spark engine > ---

[jira] [Created] (PIG-5206) Support outer join for SkewedJoin in spark mode

Xianda Ke created PIG-5206: -- Summary: Support outer join for SkewedJoin in spark mode Key: PIG-5206 URL: https://issues.apache.org/jira/browse/PIG-5206 Project: Pig Issue Type: Sub-task

[jira] [Assigned] (PIG-5206) Support outer join for SkewedJoin in spark mode

[ https://issues.apache.org/jira/browse/PIG-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke reassigned PIG-5206: -- Assignee: Xianda Ke > Support outer join for SkewedJoin in spark mode > -

[jira] [Commented] (PIG-5169) SkewedJoin_13 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950559#comment-15950559 ] Xianda Ke commented on PIG-5169: after investigation, it fails because skewedjoin currently

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950560#comment-15950560 ] Xianda Ke commented on PIG-5170: after investigation, it fails because skewedjoin currently

[jira] [Commented] (PIG-5168) SkewedJoin_12 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950558#comment-15950558 ] Xianda Ke commented on PIG-5168: after investigation, it fails because skewedjoin currently

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950708#comment-15950708 ] Nandor Kollar commented on PIG-5170: Thanks [~kexianda]! [~kellyzly] I'll close these is

[jira] [Created] (PIG-5207) BugFix e2e tests fail on spark

Adam Szita created PIG-5207: --- Summary: BugFix e2e tests fail on spark Key: PIG-5207 URL: https://issues.apache.org/jira/browse/PIG-5207 Project: Pig Issue Type: Sub-task Reporter: Adam

[jira] [Updated] (PIG-5207) BugFix e2e tests fail on spark

[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5207: Attachment: PIG-5207.0.patch > BugFix e2e tests fail on spark > -- > >

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950940#comment-15950940 ] Adam Szita commented on PIG-5207: - This test case uses COR UDF to calculate correlation betw

[jira] [Updated] (PIG-5207) BugFix e2e tests fail on spark

[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5207: Status: Patch Available (was: Open) > BugFix e2e tests fail on spark > -- > >

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950944#comment-15950944 ] Xianda Ke commented on PIG-5170: Hi [~nkollar], I prefer to support PIG-5026 in 0.17. [~kel

[jira] [Comment Edited] (PIG-5170) SkewedJoin_14 is failing with spark exec type

[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15950944#comment-15950944 ] Xianda Ke edited comment on PIG-5170 at 3/31/17 2:04 PM: - Hi [~nkoll

[jira] [Commented] (PIG-5203) Partitioner E2E test fails on spark

[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951024#comment-15951024 ] Adam Szita commented on PIG-5203: - Without this patch it was relying on the cfe value, so wh

[jira] [Commented] (PIG-5200) Orc_1 and Orc_Pushdown_* tests fail on Spark

[ https://issues.apache.org/jira/browse/PIG-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951070#comment-15951070 ] Adam Szita commented on PIG-5200: - Thanks for the tip, I'll take a look > Orc_1 and Orc_Pus

[jira] [Commented] (PIG-5199) exclude jline in spark dependency

[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951097#comment-15951097 ] Adam Szita commented on PIG-5199: - It seems like you created the merge issue on the *test ji

[jira] [Created] (PIG-5208) Two HBase Loads Followed By a Merge Join Fails in Mapreduce or Tez Mode

William Watson created PIG-5208: --- Summary: Two HBase Loads Followed By a Merge Join Fails in Mapreduce or Tez Mode Key: PIG-5208 URL: https://issues.apache.org/jira/browse/PIG-5208 Project: Pig

[jira] [Updated] (PIG-4677) Display failure information on stop on failure

[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4677: Attachment: PIG-4677-fixflakytest.patch The test was flaky based on the order of jobs launched

[jira] [Commented] (PIG-5194) HiveUDF fails with Spark exec type

[ https://issues.apache.org/jira/browse/PIG-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951705#comment-15951705 ] Rohini Palaniswamy commented on PIG-5194: - [~daijy] knows about HiveUDF better. So h

[jira] [Commented] (PIG-4677) Display failure information on stop on failure

[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951709#comment-15951709 ] Daniel Dai commented on PIG-4677: - +1 on PIG-4677-fixflakytest.patch. > Display failure inf

[jira] [Commented] (PIG-4677) Display failure information on stop on failure

[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951726#comment-15951726 ] Rohini Palaniswamy commented on PIG-4677: - Committed PIG-4677-fixflakytest.patch to

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951729#comment-15951729 ] Rohini Palaniswamy commented on PIG-5207: - bq. This is due to another plan generatio

Build failed in Jenkins: Pig-trunk-commit #2469

See Changes: [rohini] Fix flaky test in PIG-4677 (rohini) -- [...truncated 163.64 KB...] A contrib/piggybank/java/src/test/java/org/apache/pig/piggybank/test/stor

[jira] [Updated] (PIG-5153) Change of behavior in FLATTEN(map)

[ https://issues.apache.org/jira/browse/PIG-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5153: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Status: R

[jira] [Created] (PIG-5209) Cross product on flatten(map) fails with ClassCastException

Koji Noguchi created PIG-5209: - Summary: Cross product on flatten(map) fails with ClassCastException Key: PIG-5209 URL: https://issues.apache.org/jira/browse/PIG-5209 Project: Pig Issue Type: Bu

[jira] [Updated] (PIG-5209) Cross product on flatten(map) fails with ClassCastException

[ https://issues.apache.org/jira/browse/PIG-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5209: -- Attachment: pig-5209-v01.patch Full stacktrace. {noformat} 2017-04-01 00:01:38,439 [Thread-40] WARN org.

[jira] [Commented] (PIG-5209) Cross product on flatten(map) fails with ClassCastException

[ https://issues.apache.org/jira/browse/PIG-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952010#comment-15952010 ] Rohini Palaniswamy commented on PIG-5209: - +1 > Cross product on flatten(map) fails

[jira] [Resolved] (PIG-4640) Compiling Pig with JDK8 or JDK7 Update 85 breaks Ruby UDFs

[ https://issues.apache.org/jira/browse/PIG-4640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-4640. - Resolution: Fixed Assignee: Daniel Dai Fix Version/s: 0.17.0 [~daijy] has fi

[jira] [Created] (PIG-5210) Print MR/Tez plan before launching

Lili Yu created PIG-5210: Summary: Print MR/Tez plan before launching Key: PIG-5210 URL: https://issues.apache.org/jira/browse/PIG-5210 Project: Pig Issue Type: Improvement Reporter: Lili

[jira] [Assigned] (PIG-5210) Print MR/Tez plan before launching

[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-5210: --- Assignee: Lili Yu > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Affects Version/s: 0.17.0 Status: Patch Available (was: Open) > Print MR/Tez plan before launching >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Status: Open (was: Patch Available) > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: PrintPlan.patch > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Status: Patch Available (was: Open) > Print MR/Tez plan before launching > -- > >

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (42 issues) Subscriber: pigdaily Key Summary PIG-5210Print MR/Tez plan before launching https://issues.apache.org/jira/browse/PIG-5210 PIG-5207BugFix e2e tests fail on spark https://issues.apache.org/jira/brows

[jira] [Commented] (PIG-5201) Null handling on FLATTEN

[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15952064#comment-15952064 ] Daniel Dai commented on PIG-5201: - This is PIG-2537, this is a bug we shall fix. > Null han