[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Lili Yu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Status: Patch Available (was: Open) > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Lili Yu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Attachment: PrintPlan.patch > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Lili Yu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Status: Open (was: Patch Available) > Print MR/Tez plan before launching > -- > >

[jira] [Updated] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Lili Yu (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lili Yu updated PIG-5210: - Affects Version/s: 0.17.0 Status: Patch Available (was: Open) > Print MR/Tez plan before launching

[jira] [Assigned] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai reassigned PIG-5210: --- Assignee: Lili Yu > Print MR/Tez plan before launching > -- > >

[jira] [Created] (PIG-5210) Print MR/Tez plan before launching

2017-03-31 Thread Lili Yu (JIRA)
Lili Yu created PIG-5210: Summary: Print MR/Tez plan before launching Key: PIG-5210 URL: https://issues.apache.org/jira/browse/PIG-5210 Project: Pig Issue Type: Improvement Reporter:

[jira] [Resolved] (PIG-4640) Compiling Pig with JDK8 or JDK7 Update 85 breaks Ruby UDFs

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy resolved PIG-4640. - Resolution: Fixed Assignee: Daniel Dai Fix Version/s: 0.17.0 [~daijy] has

[jira] [Updated] (PIG-5209) Cross product on flatten(map) fails with ClassCastException

2017-03-31 Thread Koji Noguchi (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5209: -- Attachment: pig-5209-v01.patch Full stacktrace. {noformat} 2017-04-01 00:01:38,439 [Thread-40] WARN

[jira] [Created] (PIG-5209) Cross product on flatten(map) fails with ClassCastException

2017-03-31 Thread Koji Noguchi (JIRA)
Koji Noguchi created PIG-5209: - Summary: Cross product on flatten(map) fails with ClassCastException Key: PIG-5209 URL: https://issues.apache.org/jira/browse/PIG-5209 Project: Pig Issue Type:

[jira] [Updated] (PIG-5153) Change of behavior in FLATTEN(map)

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5153: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 0.17.0 Status:

Build failed in Jenkins: Pig-trunk-commit #2469

2017-03-31 Thread Apache Jenkins Server
See Changes: [rohini] Fix flaky test in PIG-4677 (rohini) -- [...truncated 163.64 KB...] A

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951729#comment-15951729 ] Rohini Palaniswamy commented on PIG-5207: - bq. This is due to another plan generation bug and it is

[jira] [Commented] (PIG-4677) Display failure information on stop on failure

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951726#comment-15951726 ] Rohini Palaniswamy commented on PIG-4677: - Committed PIG-4677-fixflakytest.patch to trunk. Thanks

[jira] [Commented] (PIG-4677) Display failure information on stop on failure

2017-03-31 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951709#comment-15951709 ] Daniel Dai commented on PIG-4677: - +1 on PIG-4677-fixflakytest.patch. > Display failure information on stop

[jira] [Commented] (PIG-5194) HiveUDF fails with Spark exec type

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951705#comment-15951705 ] Rohini Palaniswamy commented on PIG-5194: - [~daijy] knows about HiveUDF better. So he will be

[jira] [Updated] (PIG-4677) Display failure information on stop on failure

2017-03-31 Thread Rohini Palaniswamy (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-4677: Attachment: PIG-4677-fixflakytest.patch The test was flaky based on the order of jobs

[jira] [Created] (PIG-5208) Two HBase Loads Followed By a Merge Join Fails in Mapreduce or Tez Mode

2017-03-31 Thread William Watson (JIRA)
William Watson created PIG-5208: --- Summary: Two HBase Loads Followed By a Merge Join Fails in Mapreduce or Tez Mode Key: PIG-5208 URL: https://issues.apache.org/jira/browse/PIG-5208 Project: Pig

[jira] [Commented] (PIG-5199) exclude jline in spark dependency

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951097#comment-15951097 ] Adam Szita commented on PIG-5199: - It seems like you created the merge issue on the *test jira instance*:

[jira] [Commented] (PIG-5200) Orc_1 and Orc_Pushdown_* tests fail on Spark

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951070#comment-15951070 ] Adam Szita commented on PIG-5200: - Thanks for the tip, I'll take a look > Orc_1 and Orc_Pushdown_* tests

[jira] [Commented] (PIG-5203) Partitioner E2E test fails on spark

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15951024#comment-15951024 ] Adam Szita commented on PIG-5203: - Without this patch it was relying on the cfe value, so whatever comes

[jira] [Comment Edited] (PIG-5170) SkewedJoin_14 is failing with spark exec type

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950944#comment-15950944 ] Xianda Ke edited comment on PIG-5170 at 3/31/17 2:04 PM: - Hi [~nkollar], I prefer

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950944#comment-15950944 ] Xianda Ke commented on PIG-5170: Hi [~nkollar], I prefer to support PIG-5026 in 0.17. [~kellyzly], any

[jira] [Updated] (PIG-5207) BugFix e2e tests fail on spark

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5207: Status: Patch Available (was: Open) > BugFix e2e tests fail on spark > -- > >

[jira] [Commented] (PIG-5207) BugFix e2e tests fail on spark

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950940#comment-15950940 ] Adam Szita commented on PIG-5207: - This test case uses COR UDF to calculate correlation between 3 vars. The

[jira] [Updated] (PIG-5207) BugFix e2e tests fail on spark

2017-03-31 Thread Adam Szita (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5207: Attachment: PIG-5207.0.patch > BugFix e2e tests fail on spark > -- > >

[jira] [Created] (PIG-5207) BugFix e2e tests fail on spark

2017-03-31 Thread Adam Szita (JIRA)
Adam Szita created PIG-5207: --- Summary: BugFix e2e tests fail on spark Key: PIG-5207 URL: https://issues.apache.org/jira/browse/PIG-5207 Project: Pig Issue Type: Sub-task Reporter: Adam

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

2017-03-31 Thread Nandor Kollar (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950708#comment-15950708 ] Nandor Kollar commented on PIG-5170: Thanks [~kexianda]! [~kellyzly] I'll close these issues as

[jira] [Commented] (PIG-5168) SkewedJoin_12 is failing with spark exec type

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950558#comment-15950558 ] Xianda Ke commented on PIG-5168: after investigation, it fails because skewedjoin currently doesn't support

[jira] [Commented] (PIG-5169) SkewedJoin_13 is failing with spark exec type

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950559#comment-15950559 ] Xianda Ke commented on PIG-5169: after investigation, it fails because skewedjoin currently doesn't support

[jira] [Commented] (PIG-5170) SkewedJoin_14 is failing with spark exec type

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950560#comment-15950560 ] Xianda Ke commented on PIG-5170: after investigation, it fails because skewedjoin currently doesn't support

[jira] [Created] (PIG-5206) Support outer join for SkewedJoin in spark mode

2017-03-31 Thread Xianda Ke (JIRA)
Xianda Ke created PIG-5206: -- Summary: Support outer join for SkewedJoin in spark mode Key: PIG-5206 URL: https://issues.apache.org/jira/browse/PIG-5206 Project: Pig Issue Type: Sub-task

[jira] [Assigned] (PIG-5206) Support outer join for SkewedJoin in spark mode

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-5206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke reassigned PIG-5206: -- Assignee: Xianda Ke > Support outer join for SkewedJoin in spark mode >

[jira] [Resolved] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel resolved PIG-4858. --- Resolution: Fixed > Implement Skewed join for spark engine >

[jira] [Commented] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950552#comment-15950552 ] liyunzhang_intel commented on PIG-4858: --- [~kexianda]: LGTM for PIG-4858_8.patch , commit to spark

[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_8.patch refine the code in SparkCompiler. Use getSkewedJoinSampleJob() [~kellyzly],

[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_7.patch minor change: enable UT case for spark engine. [~kellyzly], please help review.

[jira] [Updated] (PIG-4858) Implement Skewed join for spark engine

2017-03-31 Thread Xianda Ke (JIRA)
[ https://issues.apache.org/jira/browse/PIG-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianda Ke updated PIG-4858: --- Attachment: PIG-4858_6.patch 1. resovle merge conflicts, and some minor import statements change. 2. enable UT

[jira] Subscription: PIG patch available

2017-03-31 Thread jira
Issue Subscription Filter: PIG patch available (41 issues) Subscriber: pigdaily Key Summary PIG-5203Partitioner E2E test fails on spark https://issues.apache.org/jira/browse/PIG-5203 PIG-5199exclude jline in spark dependency