[jira] [Updated] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5246: -- Status: Patch Available (was: Open) > Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after u

[jira] [Updated] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

[ https://issues.apache.org/jira/browse/PIG-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liyunzhang_intel updated PIG-5246: -- Attachment: PIG-5246.patch [~nkollar], [~szita]: help review in spark2, spark-assembly*.jar does

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032514#comment-16032514 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: have tested that we can remove Jo

[jira] Subscription: PIG patch available

Issue Subscription Filter: PIG patch available (32 issues) Subscriber: pigdaily Key Summary PIG-5225Several unit tests are not annotated with @Test https://issues.apache.org/jira/browse/PIG-5225 PIG-5160SchemaTupleFrontend.java is not thread safe, cause PigServer throw

[jira] [Commented] (PIG-5247) Investigate stopOnFailure feature with Spark execution engine

[ https://issues.apache.org/jira/browse/PIG-5247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032292#comment-16032292 ] liyunzhang_intel commented on PIG-5247: --- [~szita]: what i am confused is currently thi

[jira] [Commented] (PIG-5225) Several unit tests are not annotated with @Test

[ https://issues.apache.org/jira/browse/PIG-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032078#comment-16032078 ] Nandor Kollar commented on PIG-5225: Ok, uploaded PIG-5225_2.patch with the test case re

[jira] [Updated] (PIG-5225) Several unit tests are not annotated with @Test

[ https://issues.apache.org/jira/browse/PIG-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nandor Kollar updated PIG-5225: --- Attachment: PIG-5225_2.patch > Several unit tests are not annotated with @Test > ---

Build failed in Jenkins: Pig-trunk-commit #2498

See -- [...truncated 181.49 KB...] A src/org/apache/pig/parser/FunctionType.java A src/org/apache/pig/parser/DuplicatedSchemaAliasException.java A src/org/apache/p

[jira] [Commented] (PIG-5225) Several unit tests are not annotated with @Test

[ https://issues.apache.org/jira/browse/PIG-5225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16032007#comment-16032007 ] Daniel Dai commented on PIG-5225: - The test is added even before me. The test won't throw ex

Build failed in Jenkins: Pig-trunk-commit #2497

See Changes: [rohini] PIG-5248: Fix TestCombiner#testGroupByLimit after PigOnSpark merge (rohini) [rohini] PIG-5245: TestGrunt.testStopOnFailure is flaky (rohini) [daijy] PIG-5216: Customizable Error Handling

[jira] [Commented] (PIG-4059) Pig on Spark

[ https://issues.apache.org/jira/browse/PIG-4059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031937#comment-16031937 ] Rohini Palaniswamy commented on PIG-4059: - [~szita], With PIG-4941, support for

[jira] [Updated] (PIG-5248) Fix TestCombiner#testGroupByLimit after PigOnSpark merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5248: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Availabl

[jira] [Updated] (PIG-5201) Null handling on FLATTEN

[ https://issues.apache.org/jira/browse/PIG-5201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi updated PIG-5201: -- Attachment: pig-5201-v03.patch Noticed I forgot to take out some debug print/dump statements. Taking them

[jira] [Updated] (PIG-5248) Fix TestCombiner#testGroupByLimit after PigOnSpark merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5248: Summary: Fix TestCombiner#testGroupByLimit after PigOnSpark merge (was: Fix TestCombiner#test

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5245: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Availabl

[jira] [Resolved] (PIG-3368) doc pig flatten operator applied to empty vs null bag

[ https://issues.apache.org/jira/browse/PIG-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Koji Noguchi resolved PIG-3368. --- Resolution: Duplicate Assignee: (was: Aniket Mokashi) Fix Version/s: (was: 0.18.0

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031861#comment-16031861 ] Adam Szita commented on PIG-5245: - +1 for [^PIG-5245-3.patch] > TestGrunt.testStopOnFailure

[jira] [Commented] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031856#comment-16031856 ] Koji Noguchi commented on PIG-5248: --- bq. It is not a quick fix. Skipped the test for now a

[jira] [Updated] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5248: Assignee: Rohini Palaniswamy Status: Patch Available (was: Open) > Fix TestCombiner#tes

[jira] [Updated] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5248: Attachment: PIG-5248-1.patch It is not a quick fix. Skipped the test for now and created PIG-5

[jira] [Created] (PIG-5249) Group followed by Limit does not have combiner optimization in Tez

Rohini Palaniswamy created PIG-5249: --- Summary: Group followed by Limit does not have combiner optimization in Tez Key: PIG-5249 URL: https://issues.apache.org/jira/browse/PIG-5249 Project: Pig

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5245: Attachment: PIG-5245-3.patch Final patch including [~szita]'s changes for spark. Also reduced

[jira] [Resolved] (PIG-5216) Customizable Error Handling for Loaders in Pig

[ https://issues.apache.org/jira/browse/PIG-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai resolved PIG-5216. - Resolution: Fixed Hadoop Flags: Reviewed Also did rebase after spark merge. Patch committed to trunk.

[jira] [Updated] (PIG-5216) Customizable Error Handling for Loaders in Pig

[ https://issues.apache.org/jira/browse/PIG-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Dai updated PIG-5216: Attachment: PIG-5216-4.patch Find several issues when running unit tests: 1. In POLoad.setup, we also need to

[jira] [Updated] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5248: Description: This test started failing on TEZ after we merged PoS. The test checks if there is a "Combiner pl

[jira] [Commented] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

[ https://issues.apache.org/jira/browse/PIG-5248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031231#comment-16031231 ] Adam Szita commented on PIG-5248: - [~rohini] can you take a look on this please? > Fix Test

[jira] [Created] (PIG-5248) Fix TestCombiner#testGroupByLimit after PoS merge

Adam Szita created PIG-5248: --- Summary: Fix TestCombiner#testGroupByLimit after PoS merge Key: PIG-5248 URL: https://issues.apache.org/jira/browse/PIG-5248 Project: Pig Issue Type: Improvement

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031205#comment-16031205 ] Adam Szita commented on PIG-5245: - [~rohini] I've spotted a missing part in the YarnMiniclus

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Szita updated PIG-5245: Attachment: PIG-5245-2.addingSparkLibsToMiniCluster.patch > TestGrunt.testStopOnFailure is flaky > ---

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16031188#comment-16031188 ] Adam Szita commented on PIG-5245: - +1 for [^PIG-5245-2.patch] - I verified all Spark unit te

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030993#comment-16030993 ] Nandor Kollar commented on PIG-5245: Having this test fixed for MR and for Tez, but not

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030991#comment-16030991 ] Nandor Kollar commented on PIG-5157: Ok, thanks, then I'll uncomment that and test it. A

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030988#comment-16030988 ] Adam Szita commented on PIG-5245: - [~kellyzly] I think that has a different mechanism compar

[jira] [Created] (PIG-5247) Investigate stopOnFailure feature with Spark execution engine

Adam Szita created PIG-5247: --- Summary: Investigate stopOnFailure feature with Spark execution engine Key: PIG-5247 URL: https://issues.apache.org/jira/browse/PIG-5247 Project: Pig Issue Type: Impr

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030847#comment-16030847 ] liyunzhang_intel commented on PIG-5245: --- [~rohini]: stop_on_failure is implemented in

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5245: Attachment: PIG-5245-2.patch Skipped this test for Spark as stop on failure is not implemented

[jira] [Created] (PIG-5246) Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2

liyunzhang_intel created PIG-5246: - Summary: Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2 Key: PIG-5246 URL: https://issues.apache.org/jira/browse/PIG-5246 Project: P

[jira] [Commented] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030814#comment-16030814 ] Adam Szita commented on PIG-5245: - +1 for [^PIG-5245-1.patch] > TestGrunt.testStopOnFailure

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5245: Status: Patch Available (was: Open) > TestGrunt.testStopOnFailure is flaky >

[jira] [Comment Edited] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030799#comment-16030799 ] liyunzhang_intel edited comment on PIG-5157 at 5/31/17 7:54 AM: --

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030799#comment-16030799 ] liyunzhang_intel commented on PIG-5157: --- [~nkollar]: bq. in JobMetricsListener.java th

[jira] [Issue Comment Deleted] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] hsj updated PIG-5157: - Comment: was deleted (was: [~nkollar]: bq. in JobMetricsListener.java there's a huge code section commented out (uncomment

[jira] [Commented] (PIG-5157) Upgrade to Spark 2.0

[ https://issues.apache.org/jira/browse/PIG-5157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16030795#comment-16030795 ] hsj commented on PIG-5157: -- [~nkollar]: bq. in JobMetricsListener.java there's a huge code section

[jira] [Updated] (PIG-5245) TestGrunt.testStopOnFailure is flaky

[ https://issues.apache.org/jira/browse/PIG-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohini Palaniswamy updated PIG-5245: Attachment: PIG-5245-1.patch Reduced general resource and heap usage of AM and task containers

[jira] [Created] (PIG-5245) TestGrunt.testStopOnFailure is flaky

Rohini Palaniswamy created PIG-5245: --- Summary: TestGrunt.testStopOnFailure is flaky Key: PIG-5245 URL: https://issues.apache.org/jira/browse/PIG-5245 Project: Pig Issue Type: Bug