svn commit: r1782286 - in /pig/branches/spark: ./ src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/ src/org/apache/pig/backend/hadoop/executionengine/spark/ src/org/

Author: zly Date: Thu Feb 9 01:34:12 2017 New Revision: 1782286 URL: http://svn.apache.org/viewvc?rev=1782286=rev Log: PIG-4891: Implement FR join by broadcasting small rdd not making more copys of data (Nandor via Liyun) Added: pig/branches/spark/src/org/apache/pig/backend/hadoop

svn commit: r1783167 - /pig/branches/spark/test/org/apache/pig/test/TestPigRunner.java

Author: zly Date: Thu Feb 16 03:32:49 2017 New Revision: 1783167 URL: http://svn.apache.org/viewvc?rev=1783167=rev Log: PIG-5128: Fix TestPigRunner.simpleMultiQueryTest3 unit test failure (Nandor via Liyun) Modified: pig/branches/spark/test/org/apache/pig/test/TestPigRunner.java Modified

svn commit: r1783988 [20/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestPlanGeneration.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestPlanGeneration.java?rev=1783988=1783987=1783988=diff == ---

svn commit: r1783988 [6/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml?rev=1783988=auto == --- pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml (added)

svn commit: r1783988 [1/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Author: zly Date: Wed Feb 22 09:43:41 2017 New Revision: 1783988 URL: http://svn.apache.org/viewvc?rev=1783988=rev Log: PIG-5132:Merge from trunk (5) [Spark Branch](Adam via Liyun) Added: pig/branches/spark/BUILDING.md pig/branches/spark/PIG-5132.2.patch pig/branches/spark/ant

svn commit: r1783988 [9/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/expressionOperators/POCast.java URL:

svn commit: r1783988 [7/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/docs/src/documentation/content/xdocs/func.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/src/docs/src/documentation/content/xdocs/func.xml?rev=1783988=1783987=1783988=diff == ---

svn commit: r1783988 [23/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-3-OPTOFF.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-3-OPTOFF.gld?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [3/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/ant-contrib-1.0b3.jar URL: http://svn.apache.org/viewvc/pig/branches/spark/ant-contrib-1.0b3.jar?rev=1783988=auto == --- pig/branches/spark/ant-contrib-1.0b3.jar (added) +++

svn commit: r1783988 [10/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/TezLauncher.java?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [2/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/PIG-5132.2.patch URL: http://svn.apache.org/viewvc/pig/branches/spark/PIG-5132.2.patch?rev=1783988=auto == --- pig/branches/spark/PIG-5132.2.patch (added) +++ pig/branches/spark/PIG-5132.2.patch

svn commit: r1783988 [18/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestLogicalPlanBuilder.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestLogicalPlanBuilder.java?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [11/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/operator/POCounterStatsTez.java?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [15/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/e2e/pig/tests/nightly.conf URL: http://svn.apache.org/viewvc/pig/branches/spark/test/e2e/pig/tests/nightly.conf?rev=1783988=1783987=1783988=diff == ---

svn commit: r1783988 [16/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/SparkMiniCluster.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/SparkMiniCluster.java?rev=1783988=auto == ---

svn commit: r1783988 [12/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/util/MapRedUtil.java?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [5/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/contrib/piggybank/java/src/test/java/org/apache/pig/piggybank/test/storage/TestMultiStorage.java URL:

svn commit: r1783988 [24/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/tez/TestTezGraceParallelism.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/tez/TestTezGraceParallelism.java?rev=1783988=1783987=1783988=diff

svn commit: r1783988 [19/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/TestNewPredicatePushDown.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestNewPredicatePushDown.java?rev=1783988=auto == ---

svn commit: r1783988 [22/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-9.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-9.gld?rev=1783988=auto ==

svn commit: r1783988 [4/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/bin/pig URL: http://svn.apache.org/viewvc/pig/branches/spark/bin/pig?rev=1783988=1783987=1783988=diff == --- pig/branches/spark/bin/pig (original) +++ pig/branches/spark/bin/pig Wed Feb 22

svn commit: r1783988 [21/24] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-BloomJoin-5.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-BloomJoin-5.gld?rev=1783988=auto

svn commit: r1784224 [3/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/docs/src/documentation/content/xdocs/func.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/src/docs/src/documentation/content/xdocs/func.xml?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [11/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestCounters.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestCounters.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [7/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/TezOperDependencyParallelismEstimator.java URL:

svn commit: r1784224 [2/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java URL:

svn commit: r1784224 [15/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-3-OPTOFF.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-3-OPTOFF.gld?rev=1784224=1784223=1784224=diff

svn commit: r1784224 [14/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestPigRunner.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestPigRunner.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [9/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/parser/RegisterResolver.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/parser/RegisterResolver.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [13/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestMRJobStats.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestMRJobStats.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [12/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestLineageFindRelVisitor.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestLineageFindRelVisitor.java?rev=1784224=1784223=1784224=diff

svn commit: r1784224 [8/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/data/SortedSpillBag.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/data/SortedSpillBag.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [4/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/JobControlCompiler.java?rev=1784224=1784223=1784224=diff

svn commit: r1784224 [17/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/tez/TestTezLauncher.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/tez/TestTezLauncher.java?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784224 [10/17] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/e2e/pig/tests/nightly.conf URL: http://svn.apache.org/viewvc/pig/branches/spark/test/e2e/pig/tests/nightly.conf?rev=1784224=1784223=1784224=diff == ---

svn commit: r1784237 [14/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/e2e/pig/tests/turing_jython.conf URL: http://svn.apache.org/viewvc/pig/branches/spark/test/e2e/pig/tests/turing_jython.conf?rev=1784237=1784236=1784237=diff == ---

svn commit: r1784237 [13/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/pig-default.properties URL: http://svn.apache.org/viewvc/pig/branches/spark/src/pig-default.properties?rev=1784237=1784236=1784237=diff == --- pig/branches/spark/src/pig-default.properties

svn commit: r1784237 [6/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/src/org/apache/pig/backend/hadoop/PigATSClient.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/PigATSClient.java?rev=1784237=auto == ---

svn commit: r1784237 [4/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml?rev=1784237=auto == --- pig/branches/spark/src/docs/jdiff/pig_0.16.0.xml (added)

svn commit: r1784237 [1/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Author: zly Date: Fri Feb 24 08:19:42 2017 New Revision: 1784237 URL: http://svn.apache.org/viewvc?rev=1784237=rev Log: PIG-5132:Merge from trunk (5) [Spark Branch]-2 (Adam via Liyun) Added: pig/branches/spark/BUILDING.md pig/branches/spark/contrib/piggybank/java/src/test/java/org

svn commit: r1784237 [7/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Added: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigMapBase.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/PigMapBase.java?rev=1784237=auto

svn commit: r1784237 [22/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/tez/TestTezGraceParallelism.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/tez/TestTezGraceParallelism.java?rev=1784237=1784236=1784237=diff

svn commit: r1784237 [20/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-9.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-MQ-9.gld?rev=1784237=auto ==

svn commit: r1784237 [5/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/docs/src/documentation/content/xdocs/basic.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/src/docs/src/documentation/content/xdocs/basic.xml?rev=1784237=1784236=1784237=diff ==

svn commit: r1784237 [10/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/optimizer/TezOperDependencyParallelismEstimator.java URL:

svn commit: r1784237 [18/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestPlanGeneration.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestPlanGeneration.java?rev=1784237=1784236=1784237=diff == ---

svn commit: r1784237 [17/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/TestNewPredicatePushDown.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestNewPredicatePushDown.java?rev=1784237=auto == ---

svn commit: r1784237 [8/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POPoissonSample.java URL:

svn commit: r1784237 [15/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestDataBag.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestDataBag.java?rev=1784237=1784236=1784237=diff == ---

svn commit: r1784237 [9/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainer.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/tez/plan/TezPlanContainer.java?rev=1784237=1784236=1784237=diff

svn commit: r1784237 [11/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/src/org/apache/pig/data/SortedDataBag.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/data/SortedDataBag.java?rev=1784237=1784236=1784237=diff == ---

svn commit: r1784237 [12/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/src/org/apache/pig/newplan/logical/visitor/ForEachUserSchemaVisitor.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/newplan/logical/visitor/ForEachUserSchemaVisitor.java?rev=1784237=auto

svn commit: r1784237 [3/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/ivy.xml URL: http://svn.apache.org/viewvc/pig/branches/spark/ivy.xml?rev=1784237=1784236=1784237=diff == --- pig/branches/spark/ivy.xml (original) +++ pig/branches/spark/ivy.xml Fri Feb 24

svn commit: r1784237 [16/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/TestLogicalPlanBuilder.java URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/TestLogicalPlanBuilder.java?rev=1784237=1784236=1784237=diff

svn commit: r1784237 [19/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Added: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-BloomJoin-5.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-BloomJoin-5.gld?rev=1784237=auto

svn commit: r1784237 [2/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/ja

Modified: pig/branches/spark/contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/MaxTupleBy1stField.java URL:

svn commit: r1784237 [21/22] - in /pig/branches/spark: ./ bin/ conf/ contrib/piggybank/java/ contrib/piggybank/java/src/main/java/org/apache/pig/piggybank/evaluation/ contrib/piggybank/java/src/main/j

Modified: pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-3-OPTOFF.gld URL: http://svn.apache.org/viewvc/pig/branches/spark/test/org/apache/pig/test/data/GoldenFiles/tez/TEZC-Union-3-OPTOFF.gld?rev=1784237=1784236=1784237=diff

svn commit: r1783304 - in /pig/branches/spark/src/org/apache/pig: backend/hadoop/executionengine/spark/converter/LoadConverter.java tools/pigstats/spark/SparkPigStats.java tools/pigstats/spark/SparkSt

Author: zly Date: Thu Feb 16 21:26:32 2017 New Revision: 1783304 URL: http://svn.apache.org/viewvc?rev=1783304=rev Log: PIG-4899: The number of records of input file is calculated wrongly in spark mode in multiquery case (Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig

svn commit: r1789416 - in /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark: SparkLauncher.java optimizer/JoinGroupOptimizerSpark.java

Author: zly Date: Wed Mar 29 21:42:48 2017 New Revision: 1789416 URL: http://svn.apache.org/viewvc?rev=1789416=rev Log: PIG-5163:MultiQuery_Streaming_1 is failing with spark exec type(Nandor via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1789423 - in /pig/branches/spark/test/e2e/pig/tests: bigdata.conf cmdline.conf grunt.conf hcat.conf multiquery.conf negative.conf nightly.conf orc.conf turing_jython.conf

Author: zly Date: Thu Mar 30 02:01:01 2017 New Revision: 1789423 URL: http://svn.apache.org/viewvc?rev=1789423=rev Log: PIG-5158:Several e2e tests are marked to run only in Tez or MR mode only(Nandor via Liyun) Modified: pig/branches/spark/test/e2e/pig/tests/bigdata.conf pig/branches

svn commit: r1787852 - in /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark: SparkLauncher.java SparkPOUserFuncVisitor.java

Author: zly Date: Mon Mar 20 21:59:36 2017 New Revision: 1787852 URL: http://svn.apache.org/viewvc?rev=1787852=rev Log: PIG-5187:UdfDistributedCache_1 is failing with spark exec type (Nandor via Liyun) Added: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1791060 [4/4] - in /pig/branches/spark: ./ bin/ src/docs/src/documentation/content/xdocs/ src/org/apache/pig/ src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/ src/org/apa

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/running/PigInputFormatSpark.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/running/PigInputFormatSpark.java?rev=1791060=1791059=1791060=diff

svn commit: r1791059 - in /pig/branches/spark/src/org/apache/pig: PigConfiguration.java backend/hadoop/executionengine/spark/SparkLauncher.java

Author: zly Date: Wed Apr 12 01:52:15 2017 New Revision: 1791059 URL: http://svn.apache.org/viewvc?rev=1791059=rev Log: PIG-5176:Several ComputeSpec test cases fail(Nandor via Liyun) Modified: pig/branches/spark/src/org/apache/pig/PigConfiguration.java pig/branches/spark/src/org/apache

svn commit: r1791057 - in /pig/branches/spark: src/org/apache/pig/backend/hadoop/executionengine/spark/ test/org/apache/pig/spark/ test/org/apache/pig/test/data/GoldenFiles/spark/

Author: zly Date: Wed Apr 12 01:43:53 2017 New Revision: 1791057 URL: http://svn.apache.org/viewvc?rev=1791057=rev Log: PIG-5202:Create a TestSparkCompiler test class for spark branch(Adam via Liyun) Added: pig/branches/spark/test/org/apache/pig/spark/TestSparkCompiler.java pig/branches

svn commit: r1791060 [2/4] - in /pig/branches/spark: ./ bin/ src/docs/src/documentation/content/xdocs/ src/org/apache/pig/ src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/ src/org/apa

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/CounterConverter.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/CounterConverter.java?rev=1791060=1791059=1791060=diff

svn commit: r1791060 [3/4] - in /pig/branches/spark: ./ bin/ src/docs/src/documentation/content/xdocs/ src/org/apache/pig/ src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/ src/org/apa

Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java URL: http://svn.apache.org/viewvc/pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java?rev=1791060=1791059=1791060=diff

svn commit: r1790726 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java

Author: zly Date: Sat Apr 8 22:37:48 2017 New Revision: 1790726 URL: http://svn.apache.org/viewvc?rev=1790726=rev Log: PIG-5200:Orc_1 and Orc_Pushdown_* tests fail on Spark(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1791666 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java

Author: zly Date: Mon Apr 17 07:54:49 2017 New Revision: 1791666 URL: http://svn.apache.org/viewvc?rev=1791666=rev Log: PIG-5215:Merge changes from review board to spark branch-2(Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java

svn commit: r1786612 - in /pig/branches/spark/test/e2e/pig: conf/spark.conf drivers/TestDriverPig.pm

Author: zly Date: Sun Mar 12 21:08:54 2017 New Revision: 1786612 URL: http://svn.apache.org/viewvc?rev=1786612=rev Log: PIG-5187:Fix configuration for E2E spark mode (Adam via Liyun) Modified: pig/branches/spark/test/e2e/pig/conf/spark.conf pig/branches/spark/test/e2e/pig/drivers

svn commit: r1786613 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/JobGraphBuilder.java

Author: zly Date: Sun Mar 12 21:13:49 2017 New Revision: 1786613 URL: http://svn.apache.org/viewvc?rev=1786613=rev Log: PIG-5180: MergeSparseJoin fails with Spark exec type (Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1784867 - in /pig/branches/spark: ivy.xml ivy/libraries.properties src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POMergeJoin.java test/e2e/pig/lib/ha

Author: zly Date: Wed Mar 1 08:17:12 2017 New Revision: 1784867 URL: http://svn.apache.org/viewvc?rev=1784867=rev Log: PIG-5132:Merge from trunk (5) [Spark Branch]-3(Adam via Liyun) Modified: pig/branches/spark/ivy.xml pig/branches/spark/ivy/libraries.properties pig/branches/spark

svn commit: r1784872 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/physicalLayer/relationalOperators/POFRJoinSpark.java

Author: zly Date: Wed Mar 1 08:33:07 2017 New Revision: 1784872 URL: http://svn.apache.org/viewvc?rev=1784872=rev Log: PIG-5155:Fix FRJoin related issues after trunk merge (Nandor via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/physicalLayer

svn commit: r1784875 - in /pig/branches/spark: src/org/apache/pig/backend/hadoop/executionengine/spark/JobGraphBuilder.java src/org/apache/pig/tools/pigstats/spark/SparkStatsUtil.java test/org/apache/

Author: zly Date: Wed Mar 1 08:38:33 2017 New Revision: 1784875 URL: http://svn.apache.org/viewvc?rev=1784875=rev Log: PIG-5140:fix TestEmptyInputDir unit test failure after PIG-5132(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1784876 - /pig/branches/spark/test/org/apache/pig/test/TestLineageFindRelVisitor.java

Author: zly Date: Wed Mar 1 08:40:51 2017 New Revision: 1784876 URL: http://svn.apache.org/viewvc?rev=1784876=rev Log: PIG-5145:fix TestLineageFindRelVisitor unit test failure after PIG-5132 (Adam via Liyun Modified: pig/branches/spark/test/org/apache/pig/test

svn commit: r1784882 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/LoadConverter.java

Author: zly Date: Wed Mar 1 08:56:54 2017 New Revision: 1784882 URL: http://svn.apache.org/viewvc?rev=1784882=rev Log: PIG-5154:Fix GFCross related issues after merging from trunk to spark(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1790493 - in /pig/branches/spark/test: excluded-tests-spark org/apache/pig/pigunit/PigTest.java

Author: zly Date: Fri Apr 7 01:48:07 2017 New Revision: 1790493 URL: http://svn.apache.org/viewvc?rev=1790493=rev Log: PIG-5136:Fix TestPigTest unit test in Spark mode(Liyun) Modified: pig/branches/spark/test/excluded-tests-spark pig/branches/spark/test/org/apache/pig/pigunit

svn commit: r1790492 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/optimizer/CombinerOptimizer.java

Author: zly Date: Fri Apr 7 01:41:05 2017 New Revision: 1790492 URL: http://svn.apache.org/viewvc?rev=1790492=rev Log: PIG-5203:Partitioner E2E test fails on spark(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/optimizer

svn commit: r1791870 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java

Author: zly Date: Wed Apr 19 08:08:00 2017 New Revision: 1791870 URL: http://svn.apache.org/viewvc?rev=1791870=rev Log: PIG-5212:SkewedJoin_6 is failing on Spark(Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/plan/SparkCompiler.java Modified

svn commit: r1791874 - in /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter: IndexedKey.java PigSecondaryKeyComparatorSpark.java

Author: zly Date: Wed Apr 19 08:22:02 2017 New Revision: 1791874 URL: http://svn.apache.org/viewvc?rev=1791874=rev Log: PIG-5171:SecondarySort_7 is failing with spark exec type(Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter

svn commit: r1791846 - /pig/branches/spark/test/org/apache/pig/spark/TestSparkCompiler.java

Author: zly Date: Wed Apr 19 01:52:39 2017 New Revision: 1791846 URL: http://svn.apache.org/viewvc?rev=1791846=rev Log: PIG-5202:Create a TestSparkCompiler test class for spark branch-2(Adam via Liyun) Modified: pig/branches/spark/test/org/apache/pig/spark/TestSparkCompiler.java Modified

svn commit: r1791880 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java

Author: zly Date: Wed Apr 19 08:47:27 2017 New Revision: 1791880 URL: http://svn.apache.org/viewvc?rev=1791880=rev Log: PIG-5176:Several ComputeSpec test cases fail-2(Nandor via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/SparkLauncher.java

svn commit: r1792564 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SkewedJoinConverter.java

Author: zly Date: Tue Apr 25 01:28:23 2017 New Revision: 1792564 URL: http://svn.apache.org/viewvc?rev=1792564=rev Log: PIG-5047:support outer join for skewedjoin in spark mode(Xianda via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter

svn commit: r1802347 [1/2] - in /pig/trunk: ./ ivy/ src/org/apache/pig/backend/hadoop/executionengine/spark/ src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ src/org/apache/pig/tools

Author: zly Date: Wed Jul 19 01:32:41 2017 New Revision: 1802347 URL: http://svn.apache.org/viewvc?rev=1802347=rev Log: PIG-5157:Upgrade to Spark 2.0 (nkollar via liyunzhang) Added: pig/trunk/src/org/apache/pig/backend/hadoop/executionengine/spark/FlatMapFunctionAdapter.java pig/trunk

svn commit: r1802880 - in /pig/trunk: CHANGES.txt bin/pig

Author: zly Date: Tue Jul 25 01:54:54 2017 New Revision: 1802880 URL: http://svn.apache.org/viewvc?rev=1802880=rev Log: PIG-5246: Modify bin/pig about SPARK_HOME, SPARK_ASSEMBLY_JAR after upgrading spark to 2 (liyunzhang) Modified: pig/trunk/CHANGES.txt pig/trunk/bin/pig Modified: pig

svn commit: r1792822 - in /pig/branches/spark/test/e2e/pig: drivers/TestDriverPig.pm tests/nightly.conf tools/test/floatpostprocessor.pl

Author: zly Date: Wed Apr 26 21:31:44 2017 New Revision: 1792822 URL: http://svn.apache.org/viewvc?rev=1792822=rev Log: PIG-5166:GroupAggFunc_9 is failing with spark exec type(Adam via Liyun) Modified: pig/branches/spark/test/e2e/pig/drivers/TestDriverPig.pm pig/branches/spark/test/e2e

svn commit: r1792835 - in /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark: JobGraphBuilder.java plan/SparkCompiler.java

Author: zly Date: Thu Apr 27 02:06:36 2017 New Revision: 1792835 URL: http://svn.apache.org/viewvc?rev=1792835=rev Log: PIG-5165:MultiQuery_Union_7 is failing with spark exec type(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1792838 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SecondaryKeySortUtil.java

Author: zly Date: Thu Apr 27 04:50:28 2017 New Revision: 1792838 URL: http://svn.apache.org/viewvc?rev=1792838=rev Log: PIG-5164:MultiQuery_Union_3 is failing with spark exec type(Adam via Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter

svn commit: r1793017 - /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter/SecondaryKeySortUtil.java

Author: zly Date: Fri Apr 28 08:55:06 2017 New Revision: 1793017 URL: http://svn.apache.org/viewvc?rev=1793017=rev Log: PIG-5230:Fix the RuntimeException throws in SecondaryKeySortUtil(Liyun) Modified: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark/converter

svn commit: r1795482 - in /pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark: SparkPigRecordReader.java SparkPigSplit.java

Author: zly Date: Thu May 18 06:31:43 2017 New Revision: 1795482 URL: http://svn.apache.org/viewvc?rev=1795482=rev Log: PIG-5135:HDFS bytes read stats are always 0 in Spark mode-2(Adam via Liyun) Added: pig/branches/spark/src/org/apache/pig/backend/hadoop/executionengine/spark

svn commit: r1795485 - in /pig/branches/spark: build.xml ivy.xml

Author: zly Date: Thu May 18 06:57:16 2017 New Revision: 1795485 URL: http://svn.apache.org/viewvc?rev=1795485=rev Log: PIG-5199:exclude jline in spark dependency(Adam via Liyun) Modified: pig/branches/spark/build.xml pig/branches/spark/ivy.xml Modified: pig/branches/spark/build.xml URL

svn commit: r1796232 - in /pig/branches/spark: ./ src/org/apache/pig/ src/org/apache/pig/backend/hadoop/executionengine/spark/ src/org/apache/pig/backend/hadoop/executionengine/spark/converter/ src/or

Author: zly Date: Fri May 26 02:01:13 2017 New Revision: 1796232 URL: http://svn.apache.org/viewvc?rev=1796232=rev Log: PIG-5215:Merge changes from review board to spark branch(Liyun) Modified: pig/branches/spark/build.xml pig/branches/spark/src/org/apache/pig/PigConfiguration.java

svn commit: r1794283 - in /pig/branches/spark: bin/pig build.xml

Author: zly Date: Mon May 8 04:32:33 2017 New Revision: 1794283 URL: http://svn.apache.org/viewvc?rev=1794283=rev Log: PIG-5218:Jyhton_Checkin_3 fails with spark exec type(Adam via Liyun) Modified: pig/branches/spark/bin/pig pig/branches/spark/build.xml Modified: pig/branches/spark/bin

svn commit: r1793981 - in /pig/branches/spark: ivy/ src/org/apache/pig/backend/hadoop/executionengine/mapReduceLayer/ src/org/apache/pig/backend/hadoop/executionengine/spark/ src/org/apache/pig/backen

Author: zly Date: Fri May 5 08:39:42 2017 New Revision: 1793981 URL: http://svn.apache.org/viewvc?rev=1793981=rev Log: PIG-5215:Merge changes from review board to spark branch(Liyun) Modified: pig/branches/spark/ivy/libraries.properties pig/branches/spark/src/org/apache/pig/backend