[GitHub] spark issue #13324: [SPARK-15559][PYTHON][STREAMING] Add hash method for Top...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13324 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13324: [SPARK-15559][PYTHON][STREAMING] Add hash method for Top...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13324 **[Test build #65537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65537/consoleFull)** for PR 13324 at commit

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65540 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65540/consoleFull)** for PR 15131 at commit

[GitHub] spark pull request #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances w...

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15093 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15093 Merging to master, and to 2.0 to match the parent JIRA, even though this is probably less important, yet still a clean small win --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #15131: [SPARK-17577][SparkR] SparkR support add files to Spark ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15131 **[Test build #65539 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65539/consoleFull)** for PR 15131 at commit

[GitHub] spark pull request #15131: [SPARK-17577][SparkR] SparkR support add files to...

2016-09-17 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/15131 [SPARK-17577][SparkR] SparkR support add files to Spark job and get by executors ## What changes were proposed in this pull request? Scala/Python users can add files to Spark job by submit

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65534/ Test PASSed. ---

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65534 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65534/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #15073: [SPARK-17518] [SQL] Block Users to Specify the Internal ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15073 **[Test build #65538 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65538/consoleFull)** for PR 15073 at commit

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

2016-09-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r79286533 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -378,6 +380,47 @@ private[hive] class HiveClientImpl(

[GitHub] spark pull request #15073: [SPARK-17518] [SQL] Block Users to Specify the In...

2016-09-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15073#discussion_r79286493 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -316,6 +316,9 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark issue #14981: [SPARK-17418] Remove Kinesis artifacts from Spark releas...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14981 CC @rxin I think the direct but slightly hacky way to just address this issue is to modify `release-build.sh` around here ... ``` # Remove any extra files generated during install

[GitHub] spark issue #13324: [SPARK-15559][PYTHON][STREAMING] Add hash method for Top...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13324 **[Test build #65537 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65537/consoleFull)** for PR 13324 at commit

[GitHub] spark pull request #15130: [SPARK-17575][DOCS] Remove extra table tags in co...

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15130 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15130 Merged to master/2.0 because it's trivial --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15084: [SPARK-17529][core] Implement BitSet.clearUntil a...

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15084 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15084 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65536 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65536/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15093 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15099: [SPARK-17541][SQL] fix some DDL bugs about table ...

2016-09-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15099#discussion_r79285998 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -284,8 +284,12 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65535/ Test FAILed. ---

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15093 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65535 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65535/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #15129: [SPARK-17546] [DEPLOY] start-* scripts should use hostna...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15129 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65532/ Test PASSed. ---

[GitHub] spark issue #15129: [SPARK-17546] [DEPLOY] start-* scripts should use hostna...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15129 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15129: [SPARK-17546] [DEPLOY] start-* scripts should use hostna...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15129 **[Test build #65532 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65532/consoleFull)** for PR 15129 at commit

[GitHub] spark pull request #14862: [SPARK-17295][SQL] Create TestHiveSessionState us...

2016-09-17 Thread jiangxb1987
Github user jiangxb1987 closed the pull request at: https://github.com/apache/spark/pull/14862 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65535 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65535/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances which ca...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15093 **[Test build #65534 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65534/consoleFull)** for PR 15093 at commit

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15130 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15130 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65533/ Test PASSed. ---

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15130 **[Test build #65533 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65533/consoleFull)** for PR 15130 at commit

[GitHub] spark issue #15084: [SPARK-17529][core] Implement BitSet.clearUntil and use ...

2016-09-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15084 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15130 OK, but this doesn't need a JIRA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15130: [SPARK-17575][DOCS] Remove extra table tags in configura...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15130 **[Test build #65533 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65533/consoleFull)** for PR 15130 at commit

[GitHub] spark pull request #15130: remove extra table tags in configuration document

2016-09-17 Thread phalodi
GitHub user phalodi opened a pull request: https://github.com/apache/spark/pull/15130 remove extra table tags in configuration document ## What changes were proposed in this pull request? Remove extra table tags in configurations document. ## How was this

[GitHub] spark pull request #14858: [SPARK-17219][ML] Add NaN value handling in Bucke...

2016-09-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14858#discussion_r79282998 --- Diff: mllib/src/main/scala/org/apache/spark/ml/feature/QuantileDiscretizer.scala --- @@ -109,7 +114,7 @@ final class QuantileDiscretizer @Since("1.6.0")

[GitHub] spark issue #15129: [SPARK-17546] [DEPLOY] start-* scripts should use hostna...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15129 **[Test build #65532 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65532/consoleFull)** for PR 15129 at commit

[GitHub] spark pull request #15129: [SPARK-17546] [DEPLOY] start-* scripts should use...

2016-09-17 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/15129 [SPARK-17546] [DEPLOY] start-* scripts should use hostname -f ## What changes were proposed in this pull request? Call `hostname -f` to get fully qualified host name ## How was

[GitHub] spark pull request #14762: [SPARK-16962][CORE][SQL] Fix misaligned record ac...

2016-09-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14762#discussion_r79282710 --- Diff: common/unsafe/src/main/java/org/apache/spark/unsafe/array/ByteArrayMethods.java --- @@ -40,24 +41,41 @@ public static int

[GitHub] spark issue #14817: [SPARK-17247][SQL]: when calcualting size of a relation ...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14817 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15105: [SPARK-17548] [MLlib] Word2VecModel.findSynonyms ...

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15105 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15105: [SPARK-17548] [MLlib] Word2VecModel.findSynonyms no long...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15105 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances w...

2016-09-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15093#discussion_r79282293 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1657,21 +1657,12 @@ class Analyzer(

[GitHub] spark pull request #15093: [SPARK-17480][SQL][FOLLOWUP] Fix more instances w...

2016-09-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15093#discussion_r79282245 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1657,21 +1657,12 @@ class Analyzer( //

[GitHub] spark issue #15117: [SPARK-17561] [DOCS] DataFrameWriter documentation forma...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15117 Sure, I just merged it to 2.0 and resolved the conflict because that was straightforward here. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD when the e...

2016-09-17 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/15128 Need more thinking about this. Close this now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD whe...

2016-09-17 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/15128 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15121: [SPARK-17567][Docs] Use valid url to Spark RDD pa...

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15121 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14975: Correct fetchsize property name in docs

2016-09-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14975 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15121: [SPARK-17567][Docs] Use valid url to Spark RDD paper

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15121 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14975: Correct fetchsize property name in docs

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14975 Merged to master/2.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15099: [SPARK-17541][SQL] fix some DDL bugs about table ...

2016-09-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15099#discussion_r79281773 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/internal/CatalogImpl.scala --- @@ -284,8 +284,12 @@ class CatalogImpl(sparkSession: SparkSession)

[GitHub] spark issue #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD when the e...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15128 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65531/ Test FAILed. ---

[GitHub] spark issue #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD when the e...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15128 **[Test build #65531 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65531/consoleFull)** for PR 15128 at commit

[GitHub] spark issue #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD when the e...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15128 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15073: [SPARK-17518] [SQL] Block Users to Specify the In...

2016-09-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15073#discussion_r79281497 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -316,6 +316,9 @@ class SparkSqlAstBuilder(conf: SQLConf)

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

2016-09-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r79281449 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -378,6 +380,47 @@ private[hive] class HiveClientImpl(

[GitHub] spark pull request #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated S...

2016-09-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14971#discussion_r79281395 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala --- @@ -378,6 +380,47 @@ private[hive] class HiveClientImpl(

[GitHub] spark issue #14975: Correct fetchsize property name in docs

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14975 **[Test build #3278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3278/consoleFull)** for PR 14975 at commit

[GitHub] spark pull request #15054: [SPARK-17502] [SQL] Fix Multiple Bugs in DDL Stat...

2016-09-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15054#discussion_r79281274 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -65,7 +64,11 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD when the e...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15128 **[Test build #65531 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65531/consoleFull)** for PR 15128 at commit

[GitHub] spark pull request #15128: [SPARK-17574][Core] Cache ShuffleExchange RDD whe...

2016-09-17 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/15128 [SPARK-17574][Core] Cache ShuffleExchange RDD when the exchange is reused ## What changes were proposed in this pull request? We have the rule `ReuseExchange` to reuse exchange in the

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65529/ Test PASSed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65529 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65529/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15126 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15067 **[Test build #3276 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3276/consoleFull)** for PR 15067 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15126 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65527/ Test PASSed. ---

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #65527 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65527/consoleFull)** for PR 15126 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15127 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15127 **[Test build #65530 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65530/consoleFull)** for PR 15127 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15127 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65530/ Test FAILed. ---

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #3277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3277/consoleFull)** for PR 15126 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15126 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15126 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65528/ Test FAILed. ---

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #65528 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65528/consoleFull)** for PR 15126 at commit

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65526/ Test PASSed. ---

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14971 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65526 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65526/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65524/ Test PASSed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #65524 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65524/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15067 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65525/ Test PASSed. ---

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15067 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecution gar...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15067 **[Test build #65525 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65525/consoleFull)** for PR 15067 at commit

[GitHub] spark issue #14975: Correct fetchsize property name in docs

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14975 **[Test build #3278 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3278/consoleFull)** for PR 14975 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15126 @petermaxlee why are we not making this change in https://github.com/apache/spark/pull/15067 ? looks like you forked someone else's PR while it was active. --- If your project is set up for it,

[GitHub] spark issue #15027: [SPARK-17475] [STREAMING] Delete CRC files if the filesy...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15027 **[Test build #3275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3275/consoleFull)** for PR 15027 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15127 **[Test build #65530 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65530/consoleFull)** for PR 15127 at commit

[GitHub] spark issue #15127: [SPARK-17571][SQL] AssertOnQuery.condition should always...

2016-09-17 Thread petermaxlee
Github user petermaxlee commented on the issue: https://github.com/apache/spark/pull/15127 cc @tdas @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #15127: [SPARK-17571][SQL] AssertOnQuery.condition should...

2016-09-17 Thread petermaxlee
GitHub user petermaxlee opened a pull request: https://github.com/apache/spark/pull/15127 [SPARK-17571][SQL] AssertOnQuery.condition should always return Boolean value ## What changes were proposed in this pull request? AssertOnQuery has two apply constructor: one that accepts

[GitHub] spark issue #14971: [SPARK-17410] [SPARK-17284] Move Hive-generated Stats In...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14971 **[Test build #65529 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65529/consoleFull)** for PR 14971 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #65528 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65528/consoleFull)** for PR 15126 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #3277 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3277/consoleFull)** for PR 15126 at commit

[GitHub] spark issue #15126: [SPARK-17513][SQL] Make StreamExecution garbage-collect ...

2016-09-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15126 **[Test build #65527 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65527/consoleFull)** for PR 15126 at commit

[GitHub] spark pull request #15126: [SPARK-17513][SQL] Make StreamExecution garbage-c...

2016-09-17 Thread petermaxlee
GitHub user petermaxlee opened a pull request: https://github.com/apache/spark/pull/15126 [SPARK-17513][SQL] Make StreamExecution garbage-collect its metadata ## What changes were proposed in this pull request? This PR modifies StreamExecution such that it discards metadata for

[GitHub] spark pull request #15067: [SPARK-17513] [STREAMING] [SQL] Make StreamExecut...

2016-09-17 Thread petermaxlee
Github user petermaxlee commented on a diff in the pull request: https://github.com/apache/spark/pull/15067#discussion_r79278249 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -125,6 +125,32 @@ class StreamingQuerySuite extends

<    1   2   3   >