[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16928 **[Test build #72971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72971/testReport)** for PR 16928 at commit

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r101438354 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -340,3 +341,91 @@ object CaseKeyWhen {

[GitHub] spark issue #16818: [SPARK-19451][SQL][Core] Underlying integer overflow in ...

2017-02-15 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16818 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #16948: [SPARK-19618][SQL] Inconsistency wrt max. buckets allowe...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16948 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16948: [SPARK-19618][SQL] Inconsistency wrt max. buckets allowe...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16948 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72973/ Test PASSed. ---

[GitHub] spark issue #16948: [SPARK-19618][SQL] Inconsistency wrt max. buckets allowe...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16948 **[Test build #72973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72973/testReport)** for PR 16948 at commit

[GitHub] spark issue #16945: [SPARK-19616][SparkR]:weightCol and aggregationDepth sho...

2017-02-15 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16945 could you add some tests (I don't think we need one for each) that the weight col is set properly? --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447842 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -65,6 +66,8 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r101448019 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -813,7 +813,14 @@ private[spark] class BlockManager(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447797 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -195,17 +198,39 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101446961 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,43 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests bro...

2017-02-15 Thread felixcheung
Github user felixcheung closed the pull request at: https://github.com/apache/spark/pull/16950 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447394 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,43 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447703 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -195,17 +198,39 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101446619 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,43 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101446632 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,43 @@ private[spark] class BlockManager( }

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101446759 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -195,17 +198,39 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447547 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -195,17 +198,39 @@ class BlockManagerMasterEndpoint(

[GitHub] spark pull request #16915: [SPARK-18871][SQL][TESTS] New test cases for IN/N...

2017-02-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16915 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447632 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManagerMasterEndpoint.scala --- @@ -195,17 +198,39 @@ class BlockManagerMasterEndpoint(

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16950 merged to branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14412: [SPARK-15355] [CORE] Proactive block replication

2017-02-15 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/14412#discussion_r101447299 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1131,14 +1131,43 @@ private[spark] class BlockManager( }

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16949 **[Test build #72986 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72986/testReport)** for PR 16949 at commit

[GitHub] spark pull request #16952: [SPARK-19620][SQL]Fix incorrect exchange coordina...

2017-02-15 Thread carsonwang
GitHub user carsonwang opened a pull request: https://github.com/apache/spark/pull/16952 [SPARK-19620][SQL]Fix incorrect exchange coordinator id in the physical plan ## What changes were proposed in this pull request? When adaptive execution is enabled, an exchange coordinator

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101456952 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,23 +161,49 @@ private[hive] class

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101456890 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,23 +161,49 @@ private[hive] class

[GitHub] spark pull request #16895: [SPARK-15615][SQL] Add an API to load DataFrame f...

2017-02-15 Thread pjfanning
Github user pjfanning commented on a diff in the pull request: https://github.com/apache/spark/pull/16895#discussion_r101456955 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1364,10 +1364,11 @@ class JsonSuite extends

[GitHub] spark pull request #16895: [SPARK-15615][SQL] Add an API to load DataFrame f...

2017-02-15 Thread pjfanning
Github user pjfanning commented on a diff in the pull request: https://github.com/apache/spark/pull/16895#discussion_r101460138 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1364,10 +1364,11 @@ class JsonSuite extends

[GitHub] spark pull request #16941: [SPARK-16475][SQL] broadcast hint for SQL queries...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16941#discussion_r101435067 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala --- @@ -524,7 +530,7 @@ class PlanParserSuite extends

[GitHub] spark issue #16935: [SPARK-19604] [TESTS] Log the start of every Python test

2017-02-15 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/16935 cool. It has been merged. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark pull request #16476: [SPARK-19084][SQL] Implement expression field

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16476#discussion_r101436701 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/conditionalExpressions.scala --- @@ -340,3 +343,104 @@ object CaseKeyWhen {

[GitHub] spark issue #16776: [SPARK-19436][SQL] Add missing tests for approxQuantile

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16776 **[Test build #72983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72983/testReport)** for PR 16776 at commit

[GitHub] spark pull request #16951: [SPARK-19619][SPARKR] SparkR approxQuantile suppo...

2017-02-15 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/16951 [SPARK-19619][SPARKR] SparkR approxQuantile supports input multiple columns ## What changes were proposed in this pull request? SparkR ```approxQuantile``` supports input multiple columns.

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-15 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16620 LGTM! Thanks for finding this subtle bug and all of the hard work to fix it @jinxing64. I'll wait until tomorrow to merge this to give Mark and Imran a chance for any last comments. --- If

[GitHub] spark pull request #16948: [SPARK-19618][SQL] Inconsistency wrt max. buckets...

2017-02-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16948 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101457755 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSchemaInferenceSuite.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101457828 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSchemaInferenceSuite.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #16923: [SPARK-19038][Hive][YARN] Correctly figure out keytab fi...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16923 **[Test build #72976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72976/testReport)** for PR 16923 at commit

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #72978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72978/testReport)** for PR 16944 at commit

[GitHub] spark pull request #16714: [SPARK-16333][Core] Enable EventLoggingListener t...

2017-02-15 Thread jisookim0513
Github user jisookim0513 commented on a diff in the pull request: https://github.com/apache/spark/pull/16714#discussion_r101438216 --- Diff: core/src/main/scala/org/apache/spark/scheduler/EventLoggingListener.scala --- @@ -64,6 +64,12 @@ private[spark] class EventLoggingListener(

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16950 **[Test build #72981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72981/testReport)** for PR 16950 at commit

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16950 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16950 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72981/ Test FAILed. ---

[GitHub] spark issue #16934: [SPARK-19603][SS]Fix StreamingQuery explain command

2017-02-15 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16934 Thanks! Merging to master and 2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72974/ Test PASSed. ---

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16620 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16950 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72982/ Test PASSed. ---

[GitHub] spark issue #16950: [SPARK-19399][SPARKR][BACKPORT-2.1] fix tests broken by ...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16950 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16722: [SPARK-19591][ML][MLlib] Add sample weights to de...

2017-02-15 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r101449037 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/BaggedPoint.scala --- @@ -60,12 +68,14 @@ private[spark] object BaggedPoint {

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16944 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72978/ Test PASSed. ---

[GitHub] spark issue #16951: [SPARK-19619][SPARKR] SparkR approxQuantile supports inp...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16951 **[Test build #72985 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72985/testReport)** for PR 16951 at commit

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16949 cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16909: [SPARK-13450] Introduce ExternalAppendOnlyUnsafeR...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16909#discussion_r101454158 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExternalAppendOnlyUnsafeRowArray.scala --- @@ -0,0 +1,218 @@ +/* + * Licensed to

[GitHub] spark issue #16951: [SPARK-19619][SPARKR] SparkR approxQuantile supports inp...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16951 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72985/ Test PASSed. ---

[GitHub] spark pull request #16951: [SPARK-19619][SPARKR] SparkR approxQuantile suppo...

2017-02-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16951#discussion_r101453993 --- Diff: R/pkg/R/stats.R --- @@ -149,15 +149,18 @@ setMethod("freqItems", signature(x = "SparkDataFrame", cols = "character"), #' This method

[GitHub] spark issue #16386: [SPARK-18352][SQL] Support parsing multiline json files

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16386 LGTM if the test can pass. It will be good if you can also address https://github.com/apache/spark/pull/16386#discussion_r100679183 --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101460842 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,23 +161,49 @@ private[hive] class

[GitHub] spark issue #16739: [SPARK-19399][SPARKR] Add R coalesce API for DataFrame a...

2017-02-15 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/16739 Thank YOU, always! :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16947: [SPARK-19617][SS][WIP]Don't interrupt 'mkdirs' to workar...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16947 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16947: [SPARK-19617][SS][WIP]Don't interrupt 'mkdirs' to workar...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16947 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72972/ Test PASSed. ---

[GitHub] spark pull request #16934: [SPARK-19603][SS]Fix StreamingQuery explain comma...

2017-02-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16934 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16844 **[Test build #72977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72977/testReport)** for PR 16844 at commit

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16844 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16844 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72977/ Test PASSed. ---

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/16949 jenkins crushed. retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16951: [SPARK-19619][SPARKR] SparkR approxQuantile suppo...

2017-02-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16951#discussion_r101454291 --- Diff: R/pkg/R/stats.R --- @@ -149,15 +149,18 @@ setMethod("freqItems", signature(x = "SparkDataFrame", cols = "character"), #' This method

[GitHub] spark issue #16948: [SPARK-19618][SQL] Inconsistency wrt max. buckets allowe...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16948 thanks, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #16951: [SPARK-19619][SPARKR] SparkR approxQuantile suppo...

2017-02-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16951#discussion_r101454138 --- Diff: R/pkg/R/stats.R --- @@ -149,15 +149,18 @@ setMethod("freqItems", signature(x = "SparkDataFrame", cols = "character"), #' This method

[GitHub] spark issue #15125: [SPARK-5484][GraphX] Periodically do checkpoint in Prege...

2017-02-15 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15125 I think @mallman is saying he would merge changes to @dding3 branch --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request #16951: [SPARK-19619][SPARKR] SparkR approxQuantile suppo...

2017-02-15 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16951#discussion_r101454231 --- Diff: R/pkg/R/stats.R --- @@ -149,15 +149,18 @@ setMethod("freqItems", signature(x = "SparkDataFrame", cols = "character"), #' This method

[GitHub] spark issue #16729: [SPARK-19391][SparkR][ML] Tweedie GLM API for SparkR

2017-02-15 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16729 @felixcheung Thanks for the discussions. Will work on this in two weeks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16947: [SPARK-19617][SS][WIP]Don't interrupt 'mkdirs' to workar...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16947 **[Test build #72988 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72988/testReport)** for PR 16947 at commit

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101461535 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -161,23 +161,49 @@ private[hive] class

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72969/ Test PASSed. ---

[GitHub] spark issue #16928: [SPARK-18699][SQL] Put malformed tokens into a new field...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16928 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #14872: [SPARK-3162][MLlib][WIP] Add local tree training for dec...

2017-02-15 Thread hollinwilkins
Github user hollinwilkins commented on the issue: https://github.com/apache/spark/pull/14872 Hey, would definitely like to see this included in Spark. We are having issues with OOM errors training pretty small RFs. It could have something to do with the cross validation

[GitHub] spark pull request #16722: [SPARK-19591][ML][MLlib] Add sample weights to de...

2017-02-15 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r101448976 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/impl/BaggedPoint.scala --- @@ -82,16 +92,16 @@ private[spark] object BaggedPoint { val

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16944 **[Test build #72978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72978/testReport)** for PR 16944 at commit

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16949 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/72979/ Test FAILed. ---

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16949 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16949: [SPARK-16122][CORE] Add rest api for job environment

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16949 **[Test build #72979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72979/testReport)** for PR 16949 at commit

[GitHub] spark pull request #16818: [SPARK-19451][SQL][Core] Underlying integer overf...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16818#discussion_r101451202 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/expressions/WindowSpec.scala --- @@ -180,16 +180,20 @@ class WindowSpec private[sql](

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r101453350 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -261,14 +261,18 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark pull request #16895: [SPARK-15615][SQL] Add an API to load DataFrame f...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16895#discussion_r101454773 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/json/JsonSuite.scala --- @@ -1364,10 +1364,11 @@ class JsonSuite extends

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101461155 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSchemaInferenceSuite.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-15 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16620 @kayousterhout @squito @markhamstra Thanks for all of your work for this patch. Really appreciate your help : ) --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesToBytesMa...

2017-02-15 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16844 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #16844: [SPARK-19500] [SQL] Fix off-by-one bug in BytesTo...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16844#discussion_r101435816 --- Diff: core/src/main/java/org/apache/spark/unsafe/map/BytesToBytesMap.java --- @@ -742,7 +742,7 @@ public boolean append(Object kbase, long koff, int

[GitHub] spark issue #16944: [SPARK-19611][SQL] Introduce configurable table schema i...

2017-02-15 Thread budde
Github user budde commented on the issue: https://github.com/apache/spark/pull/16944 Looks like I missed a Catalyst test. Updating the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16620: [SPARK-19263] DAGScheduler should avoid sending conflict...

2017-02-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16620 **[Test build #72974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/72974/testReport)** for PR 16620 at commit

[GitHub] spark pull request #16499: [SPARK-17204][CORE] Fix replicated off heap stora...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16499#discussion_r101447383 --- Diff: core/src/main/scala/org/apache/spark/storage/BlockManager.scala --- @@ -1018,7 +1025,9 @@ private[spark] class BlockManager( try {

[GitHub] spark issue #16841: [SPARK-18871][SQL][TESTS] New test cases for IN/NOT IN s...

2017-02-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/16841 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16722: [SPARK-19591][ML][MLlib] Add sample weights to de...

2017-02-15 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/16722#discussion_r101448658 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/DecisionTreeClassifierSuite.scala --- @@ -351,6 +370,36 @@ class

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r101451677 --- Diff: python/pyspark/sql/readwriter.py --- @@ -159,18 +159,21 @@ def json(self, path, schema=None, primitivesAsString=None, prefersDecimal=None,

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r101451711 --- Diff: python/pyspark/sql/streaming.py --- @@ -442,6 +444,8 @@ def json(self, path, schema=None, primitivesAsString=None, prefersDecimal=None,

[GitHub] spark pull request #16386: [SPARK-18352][SQL] Support parsing multiline json...

2017-02-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/16386#discussion_r101453441 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/DataFrameReader.scala --- @@ -332,20 +336,21 @@ class DataFrameReader private[sql](sparkSession:

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101456277 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -186,8 +212,7 @@ private[hive] class

[GitHub] spark issue #16953: [SPARK-19622][WebUI]Fix a http error in a paged table wh...

2017-02-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16953 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16944: [SPARK-19611][SQL] Introduce configurable table s...

2017-02-15 Thread budde
Github user budde commented on a diff in the pull request: https://github.com/apache/spark/pull/16944#discussion_r101461357 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveSchemaInferenceSuite.scala --- @@ -0,0 +1,162 @@ +/* + * Licensed to the Apache

  1   2   3   4   5   6   >