[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/15717 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16263 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92119730 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark issue #16257: [SPARK-18752][sql] Follow-up: add scaladoc explaining is...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16257 **[Test build #3494 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3494/consoleFull)** for PR 16257 at commit

[GitHub] spark issue #15314: [SPARK-17747][ML] WeightCol support non-double numeric d...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15314 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70067/ Test PASSed. ---

[GitHub] spark issue #15314: [SPARK-17747][ML] WeightCol support non-double numeric d...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15314 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15995: [SPARK-18566][SQL] remove OverwriteOptions

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15717 Could you please add a test case for verifying the metadata field of the column will not be lost after adding a comment? Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15717 @gatorsmile Thank you for your suggestions! I'll update the code this evening! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92120744 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92115931 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92117938 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70065/ Test FAILed. ---

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16263 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70071/ Test FAILed. ---

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16142 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15996: [SPARK-18567][SQL] Simplify CreateDataSourceTableAsSelec...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15996 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15915: [SPARK-18485][CORE] Underlying integer overflow when cre...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15915 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70063/ Test FAILed. ---

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16263 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92117893 --- Diff: sql/core/src/test/resources/sql-tests/inputs/change-column.sql --- @@ -0,0 +1,53 @@ +-- Create the origin table +CREATE TABLE

[GitHub] spark issue #16104: [SPARK-18675][SQL] CTAS for hive serde table should work...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16104 **[Test build #70075 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70075/consoleFull)** for PR 16104 at commit

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16263 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #16250: [CORE][MINOR] Stylistic changes in DAGScheduler (to ease...

2016-12-13 Thread jaceklaskowski
Github user jaceklaskowski commented on the issue: https://github.com/apache/spark/pull/16250 Just to have the list of the reasons not to accept the changes: 1. @rxin "just fyi this is going to be slower than the original code." 2. @shivaram "Its hard to profile these

[GitHub] spark issue #15996: [SPARK-18567][SQL] Simplify CreateDataSourceTableAsSelec...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15996 **[Test build #70074 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70074/consoleFull)** for PR 15996 at commit

[GitHub] spark issue #15819: [SPARK-18372][SQL][Branch-1.6].Staging directory fail to...

2016-12-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15819 yea, I think we should backport a complete staging dir cleanup functionality to 1.6, let's wait for #16134 --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92118904 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark pull request #15915: [SPARK-18485][CORE] Underlying integer overflow w...

2016-12-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/15915#discussion_r92123402 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBufferOutputStream.scala --- @@ -30,9 +31,14 @@ import

[GitHub] spark issue #15995: [SPARK-18566][SQL] remove OverwriteOptions

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15995 **[Test build #70060 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70060/consoleFull)** for PR 15995 at commit

[GitHub] spark issue #15314: [SPARK-17747][ML] WeightCol support non-double numeric d...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15314 **[Test build #70067 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70067/consoleFull)** for PR 15314 at commit

[GitHub] spark issue #15995: [SPARK-18566][SQL] remove OverwriteOptions

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70060/ Test PASSed. ---

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15717 Could you please also add a test case when `spark.sql.caseSensitive` is on? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92118438 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16263 **[Test build #70076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70076/consoleFull)** for PR 16263 at commit

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15717 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16142: [SPARK-18716][CORE] Restrict the disk usage of spark eve...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16142 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70066/ Test FAILed. ---

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15717 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70064/ Test FAILed. ---

[GitHub] spark issue #15996: [SPARK-18567][SQL] Simplify CreateDataSourceTableAsSelec...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15996 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70061/ Test FAILed. ---

[GitHub] spark issue #15996: [SPARK-18567][SQL] Simplify CreateDataSourceTableAsSelec...

2016-12-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15996 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16263 **[Test build #70072 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70072/consoleFull)** for PR 16263 at commit

[GitHub] spark issue #15717: [SPARK-17910][SQL] Allow users to update the comment of ...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15717 **[Test build #70073 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70073/consoleFull)** for PR 15717 at commit

[GitHub] spark pull request #15717: [SPARK-17910][SQL] Allow users to update the comm...

2016-12-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15717#discussion_r92117267 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala --- @@ -274,6 +274,76 @@ case class AlterTableUnsetPropertiesCommand(

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16263 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70072/ Test FAILed. ---

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16263 **[Test build #70072 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70072/consoleFull)** for PR 16263 at commit

[GitHub] spark pull request #16250: [CORE][MINOR] Stylistic changes in DAGScheduler (...

2016-12-13 Thread jaceklaskowski
Github user jaceklaskowski closed the pull request at: https://github.com/apache/spark/pull/16250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16263: [SPARK-18281][SQL][PySpark] Consumes the returned local ...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16263 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16176: [SPARK-18746][SQL] Add implicit encoder for BigDecimal, ...

2016-12-13 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/16176 sorry it conflict... can you update? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16210: [Core][SPARK-18778]Fix the scala classpath under some en...

2016-12-13 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/16210 OK. This PR doesn't move the handling / get rid of SPARK_SUBMIT_OPTS. Should this then be closed and the JIRA updated? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request #16258: [SPARK-18834][SS] Expose event time stats through...

2016-12-13 Thread tdas
Github user tdas closed the pull request at: https://github.com/apache/spark/pull/16258 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14079 thanks for the review @kayousterhout. I also added a testcase to BlacklistTrackerSuite, "task failure timeout works as expected for long-running tasksets" to cover your point about the long running

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16271 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70100/ Test PASSed. ---

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16271 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16246 **[Test build #70094 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70094/consoleFull)** for PR 16246 at commit

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16271 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70101/ Test PASSed. ---

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16271 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16271 **[Test build #70101 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70101/consoleFull)** for PR 16271 at commit

[GitHub] spark pull request #16273: [SPARK-18852][SS]StreamingQuery.lastProgress shou...

2016-12-13 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16273 [SPARK-18852][SS]StreamingQuery.lastProgress should be null when recentProgress is empty ## What changes were proposed in this pull request? Right now `StreamingQuery.lastProgress` throws

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16273 **[Test build #70105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70105/consoleFull)** for PR 16273 at commit

[GitHub] spark pull request #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS qu...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16246#discussion_r92285487 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/CheckAnalysis.scala --- @@ -124,6 +124,12 @@ trait CheckAnalysis extends

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70096/ Test PASSed. ---

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16189 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16271: [SPARK-18845][GraphX] PageRank has incorrect initializat...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16271 **[Test build #70101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70101/consoleFull)** for PR 16271 at commit

[GitHub] spark pull request #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r92275871 --- Diff: core/src/test/scala/org/apache/spark/scheduler/TaskSchedulerImplSuite.scala --- @@ -408,6 +411,96 @@ class TaskSchedulerImplSuite extends

[GitHub] spark pull request #16272: [SPARK-18850][SS]Make StreamExecution serializabl...

2016-12-13 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16272 [SPARK-18850][SS]Make StreamExecution serializable ## What changes were proposed in this pull request? This PR makes StreamExecution serializable because it is too easy for it to get

[GitHub] spark issue #14079: [SPARK-8425][CORE] Application Level Blacklisting

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14079 **[Test build #70102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70102/consoleFull)** for PR 14079 at commit

[GitHub] spark pull request #16258: [SPARK-18834][SS] Expose event time stats through...

2016-12-13 Thread tdas
GitHub user tdas reopened a pull request: https://github.com/apache/spark/pull/16258 [SPARK-18834][SS] Expose event time stats through StreamingQueryProgress ## What changes were proposed in this pull request? - Changed `StreamingQueryProgress.watermark` to

[GitHub] spark pull request #16272: [SPARK-18850][SS]Make StreamExecution serializabl...

2016-12-13 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16272#discussion_r92279247 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala --- @@ -71,7 +71,7 @@ trait ProgressReporter extends

[GitHub] spark issue #16258: [SPARK-18834][SS] Expose event time stats through Stream...

2016-12-13 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16258 Merging to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #16189: [SPARK-18761][CORE] Introduce "task reaper" to oversee t...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16189 **[Test build #70109 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70109/consoleFull)** for PR 16189 at commit

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread brkyvz
Github user brkyvz commented on the issue: https://github.com/apache/spark/pull/16273 Left one comment on updating docs, otherwise LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16270: [SPARK-18846][Scheduler] Fix flakiness in Schedul...

2016-12-13 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/16270#discussion_r92276753 --- Diff: core/src/test/scala/org/apache/spark/scheduler/SchedulerIntegrationSuite.scala --- @@ -157,8 +160,16 @@ abstract class

[GitHub] spark pull request #16270: [SPARK-18846][Scheduler] Fix flakiness in Schedul...

2016-12-13 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/16270#discussion_r92276597 --- Diff: core/src/test/scala/org/apache/spark/scheduler/SchedulerIntegrationSuite.scala --- @@ -27,6 +27,9 @@ import scala.language.existentials

[GitHub] spark issue #16268: [SPARK-18843][Core]Fix timeout in awaitResultInForkJoinS...

2016-12-13 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16268 Thanks! Merging to 2.1 and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread kayousterhout
Github user kayousterhout commented on the issue: https://github.com/apache/spark/pull/16270 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16273: [SPARK-18852][SS]StreamingQuery.lastProgress shou...

2016-12-13 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16273#discussion_r92294157 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -312,6 +313,24 @@ class StreamingQuerySuite extends

[GitHub] spark pull request #16273: [SPARK-18852][SS]StreamingQuery.lastProgress shou...

2016-12-13 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16273#discussion_r92294218 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ProgressReporter.scala --- @@ -102,7 +102,7 @@ trait ProgressReporter extends

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70098 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70098/consoleFull)** for PR 16270 at commit

[GitHub] spark pull request #16264: [SPARK-18793] [SPARK-18794] [R] add spark.randomF...

2016-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16264 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16258: [SPARK-18834][SS] Expose event time stats through Stream...

2016-12-13 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/16258 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16258: [SPARK-18834][SS] Expose event time stats through...

2016-12-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16258 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution serializable

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16272 **[Test build #70103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70103/consoleFull)** for PR 16272 at commit

[GitHub] spark pull request #16270: [SPARK-18846][Scheduler] Fix flakiness in Schedul...

2016-12-13 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/16270#discussion_r92281126 --- Diff: core/src/test/scala/org/apache/spark/scheduler/SchedulerIntegrationSuite.scala --- @@ -27,6 +27,8 @@ import scala.language.existentials

[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution serializable

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16272 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution serializable

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16272 **[Test build #70103 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70103/consoleFull)** for PR 16272 at commit

[GitHub] spark issue #16272: [SPARK-18850][SS]Make StreamExecution serializable

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16272 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70103/ Test FAILed. ---

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/70094/ Test PASSed. ---

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16246 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16232: [SPARK-18800][SQL] Fix UnsafeKVExternalSorter by ...

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/16232#discussion_r92289637 --- Diff: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeKVExternalSorter.java --- @@ -96,13 +98,35 @@ public UnsafeKVExternalSorter(

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16246 **[Test build #70110 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70110/consoleFull)** for PR 16246 at commit

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread nsyca
Github user nsyca commented on the issue: https://github.com/apache/spark/pull/16246 @hvanhovell, I really appreciate your time reviewing my code. I have addressed all your four comments. Thanks! --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #15018: [SPARK-17455][MLlib] Improve PAVA implementation ...

2016-12-13 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/15018#discussion_r92298473 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/regression/IsotonicRegression.scala --- @@ -344,27 +344,30 @@ class IsotonicRegression private

[GitHub] spark issue #16264: [SPARK-18793] [SPARK-18794] [R] add spark.randomForest/s...

2016-12-13 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/16264 Merged into master and branch-2.1. The last commit passed Jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16268: [SPARK-18843][Core]Fix timeout in awaitResultInForkJoinS...

2016-12-13 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/16268 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #16268: [SPARK-18843][Core]Fix timeout in awaitResultInFo...

2016-12-13 Thread zsxwing
Github user zsxwing closed the pull request at: https://github.com/apache/spark/pull/16268 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16273: [SPARK-18852][SS]StreamingQuery.lastProgress shou...

2016-12-13 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/16273#discussion_r92294010 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingQuerySuite.scala --- @@ -312,6 +313,24 @@ class StreamingQuerySuite extends

[GitHub] spark issue #16246: [SPARK-18814][SQL] CheckAnalysis rejects TPCDS query 32

2016-12-13 Thread hvanhovell
Github user hvanhovell commented on the issue: https://github.com/apache/spark/pull/16246 LGTM - pending jenkins. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16270: [SPARK-18846][Scheduler] Fix flakiness in SchedulerInteg...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16270 **[Test build #70104 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70104/consoleFull)** for PR 16270 at commit

[GitHub] spark issue #16273: [SPARK-18852][SS]StreamingQuery.lastProgress should be n...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16273 **[Test build #70112 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70112/consoleFull)** for PR 16273 at commit

[GitHub] spark issue #16266: [SPARK-18842][TESTS][LAUNCHER] De-duplicate paths in cla...

2016-12-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16266 Let me try to fix the tests accordingly. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16158: [SPARK-18724][ML] Add TuningSummary for TrainValidationS...

2016-12-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16158 **[Test build #70097 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70097/consoleFull)** for PR 16158 at commit

  1   2   3   4   5   >