[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61775300 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StreamTest.scala --- @@ -142,7 +142,10 @@ trait StreamTest extends QueryTest with Timeouts {

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-216309861 Some minor comments about code understandability, but overall this looks good. Thanks for working on this! --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61774969 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ProcessingTimeExecutorSuite.scala --- @@ -21,19 +21,41 @@ import

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61774572 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ProcessingTimeExecutorSuite.scala --- @@ -21,19 +21,41 @@ import

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61774375 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TriggerExecutor.scala --- @@ -65,8 +65,22 @@ case class

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61774365 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/StreamTest.scala --- @@ -280,19 +283,35 @@ trait StreamTest extends QueryTest with Timeouts {

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61773617 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TriggerExecutor.scala --- @@ -65,8 +65,22 @@ case class

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-05-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61771197 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/TriggerExecutor.scala --- @@ -65,8 +65,22 @@ case class

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215929410 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215929409 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215929256 **[Test build #57391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57391/consoleFull)** for PR 12797 at commit

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215928373 @marmbrus @tdas @zsxwing would you mind taking a look? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61663843 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamSuite.scala --- @@ -136,6 +136,22 @@ class StreamSuite extends StreamTest with

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/12797#discussion_r61663787 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/ProcessingTimeExecutorSuite.scala --- @@ -21,19 +21,41 @@ import

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215925062 **[Test build #57391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/57391/consoleFull)** for PR 12797 at commit

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/12797 [SPARK-15022][SPARK-15023] Add support for testing against the `ProcessingTime(intervalMS > 0)` trigger and `ManualClock` ## What changes were proposed in this pull request? Currently in

[GitHub] spark pull request: [SPARK-15022][SPARK-15023] Add support for tes...

2016-04-29 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/12797#issuecomment-215924685 still editing, will explain why ProcessingTimeExecutor, where for a batch it should run batchRunner only once but might run multiple times under certain conditions;