[GitHub] spark issue #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21050 **[Test build #90766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90766/testReport)** for PR 21050 at commit [`647528f`](https://github.com/apache/spark/commit/64

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21258 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #21061: [SPARK-23914][SQL] Add array_union function

2018-05-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21061 cc @ueshin --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.

[GitHub] spark issue #19449: [SPARK-22219][SQL] Refactor code to get a value for "spa...

2018-05-17 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/19449 When #21299 will be merged, I think that we can revisit this PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20936 **[Test build #4181 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4181/testReport)** for PR 20936 at commit [`b1b9985`](https://github.com/apache/spark/commit/

[GitHub] spark issue #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21050 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3314/ Tes

[GitHub] spark issue #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21050 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread huaxingao
Github user huaxingao commented on a diff in the pull request: https://github.com/apache/spark/pull/21050#discussion_r189149082 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1059,3 +1059,96 @@ case class Flatten(

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21291: [SPARK-24242][SQL] RangeExec should have correct ...

2018-05-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/21291#discussion_r189149095 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/ConfigBehaviorSuite.scala --- @@ -39,7 +39,9 @@ class ConfigBehaviorSuite extends QueryTest with Shar

[GitHub] spark issue #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21050 **[Test build #90765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90765/testReport)** for PR 21050 at commit [`9a42723`](https://github.com/apache/spark/commit/9a

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90759/ Test PASSed. ---

[GitHub] spark pull request #21050: [SPARK-23912][SQL]add array_distinct

2018-05-17 Thread huaxingao
Github user huaxingao commented on a diff in the pull request: https://github.com/apache/spark/pull/21050#discussion_r189148953 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -1059,3 +1059,96 @@ case class Flatten(

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21173 **[Test build #90759 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90759/testReport)** for PR 21173 at commit [`0e156ca`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21343: [SPARK-24292][SQL] Proxy user cannot connect to HiveMeta...

2018-05-17 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/21343 @gatorsmile @cloud-fan Could you help to review this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For ad

[GitHub] spark issue #20894: [SPARK-23786][SQL] Checking column names of csv headers

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20894 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20894: [SPARK-23786][SQL] Checking column names of csv headers

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20894 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90756/ Test PASSed. ---

[GitHub] spark issue #20894: [SPARK-23786][SQL] Checking column names of csv headers

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20894 **[Test build #90756 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90756/testReport)** for PR 20894 at commit [`795a878`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21163 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90763/ Test FAILed. ---

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21163 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21163 **[Test build #90763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90763/testReport)** for PR 21163 at commit [`3ccf94e`](https://github.com/apache/spark/commit/3

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21163 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3313/ Tes

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21163 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20936 **[Test build #90764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90764/testReport)** for PR 20936 at commit [`b1b9985`](https://github.com/apache/spark/commit/b1

[GitHub] spark issue #20826: [Spark-2489][SQL] Unsupported parquet datatype optional ...

2018-05-17 Thread aws-awinstan
Github user aws-awinstan commented on the issue: https://github.com/apache/spark/pull/20826 Pinging on this once again. Is there anything more you'd like to see before this is merged? --- - To unsubscribe, e-mail: r

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread jose-torres
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20936 ugh that flaky kafka test. It's already reported, and I've been looking into it this week albeit with little luck. --- - To

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread jose-torres
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/20936 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: review

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21163 **[Test build #90763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90763/testReport)** for PR 21163 at commit [`3ccf94e`](https://github.com/apache/spark/commit/3c

[GitHub] spark issue #21356: [SPARK-24309][CORE] AsyncEventQueue should stop on inter...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21356 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21356: [SPARK-24309][CORE] AsyncEventQueue should stop on inter...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21356 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90753/ Test PASSed. ---

[GitHub] spark issue #21356: [SPARK-24309][CORE] AsyncEventQueue should stop on inter...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21356 **[Test build #90753 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90753/testReport)** for PR 21356 at commit [`a689f52`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20936 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20936 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90758/ Test FAILed. ---

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20936 **[Test build #90758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90758/testReport)** for PR 20936 at commit [`b1b9985`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/21163 jenkins test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: re

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21337 **[Test build #90762 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90762/testReport)** for PR 21337 at commit [`de21b1c`](https://github.com/apache/spark/commit/de

[GitHub] spark issue #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21199 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90755/ Test PASSed. ---

[GitHub] spark issue #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21199 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21199 **[Test build #90755 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90755/testReport)** for PR 21199 at commit [`68c5eed`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21337 **[Test build #90761 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90761/testReport)** for PR 21337 at commit [`97f7e8f`](https://github.com/apache/spark/commit/97

[GitHub] spark issue #21357: [SPARK-24311][SS] Refactor HDFSBackedStateStoreProvider ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90754/ Test PASSed. ---

[GitHub] spark issue #21357: [SPARK-24311][SS] Refactor HDFSBackedStateStoreProvider ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21357 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21357: [SPARK-24311][SS] Refactor HDFSBackedStateStoreProvider ...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21357 **[Test build #90754 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90754/testReport)** for PR 21357 at commit [`8ad2a3f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21163: [SPARK-24097][ML] Instrumentation improvements - RandomF...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21163 **[Test build #4180 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4180/testReport)** for PR 21163 at commit [`3ccf94e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #21231: [SPARK-24119][SQL]Add interpreted execution to SortPrefi...

2018-05-17 Thread bersprockets
Github user bersprockets commented on the issue: https://github.com/apache/spark/pull/21231 @maropu @hvanhovell @viirya Are all pending issues resolved? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-17 Thread jose-torres
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/21337 Actually, now that I think about it, there's a lot of value in having that interface, both to make sure we don't accidentally leak across it and possibly allow debugging mode in the future. I'll

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread jose-torres
Github user jose-torres commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189133964 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/UnsafeRowReceiver.scala --- @@ -0,0 +1,64 @@ +/*

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21296 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21296 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90752/ Test PASSed. ---

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21296 **[Test build #90752 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90752/testReport)** for PR 21296 at commit [`f89eeb7`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21158 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90750/ Test PASSed. ---

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21158 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21158 **[Test build #90750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90750/testReport)** for PR 21158 at commit [`6ca25e3`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21296 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90751/ Test PASSed. ---

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21296 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21296: [SPARK-24244][SQL] Passing only required columns to the ...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21296 **[Test build #90751 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90751/testReport)** for PR 21296 at commit [`7dcfc7a`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #19449: [SPARK-22219][SQL] Refactor code to get a value for "spa...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19449 **[Test build #90760 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90760/testReport)** for PR 19449 at commit [`be4220d`](https://github.com/apache/spark/commit/be

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189127139 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/UnsafeRowReceiver.scala --- @@ -0,0 +1,64 @@ +/* + * Lic

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189125545 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/ContinuousShuffleReadRDD.scala --- @@ -0,0 +1,67 @@ +/*

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189129070 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/ContinuousShuffleReadRDD.scala --- @@ -0,0 +1,67 @@ +/*

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189129893 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/continuous/shuffle/ContinuousShuffleReadSuite.scala --- @@ -0,0 +1,137 @@ +/* + * Lic

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-17 Thread tdas
Github user tdas commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r189130600 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/streaming/continuous/shuffle/ContinuousShuffleReadSuite.scala --- @@ -0,0 +1,137 @@ +/* + * Lic

[GitHub] spark pull request #21358: [SPARK-22884][ML] ML tests for StructuredStreamin...

2018-05-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21358 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/21358 LGTM. Merged into master. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-ma

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21358 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21358 **[Test build #90757 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90757/testReport)** for PR 21358 at commit [`95f6f29`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90757/ Test PASSed. ---

[GitHub] spark issue #21282: [SPARK-23934][SQL] Adding map_from_entries function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21282 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90748/ Test FAILed. ---

[GitHub] spark issue #21282: [SPARK-23934][SQL] Adding map_from_entries function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21282 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21282: [SPARK-23934][SQL] Adding map_from_entries function

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21282 **[Test build #90748 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90748/testReport)** for PR 21282 at commit [`7fd824e`](https://github.com/apache/spark/commit/7

[GitHub] spark issue #21061: [SPARK-23914][SQL] Add array_union function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21061 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90745/ Test PASSed. ---

[GitHub] spark issue #21061: [SPARK-23914][SQL] Add array_union function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21061 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21061: [SPARK-23914][SQL] Add array_union function

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21061 **[Test build #90745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90745/testReport)** for PR 21061 at commit [`bbb9b1c`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #20894: [SPARK-23786][SQL] Checking column names of csv h...

2018-05-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/20894#discussion_r189122294 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVOptions.scala --- @@ -153,6 +153,12 @@ class CSVOptions( val

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3312/ Tes

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21173 **[Test build #90759 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90759/testReport)** for PR 21173 at commit [`0e156ca`](https://github.com/apache/spark/commit/0e

[GitHub] spark pull request #21266: [SPARK-24206][SQL] Improve DataSource read benchm...

2018-05-17 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21266#discussion_r189120967 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataSourceReadBenchmark.scala --- @@ -0,0 +1,826 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-17 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/21173 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h..

[GitHub] spark pull request #21288: [SPARK-24206][SQL] Improve FilterPushdownBenchmar...

2018-05-17 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21288#discussion_r189120527 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/FilterPushdownBenchmark.scala --- @@ -105,138 +128,306 @@ object FilterPushdownBenchmark { }

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20936 **[Test build #90758 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90758/testReport)** for PR 20936 at commit [`b1b9985`](https://github.com/apache/spark/commit/b1

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20936 **[Test build #4181 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4181/testReport)** for PR 20936 at commit [`b1b9985`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #20936: [SPARK-23503][SS] Enforce sequencing of committed epochs...

2018-05-17 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/20936 jenkins retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: revi

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21358 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21358 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3311/ Tes

[GitHub] spark issue #21358: [SPARK-22884][ML] ML tests for StructuredStreaming: spar...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21358 **[Test build #90757 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90757/testReport)** for PR 21358 at commit [`95f6f29`](https://github.com/apache/spark/commit/95

[GitHub] spark issue #20319: [SPARK-22884][ML][TESTS] ML test for StructuredStreaming...

2018-05-17 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/20319 Done! Here it is: https://github.com/apache/spark/pull/21358 @smurakozi Could you please close this issue and help review the new PR if you have time? Thanks! ---

[GitHub] spark pull request #21358: [SPARK-22884][ML] ML tests for StructuredStreamin...

2018-05-17 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/21358 [SPARK-22884][ML] ML tests for StructuredStreaming: spark.ml.clustering ## What changes were proposed in this pull request? Converting clustering tests to also check code with structured

[GitHub] spark pull request #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21199#discussion_r189111977 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/ContinuousRecordEndpoint.scala --- @@ -0,0 +1,61 @@ +/* + * Licens

[GitHub] spark issue #21355: [SPARK-24308][SQL] Handle DataReaderFactory to InputPart...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21355 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21355: [SPARK-24308][SQL] Handle DataReaderFactory to InputPart...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21355 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90743/ Test PASSed. ---

[GitHub] spark pull request #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21199#discussion_r189111878 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/streaming/sources/TextSocketStreamSuite.scala --- @@ -256,7 +258,101 @@ class TextSo

[GitHub] spark issue #21355: [SPARK-24308][SQL] Handle DataReaderFactory to InputPart...

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21355 **[Test build #90743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90743/testReport)** for PR 21355 at commit [`b362574`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #21199: [SPARK-24127][SS] Continuous text socket source

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21199 **[Test build #90755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90755/testReport)** for PR 21199 at commit [`68c5eed`](https://github.com/apache/spark/commit/68

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90746/ Test FAILed. ---

[GitHub] spark issue #20894: [SPARK-23786][SQL] Checking column names of csv headers

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20894 **[Test build #90756 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90756/testReport)** for PR 20894 at commit [`795a878`](https://github.com/apache/spark/commit/79

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21258 **[Test build #90746 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90746/testReport)** for PR 21258 at commit [`ba12147`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of priv...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21352 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21352: [SPARK-24305][SQL][FOLLOWUP] Avoid serialization of priv...

2018-05-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21352 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90747/ Test FAILed. ---

<    1   2   3   4   5   6   >