[GitHub] spark issue #20344: [MINOR] Typo fixes

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20344 **[Test build #86447 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86447/testReport)** for PR 20344 at commit

[GitHub] spark issue #19340: [SPARK-22119][ML] Add cosine distance to KMeans

Github user srowen commented on the issue: https://github.com/apache/spark/pull/19340 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20208 Hi, @gatorsmile , @cloud-fan , @sameeragarwal , @HyukjinKwon . The PR is ready for review again. Spark commit log seems to be a little quiet since yesterday. Could you squeeze some

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20339 **[Test build #86430 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86430/testReport)** for PR 20339 at commit

[GitHub] spark issue #20339: [SPARK-23169][INFRA][R] Run lintr on the changes of lint...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20339 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86444/testReport)** for PR 20343 at commit

[GitHub] spark issue #20344: [MINOR] Typo fixes

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20344 **[Test build #86447 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86447/testReport)** for PR 20344 at commit

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20342 **[Test build #86446 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86446/testReport)** for PR 20342 at commit

[GitHub] spark issue #20340: [SPARK-21293][SS][SPARKR] Add doc example for streaming ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20340 **[Test build #86434 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86434/testReport)** for PR 20340 at commit

[GitHub] spark issue #20341: [MINOR] [SQL] Test case cleanups for recent PRs

Github user mgaido91 commented on the issue: https://github.com/apache/spark/pull/20341 LGTM --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/76/ Test

[GitHub] spark issue #20333: [SPARK-23087][SQL] CheckCartesianProduct too restrictive...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20333 Will address my comment in my PR. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20340: [SPARK-21293][SS][SPARKR] Add doc example for streaming ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20340 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20338: [SPARK-11222][BUILD][PYTHON] python code style ch...

GitHub user rekhajoshm opened a pull request: https://github.com/apache/spark/pull/20338 [SPARK-11222][BUILD][PYTHON] python code style checker update ## What changes were proposed in this pull request? Referencing latest python code style checking from PyPi/pycodestyle

[GitHub] spark issue #20340: [SPARK-21293][SS][SPARKR] Add doc example for streaming ...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20340 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86436/ Test PASSed. ---

[GitHub] spark issue #20340: [SPARK-21293][SS][SPARKR] Add doc example for streaming ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20340 **[Test build #86436 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86436/testReport)** for PR 20340 at commit

[GitHub] spark issue #20333: [SPARK-23087][SQL] CheckCartesianProduct too restrictive...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20333 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #18277: [SPARK-20947][PYTHON] Fix encoding/decoding error in pip...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18277 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #18277: [SPARK-20947][PYTHON] Fix encoding/decoding error in pip...

Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/18277 Let me merge this one only into master considering the concerns - https://github.com/apache/spark/pull/18277#pullrequestreview-90007120 and

[GitHub] spark issue #18277: [SPARK-20947][PYTHON] Fix encoding/decoding error in pip...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18277 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20208: [SPARK-23007][SQL][TEST] Add schema evolution tes...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20208#discussion_r162835707 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/SchemaEvolutionTest.scala --- @@ -0,0 +1,406 @@ +/* + *

[GitHub] spark issue #20338: [SPARK-11222][BUILD][PYTHON] python code style checker u...

Github user rekhajoshm commented on the issue: https://github.com/apache/spark/pull/20338 Thanks @HyukjinKwon for your review.updated, please verify. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20338: [SPARK-11222][BUILD][PYTHON] python code style checker u...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20338 **[Test build #86451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86451/testReport)** for PR 20338 at commit

[GitHub] spark issue #20338: [SPARK-11222][BUILD][PYTHON] python code style checker u...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20338 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20338: [SPARK-23174][BUILD][PYTHON] python code style ch...

Github user rekhajoshm commented on a diff in the pull request: https://github.com/apache/spark/pull/20338#discussion_r162838933 --- Diff: dev/tox.ini --- @@ -13,7 +13,7 @@ # See the License for the specific language governing permissions and # limitations under the

[GitHub] spark issue #20346: [MINOR][SQL] Fix wrong comments on org.apache.spark.sql....

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20346 Thank you for review and approval, @HyukjinKwon ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #18906: [SPARK-21692][PYSPARK][SQL] Add nullability support to P...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18906 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20337 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/61/ Test

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20345 **[Test build #86449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86449/testReport)** for PR 20345 at commit

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/79/ Test

[GitHub] spark issue #20337: [SPARK-11630] [core] ClosureCleaner moved from warning t...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20337 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #18906: [SPARK-21692][PYSPARK][SQL] Add nullability support to P...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18906 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86445/ Test PASSed. ---

[GitHub] spark issue #20345: [SPARK-23172][SQL] Respect Project nodes in ReorderJoin

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20345 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20341: [MINOR] [SQL] Test case cleanups for recent PRs

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20341 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19993: [SPARK-22799][ML] Bucketizer should throw exception if s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19993 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/69/ Test

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20342 **[Test build #86441 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86441/testReport)** for PR 20342 at commit

[GitHub] spark issue #19993: [SPARK-22799][ML] Bucketizer should throw exception if s...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19993 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20342: [SPARK-23170][SQL] Dump the statistics of effective runs...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86441/ Test PASSed. ---

[GitHub] spark pull request #20344: [MINOR] Typo fixes

GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/20344 [MINOR] Typo fixes ## What changes were proposed in this pull request? Typo fixes ## How was this patch tested? Local build / Doc-only changes You can merge this

[GitHub] spark pull request #20341: [MINOR] [SQL] Test case cleanups by recent PRs

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20341#discussion_r162812208 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameJoinSuite.scala --- @@ -276,16 +277,14 @@ class DataFrameJoinSuite extends QueryTest

[GitHub] spark pull request #20341: [MINOR] [SQL] Test case cleanups by recent PRs

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20341#discussion_r162812178 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/HiveUDAFSuite.scala --- @@ -49,8 +49,12 @@ class HiveUDAFSuite extends QueryTest

[GitHub] spark pull request #20338: [SPARK-11222][BUILD][PYTHON] python code style ch...

Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/20338#discussion_r162804815 --- Diff: dev/lint-python --- @@ -35,11 +35,9 @@ compile_status="${PIPESTATUS[0]}" # Get pep8 at runtime so that we don't rely on it being

[GitHub] spark pull request #20341: [MINOR] [SQL] Test case cleanups by recent PRs

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20341#discussion_r162812196 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/test/TestHive.scala --- @@ -492,8 +492,7 @@ private[hive] class TestHiveSparkSession(

[GitHub] spark pull request #20342: [SPARK-23170][SQL] Dump the statistics of effecti...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20342#discussion_r162817354 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/rules/QueryExecutionMetering.scala --- @@ -0,0 +1,90 @@ +/* + * Licensed to

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20342 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20177: [SPARK-22954][SQL] Fix the exception thrown by Analyze c...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20177 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20177: [SPARK-22954][SQL] Fix the exception thrown by Analyze c...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20177 **[Test build #86425 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86425/testReport)** for PR 20177 at commit

[GitHub] spark issue #20342: [SPARK-23170] Dump the statistics of effective runs of a...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/20342 You forgot to add `[SQL]` in the title? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20340: [SPARK-21293][SS][SPARKR] Add doc example for streaming ...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20340 **[Test build #86434 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86434/testReport)** for PR 20340 at commit

[GitHub] spark pull request #20339: [SPARK-23169][INFRA][R] Run lintr on the changes ...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20339 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user maropu commented on the issue: https://github.com/apache/spark/pull/20343 retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20343#discussion_r162835887 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -339,6 +340,30 @@ class TPCDSQuerySuite extends BenchmarkQueryTest {

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86452/testReport)** for PR 20343 at commit

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20343#discussion_r162835844 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -339,6 +340,30 @@ class TPCDSQuerySuite extends

[GitHub] spark pull request #18277: [SPARK-20947][PYTHON] Fix encoding/decoding error...

Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18277 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/81/ Test

[GitHub] spark pull request #20331: [SPARK-23158] [SQL] Move HadoopFsRelationTest tes...

Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/20331#discussion_r162838622 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/orc/OrcHadoopFsRelationSuite.scala --- @@ -82,44 +80,4 @@ class

[GitHub] spark issue #20346: [MINOR][SQL] Fix wrong comments on org.apache.spark.sql....

Github user viirya commented on the issue: https://github.com/apache/spark/pull/20346 This is an old code comment we should remove it before. Thanks for fixing it. LGTM On Jan 22, 2018 11:20 AM, "Dongjoon Hyun" wrote: > cc

[GitHub] spark pull request #19285: [SPARK-22068][CORE]Reduce the duplicate code betw...

Github user ConeyLiu commented on a diff in the pull request: https://github.com/apache/spark/pull/19285#discussion_r162840776 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -162,26 +162,29 @@ private[spark] class MemoryStore( }

[GitHub] spark pull request #19285: [SPARK-22068][CORE]Reduce the duplicate code betw...

Github user ConeyLiu commented on a diff in the pull request: https://github.com/apache/spark/pull/19285#discussion_r162840896 --- Diff: core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala --- @@ -162,26 +162,29 @@ private[spark] class MemoryStore( }

[GitHub] spark issue #19285: [SPARK-22068][CORE]Reduce the duplicate code between put...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19285 **[Test build #86455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86455/testReport)** for PR 19285 at commit

[GitHub] spark pull request #20347: [SPARK-20129][Core] JavaSparkContext should use S...

GitHub user rekhajoshm opened a pull request: https://github.com/apache/spark/pull/20347 [SPARK-20129][Core] JavaSparkContext should use SparkContext.getOrCreate ## What changes were proposed in this pull request? Using SparkContext getOrCreate() instead of recreating new sc in

[GitHub] spark issue #20347: [SPARK-20129][Core] JavaSparkContext should use SparkCon...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20347 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/84/ Test

[GitHub] spark issue #20347: [SPARK-20129][Core] JavaSparkContext should use SparkCon...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20347 **[Test build #86456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86456/testReport)** for PR 20347 at commit

[GitHub] spark issue #20347: [SPARK-20129][Core] JavaSparkContext should use SparkCon...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20347 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20346: [MINOR][SQL] Fix wrong comments on org.apache.spark.sql....

Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20346 Thank you for review and confirming, @viirya ! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20316: [SPARK-23149][SQL] polish ColumnarBatch

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20316#discussion_r162842712 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ColumnarBatch.java --- @@ -96,16 +90,6 @@ public void setNumRows(int numRows) {

[GitHub] spark pull request #20277: [SPARK-23090][SQL] polish ColumnVector

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20277#discussion_r162844101 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ArrowColumnVector.java --- @@ -55,164 +43,82 @@ public void close() { if

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86457/testReport)** for PR 20343 at commit

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/85/ Test

[GitHub] spark pull request #20325: [SPARK-22808][DOCS] add insertInto when save hive...

Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20325#discussion_r162845525 --- Diff: docs/sql-programming-guide.md --- @@ -580,6 +580,9 @@ default local Hive metastore (using Derby) for you. Unlike the `createOrReplaceT

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add schema evolution test suite...

Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20208 Will do it after 2.3 release --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20343 **[Test build #86452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86452/testReport)** for PR 20343 at commit

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86452/ Test FAILed. ---

[GitHub] spark pull request #20338: [SPARK-23174][BUILD][PYTHON] python code style ch...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/20338#discussion_r162852255 --- Diff: dev/lint-python --- @@ -35,11 +35,10 @@ compile_status="${PIPESTATUS[0]}" # Get pep8 at runtime so that we don't rely on it being

[GitHub] spark issue #20259: [SPARK-23066][WEB-UI] Master Page increase master start-...

Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20259 I kind of agree with @CodingCat , I think we have plenty of third-party monitoring tools to monitor the availability of Master process, it is not so necessary to expose here in Master UI. ---

[GitHub] spark pull request #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pys...

Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/13599#discussion_r162856254 --- Diff: python/pyspark/context.py --- @@ -1023,6 +1032,35 @@ def getConf(self): conf.setAll(self._conf.getAll()) return conf

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13599 I think this is important functionality, however the current PR will break in the event of executor restart and that isn't acceptable. I'm -1 on this until that issue is fixed. ---

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13599 I want to be clear, there are ways to support this which don't break on executor restart which is why the hard block. Resilience is a first class concept for Spark and we can't abandon it to

[GitHub] spark issue #20297: [SPARK-23020][CORE] Fix races in launcher code, test.

Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20297 thanks, merging to master/2.3! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark pull request #18906: [SPARK-21692][PYSPARK][SQL] Add nullability suppo...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18906#discussion_r162857996 --- Diff: python/pyspark/sql/tests.py --- @@ -602,6 +602,30 @@ def test_non_existed_udf(self): self.assertRaisesRegexp(AnalysisException, "Can

[GitHub] spark pull request #18906: [SPARK-21692][PYSPARK][SQL] Add nullability suppo...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18906#discussion_r162857718 --- Diff: python/pyspark/sql/functions.py --- @@ -2231,6 +2239,16 @@ def pandas_udf(f=None, returnType=None, functionType=None): ... return

[GitHub] spark pull request #18906: [SPARK-21692][PYSPARK][SQL] Add nullability suppo...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/18906#discussion_r162857704 --- Diff: python/pyspark/sql/functions.py --- @@ -2103,6 +2103,14 @@ def udf(f=None, returnType=StringType()): >>> import random >>>

[GitHub] spark pull request #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCD...

Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20343#discussion_r162860188 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/TPCDSQuerySuite.scala --- @@ -339,6 +340,30 @@ class TPCDSQuerySuite extends BenchmarkQueryTest {

[GitHub] spark pull request #20053: [SPARK-22873] [CORE] Init lastReportTimestamp wit...

Github user Ngone51 closed the pull request at: https://github.com/apache/spark/pull/20053 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20056: [SPARK-22878] [CORE] Count totalDroppedEvents for...

Github user Ngone51 closed the pull request at: https://github.com/apache/spark/pull/20056 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19285: [SPARK-22068][CORE]Reduce the duplicate code between put...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19285 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20277: [SPARK-23090][SQL] polish ColumnVector

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20277 **[Test build #86459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86459/testReport)** for PR 20277 at commit

[GitHub] spark issue #20146: [SPARK-11215][ML] Add multiple columns support to String...

Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20146 **[Test build #86460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/86460/testReport)** for PR 20146 at commit

[GitHub] spark pull request #20277: [SPARK-23090][SQL] polish ColumnVector

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/20277#discussion_r162860736 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/VectorizedHashMapGenerator.scala --- @@ -127,8 +127,10 @@ class

[GitHub] spark issue #20343: [SPARK-23167][SQL] Add TPCDS queries v2.7 in TPCDSQueryS...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20343 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/89/ Test

[GitHub] spark issue #20348: [SPARK-23122][PYSPARK][FOLLOW-UP] Update the docs for UD...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20348 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/88/ Test

[GitHub] spark issue #20348: [SPARK-23122][PYSPARK][FOLLOW-UP] Update the docs for UD...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20348 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20277: [SPARK-23090][SQL] polish ColumnVector

Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/20277#discussion_r162862761 --- Diff: sql/core/src/main/java/org/apache/spark/sql/vectorized/ArrowColumnVector.java --- @@ -33,18 +33,6 @@ private final ArrowVectorAccessor

[GitHub] spark issue #20338: [SPARK-23174][BUILD][PYTHON] python code style checker u...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20338 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/86454/ Test PASSed. ---

[GitHub] spark issue #20338: [SPARK-23174][BUILD][PYTHON] python code style checker u...

Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20338 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20348: [SPARK-23122][PYSPARK][FOLLOW-UP] Update the docs...

Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/20348#discussion_r162856477 --- Diff: python/pyspark/sql/udf.py --- @@ -200,7 +200,7 @@ def __init__(self, sparkSession): @since("1.3.1") def register(self, name, f,

  1   2   3   4   >