[GitHub] [spark] HyukjinKwon commented on a change in pull request #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

HyukjinKwon commented on a change in pull request #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#discussion_r303748384 ## File path: python/pyspark/sql/tests/test

[GitHub] [spark] AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-511687261 Can one of the admins verify this patch? -

[GitHub] [spark] xianyinxin commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

xianyinxin commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-511687033 This pr is for branch-2.4. The master branch may need further investigation since there's

[GitHub] [spark] AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-511686705 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

AmplabJenkins removed a comment on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-511686547 Can one of the admins verify this patch? -

[GitHub] [spark] AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly.

AmplabJenkins commented on issue #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem eagerly. URL: https://github.com/apache/spark/pull/25169#issuecomment-511686547 Can one of the admins verify this patch? -

[GitHub] [spark] xianyinxin opened a new pull request #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem(FS) eagerly.

xianyinxin opened a new pull request #25169: [Spark 21067][SQL] Initialize the HdfsEncryptionShim and the underlying FileSystem(FS) eagerly. URL: https://github.com/apache/spark/pull/25169 …agerly ## What changes were proposed in this pull request? This pr fix the "Filesystem

[GitHub] [spark] maropu commented on a change in pull request #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

maropu commented on a change in pull request #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#discussion_r303744926 ## File path: python/pyspark/sql/tests/test_func

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-511677285 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] gatorsmile commented on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type

gatorsmile commented on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type URL: https://github.com/apache/spark/pull/25137#issuecomment-511677563 cc @cloud-fan @gengliangwang @maropu -

[GitHub] [spark] gatorsmile commented on issue #25158: [SPARK-28395][SQL] Division operator support integral division

gatorsmile commented on issue #25158: [SPARK-28395][SQL] Division operator support integral division URL: https://github.com/apache/spark/pull/25158#issuecomment-511677516 cc @cloud-fan @gengliangwang This is an automated me

[GitHub] [spark] AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

AmplabJenkins removed a comment on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-511677291 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-511677285 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

AmplabJenkins commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-511677291 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] SparkQA commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command

SparkQA commented on issue #24759: [SPARK-27395][SQL][WIP] Improve EXPLAIN command URL: https://github.com/apache/spark/pull/24759#issuecomment-511675959 **[Test build #107722 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107722/testReport)** for PR 24759

[GitHub] [spark] AngersZhuuuu commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AngersZh commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511675540 > Hi, @AngersZh, could you show us use cases for this extension and add them in the PR description? (I think this is one of

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511674284 @gaborgsomogyi have added you as collaborator -

[GitHub] [spark] wangyum commented on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type

wangyum commented on issue #25137: [SPARK-28348][SQL] Decimal precision promotion for binary arithmetic with casted decimal type URL: https://github.com/apache/spark/pull/25137#issuecomment-511672413 Benchmark and benchmark result after add a flag(`spark.sql.customCheckOverflow`): ```sc

[GitHub] [spark] HyukjinKwon removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's

HyukjinKwon removed a comment on issue #24898: [SPARK-22340][PYTHON] Add a mode to pin Python thread into JVM's URL: https://github.com/apache/spark/pull/24898#issuecomment-505863626 retest this please This is an automated me

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511671184 @tengpeng Tried cherry-picking your change. It's not a direct cherry pick. Directory pa

[GitHub] [spark] maropu commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

maropu commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511670847 Hi, @AngersZh, could you show us use cases for this extension and add them in the PR description? (I think this is one of FAQ for

[GitHub] [spark] xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511667388 @shivsood Accepted. Seems good. -

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511666773 @Xianyin Xin @tengpeng - I added you as collaborators

[GitHub] [spark] xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-51130 @shivsood OK for me.

[GitHub] [spark] SparkQA commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

SparkQA commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666565 **[Test build #107721 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107721/testReport)** for PR 24931 at comm

[GitHub] [spark] AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666284 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666286 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenki

[GitHub] [spark] AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666286 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666208 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666284 Merged build finished. Test PASSed. This is an automated message from th

[GitHub] [spark] AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job

[GitHub] [spark] AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

AmplabJenkins commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511666208 Merged build finished. Test PASSed. This is an automated message from th

[GitHub] [spark] SparkQA removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

SparkQA removed a comment on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511633815 **[Test build #107713 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107713/testReport)** for PR 2493

[GitHub] [spark] SparkQA commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql

SparkQA commented on issue #24931: [SPARK-28129][SQL][TEST] Port float8.sql URL: https://github.com/apache/spark/pull/24931#issuecomment-511665985 **[Test build #107713 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107713/testReport)** for PR 24931 at com

[GitHub] [spark] maropu commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

maropu commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r303728233 ## File path: sql/core/src/main/scala/org/apache/spark/sql/ex

[GitHub] [spark] SparkQA commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

SparkQA commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#issuecomment-511665203 **[Test build #107719 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] SparkQA commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

SparkQA commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511665202 **[Test build #107720 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107720/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

AmplabJenkins removed a comment on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#issuecomment-511664913 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

AmplabJenkins removed a comment on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#issuecomment-511664916 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins removed a comment on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

AmplabJenkins removed a comment on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511664896 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

AmplabJenkins commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511664892 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

AmplabJenkins commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#issuecomment-511664916 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

AmplabJenkins commented on issue #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#issuecomment-511664913 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

AmplabJenkins commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511664896 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins removed a comment on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

AmplabJenkins removed a comment on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511664892 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] viirya commented on a change in pull request #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

viirya commented on a change in pull request #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168#discussion_r303727263 ## File path: sql/core/src/test/resources/sql-tests/results/udf/udf-cros

[GitHub] [spark] viirya opened a new pull request #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base

viirya opened a new pull request #25168: [SPARK-28276][SQL][PYTHON][TEST] Convert and port 'cross-join.sql' into UDF test base URL: https://github.com/apache/spark/pull/25168 ## What changes were proposed in this pull request? This PR adds some tests converted from `cross-join.sql'`

[GitHub] [spark] dongjoon-hyun commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

dongjoon-hyun commented on issue #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#issuecomment-511664286 Retest this please. This is an automated message from the

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax

dongjoon-hyun commented on a change in pull request #25074: [SPARK-27924]Support ANSI SQL Boolean-Predicate syntax URL: https://github.com/apache/spark/pull/25074#discussion_r303727027 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/booleanExpre

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r303726406 ## File path: sql/hive/src/test/scala/org/apache/spark

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r303726170 ## File path: sql/hive/src/main/scala/org/apache/spark

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511662285 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins removed a comment on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511662288 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511662288 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

AmplabJenkins commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511662285 Merged build finished. Test PASSed.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r303724838 ## File path: sql/core/src/main/scala/org/apache/spark

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511661617 @Xianyin Xin if i just create Work In Progress PR . Is it possible for all of us to

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

dongjoon-hyun commented on a change in pull request #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#discussion_r303724495 ## File path: sql/core/src/main/scala/org/apache/spark

[GitHub] [spark] SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

SparkQA commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511661278 **[Test build #107717 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107717/testReport)** for PR 25

[GitHub] [spark] SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

SparkQA commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511661291 **[Test build #107718 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511660930 Merged build finished. Test PASSed. This is an automat

[GitHub] [spark] AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins removed a comment on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511660937 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511660930 Merged build finished. Test PASSed. This is an automated messa

[GitHub] [spark] dongjoon-hyun commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command

dongjoon-hyun commented on issue #24903: [SPARK-28084][SQL] Resolving the partition column name based on the resolver in sql load command URL: https://github.com/apache/spark/pull/24903#issuecomment-511660932 Retest this please.

[GitHub] [spark] AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

AmplabJenkins commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511660937 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/je

[GitHub] [spark] cloud-fan commented on a change in pull request #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile

cloud-fan commented on a change in pull request #25134: [SPARK-28366][CORE] Logging in driver when loading single large unsplittable file via sc.textFile URL: https://github.com/apache/spark/pull/25134#discussion_r303723935 ## File path: core/src/main/scala/org/apache/spark/rdd/Hado

[GitHub] [spark] dongjoon-hyun commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint

dongjoon-hyun commented on issue #25071: [SPARK-28292][SQL] Enable inject user-defined Hint URL: https://github.com/apache/spark/pull/25071#issuecomment-511660239 Retest this please. This is an automated message from the Apac

[GitHub] [spark] dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511659069 Hi, @gatorsmile, @cloud-fan , @JoshRosen . Since this is a very old issue, I'm wondering if this has not b

[GitHub] [spark] shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

shivsood commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511658972 Sound's ok to me. I will try try to get this out soon. Regards, Shiv On

[GitHub] [spark] AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins removed a comment on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511657024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

SparkQA removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511656063 **[Test build #107715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107715/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657007 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657163 Merged build finished. Test FAILed. This is a

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657004 Merged build finished. Test PASSed. This is an automa

[GitHub] [spark] SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

SparkQA commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511657282 **[Test build #107716 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107716/testRe

[GitHub] [spark] AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins removed a comment on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657004 Merged build finished. Test PASSed. This is a

[GitHub] [spark] xianyinxin commented on a change in pull request #25115: [SPARK-28351][SQL] Support DELETE in DataSource V2

xianyinxin commented on a change in pull request #25115: [SPARK-28351][SQL] Support DELETE in DataSource V2 URL: https://github.com/apache/spark/pull/25115#discussion_r303721366 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/sources/filters.scala ## @@ -16

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657165 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkele

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657159 **[Test build #107715 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107715/testReport)**

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657163 Merged build finished. Test FAILed. This is an automa

[GitHub] [spark] AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

AmplabJenkins commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511657007 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkel

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511657018 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

AmplabJenkins commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511657024 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API

xianyinxin commented on issue #21861: [SPARK-24907][SQL][WIP] Migrate JDBC DataSource to JDBCDataSourceV2 Read using DataSourceV2 API URL: https://github.com/apache/spark/pull/21861#issuecomment-511656676 Glad you have already some work on this @shivsood . Since this is a private repo whic

[GitHub] [spark] AmplabJenkins removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AmplabJenkins removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511656401 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AmplabJenkins removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511656404 Test PASSed. Refer to this link for build results (access r

[GitHub] [spark] dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset

dongjoon-hyun commented on issue #24993: [SPARK-18299][SQL] Allow more aggregations on KeyValueGroupedDataset URL: https://github.com/apache/spark/pull/24993#issuecomment-511656538 Retest this please. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AmplabJenkins commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511656404 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

AmplabJenkins removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511656223 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

AmplabJenkins commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511656401 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

AmplabJenkins removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511656227 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

AmplabJenkins commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511656223 Merged build finished. Test PASSed. T

[GitHub] [spark] SparkQA removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

SparkQA removed a comment on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511651040 **[Test build #107714 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] AmplabJenkins commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

AmplabJenkins commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511656227 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] SparkQA removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

SparkQA removed a comment on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511632249 **[Test build #107712 has started](https://amplab.cs.berkeley.edu/j

[GitHub] [spark] SparkQA commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first.

SparkQA commented on issue #24909: [SPARK-28106][SQL] When Spark SQL use "add jar" , before add to SparkContext, check jar path exist first. URL: https://github.com/apache/spark/pull/24909#issuecomment-511656107 **[Test build #107712 has finished](https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

SparkQA commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511656063 **[Test build #107715 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/107715/testReport)**

[GitHub] [spark] SparkQA commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork

SparkQA commented on issue #25138: [SPARK-26175][PYSPARK] Closing stdin of the worker process right after fork URL: https://github.com/apache/spark/pull/25138#issuecomment-511656055 **[Test build #107714 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10771

[GitHub] [spark] HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API

HyukjinKwon commented on issue #24232: [SPARK-27297] [SQL] Add higher order functions to scala API URL: https://github.com/apache/spark/pull/24232#issuecomment-511655941 I think current PR uses the profiles below: `./build/sbt -Phadoop-2.7 -Pkubernetes -Phive-thriftserver -Phadoop-cl

  1   2   3   4   5   6   7   8   9   >