[GitHub] [spark] AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] add metrics to shuffle reader

AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] add metrics to shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-604095073 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] add metrics to shuffle reader

AmplabJenkins removed a comment on issue #28022: [SPARK-31253][SQL] add metrics to shuffle reader URL: https://github.com/apache/spark/pull/28022#issuecomment-604095083 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP)

AmplabJenkins removed a comment on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP) URL: https://github.com/apache/spark/pull/28026#issuecomment-604118631 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP)

AmplabJenkins removed a comment on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP) URL: https://github.com/apache/spark/pull/28026#issuecomment-604118640 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP)

AmplabJenkins commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP) URL: https://github.com/apache/spark/pull/28026#issuecomment-604118640 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP)

AmplabJenkins commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP) URL: https://github.com/apache/spark/pull/28026#issuecomment-604118631 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] SparkQA commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP)

SparkQA commented on issue #28026: [SPARK-18885][SQL] Unify create table syntax (WIP) URL: https://github.com/apache/spark/pull/28026#issuecomment-604118010 **[Test build #120376 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120376/testReport)** for PR

[GitHub] [spark] rdblue commented on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP)

rdblue commented on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP) URL: https://github.com/apache/spark/pull/28027#issuecomment-604124358 FYI @HeartSaVioR and @brkyvz. This is an automated message

[GitHub] [spark] dongjoon-hyun commented on issue #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource

dongjoon-hyun commented on issue #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource URL: https://github.com/apache/spark/pull/28016#issuecomment-604128330 Retest this please.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

AmplabJenkins removed a comment on issue #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#issuecomment-604142520 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets

AmplabJenkins removed a comment on issue #28001: [SPARK-31237][SQL][TESTS] Replace 3-letter time zones by zone offsets URL: https://github.com/apache/spark/pull/28001#issuecomment-604142525 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] github-actions[bot] closed pull request #26044: [SPARK-29375][SQL] Exchange reuse across all subquery levels

github-actions[bot] closed pull request #26044: [SPARK-29375][SQL] Exchange reuse across all subquery levels URL: https://github.com/apache/spark/pull/26044 This is an automated message from the Apache Git Service. To

[GitHub] [spark] github-actions[bot] commented on issue #26756: [SPARK-30119][WebUI]Support Pagination for Batch Tables in Streaming Tab

github-actions[bot] commented on issue #26756: [SPARK-30119][WebUI]Support Pagination for Batch Tables in Streaming Tab URL: https://github.com/apache/spark/pull/26756#issuecomment-604154485 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the

[GitHub] [spark] github-actions[bot] closed pull request #26270: [SPARK-26544][SQL] Escape struct string in spark thriftserver to keep alignment with hive

github-actions[bot] closed pull request #26270: [SPARK-26544][SQL] Escape struct string in spark thriftserver to keep alignment with hive URL: https://github.com/apache/spark/pull/26270 This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side

AmplabJenkins removed a comment on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side URL: https://github.com/apache/spark/pull/28005#issuecomment-604161400 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604164985 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604164972 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604164972 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

SparkQA removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604120811 **[Test build #120377 has

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28024: [SPARK-31254][SQL] Use the current session time zone in `HiveResult.toHiveString`

HyukjinKwon commented on a change in pull request #28024: [SPARK-31254][SQL] Use the current session time zone in `HiveResult.toHiveString` URL: https://github.com/apache/spark/pull/28024#discussion_r398264310 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names

HyukjinKwon commented on issue #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names URL: https://github.com/apache/spark/pull/28025#issuecomment-604180059 Looks good. a couple of questions.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names

HyukjinKwon commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names URL: https://github.com/apache/spark/pull/28025#discussion_r398270416 ## File path: python/pyspark/sql/pandas/conversion.py ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604189159 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604189153 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604189153 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604189159 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604192138 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604192138 Merged build finished. Test FAILed. This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604192145 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604191935 **[Test build #120385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120385/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604192145 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc

SparkQA removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604184213 **[Test build #120385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120385/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side

AmplabJenkins commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side URL: https://github.com/apache/spark/pull/28005#issuecomment-604199929 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side

AmplabJenkins commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side URL: https://github.com/apache/spark/pull/28005#issuecomment-604199937 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon edited a comment on issue #27989: [SPARK-31228][DSTREAMS] Add version information to the configuration of Kafka

HyukjinKwon edited a comment on issue #27989: [SPARK-31228][DSTREAMS] Add version information to the configuration of Kafka URL: https://github.com/apache/spark/pull/27989#issuecomment-604207880 Oh, okay, about options right? Sure, it's best to add the versions I guess. Let's do it

[GitHub] [spark] SparkQA commented on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP)

SparkQA commented on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP) URL: https://github.com/apache/spark/pull/28027#issuecomment-604208444 **[Test build #120378 has

[GitHub] [spark] SparkQA removed a comment on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP)

SparkQA removed a comment on issue #28027: [SPARK-31255][SQL] Add SupportsMetadataColumns to DSv2 (WIP) URL: https://github.com/apache/spark/pull/28027#issuecomment-604126136 **[Test build #120378 has

[GitHub] [spark] HyukjinKwon removed a comment on issue #27989: [SPARK-31228][DSTREAMS] Add version information to the configuration of Kafka

HyukjinKwon removed a comment on issue #27989: [SPARK-31228][DSTREAMS] Add version information to the configuration of Kafka URL: https://github.com/apache/spark/pull/27989#issuecomment-604207880 Oh, okay, about options right? Sure, it's best to add the versions I guess. Let's do it

[GitHub] [spark] dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#discussion_r398302492 ## File path:

[GitHub] [spark] Ngone51 commented on a change in pull request #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

Ngone51 commented on a change in pull request #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#discussion_r398307088 ## File path:

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

SparkQA commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604222600 **[Test build #120392 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120392/testReport)** for

[GitHub] [spark] turboFei edited a comment on issue #28030: [SPARK-31263][SHUFFLE] Enable yarn shuffle service to close the idle connections

turboFei edited a comment on issue #28030: [SPARK-31263][SHUFFLE] Enable yarn shuffle service to close the idle connections URL: https://github.com/apache/spark/pull/28030#issuecomment-604220710 just keep consistent with:

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604226923 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604226921 Merged build finished. Test PASSed. This is an

[GitHub] [spark] SparkQA commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

SparkQA commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604226821 **[Test build #120392 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120392/testReport)** for

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

AmplabJenkins commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604226923 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

AmplabJenkins commented on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604226921 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] dongjoon-hyun commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

dongjoon-hyun commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-604227335 Hi, @cloud-fan . This seems to be not in `branch-3.0` yet.

[GitHub] [spark] SparkQA removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

SparkQA removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604222600 **[Test build #120392 has

[GitHub] [spark] SparkQA commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir

SparkQA commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir URL: https://github.com/apache/spark/pull/27969#issuecomment-604236864 **[Test build #120395 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir

AmplabJenkins removed a comment on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir URL: https://github.com/apache/spark/pull/27969#issuecomment-604237223 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] AmplabJenkins commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir

AmplabJenkins commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir URL: https://github.com/apache/spark/pull/27969#issuecomment-604237223 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir

AmplabJenkins commented on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir URL: https://github.com/apache/spark/pull/27969#issuecomment-604237221 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir

AmplabJenkins removed a comment on issue #27969: [SPARK-31170][SQL][test-hive1.2] Spark SQL Cli should respect hive-site.xml and spark.sql.warehouse.dir URL: https://github.com/apache/spark/pull/27969#issuecomment-604237221 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator

SparkQA commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604240932 **[Test build #120397 has

[GitHub] [spark] dongjoon-hyun commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

dongjoon-hyun commented on issue #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#issuecomment-604240855 BTW, @xuanyuanking . Could you confirm the above question? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite

AmplabJenkins removed a comment on issue #25748: [SPARK-28904][K8S][TESTS] Create mount for PvTestSuite URL: https://github.com/apache/spark/pull/25748#issuecomment-604240730 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group

dongjoon-hyun commented on a change in pull request #27665: [SPARK-30623][Core] Spark external shuffle allow disable of separate event loop group URL: https://github.com/apache/spark/pull/27665#discussion_r398328411 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource

cloud-fan commented on a change in pull request #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource URL: https://github.com/apache/spark/pull/28016#discussion_r398329137 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator

AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604241230 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator

AmplabJenkins commented on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604241225 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator

AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604241225 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27695: [SPARK-30949][K8S][CORE] decouple requests and parallelism on kubernetes drivers

SparkQA commented on issue #27695: [SPARK-30949][K8S][CORE] decouple requests and parallelism on kubernetes drivers URL: https://github.com/apache/spark/pull/27695#issuecomment-604240942 **[Test build #120398 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator

AmplabJenkins removed a comment on issue #28028: [SPARK-31259][CORE] Fix log message about fetch request size in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604241230 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] MaxGekk commented on a change in pull request #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource

MaxGekk commented on a change in pull request #28016: [SPARK-31238][SQL][test-hive1.2] Rebase dates to/from Julian calendar in write/read for ORC datasource URL: https://github.com/apache/spark/pull/28016#discussion_r398331763 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #28015: [SPARK-31244][K8S][TEST] Use Minio instead of Ceph in K8S DepsTestsSuite

HyukjinKwon commented on issue #28015: [SPARK-31244][K8S][TEST] Use Minio instead of Ceph in K8S DepsTestsSuite URL: https://github.com/apache/spark/pull/28015#issuecomment-604172033 Haven't taken a close look but looks good. +1

[GitHub] [spark] maropu commented on issue #28018: [SPARK-30758][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments

maropu commented on issue #28018: [SPARK-30758][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments URL: https://github.com/apache/spark/pull/28018#issuecomment-604175237 I think this issue is worth filing a new jira.

[GitHub] [spark] yaooqinn commented on issue #28020: [SPARK-31258][BUILD] Pin the avro version in SBT

yaooqinn commented on issue #28020: [SPARK-31258][BUILD] Pin the avro version in SBT URL: https://github.com/apache/spark/pull/28020#issuecomment-604178225 @dongjoon-hyun @HyukjinKwon, thanks. I have filed the Jira and update sbt-dependencyTree

[GitHub] [spark] HyukjinKwon commented on issue #28020: [SPARK-31258][BUILD] Pin the avro version in SBT

HyukjinKwon commented on issue #28020: [SPARK-31258][BUILD] Pin the avro version in SBT URL: https://github.com/apache/spark/pull/28020#issuecomment-604180663 Looks good given they many people faced this randomly in unidoc. I checked the avro version is 1.8.2 from branch-2.4 to master.

[GitHub] [spark] viirya commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names

viirya commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names URL: https://github.com/apache/spark/pull/28025#discussion_r398271547 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -132,25

[GitHub] [spark] viirya commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names

viirya commented on a change in pull request #28025: [SPARK-31186][PySpark][SQL] toPandas should not fail on duplicate column names URL: https://github.com/apache/spark/pull/28025#discussion_r398271448 ## File path: python/pyspark/sql/pandas/conversion.py ## @@ -132,25

[GitHub] [spark] HyukjinKwon closed pull request #28020: [SPARK-31258][BUILD] Pin the avro version in SBT

HyukjinKwon closed pull request #28020: [SPARK-31258][BUILD] Pin the avro version in SBT URL: https://github.com/apache/spark/pull/28020 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604182369 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService

manuzhang commented on issue #27998: [SPARK-31219][YARN] Enable closeIdleConnections in YarnShuffleService URL: https://github.com/apache/spark/pull/27998#issuecomment-604182314 @xuanyuanking @tgravescs Here are detailed timelines of our investigation. 1. We found connections on

[GitHub] [spark] AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins removed a comment on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604182374 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

AmplabJenkins commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604182369 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604181975 **[Test build #120384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120384/testReport)** for PR

[GitHub] [spark] yaooqinn commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

yaooqinn commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604181984 retest this please This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator

SparkQA commented on issue #28028: [SPARK-31259][CORE] Fix log error of curRequestSize in ShuffleBlockFetcherIterator URL: https://github.com/apache/spark/pull/28028#issuecomment-604188651 **[Test build #120386 has

[GitHub] [spark] HyukjinKwon commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

HyukjinKwon commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604196006 retest this please This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side

HyukjinKwon commented on issue #28005: [DO-NOT-MERGE] Check if SPARK-31231 is fixed in setuptools side URL: https://github.com/apache/spark/pull/28005#issuecomment-604206859 Okay, appearntly it's not fixed yet. I am going back to the original fix and merge it.

[GitHub] [spark] beliefer commented on a change in pull request #28018: [SPARK-31262][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments

beliefer commented on a change in pull request #28018: [SPARK-31262][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments URL: https://github.com/apache/spark/pull/28018#discussion_r398296786 ## File path: sql/core/src/test/resources/sql-tests/inputs/comments.sql

[GitHub] [spark] beliefer commented on issue #28018: [SPARK-31262][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments

beliefer commented on issue #28018: [SPARK-31262][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments URL: https://github.com/apache/spark/pull/28018#issuecomment-604207020 > I think this issue is worth filing a new jira. OK. I created a new JIRA and update the title of

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219243 Merged build finished. Test FAILed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219243 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219251 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

SparkQA commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604218784 **[Test build #120390 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219173 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219173 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219168 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

AmplabJenkins removed a comment on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219168 Merged build finished. Test PASSed.

[GitHub] [spark] wang-zhun commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications

wang-zhun commented on issue #28009: [SPARK-31235][YARN] Separates different categories of applications URL: https://github.com/apache/spark/pull/28009#issuecomment-604219023 @jiangxb1987 @tgravescs Thanks for your responses and suggestions

[GitHub] [spark] dongjoon-hyun commented on issue #27588: [BACKPORT] Backport of [SPARK-20628][CORE][K8S] Start to improve decommissioning

dongjoon-hyun commented on issue #27588: [BACKPORT] Backport of [SPARK-20628][CORE][K8S] Start to improve decommissioning URL: https://github.com/apache/spark/pull/27588#issuecomment-604221764 Retest this please This is an

[GitHub] [spark] dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#discussion_r398314267 ## File path:

[GitHub] [spark] cloud-fan commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only

cloud-fan commented on issue #28003: [SPARK-31234][SQL] ResetCommand should reset config to sc.conf only URL: https://github.com/apache/spark/pull/28003#issuecomment-604243019 I think this is clearly a bug. If users set a static SQL config in the config file, this should not be affected

[GitHub] [spark] AmplabJenkins removed a comment on issue #27588: [BACKPORT] Backport of [SPARK-20628][CORE][K8S] Start to improve decommissioning

AmplabJenkins removed a comment on issue #27588: [BACKPORT] Backport of [SPARK-20628][CORE][K8S] Start to improve decommissioning URL: https://github.com/apache/spark/pull/27588#issuecomment-604242125 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] beliefer commented on a change in pull request #28018: [SPARK-30758][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments

beliefer commented on a change in pull request #28018: [SPARK-30758][SQL][TESTS][FOLLOWUP] Fix bug tests imported bracketed comments URL: https://github.com/apache/spark/pull/28018#discussion_r398261109 ## File path: sql/core/src/test/resources/sql-tests/inputs/comments.sql

[GitHub] [spark] SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc

SparkQA commented on issue #28017: [MINOR][DOCS] Fix some links for python api doc URL: https://github.com/apache/spark/pull/28017#issuecomment-604190858 **[Test build #120384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/120384/testReport)** for PR

[GitHub] [spark] dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet

dbtsai commented on a change in pull request #27728: [SPARK-25556][SPARK-17636][SPARK-31026][SPARK-31060][SQL][test-hive1.2] Nested Column Predicate Pushdown for Parquet URL: https://github.com/apache/spark/pull/27728#discussion_r398280601 ## File path:

[GitHub] [spark] SparkQA commented on issue #28029: [SPARK-31261][SQL] Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified

SparkQA commented on issue #28029: [SPARK-31261][SQL] Avoid npe when reading bad csv input with `columnNameCorruptRecord` specified URL: https://github.com/apache/spark/pull/28029#issuecomment-604198014 **[Test build #120387 has

<    1   2   3   4   5   6   7   8   9   10   >