[GitHub] gengliangwang commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

gengliangwang commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456471405 Hi @dongjoon-hyun , I ran the orc test cases before pushing the code. After I push code, I find

[GitHub] AmplabJenkins commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456472044 Merged build finished. Test PASSed.

[GitHub] asfgit closed pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

asfgit closed pull request #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590 This is an automated message from the Apache Git

[GitHub] dongjoon-hyun commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

dongjoon-hyun commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456487194 I got it~ And, thanks for the fix, @gengliangwang .

[GitHub] rdblue commented on issue #23608: [SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for Hadoop.

rdblue commented on issue #23608: [SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for Hadoop. URL: https://github.com/apache/spark/pull/23608#issuecomment-456501215 Retest this please. This is an automated

[GitHub] SparkQA commented on issue #23156: [SPARK-24063][SS] Add maximum epoch queue threshold for ContinuousExecution

SparkQA commented on issue #23156: [SPARK-24063][SS] Add maximum epoch queue threshold for ContinuousExecution URL: https://github.com/apache/spark/pull/23156#issuecomment-456514110 **[Test build #101550 has

[GitHub] AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456445760 Merged build finished. Test PASSed. This is an

[GitHub] MaxGekk commented on a change in pull request #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds

MaxGekk commented on a change in pull request #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds URL: https://github.com/apache/spark/pull/23597#discussion_r249834562 ## File path:

[GitHub] SparkQA removed a comment on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths

SparkQA removed a comment on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths URL: https://github.com/apache/spark/pull/23613#issuecomment-456364716 **[Test build #101530 has

[GitHub] SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

SparkQA commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456474587 **[Test build #101538 has

[GitHub] AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins removed a comment on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456475112 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#issuecomment-456477050 Thanks! Merging to master and 2.4.

[GitHub] SparkQA commented on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

SparkQA commented on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456477180 **[Test build #101537 has

[GitHub] zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#issuecomment-456490434 @dongjoon-hyun Sure. This is a pretty safe change. I just pushed to branch-2.3.

[GitHub] srowen commented on issue #23607: [SPARK-26681][SQL] Support Ammonite inner-class scopes.

srowen commented on issue #23607: [SPARK-26681][SQL] Support Ammonite inner-class scopes. URL: https://github.com/apache/spark/pull/23607#issuecomment-456490800 It doesn't seem to hurt anything else, and if it makes a use case work, sure seems fine as-is.

[GitHub] dongjoon-hyun commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

dongjoon-hyun commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#issuecomment-456498089 Great! Thank you so much, @zsxwing .

[GitHub] AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456506111 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456506107 Merged build finished. Test PASSed. This is an automated

[GitHub] AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456506111 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456506107 Merged build finished. Test PASSed. This is an

[GitHub] asfgit closed pull request #23611: [SPARK-26685][K8S] Correct placement of ARG declaration

asfgit closed pull request #23611: [SPARK-26685][K8S] Correct placement of ARG declaration URL: https://github.com/apache/spark/pull/23611 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] vanzin commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache.

vanzin commented on a change in pull request #23525: [SPARK-26595][core] Allow credential renewal based on kerberos ticket cache. URL: https://github.com/apache/spark/pull/23525#discussion_r249916044 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala

[GitHub] SparkQA removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

SparkQA removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456512225 **[Test build #101549 has

[GitHub] AmplabJenkins removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

AmplabJenkins removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456523176 Build finished. Test FAILed.

[GitHub] AmplabJenkins removed a comment on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate

AmplabJenkins removed a comment on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate URL: https://github.com/apache/spark/pull/23617#issuecomment-456530495 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks

AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#issuecomment-456534714 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks

AmplabJenkins commented on issue #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#issuecomment-456534708 Merged build finished. Test PASSed. This is an automated message from the

[GitHub] SparkQA commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate

SparkQA commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate URL: https://github.com/apache/spark/pull/23617#issuecomment-456538039 **[Test build #101553 has

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456445767 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] MaxGekk commented on a change in pull request #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds

MaxGekk commented on a change in pull request #23597: [SPARK-26653][SQL] Use Proleptic Gregorian calendar in parsing JDBC lower/upper bounds URL: https://github.com/apache/spark/pull/23597#discussion_r249834969 ## File path:

[GitHub] AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

AmplabJenkins removed a comment on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456445760 Merged build finished. Test PASSed. This

[GitHub] AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456464310 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456464297 Merged build finished. Test PASSed.

[GitHub] SparkQA removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

SparkQA removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456388429 **[Test build #101537 has

[GitHub] AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#issuecomment-456485785 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

AmplabJenkins removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#issuecomment-456485792 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] AmplabJenkins commented on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

AmplabJenkins commented on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#issuecomment-456485792 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] asfgit closed pull request #22904: [SPARK-25887][K8S] Configurable K8S context support

asfgit closed pull request #22904: [SPARK-25887][K8S] Configurable K8S context support URL: https://github.com/apache/spark/pull/22904 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] BryanCutler commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame

BryanCutler commented on issue #22954: [WIP][SPARK-25981][R] Enables Arrow optimization from R DataFrame to Spark DataFrame URL: https://github.com/apache/spark/pull/22954#issuecomment-456521589 retest this please This is an

[GitHub] AmplabJenkins removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

AmplabJenkins removed a comment on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456523182 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456534303 Merged build finished. Test PASSed. This is an

[GitHub] AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456534303 Merged build finished. Test PASSed. This is an automated

[GitHub] AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins commented on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456534306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT

AmplabJenkins removed a comment on issue #23615: [MINOR][DOC] Documentation on JVM options for SBT URL: https://github.com/apache/spark/pull/23615#issuecomment-456534306 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23539: [SPARK-26617][SQL] Cache manager locks

SparkQA commented on issue #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#issuecomment-456534227 **[Test build #101552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101552/testReport)** for PR 23539 at

[GitHub] SparkQA commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths

SparkQA commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths URL: https://github.com/apache/spark/pull/23613#issuecomment-456450734 **[Test build #101530 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101530/testReport)**

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249838108 ## File path: docs/monitoring.md ## @@ -248,6 +248,27 @@

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249838692 ## File path: docs/monitoring.md ## @@ -248,6 +248,27 @@

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249831590 ## File path:

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249839165 ## File path: docs/running-on-yarn.md ## @@ -472,6 +472,36

[GitHub] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456458102 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456472053 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins commented on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456472053 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

AmplabJenkins removed a comment on issue #23601: [WIP][SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456472044 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456477979 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query

AmplabJenkins removed a comment on issue #23609: [SPARK-26379][SS] Fix issue on adding current_timestamp/current_date to streaming query URL: https://github.com/apache/spark/pull/23609#issuecomment-456477967 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins commented on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

AmplabJenkins commented on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#issuecomment-456485785 Merged build finished. Test PASSed.

[GitHub] SparkQA removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line

SparkQA removed a comment on issue #23276: [SPARK-26321][SQL] Improve the behavior of sql text splitting for the spark-sql command line URL: https://github.com/apache/spark/pull/23276#issuecomment-456385409 **[Test build #101536 has

[GitHub] huaxingao commented on issue #23592: [SPARK-16838][PYTHON]Add PMML export for ML KMeans in PySpark

huaxingao commented on issue #23592: [SPARK-16838][PYTHON]Add PMML export for ML KMeans in PySpark URL: https://github.com/apache/spark/pull/23592#issuecomment-456494224 Thanks! @srowen @felixcheung This is an automated

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456509174 Merged build finished. Test PASSed.

[GitHub] AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

AmplabJenkins removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456509182 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] BryanCutler commented on a change in pull request #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow

BryanCutler commented on a change in pull request #22807: [SPARK-25811][PySpark] Raise a proper error when unsafe cast is detected by PyArrow URL: https://github.com/apache/spark/pull/22807#discussion_r249913433 ## File path:

[GitHub] SparkQA commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

SparkQA commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456523126 **[Test build #101549 has

[GitHub] AmplabJenkins commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

AmplabJenkins commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456523182 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors

AmplabJenkins commented on issue #19433: [SPARK-3162] [MLlib] Add local tree training for decision tree regressors URL: https://github.com/apache/spark/pull/19433#issuecomment-456523176 Build finished. Test FAILed. This is

[GitHub] srowen commented on issue #23592: [SPARK-16838][PYTHON]Add PMML export for ML KMeans in PySpark

srowen commented on issue #23592: [SPARK-16838][PYTHON]Add PMML export for ML KMeans in PySpark URL: https://github.com/apache/spark/pull/23592#issuecomment-456443947 Merged to master This is an automated message from the

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249841142 ## File path:

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249824309 ## File path:

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249836436 ## File path:

[GitHub] squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS

squito commented on a change in pull request #23260: [SPARK-26311][CORE] New feature: apply custom log URL pattern for executor log URLs in SHS URL: https://github.com/apache/spark/pull/23260#discussion_r249827598 ## File path:

[GitHub] AmplabJenkins commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths

AmplabJenkins commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths URL: https://github.com/apache/spark/pull/23613#issuecomment-456451650 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths

AmplabJenkins commented on issue #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths URL: https://github.com/apache/spark/pull/23613#issuecomment-456451642 Merged build finished. Test PASSed. This is an

[GitHub] gaborgsomogyi commented on issue #17190: [SPARK-19478][SS] JDBC Sink

gaborgsomogyi commented on issue #17190: [SPARK-19478][SS] JDBC Sink URL: https://github.com/apache/spark/pull/17190#issuecomment-456456303 @HyukjinKwon or somebody can we just close this? Open for almost 2 years and here is the agreement with Micheal: > Micheal Armburst had indicated

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456475112 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins

AmplabJenkins commented on issue #23117: [WIP][SPARK-7721][INFRA] Run and generate test coverage report from Python via Jenkins URL: https://github.com/apache/spark/pull/23117#issuecomment-456475103 Merged build finished. Test FAILed.

[GitHub] SparkQA removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs

SparkQA removed a comment on issue #19788: [SPARK-9853][Core] Optimize shuffle fetch of contiguous partition IDs URL: https://github.com/apache/spark/pull/19788#issuecomment-456403275 **[Test build #101540 has

[GitHub] SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

SparkQA commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456529521 **[Test build #101546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/101546/testReport)** for PR

[GitHub] SparkQA commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate

SparkQA commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate URL: https://github.com/apache/spark/pull/23617#issuecomment-456529742 **[Test build #101544 has

[GitHub] squito commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate

squito commented on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate URL: https://github.com/apache/spark/pull/23617#issuecomment-456529763 aside from sean's comments, lgtm. Also cc @hvanhovell since you reviewed

[GitHub] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456529933 Merged build finished. Test FAILed. This is an automated message

[GitHub] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456529942 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] SparkQA commented on issue #23580: [SPARK-26660]Add warning logs when broadcasting large task binary

SparkQA commented on issue #23580: [SPARK-26660]Add warning logs when broadcasting large task binary URL: https://github.com/apache/spark/pull/23580#issuecomment-456532292 **[Test build #4525 has

[GitHub] AmplabJenkins removed a comment on issue #23539: [SPARK-26617][SQL] Cache manager locks

AmplabJenkins removed a comment on issue #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#issuecomment-456534708 Merged build finished. Test PASSed. This is an automated message

[GitHub] AmplabJenkins removed a comment on issue #23539: [SPARK-26617][SQL] Cache manager locks

AmplabJenkins removed a comment on issue #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#issuecomment-456534714 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] gaborgsomogyi commented on issue #23612: [SPARK-26686][SS] Remove unnecessary KafkaSourceProvider parameter lowercase conversion

gaborgsomogyi commented on issue #23612: [SPARK-26686][SS] Remove unnecessary KafkaSourceProvider parameter lowercase conversion URL: https://github.com/apache/spark/pull/23612#issuecomment-456449894 Either `DataSource` pass `caseInsensitiveOptions` as a parameter or

[GitHub] SparkQA commented on issue #23608: [SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for Hadoop.

SparkQA commented on issue #23608: [SPARK-26682][SQL] Use taskAttemptID instead of attemptNumber for Hadoop. URL: https://github.com/apache/spark/pull/23608#issuecomment-456502043 **[Test build #101548 has

[GitHub] vanzin commented on issue #23611: [SPARK-26685][K8S] Correct placement of ARG declaration

vanzin commented on issue #23611: [SPARK-26685][K8S] Correct placement of ARG declaration URL: https://github.com/apache/spark/pull/23611#issuecomment-456510593 Merging to master. This is an automated message from the Apache

[GitHub] vanzin commented on a change in pull request #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths

vanzin commented on a change in pull request #23613: [SPARK-26687][K8S] Fix handling of custom Dockerfile paths URL: https://github.com/apache/spark/pull/23613#discussion_r249912233 ## File path: bin/docker-image-tool.sh ## @@ -67,6 +67,16 @@ function docker_push { fi

[GitHub] AmplabJenkins removed a comment on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate

AmplabJenkins removed a comment on issue #23617: [SPARK-26680][SQL] Eagerly create inputVars while conditions are appropriate URL: https://github.com/apache/spark/pull/23617#issuecomment-456530489 Merged build finished. Test PASSed.

[GitHub] DaveDeCaprio commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks

DaveDeCaprio commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#discussion_r249932736 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ## @@ -160,34

[GitHub] DaveDeCaprio commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks

DaveDeCaprio commented on a change in pull request #23539: [SPARK-26617][SQL] Cache manager locks URL: https://github.com/apache/spark/pull/23539#discussion_r249932591 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/CacheManager.scala ## @@ -136,19

[GitHub] SparkQA commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise

SparkQA commented on issue #23566: [SPARK-26637][SQL] Makes GetArrayItem nullability more precise URL: https://github.com/apache/spark/pull/23566#issuecomment-456444933 **[Test build #101532 has

[GitHub] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456458087 Merged build finished. Test PASSed. This is an automated message

[GitHub] AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins commented on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456458102 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query

AmplabJenkins removed a comment on issue #23531: [SPARK-24497][SQL] Support recursive SQL query URL: https://github.com/apache/spark/pull/23531#issuecomment-456458087 Merged build finished. Test PASSed. This is an automated

[GitHub] AmplabJenkins removed a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#issuecomment-456468291 Merged build finished. Test PASSed.

[GitHub] SparkQA commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC

SparkQA commented on issue #23601: [SPARK-26673][SQL] File source V2 writes: create framework and migrate ORC URL: https://github.com/apache/spark/pull/23601#issuecomment-456469163 **[Test build #101547 has

[GitHub] AmplabJenkins removed a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

AmplabJenkins removed a comment on issue #20303: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/20303#issuecomment-456468300 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] rdblue commented on issue #23607: [SPARK-26681][SQL] Support Ammonite inner-class scopes.

rdblue commented on issue #23607: [SPARK-26681][SQL] Support Ammonite inner-class scopes. URL: https://github.com/apache/spark/pull/23607#issuecomment-456479722 Thanks for reviewing, @srowen! Do you need any changes before merging this?

[GitHub] zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever

zsxwing commented on issue #23590: [SPARK-26665][Core]Fix a bug that BlockTransferService.fetchBlockSync may hang forever URL: https://github.com/apache/spark/pull/23590#issuecomment-456483792 @dongjoon-hyun I think SPARK-22062 just moved codes. This is a long standing issue.

<    4   5   6   7   8   9   10   >