[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504868153 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504868153 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504868148 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504868148 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

SparkQA removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504846120 **[Test build #106816 has

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504867749 **[Test build #106816 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504864269 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504864266 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

SparkQA removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504842632 **[Test build #106815 has

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504864266 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504864269 Test FAILed. Refer to this link for build results (access

[GitHub] [spark] SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504864108 **[Test build #106815 has

[GitHub] [spark] cloud-fan commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog

cloud-fan commented on issue #24768: [SPARK-27919][SQL] Add v2 session catalog URL: https://github.com/apache/spark/pull/24768#issuecomment-504859851 > After this PR, the default catalog -- if set -- it is responsible for all table names without an explicit catalog. I'm OK with it

[GitHub] [spark] Tonix517 commented on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions

Tonix517 commented on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions URL: https://github.com/apache/spark/pull/24940#issuecomment-504857965 Thanks for the input @attilapiros, but isn't overflow a problem in this case? Or should spark SQL behavior be

[GitHub] [spark] HyukjinKwon edited a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

HyukjinKwon edited a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-504842157 There's similar case that uses `InheritableThreadLocal`,

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-504856653 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-504856651 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-504856653 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-504856651 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-504855738 **[Test build #106818 has

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296550104 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296550393 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296550282 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors

HyukjinKwon commented on issue #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors URL: https://github.com/apache/spark/pull/24834#issuecomment-504855018 cc @vanzin and @squito as well.

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296550104 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549829 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549512 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #22424: [SPARK-25303][STREAMING] For checkpointed DStreams, remove the parent…

AmplabJenkins commented on issue #22424: [SPARK-25303][STREAMING] For checkpointed DStreams, remove the parent… URL: https://github.com/apache/spark/pull/22424#issuecomment-504854189 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors

HyukjinKwon commented on issue #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors URL: https://github.com/apache/spark/pull/24834#issuecomment-504854245 > I wasn't able to checkout doing a similar approach for R collection with Arrow. @HyukjinKwon

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors

HyukjinKwon commented on a change in pull request #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors URL: https://github.com/apache/spark/pull/24834#discussion_r296549441 ## File path: python/pyspark/rdd.py ## @@ -140,14 +140,29 @@

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549177 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549124 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549148 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r296549087 ## File path:

[GitHub] [spark] cloud-fan closed pull request #24910: [SPARK-28108][SQL][test-hadoop3.2] Simplify OrcFilters

cloud-fan closed pull request #24910: [SPARK-28108][SQL][test-hadoop3.2] Simplify OrcFilters URL: https://github.com/apache/spark/pull/24910 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] cloud-fan commented on issue #24910: [SPARK-28108][SQL][test-hadoop3.2] Simplify OrcFilters

cloud-fan commented on issue #24910: [SPARK-28108][SQL][test-hadoop3.2] Simplify OrcFilters URL: https://github.com/apache/spark/pull/24910#issuecomment-504852120 thanks, merging to master! This is an automated message from

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-504851635 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-504851639 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-504851635 Merged build finished. Test PASSed.

[GitHub] [spark] jaewanbahk closed pull request #24941: Merge asof join skeleton

jaewanbahk closed pull request #24941: Merge asof join skeleton URL: https://github.com/apache/spark/pull/24941 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-504851639 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] icexelloss commented on issue #24941: Merge asof join skeleton

icexelloss commented on issue #24941: Merge asof join skeleton URL: https://github.com/apache/spark/pull/24941#issuecomment-504851118 @jaewanbahk Let's not create PR against Master. Please close this one and create one against your fork.

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-504850736 **[Test build #106817 has

[GitHub] [spark] ueshin commented on a change in pull request #24918: [SPARK-28077][SQL] Support ANSI SQL OVERLAY function.

ueshin commented on a change in pull request #24918: [SPARK-28077][SQL] Support ANSI SQL OVERLAY function. URL: https://github.com/apache/spark/pull/24918#discussion_r296543693 ## File path:

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors

HyukjinKwon commented on a change in pull request #24834: [SPARK-27992][PYTHON] Synchronize with Python connection thread to propagate errors URL: https://github.com/apache/spark/pull/24834#discussion_r296546084 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504845830 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504846120 **[Test build #106816 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins removed a comment on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504845827 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

HyukjinKwon commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504845962 I'm +1 on that

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504845830 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

AmplabJenkins commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-504845827 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

HyukjinKwon commented on a change in pull request #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#discussion_r296541958 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842331 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842335 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842632 **[Test build #106815 has

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842335 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842331 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504842157 There's similar case for `input_file_name()` too. cc @cloud-fan as well.

[GitHub] [spark] HyukjinKwon edited a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

HyukjinKwon edited a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504841715 cc @WeichenXu123, @mengxr, @tdas, @zsxwing, @HeartSaVioR

[GitHub] [spark] HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504841715 cc @WeichenXu123, @mengxr, @tdas, @zsxwing

[GitHub] [spark] HyukjinKwon commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

HyukjinKwon commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841779 cc @viirya, @dongjoon-hyun, @BryanCutler

[GitHub] [spark] AmplabJenkins removed a comment on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

AmplabJenkins removed a comment on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841139 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

AmplabJenkins removed a comment on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841141 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

HyukjinKwon commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946#issuecomment-504841543 Actual fix is

[GitHub] [spark] HyukjinKwon opened a new pull request #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker

HyukjinKwon opened a new pull request #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker URL: https://github.com/apache/spark/pull/24946 ## What changes were proposed in this pull request? This PR proposes to use `InheritableThreadLocal`

[GitHub] [spark] SparkQA commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

SparkQA commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841420 **[Test build #106814 has

[GitHub] [spark] AmplabJenkins commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

AmplabJenkins commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841141 Test PASSed. Refer to this link for build results (access rights

[GitHub] [spark] AmplabJenkins commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

AmplabJenkins commented on issue #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945#issuecomment-504841139 Merged build finished. Test PASSed.

[GitHub] [spark] HyukjinKwon opened a new pull request #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base

HyukjinKwon opened a new pull request #24945: [SPARK-27893][SQL][PYTHON][FOLLOW-UP] Allow Scalar Pandas and Python UDFs can be tested with Scala test base URL: https://github.com/apache/spark/pull/24945 ## What changes were proposed in this pull request? After this PR, we can test

[GitHub] [spark] SparkQA removed a comment on issue #24702: [SPARK-27989] [Core] Added retries on the connection to the driver for k8s

SparkQA removed a comment on issue #24702: [SPARK-27989] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#issuecomment-504801825 **[Test build #4803 has

[GitHub] [spark] SparkQA commented on issue #24702: [SPARK-27989] [Core] Added retries on the connection to the driver for k8s

SparkQA commented on issue #24702: [SPARK-27989] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#issuecomment-504838195 **[Test build #4803 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins removed a comment on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944#issuecomment-504836665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins removed a comment on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944#issuecomment-504836668 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

SparkQA commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944#issuecomment-504836961 **[Test build #106813 has

[GitHub] [spark] AmplabJenkins commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944#issuecomment-504836668 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins commented on issue #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944#issuecomment-504836665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins removed a comment on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504835550 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins removed a comment on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504835546 Merged build finished. Test PASSed.

[GitHub] [spark] wangyum opened a new pull request #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue"

wangyum opened a new pull request #24944: Revert "[SPARK-28093][SPARK-28109][SQL][2.3] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24944 ## What changes were proposed in this pull request? This reverts commit 1201a0a7. The

[GitHub] [spark] SparkQA commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

SparkQA commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504835826 **[Test build #106812 has

[GitHub] [spark] AmplabJenkins commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504835546 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

AmplabJenkins commented on issue #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943#issuecomment-504835550 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] wangyum opened a new pull request #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue"

wangyum opened a new pull request #24943: Revert "[SPARK-28093][SPARK-28109][SQL][2.4] Fix TRIM/LTRIM/RTRIM function parameter order issue" URL: https://github.com/apache/spark/pull/24943 ## What changes were proposed in this pull request? This reverts commit 4990be9. The

[GitHub] [spark] Tonix517 edited a comment on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions

Tonix517 edited a comment on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions URL: https://github.com/apache/spark/pull/24940#issuecomment-504812198 The ceil and floor of both Java and Scala work on doubles:

[GitHub] [spark] Tonix517 commented on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions

Tonix517 commented on issue #24940: [SPARK-28135] Better double support in SQL ceil/floor functions URL: https://github.com/apache/spark/pull/24940#issuecomment-504812198 The ceil and floor of both Java and Scala work on doubles:

[GitHub] [spark] viirya commented on issue #24886: [SPARK-28054][SQL] Fix error when insert Hive partitioned table dynamically where partition name is upper case

viirya commented on issue #24886: [SPARK-28054][SQL] Fix error when insert Hive partitioned table dynamically where partition name is upper case URL: https://github.com/apache/spark/pull/24886#issuecomment-504807877 Thanks @HyukjinKwon @cloud-fan

[GitHub] [spark] srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions

srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#discussion_r296508768 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RFormula.scala

[GitHub] [spark] srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions

srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#discussion_r296508970 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RFormulaParser.scala

[GitHub] [spark] srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions

srowen commented on a change in pull request #24939: [SPARK-18569][ML][R]Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#discussion_r296508859 ## File path: mllib/src/main/scala/org/apache/spark/ml/feature/RFormula.scala

[GitHub] [spark] SparkQA removed a comment on issue #24920: [SPARK-28117][ML] LDA and BisectingKMeans cache the input dataset if necessary

SparkQA removed a comment on issue #24920: [SPARK-28117][ML] LDA and BisectingKMeans cache the input dataset if necessary URL: https://github.com/apache/spark/pull/24920#issuecomment-504802735 **[Test build #4804 has

[GitHub] [spark] SparkQA commented on issue #24920: [SPARK-28117][ML] LDA and BisectingKMeans cache the input dataset if necessary

SparkQA commented on issue #24920: [SPARK-28117][ML] LDA and BisectingKMeans cache the input dataset if necessary URL: https://github.com/apache/spark/pull/24920#issuecomment-504805899 **[Test build #4804 has

[GitHub] [spark] HeartSaVioR commented on issue #24942: [SPARK-28142][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

HeartSaVioR commented on issue #24942: [SPARK-28142][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504805841 Sure, just filed SPARK-28142 and changed the title. Thanks!

[GitHub] [spark] HyukjinKwon closed pull request #24927: [SPARK-28130][PYTHON] Print pretty messages for skipped tests when xmlrunner is available in PySpark

HyukjinKwon closed pull request #24927: [SPARK-28130][PYTHON] Print pretty messages for skipped tests when xmlrunner is available in PySpark URL: https://github.com/apache/spark/pull/24927 This is an automated message from

[GitHub] [spark] HyukjinKwon commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

HyukjinKwon commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504805001 Actually, @HeartSaVioR, can we file a JIRA since it fixes an actual bug?

[GitHub] [spark] HyukjinKwon commented on issue #24927: [SPARK-28130][PYTHON] Print pretty messages for skipped tests when xmlrunner is available in PySpark

HyukjinKwon commented on issue #24927: [SPARK-28130][PYTHON] Print pretty messages for skipped tests when xmlrunner is available in PySpark URL: https://github.com/apache/spark/pull/24927#issuecomment-504804918 I'm pretty confident of this change since it doesn't break anything and just

[GitHub] [spark] AmplabJenkins removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

AmplabJenkins removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504804622 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

AmplabJenkins commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504804624 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

SparkQA removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504802272 **[Test build #106811 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

AmplabJenkins removed a comment on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504804624 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream

AmplabJenkins commented on issue #24942: [MINOR][SS] Use CaseInsensitiveStringMap for KafkaContinuousStream URL: https://github.com/apache/spark/pull/24942#issuecomment-504804622 Merged build finished. Test PASSed. This is

  1   2   3   4   >