[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505312166 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505312175 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505312166 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505312175 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] SparkQA removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

SparkQA removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505280694 **[Test build #106863 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

SparkQA commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-505311546 **[Test build #106863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

AmplabJenkins removed a comment on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-505310036 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases

SparkQA commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases URL: https://github.com/apache/spark/pull/24949#issuecomment-505310850 **[Test build #106871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106871/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-505310752 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases

AmplabJenkins removed a comment on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases URL: https://github.com/apache/spark/pull/24949#issuecomment-505310247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berk

[GitHub] [spark] AmplabJenkins removed a comment on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases

AmplabJenkins removed a comment on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases URL: https://github.com/apache/spark/pull/24949#issuecomment-505310237 Merged build finished. Test PASSed. This is an auto

[GitHub] [spark] AmplabJenkins commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases

AmplabJenkins commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases URL: https://github.com/apache/spark/pull/24949#issuecomment-505310247 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases

AmplabJenkins commented on issue #24949: [SPARK-28002][SQL][FOLLOWUP] Add more WITH test cases URL: https://github.com/apache/spark/pull/24949#issuecomment-505310237 Merged build finished. Test PASSed. This is an automated me

[GitHub] [spark] AmplabJenkins removed a comment on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

AmplabJenkins removed a comment on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-505309877 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-505310036 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

AmplabJenkins commented on issue #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962#issuecomment-505309877 Can one of the admins verify this patch?

[GitHub] [spark] jlpedrosa opened a new pull request #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching

jlpedrosa opened a new pull request #24962: [SPARK-28149][Kubernetes] Added variable to disable negative DNS caching URL: https://github.com/apache/spark/pull/24962 ## What changes were proposed in this pull request? This PR makes possible disable the negative dns caching in JVM by addin

[GitHub] [spark] AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505307774 Test FAILed. Refer to this link for build results (acces

[GitHub] [spark] AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505307767 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505307767 Merged build finished. Test FAILed. --

[GitHub] [spark] AmplabJenkins commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

AmplabJenkins commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505307774 Test FAILed. Refer to this link for build results (access rights

[GitHub] [spark] SparkQA removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

SparkQA removed a comment on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505280670 **[Test build #106862 has started](https://amplab.cs.berkeley.ed

[GitHub] [spark] SparkQA commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF)

SparkQA commented on issue #24958: [SPARK-28153][PYTHON] Use AtomicReference at InputFileBlockHolder (to support input_file_name with Python UDF) URL: https://github.com/apache/spark/pull/24958#issuecomment-505307452 **[Test build #106862 has finished](https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins removed a comment on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

AmplabJenkins removed a comment on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-505305076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.ed

[GitHub] [spark] AmplabJenkins removed a comment on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

AmplabJenkins removed a comment on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-505305067 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

AmplabJenkins commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-505305076 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkin

[GitHub] [spark] AmplabJenkins commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

AmplabJenkins commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-505305067 Merged build finished. Test PASSed. This is an automated message f

[GitHub] [spark] SparkQA commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

SparkQA commented on issue #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961#issuecomment-505303364 **[Test build #106870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106870/testReport)** for PR 24961

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505302976 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505302966 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505302966 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505302976 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] uncleGen opened a new pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type

uncleGen opened a new pull request #24961: [SPARK-28158][SQL] Hive UDFs supports UDT type URL: https://github.com/apache/spark/pull/24961 ## What changes were proposed in this pull request? After this PR, we can create and register Hive UDFs to accept UDT type, like `VectorUDT` and

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505302317 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

SparkQA removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505262329 **[Test build #106856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequest

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505302317 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505302385 **[Test build #106856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder

[GitHub] [spark] AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505302325 Test PASSed. Refer to this link for build results (acce

[GitHub] [spark] AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

AmplabJenkins commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505302325 Test PASSed. Refer to this link for build results (access right

[GitHub] [spark] SparkQA removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

SparkQA removed a comment on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505262326 **[Test build #106857 has started](https://amplab.cs.berkeley.e

[GitHub] [spark] SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs)

SparkQA commented on issue #24946: [SPARK-27234][SS][PYTHON] Use InheritableThreadLocal for current epoch in EpochTracker (to support Python UDFs) URL: https://github.com/apache/spark/pull/24946#issuecomment-505301796 **[Test build #106857 has finished](https://amplab.cs.berkeley.edu/jenk

[GitHub] [spark] dongjoon-hyun closed pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

dongjoon-hyun closed pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959 This is an automated message from the Apache Git Service. T

[GitHub] [spark] itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on a change in pull request #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#discussion_r297017724 ## File path: core/src/main/java/org/apache/spark/io/FileUtility.java ## @@ -0,0 +1,101

[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505293839 FYI: Just think out loud since I'm being cc-ed first, I'm just a one of contributors, not committers or PMC members of Apach

[GitHub] [spark] HyukjinKwon removed a comment on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

HyukjinKwon removed a comment on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505292669 oops. +1 This is an automated m

[GitHub] [spark] AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293280 Test PASSed. Refer to this link for build results (access r

[GitHub] [spark] AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293277 Merged build finished. Test PASSed. -

[GitHub] [spark] SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

SparkQA commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505293137 **[Test build #106868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106868/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292650 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins removed a comment on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292655 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun commented on a change in pull request #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#discussion_r297015054 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasou

[GitHub] [spark] AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293280 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

AmplabJenkins commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505293277 Merged build finished. Test PASSed. --

[GitHub] [spark] SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

SparkQA commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505293121 **[Test build #106869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106869/testReport)** for

[GitHub] [spark] itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

itsvikramagr commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292778 Thanks, @HeartSaVioR. I understand it a very big change. As suggested let me create a stress test suite and paste some benc

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292682 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] SparkQA removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

SparkQA removed a comment on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505257156 **[Test build #106855 has started](https://amplab.cs.berkeley.edu/je

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292685 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292640 Test PASSed. Refer to this link for build results (access rights to CI server needed): h

[GitHub] [spark] AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins removed a comment on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292639 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292655 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.

[GitHub] [spark] AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292639 Merged build finished. Test PASSed. Th

[GitHub] [spark] AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view

AmplabJenkins commented on issue #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960#issuecomment-505292650 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292685 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] HyukjinKwon commented on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to…

HyukjinKwon commented on issue #24957: [SPARK-27100][SQL][2.4] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505292669 oops. +1 This is an automated message f

[GitHub] [spark] SparkQA commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted

SparkQA commented on issue #24186: [SPARK-27254][SS] Cleanup complete but invalid output files in ManifestFileCommitProtocol if job is aborted URL: https://github.com/apache/spark/pull/24186#issuecomment-505292700 **[Test build #106855 has finished](https://amplab.cs.berkeley.edu/jenkins/j

[GitHub] [spark] AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

AmplabJenkins commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505292640 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://a

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505292682 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] viirya opened a new pull request #24960: [SPARK-28156][SQL] Self-join should not miss cached view

viirya opened a new pull request #24960: [SPARK-28156][SQL] Self-join should not miss cached view URL: https://github.com/apache/spark/pull/24960 ## What changes were proposed in this pull request? The issue is when self-join a cached view, only one side of join uses cached relation

[GitHub] [spark] dongjoon-hyun edited a comment on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun edited a comment on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505291686 This is a backport of 5a7aa6f4df . :) --

[GitHub] [spark] dongjoon-hyun commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to…

dongjoon-hyun commented on issue #24957: [SPARK-27100][SQL] Use `Array` instead of `Seq` in `FilePartition` to… URL: https://github.com/apache/spark/pull/24957#issuecomment-505291686 This is a backport of 5a7aa6f4df . This is

[GitHub] [spark] SparkQA commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

SparkQA commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505291416 **[Test build #106867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106867/

[GitHub] [spark] dongjoon-hyun opened a new pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

dongjoon-hyun opened a new pull request #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959 ## What changes were proposed in this pull request? At Spark 2.4.0/2.3.2/2.2.3, [SPARK-24948](https://issues.apa

[GitHub] [spark] dongjoon-hyun commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes

dongjoon-hyun commented on issue #24959: [SPARK-28157][CORE] Make SHS check Spark event log file permission changes URL: https://github.com/apache/spark/pull/24959#issuecomment-505291329 cc @dbtsai This is an automated messa

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290938 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290943 Test PASSed. Refer to this link for build results (access rights to CI server n

[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505291092 And please take a deep look at build result if it fails, and try to fix if build failure is related to your patch. In some c

[GitHub] [spark] AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290938 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

AmplabJenkins removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290943 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA commented on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505290475 **[Test build #106854 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs

SparkQA removed a comment on issue #24735: [SPARK-27871][SQL] LambdaVariable should use per-query unique IDs instead of globally unique IDs URL: https://github.com/apache/spark/pull/24735#issuecomment-505251808 **[Test build #106854 has started](https://amplab.cs.berkeley.edu/jenkins/job/S

[GitHub] [spark] HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

HeartSaVioR commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505290444 Thanks for the hard work, @itsvikramagr ! I agree keeping state in memory is not scalable, and the result looks promi

[GitHub] [spark] SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

SparkQA commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289667 **[Test build #106866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289144 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins removed a comment on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289140 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289140 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception

AmplabJenkins commented on issue #24947: [SPARK-28143][SQL]IN expression missing attribute should throw analysis exception URL: https://github.com/apache/spark/pull/24947#issuecomment-505289144 Test PASSed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297010198 ## File path: core/src/main/scala/org/apache/spark/storage/Dis

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297009804 ## File path: core/src/main/scala/org/apache/spark/storage/Blo

[GitHub] [spark] AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286942 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286942 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286937 Merged build finished. Test PASSed. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

AmplabJenkins removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286937 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

SparkQA removed a comment on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505262327 **[Test build #106858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10685

[GitHub] [spark] cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

cloud-fan commented on a change in pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#discussion_r297009308 ## File path: core/src/main/scala/org/apache/spark/network/Bl

[GitHub] [spark] SparkQA commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up

SparkQA commented on issue #24841: [SPARK-27369][CORE] Setup resources when Standalone Worker starts up URL: https://github.com/apache/spark/pull/24841#issuecomment-505286519 **[Test build #106858 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106858/testR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.be

[GitHub] [spark] AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins removed a comment on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285966 Merged build finished. Test PASSed. This is an au

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285970 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.e

[GitHub] [spark] AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation

AmplabJenkins commented on issue #24922: [SPARK-28120][SS] Rocksdb state storage implementation URL: https://github.com/apache/spark/pull/24922#issuecomment-505285966 Merged build finished. Test PASSed. This is an automated

  1   2   3   4   5   6   7   8   9   >