[GitHub] [spark] maropu commented on issue #26646: [SPARK-30005][INFRA] Update `test-dependencies.sh` to check `hive-1.2/2.3` profile

2019-12-02 Thread GitBox
maropu commented on issue #26646: [SPARK-30005][INFRA] Update `test-dependencies.sh` to check `hive-1.2/2.3` profile URL: https://github.com/apache/spark/pull/26646#issuecomment-560913408 Ur, I missed ping... sorry. late LGTM.

[GitHub] [spark] shaneknapp commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2019-12-02 Thread GitBox
shaneknapp commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-560935416 test this please This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941479 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
viirya commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#discussion_r352929865 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941487 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
viirya commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#discussion_r352937085 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-560970551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-560970548 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560970608 **[Test build #114744 has

[GitHub] [spark] AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-560970551 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-560970548 Merged build finished. Test PASSed. This is an

[GitHub] [spark] beliefer commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-02 Thread GitBox
beliefer commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-560980301 @maropu I have uncomment this tests. This

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-560980070 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-560980066 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26656: [SPARK-27986][SQL] Support ANSI SQL filter clause for aggregate expression URL: https://github.com/apache/spark/pull/26656#issuecomment-560980070 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs

2019-12-02 Thread GitBox
dongjoon-hyun commented on issue #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs URL: https://github.com/apache/spark/pull/26738#issuecomment-560998290 ok to test This is an automated message from the

[GitHub] [spark] SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
SparkQA commented on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-561007606 **[Test build #114754 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#issuecomment-561012407 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#issuecomment-561012558 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#issuecomment-561012567 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] SparkQA removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
SparkQA removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-560970222 **[Test build #114750 has

[GitHub] [spark] SparkQA commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
SparkQA commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-561020469 **[Test build #114750 has

[GitHub] [spark] AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-561020937 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-561020932 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-561020937 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26702: [SPARK-30070][SQL] Support ANSI datetimes predicate - overlaps URL: https://github.com/apache/spark/pull/26702#issuecomment-561020932 Merged build finished. Test PASSed. This is an

[GitHub] [spark] cloud-fan commented on a change in pull request #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs

2019-12-02 Thread GitBox
cloud-fan commented on a change in pull request #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs URL: https://github.com/apache/spark/pull/26738#discussion_r353008601 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala

[GitHub] [spark] AmplabJenkins commented on issue #26743: Merge pull request #1 from apache/master

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26743: Merge pull request #1 from apache/master URL: https://github.com/apache/spark/pull/26743#issuecomment-561038024 Can one of the admins verify this patch? This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #26743: Merge pull request #1 from apache/master

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26743: Merge pull request #1 from apache/master URL: https://github.com/apache/spark/pull/26743#issuecomment-561038373 Can one of the admins verify this patch? This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #26743: Merge pull request #1 from apache/master

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26743: Merge pull request #1 from apache/master URL: https://github.com/apache/spark/pull/26743#issuecomment-561038024 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352924644 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352921897 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352921638 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352922130 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352921779 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HeartSaVioR commented on a change in pull request #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#discussion_r352923244 ## File path:

[GitHub] [spark] SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941140 **[Test build #114745 has

[GitHub] [spark] SparkQA commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
SparkQA commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560951969 **[Test build #114748 has

[GitHub] [spark] AmplabJenkins commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#issuecomment-560963525 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#issuecomment-560963532 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
SparkQA commented on issue #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#issuecomment-560963260 **[Test build #114749 has

[GitHub] [spark] deshanxiao commented on issue #26714: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug

2019-12-02 Thread GitBox
deshanxiao commented on issue #26714: [SPARK-25100][CORE] Fix no registering TaskCommitMessage bug URL: https://github.com/apache/spark/pull/26714#issuecomment-560966136 Thanks @HeartSaVioR for so nice suggestions. This is

[GitHub] [spark] AmplabJenkins removed a comment on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-560971490 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-560971486 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-560971490 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation.

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26586: [SPARK-29950][k8s] Blacklist deleted executors in K8S with dynamic allocation. URL: https://github.com/apache/spark/pull/26586#issuecomment-560971486 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975134 **[Test build #114751 has

[GitHub] [spark] SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
SparkQA commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560979440 **[Test build #114745 has

[GitHub] [spark] SparkQA removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
SparkQA removed a comment on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941140 **[Test build #114745 has

[GitHub] [spark] SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560980606 **[Test build #114741 has

[GitHub] [spark] AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560980989 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560980989 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560980992 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560980992 Test PASSed. Refer to this link for build results

[GitHub] [spark] SparkQA removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
SparkQA removed a comment on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560904940 **[Test build #114741 has

[GitHub] [spark] dongjoon-hyun commented on issue #26742: [SPARK-30051][BUILD] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
dongjoon-hyun commented on issue #26742: [SPARK-30051][BUILD] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560993217 Hi, @srowen and @HyukjinKwon . Could you review this PR?

[GitHub] [spark] SparkQA removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
SparkQA removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975134 **[Test build #114751 has

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-561004374 **[Test build #114751 has

[GitHub] [spark] cloud-fan commented on a change in pull request #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking

2019-12-02 Thread GitBox
cloud-fan commented on a change in pull request #26716: [SPARK-30083][SQL] visitArithmeticUnary should wrap PLUS case with UnaryPositive for type checking URL: https://github.com/apache/spark/pull/26716#discussion_r35386 ## File path:

[GitHub] [spark] cloud-fan commented on issue #26696: [WIP][SPARK-18886][CORE] Only reset scheduling delay timer if allocated slots are fully utilized

2019-12-02 Thread GitBox
cloud-fan commented on issue #26696: [WIP][SPARK-18886][CORE] Only reset scheduling delay timer if allocated slots are fully utilized URL: https://github.com/apache/spark/pull/26696#issuecomment-561039532 Sufficient discussions are needed for this problem. AFAIK, the issue of delay

[GitHub] [spark] AndrewKL commented on issue #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
AndrewKL commented on issue #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#issuecomment-560939075 > * I read through the JIRA issue and see VACUUM is being supported for some systems. But

[GitHub] [spark] SparkQA commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries

2019-12-02 Thread GitBox
SparkQA commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-560939068 **[Test build #114738 has

[GitHub] [spark] SparkQA removed a comment on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries

2019-12-02 Thread GitBox
SparkQA removed a comment on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-560709548 **[Test build #114738 has

[GitHub] [spark] SparkQA commented on issue #26742: [SPARK-30051][BUILD] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
SparkQA commented on issue #26742: [SPARK-30051][BUILD] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560939153 **[Test build #114744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/114744/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-560939285 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26127: [SPARK-29348][SQL] Add observable Metrics for Streaming queries URL: https://github.com/apache/spark/pull/26127#issuecomment-560939282 Build finished. Test FAILed. This is an

[GitHub] [spark] HyukjinKwon commented on issue #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table

2019-12-02 Thread GitBox
HyukjinKwon commented on issue #26740: [SPARK-30053][SQL] Add the ability for v2 datasource so specify a vacuum action on the table URL: https://github.com/apache/spark/pull/26740#issuecomment-560952931 I copied and pasted the references mentioned in the JIRA into this PR description.

[GitHub] [spark] zhengruifeng closed pull request #26679: [SPARK-30044][ML] MNB/CNB/BNB use empty sigma matrix instead of null

2019-12-02 Thread GitBox
zhengruifeng closed pull request #26679: [SPARK-30044][ML] MNB/CNB/BNB use empty sigma matrix instead of null URL: https://github.com/apache/spark/pull/26679 This is an automated message from the Apache Git Service. To

[GitHub] [spark] zhengruifeng commented on issue #26679: [SPARK-30044][ML] MNB/CNB/BNB use empty sigma matrix instead of null

2019-12-02 Thread GitBox
zhengruifeng commented on issue #26679: [SPARK-30044][ML] MNB/CNB/BNB use empty sigma matrix instead of null URL: https://github.com/apache/spark/pull/26679#issuecomment-560964613 Merged to master, thanks @srowen for reviewing!

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975441 Merged build finished. Test PASSed.

[GitHub] [spark] yaooqinn commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
yaooqinn commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#discussion_r352963519 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975447 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975441 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-560975447 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp'

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp' URL: https://github.com/apache/spark/pull/26741#issuecomment-560981738 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp'

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp' URL: https://github.com/apache/spark/pull/26741#issuecomment-560981735 Merged build finished. Test PASSed. This is an

[GitHub] [spark] imback82 commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp'

2019-12-02 Thread GitBox
imback82 commented on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp' URL: https://github.com/apache/spark/pull/26741#issuecomment-560981986 cc: @cloud-fan This is an automated message from the

[GitHub] [spark] AmplabJenkins removed a comment on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp'

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp' URL: https://github.com/apache/spark/pull/26741#issuecomment-560981738 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp'

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26741: [SPARK-30104][SQL] Fix catalog resolution for 'global_temp' URL: https://github.com/apache/spark/pull/26741#issuecomment-560981735 Merged build finished. Test PASSed. This is

[GitHub] [spark] zhengruifeng edited a comment on issue #26735: [SPARK-30102][ML][PYSPARK] GMM supports instance weighting

2019-12-02 Thread GitBox
zhengruifeng edited a comment on issue #26735: [SPARK-30102][ML][PYSPARK] GMM supports instance weighting URL: https://github.com/apache/spark/pull/26735#issuecomment-560981773 There seems something wrong in the py doctests. 1, I manually test some scala cases/examples between 2.4.4 and

[GitHub] [spark] zhengruifeng commented on issue #26735: [SPARK-30102][ML][PYSPARK] GMM supports instance weighting

2019-12-02 Thread GitBox
zhengruifeng commented on issue #26735: [SPARK-30102][ML][PYSPARK] GMM supports instance weighting URL: https://github.com/apache/spark/pull/26735#issuecomment-560981773 There seems something wrong in the py doctests. 1, I manually test some scala cases/examples between 2.4.4 and this

[GitHub] [spark] dongjoon-hyun commented on issue #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs

2019-12-02 Thread GitBox
dongjoon-hyun commented on issue #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs URL: https://github.com/apache/spark/pull/26738#issuecomment-560995938 Thank you for pinging me, @mccheah . Sure. This is

[GitHub] [spark] gengliangwang commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
gengliangwang commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#discussion_r352993670 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
cloud-fan commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#discussion_r352998814 ## File path:

[GitHub] [spark] cloud-fan commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres

2019-12-02 Thread GitBox
cloud-fan commented on a change in pull request #26412: [SPARK-29774][SQL] Date and Timestamp type +/- null should be null as Postgres URL: https://github.com/apache/spark/pull/26412#discussion_r352998689 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs

2019-12-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #26738: [SPARK-30082][SQL] Do not replace Zeros when replacing NaNs URL: https://github.com/apache/spark/pull/26738#discussion_r353013375 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFrameNaFunctions.scala

[GitHub] [spark] yakoterry opened a new pull request #26743: Merge pull request #1 from apache/master

2019-12-02 Thread GitBox
yakoterry opened a new pull request #26743: Merge pull request #1 from apache/master URL: https://github.com/apache/spark/pull/26743 merge with pull request ### What changes were proposed in this pull request? ### Why are the changes needed? ###

[GitHub] [spark] SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink

2019-12-02 Thread GitBox
SparkQA commented on issue #26590: [SPARK-29953][SS] Don't clean up source files for FileStreamSource if the files belong to the output of FileStreamSink URL: https://github.com/apache/spark/pull/26590#issuecomment-560921097 **[Test build #114742 has

[GitHub] [spark] AmplabJenkins commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941487 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26742: [SPARK-30051][BUILD][test-hadoop3.2] Clean up hadoop-3.2 dependency URL: https://github.com/apache/spark/pull/26742#issuecomment-560941479 Merged build finished. Test PASSed. This is

[GitHub] [spark] dongjoon-hyun commented on issue #26713: [SPARK-30079][BUILD] set locale en_US in pom.xml for tests

2019-12-02 Thread GitBox
dongjoon-hyun commented on issue #26713: [SPARK-30079][BUILD] set locale en_US in pom.xml for tests URL: https://github.com/apache/spark/pull/26713#issuecomment-560945492 +1 for @srowen 's advice. We should not force to use `en_US` as a default locale.

[GitHub] [spark] srowen commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
srowen commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#discussion_r352933894 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
srowen commented on a change in pull request #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#discussion_r352933894 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560950401 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables.

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables. URL: https://github.com/apache/spark/pull/26684#issuecomment-560950466 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
AmplabJenkins removed a comment on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560950407 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560950407 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables.

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables. URL: https://github.com/apache/spark/pull/26684#issuecomment-560950474 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables.

2019-12-02 Thread GitBox
SparkQA commented on issue #26684: [SPARK-30001][SQL] ResolveRelations should handle both V1 and V2 tables. URL: https://github.com/apache/spark/pull/26684#issuecomment-560950068 **[Test build #114747 has

[GitHub] [spark] AmplabJenkins commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large

2019-12-02 Thread GitBox
AmplabJenkins commented on issue #26722: [SPARK-24666][ML] Fix infinity vectors produced by Word2Vec when numIterations are large URL: https://github.com/apache/spark/pull/26722#issuecomment-560950401 Merged build finished. Test PASSed.

  1   2   3   4   5   6   7   8   >