[GitHub] [spark] AmplabJenkins removed a comment on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-532896514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-532896452 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-532896452 Merged build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-532896509 Build finished. Test PASSed. Thi

[GitHub] [spark] AmplabJenkins commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-532896514 Test PASSed. Refer to this link for build results (access rights to CI server needed): htt

[GitHub] [spark] AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-532896459 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://am

[GitHub] [spark] SparkQA commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
SparkQA commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-532896210 **[Test build #110943 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-18 Thread GitBox
SparkQA commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-532896176 **[Test build #110944 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110944/t

[GitHub] [spark] rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables

2019-09-18 Thread GitBox
rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables URL: https://github.com/apache/spark/pull/25833#discussion_r325924735 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execu

[GitHub] [spark] HyukjinKwon commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions

2019-09-18 Thread GitBox
HyukjinKwon commented on issue #24939: [SPARK-18569][ML][R] Support RFormula arithmetic, I() and spark functions URL: https://github.com/apache/spark/pull/24939#issuecomment-532895522 retest this please This is an automated m

[GitHub] [spark] rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables

2019-09-18 Thread GitBox
rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables URL: https://github.com/apache/spark/pull/25833#discussion_r325924260 ## File path: sql/catalyst/src/main/java/org/apache/spark/sql/co

[GitHub] [spark] HyukjinKwon commented on issue #25820: [SPARK-29101][SQL] Fix count API for csv file when DROPMALFORMED mode is selected

2019-09-18 Thread GitBox
HyukjinKwon commented on issue #25820: [SPARK-29101][SQL] Fix count API for csv file when DROPMALFORMED mode is selected URL: https://github.com/apache/spark/pull/25820#issuecomment-532895338 I didn't check branch-2.4. @sandeep-katta can you check and open a bacport PR? I will review there

[GitHub] [spark] rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables

2019-09-18 Thread GitBox
rdblue commented on a change in pull request #25833: [SPARK-29127][SQL] Alternative proposal for supporting partitioning through save for V2 tables URL: https://github.com/apache/spark/pull/25833#discussion_r325924118 ## File path: sql/core/src/main/scala/org/apache/spark/sql/DataFr

[GitHub] [spark] AmplabJenkins removed a comment on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-531892632 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty URL: https://github.com/apache/spark/pull/25837#issuecomment-532894605 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package

2019-09-18 Thread GitBox
HyukjinKwon commented on issue #25022: [SPARK-24695][SQL] Move `CalendarInterval` to org.apache.spark.sql.types package URL: https://github.com/apache/spark/pull/25022#issuecomment-532894617 ok to test This is an automated me

[GitHub] [spark] SparkQA commented on issue #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty

2019-09-18 Thread GitBox
SparkQA commented on issue #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty URL: https://github.com/apache/spark/pull/25837#issuecomment-532894374 **[Test build #110942 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110942/te

[GitHub] [spark] HeartSaVioR opened a new pull request #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty

2019-09-18 Thread GitBox
HeartSaVioR opened a new pull request #25837: [MINOR][CORE][SQL][STREAMING] Unify default wait time for waitUntilEmpty URL: https://github.com/apache/spark/pull/25837 # What changes were proposed in this pull request? This is a follow-up of the [review comment](https://github.com/ap

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values

2019-09-18 Thread GitBox
HeartSaVioR commented on a change in pull request #25706: [SPARK-26989][CORE][TEST] DAGSchedulerSuite: ensure listeners are fully processed before checking recorded values URL: https://github.com/apache/spark/pull/25706#discussion_r325922809 ## File path: core/src/test/scala/org/a

[GitHub] [spark] SparkQA commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G

2019-09-18 Thread GitBox
SparkQA commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532892675 **[Test build #110941 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110941/testReport)** fo

[GitHub] [spark] AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532891250 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.

[GitHub] [spark] AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532891244 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532891244 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase ReservedCodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532891250 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532889297 Merged build finished. Test PASSed. This is an automated messag

[GitHub] [spark] AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532889300 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jen

[GitHub] [spark] AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532889297 Merged build finished. Test PASSed. This is an automate

[GitHub] [spark] AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532889300 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley

[GitHub] [spark] AmplabJenkins commented on issue #25835: [MINOR][SQL] Set log level of log generated code as ERROR in case of compile error on generated code in UT

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25835: [MINOR][SQL] Set log level of log generated code as ERROR in case of compile error on generated code in UT URL: https://github.com/apache/spark/pull/25835#issuecomment-532889148 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
SparkQA commented on issue #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836#issuecomment-532888946 **[Test build #110939 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110939/testReport)** for PR 258

[GitHub] [spark] SparkQA commented on issue #25835: [MINOR][SQL] Set log level of log generated code as ERROR in case of compile error on generated code in UT

2019-09-18 Thread GitBox
SparkQA commented on issue #25835: [MINOR][SQL] Set log level of log generated code as ERROR in case of compile error on generated code in UT URL: https://github.com/apache/spark/pull/25835#issuecomment-532888967 **[Test build #110940 has started](https://amplab.cs.berkeley.edu/jenkins/job

[GitHub] [spark] dongjoon-hyun opened a new pull request #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G

2019-09-18 Thread GitBox
dongjoon-hyun opened a new pull request #25836: [SPARK-29159][BUILD] Increase CodeCacheSize to 1G URL: https://github.com/apache/spark/pull/25836 ### What changes were proposed in this pull request? This PR aims to increase the JVM CodeCacheSize from 0.5G to 1G. ### Why are th

[GitHub] [spark] HeartSaVioR opened a new pull request #25835: [MINOR][SQL] Always log generated code in case of compile error on generated code in UT

2019-09-18 Thread GitBox
HeartSaVioR opened a new pull request #25835: [MINOR][SQL] Always log generated code in case of compile error on generated code in UT URL: https://github.com/apache/spark/pull/25835 ### What changes were proposed in this pull request? This patch proposes to change the log level of lo

[GitHub] [spark] SparkQA commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
SparkQA commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#issuecomment-532883191 **[Test build #110938 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532881857 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532881852 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532881852 Merged build finished. Test FAILed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532881857 Test FAILed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
SparkQA commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532881594 **[Test build #110921 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilde

[GitHub] [spark] SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
SparkQA removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532732416 **[Test build #110921 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
HeartSaVioR commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#discussion_r325908987 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/h

[GitHub] [spark] HeartSaVioR commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
HeartSaVioR commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#discussion_r325908987 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/h

[GitHub] [spark] SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-18 Thread GitBox
SparkQA commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-532881025 **[Test build #110937 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110937/testRep

[GitHub] [spark] zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532879853 > Never mind about my point if you meant starting with fresh map instead of sharing objec

[GitHub] [spark] HeartSaVioR commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25702: [SPARK-29001][CORE] Print events that take too long time to process URL: https://github.com/apache/spark/pull/25702#issuecomment-532879691 retest this, please This is an automated messag

[GitHub] [spark] HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532879327 Never mind about my point if you meant starting with fresh map instead of sharing obj

[GitHub] [spark] viirya commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
viirya commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#discussion_r325905716 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/e

[GitHub] [spark] viirya commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
viirya commented on a change in pull request #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#discussion_r325905716 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/e

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532872003 I guess we are talking based on different things, what I referred is SPARK-285

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532872003 I guess we are talking based on different things, what I referred is SPARK-285

[GitHub] [spark] HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532872003 I guess we are talking based on different things, what I referred is SPARK-285

[GitHub] [spark] HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532872003 I guess we are talking based on different things, what I referred is SPARK-28594, whe

[GitHub] [spark] viirya edited a comment on issue #25826: [SPARK-29042][Core][BRANCH-2.4] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-18 Thread GitBox
viirya edited a comment on issue #25826: [SPARK-29042][Core][BRANCH-2.4] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25826#issuecomment-532860559 > Did you ignore the merge script recommendation? The merge script will give you a

[GitHub] [spark] AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532869782 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532869777 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532869782 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532869777 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] SparkQA commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
SparkQA commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532869165 **[Test build #110936 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110936/testReport)** for PR 25681 at

[GitHub] [spark] zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532869010 > additional (considerable amount of) CPU/memory consumption. Additional memory con

[GitHub] [spark] zsxwing edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing edited a comment on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532869010 > additional (considerable amount of) CPU/memory consumption. Additional mem

[GitHub] [spark] rdblue commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
rdblue commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532868393 @brkyvz, I rebased, added Java API tests, and opened SPARK-29157 to track the PySpark API. -

[GitHub] [spark] HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532867903 > I think that's a separate issue since It doesn't change how long it takes to replay

[GitHub] [spark] zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532867802 By the way, I'm totally +1 on SPARK-28594. But I think without doing snapshots in driver,

[GitHub] [spark] zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532867328 > This seems to assume there're only "appends", but the reality is that there're also "up

[GitHub] [spark] SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files

2019-09-18 Thread GitBox
SparkQA commented on issue #25670: [SPARK-28869][CORE] Roll over event log files URL: https://github.com/apache/spark/pull/25670#issuecomment-532866743 **[Test build #110935 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110935/testReport)** for PR 25670 at

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532866014 Test PASSed. Refer to this link for build results (access rights to CI se

[GitHub] [spark] AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532866009 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532866014 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532866009 Merged build finished. Test PASSed. ---

[GitHub] [spark] SparkQA removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
SparkQA removed a comment on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532800853 **[Test build #110928 has started](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] [spark] SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-09-18 Thread GitBox
SparkQA commented on issue #25620: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/25620#issuecomment-532865282 **[Test build #110928 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullR

[GitHub] [spark] zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer

2019-09-18 Thread GitBox
zsxwing commented on issue #25577: [WIP][CORE][SPARK-28867] InMemoryStore checkpoint to speed up replay log file in HistoryServer URL: https://github.com/apache/spark/pull/25577#issuecomment-532864722 > I guess SPARK-28594 would be more preferred approach for streaming query in the end. I

[GitHub] [spark] SparkQA commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
SparkQA commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#issuecomment-532864046 **[Test build #110934 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReq

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532862279 Test FAILed. Refer to this link for build results (access rights to CI server needed): https:/

[GitHub] [spark] HeartSaVioR commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25830: [SPARK-29140][SQL] Handle parameters having "array" of javaType properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#issuecomment-532862764 Updated, please take a next round of review. Thanks! -

[GitHub] [spark] SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
SparkQA removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532852811 **[Test build #110932 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1109

[GitHub] [spark] AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532862272 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532862279 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.

[GitHub] [spark] AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532862272 Merged build finished. Test FAILed. This is

[GitHub] [spark] SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2

2019-09-18 Thread GitBox
SparkQA commented on issue #25771: [SPARK-28970][SQL] Implement USE CATALOG/NAMESPACE for Data Source V2 URL: https://github.com/apache/spark/pull/25771#issuecomment-532862249 **[Test build #110932 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110932/test

[GitHub] [spark] AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532861808 Merged build finished. Test PASSed. This is an automated mes

[GitHub] [spark] AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532861816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/

[GitHub] [spark] AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532861816 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins/

[GitHub] [spark] AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532861808 Merged build finished. Test PASSed. This is an automated message fro

[GitHub] [spark] SparkQA commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API

2019-09-18 Thread GitBox
SparkQA commented on issue #25681: [SPARK-28612][SQL] Add DataFrameWriterV2 API URL: https://github.com/apache/spark/pull/25681#issuecomment-532861301 **[Test build #110933 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110933/testReport)** for PR 25681 at

[GitHub] [spark] viirya commented on issue #25826: [SPARK-29042][Core][BRANCH-2.4] Sampling-based RDD with unordered input should be INDETERMINATE

2019-09-18 Thread GitBox
viirya commented on issue #25826: [SPARK-29042][Core][BRANCH-2.4] Sampling-based RDD with unordered input should be INDETERMINATE URL: https://github.com/apache/spark/pull/25826#issuecomment-532860559 > Ur, @viirya . > Did you ignore the merge script recommendation? The merge script will

[GitHub] [spark] AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-532859373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu

[GitHub] [spark] AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-532859358 Merged build finished. Test PASSed. This is an automated m

[GitHub] [spark] AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-532859358 Merged build finished. Test PASSed. This is an automated message f

[GitHub] [spark] AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-532859373 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins

[GitHub] [spark] AmplabJenkins commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532859119 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532859119 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532859128 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532859128 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins removed a comment on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532858313 Test FAILed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] SparkQA commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
SparkQA commented on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532858226 **[Test build #110925 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110925/t

[GitHub] [spark] AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file

2019-09-18 Thread GitBox
AmplabJenkins commented on issue #25690: [SPARK-27831][FOLLOW-UP][SQL][TEST][test-maven] Move Hive test jars to local file URL: https://github.com/apache/spark/pull/25690#issuecomment-532858313 Test FAILed. Refer to this link for build results (access rights to CI server needed): ht

[GitHub] [spark] SparkQA removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality

2019-09-18 Thread GitBox
SparkQA removed a comment on issue #25832: [MINOR][SS][DOCS] Adapt multiple watermark policy comment to the reality URL: https://github.com/apache/spark/pull/25832#issuecomment-532763540 **[Test build #110925 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/1

[GitHub] [spark] HeartSaVioR commented on issue #25830: [SPARK-29140][SQL] Handle BinaryType of parameter properly in HashAggregateExec

2019-09-18 Thread GitBox
HeartSaVioR commented on issue #25830: [SPARK-29140][SQL] Handle BinaryType of parameter properly in HashAggregateExec URL: https://github.com/apache/spark/pull/25830#issuecomment-532858294 >> array types is more obvious than binary types? > array type is ArrayData, which doesn't hav

[GitHub] [spark] SparkQA removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values

2019-09-18 Thread GitBox
SparkQA removed a comment on issue #25708: [SPARK-28141][SQL] Support special date values URL: https://github.com/apache/spark/pull/25708#issuecomment-532748724 **[Test build #110922 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/110922/testReport)** for P

<    1   2   3   4   5   6   7   8   9   10   >