[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573515989 **[Test build #116602 has

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573515847 **[Test build #116594 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116594/testReport)**

[GitHub] [spark] dongjoon-hyun commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573515240 cc @shivsood , @HyukjinKwon , @maropu , @srowen , @gatorsmile , @zsxwing

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573514830 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573514916 The followup PR is ready. - https://github.com/apache/spark/pull/27184

[GitHub] [spark] AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573514823 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573514830 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573514823 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573495976 **[Test build #116593 has

[GitHub] [spark] SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size

2020-01-12 Thread GitBox
SparkQA commented on issue #26434: [SPARK-29544] [SQL] optimize skewed partition based on data size URL: https://github.com/apache/spark/pull/26434#issuecomment-573514627 **[Test build #116593 has

[GitHub] [spark] dongjoon-hyun commented on issue #26076: [SPARK-29419][SQL] Fix Encoder thread-safety bug in createDataset(Seq)

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #26076: [SPARK-29419][SQL] Fix Encoder thread-safety bug in createDataset(Seq) URL: https://github.com/apache/spark/pull/26076#issuecomment-573514023 Hi, @JoshRosen . Is there any update on this PR?

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573513395 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573513391 Merged build finished. Test FAILed. This

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573513395 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573513391 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573492646 **[Test build #116585 has

[GitHub] [spark] SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events

2020-01-12 Thread GitBox
SparkQA commented on issue #27164: [SPARK-30479][SQL] Apply compaction of event log to SQL events URL: https://github.com/apache/spark/pull/27164#issuecomment-573513224 **[Test build #116585 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512531 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512525 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512531 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512525 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573512395 Merged build finished. Test PASSed. This

[GitHub] [spark] huaxingao commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods

2020-01-12 Thread GitBox
huaxingao commented on issue #27181: [SPARK-30493][PYTHON][ML] Remove OneVsRestModel setClassifier, setLabelCol and setWeightCol methods URL: https://github.com/apache/spark/pull/27181#issuecomment-573512393 @zhengruifeng Yes. These setters can be removed. The internal methods can use

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573512396 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573512396 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573512395 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573493653 **[Test build #116591 has

[GitHub] [spark] SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types

2020-01-12 Thread GitBox
SparkQA commented on issue #27176: [WIP][SPIP]Support year-month and day-time interval types URL: https://github.com/apache/spark/pull/27176#issuecomment-573512333 **[Test build #116591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116591/testReport)**

[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573512182 **[Test build #116602 has

[GitHub] [spark] HeartSaVioR commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
HeartSaVioR commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573511714 Ignore pyspark test failure for now. It's being investigated under #27183.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573511617 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573511616 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573511617 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573511616 Merged build finished. Test PASSed. This is

[GitHub] [spark] HyukjinKwon commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
HyukjinKwon commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573511490 ``` Current mem limits: 18446744073709551615 of max 18446744073709551615 Setting mem limits to

[GitHub] [spark] HeartSaVioR commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
HeartSaVioR commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573511439 IMHO, we don't necessarily need to set it very smaller if that's the case. It just needs to be different

[GitHub] [spark] SparkQA removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573498221 **[Test build #116596 has

[GitHub] [spark] SparkQA commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache

2020-01-12 Thread GitBox
SparkQA commented on issue #27145: [SPARK-30457][ML] Use PeriodicRDDCheckpointer instead of NodeIdCache URL: https://github.com/apache/spark/pull/27145#issuecomment-573511373 **[Test build #116596 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573508584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573508583 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508502 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508505 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508505 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573508583 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505754 **[Test build #116599 has

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573508584 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573508521 **[Test build #116599 has

[GitHub] [spark] AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508502 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
SparkQA commented on issue #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184#issuecomment-573508308 **[Test build #116601 has

[GitHub] [spark] dongjoon-hyun opened a new pull request #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping

2020-01-12 Thread GitBox
dongjoon-hyun opened a new pull request #27184: [SPARK-28152][SQL][FOLLOWUP][2.4] Add a legacy conf for old MsSqlServerDialect numeric mapping URL: https://github.com/apache/spark/pull/27184 ### What changes were proposed in this pull request? This is a follow-up for

[GitHub] [spark] shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573507459 Thanks a lot! Regards, Shiv On Sun, Jan 12, 2020 at 8:48 PM Dongjoon

[GitHub] [spark] dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573506830 Oh. It's okay. No problem. I mean I'm preparing the PR for this follow-up

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-573505985 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-573505993 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-12 Thread GitBox
cloud-fan commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-573506035 Similar to v1 write fallback API which uses v2 API to config the write, I think it makes more sense to use V2 API to do operator

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505961 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505961 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505957 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505957 Merged build finished. Test PASSed. This

[GitHub] [spark] shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573505866 Thanks. I am sorry about my oversight on the date. Regards, Shiv

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun edited a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573504610 @shivsood . If you read the dev mailing list, `2.4.5 RC1` is scheduled

[GitHub] [spark] cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-12 Thread GitBox
cloud-fan commented on a change in pull request #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#discussion_r365645744 ## File path:

[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505754 **[Test build #116599 has

[GitHub] [spark] SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2

2020-01-12 Thread GitBox
SparkQA commented on issue #26231: [SPARK-29572][SQL] add v1 read fallback API in DS v2 URL: https://github.com/apache/spark/pull/26231#issuecomment-573505766 **[Test build #116600 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116600/testReport)** for PR

[GitHub] [spark] HyukjinKwon commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
HyukjinKwon commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573505503 Okay, seems it's hitting the OOM due to too small limit apparently: ``` Current mem limits:

[GitHub] [spark] yhuai commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier

2020-01-12 Thread GitBox
yhuai commented on issue #27177: [SPARK-30491][INFRA] Enable dependency audit files to tell dependency classifier URL: https://github.com/apache/spark/pull/27177#issuecomment-573504504 @dongjoon-hyun @srowen What we are trying to get is a flattened list of dependencies that still allow us

[GitHub] [spark] dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573504610 @shivsood . If you see the dev mailing list, it's scheduled tomorrow and I'm

[GitHub] [spark] dongjoon-hyun edited a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun edited a comment on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573504610 @shivsood . If you read the dev mailing list, it's scheduled tomorrow and

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573503820 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501043 **[Test build #116598 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573503817 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573503820 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573503770 **[Test build #116598 has

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573503817 Merged build finished. Test FAILed. This

[GitHub] [spark] viirya commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal

2020-01-12 Thread GitBox
viirya commented on a change in pull request #26881: [SPARK-30252][SQL] Disallow negative scale of Decimal URL: https://github.com/apache/spark/pull/26881#discussion_r365644301 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/Decimal.scala ## @@

[GitHub] [spark] shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
shivsood commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573502250 I will be taking this up this week. ETA end of coming week. Regards, Shiv

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501140 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501137 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501140 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501137 Merged build finished. Test PASSed. This

[GitHub] [spark] SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
SparkQA commented on issue #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183#issuecomment-573501043 **[Test build #116598 has

[GitHub] [spark] HyukjinKwon opened a new pull request #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure

2020-01-12 Thread GitBox
HyukjinKwon opened a new pull request #27183: [DO-NOT-MERGE] Investigate 'WorkerMemoryTest.test_memory_limit' failure URL: https://github.com/apache/spark/pull/27183 ### What changes were proposed in this pull request? `WorkerMemoryTest. test_memory_limit` fails apparently on

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573499881 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on a change in pull request #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource

2020-01-12 Thread GitBox
cloud-fan commented on a change in pull request #26973: [SPARK-30323][SQL] Support filters pushdown in CSV datasource URL: https://github.com/apache/spark/pull/26973#discussion_r365641683 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/CSVFilters.scala

[GitHub] [spark] AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573499879 Merged build finished. Test FAILed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573499879 Merged build finished. Test FAILed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573499881 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
SparkQA commented on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573499742 **[Test build #116583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116583/testReport)** for PR

[GitHub] [spark] SparkQA removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #26201: [SPARK-29543][SS][UI] Init structured streaming ui URL: https://github.com/apache/spark/pull/26201#issuecomment-573485065 **[Test build #116583 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/116583/testReport)**

[GitHub] [spark] dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect

2020-01-12 Thread GitBox
dongjoon-hyun commented on issue #25248: [SPARK-28152][SQL][2.4] Mapped ShortType to SMALLINT and FloatType to REAL for MsSqlServerDialect URL: https://github.com/apache/spark/pull/25248#issuecomment-573499568 Since there is no ETA from @shivsood , I'll take over the follow-up.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573499436 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573499434 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573499436 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573499434 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay

2020-01-12 Thread GitBox
SparkQA commented on issue #24936: [SPARK-24634][SS] Add a new metric regarding number of rows later than watermark plus allowed delay URL: https://github.com/apache/spark/pull/24936#issuecomment-573499274 **[Test build #116597 has

[GitHub] [spark] AmplabJenkins commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573499093 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573499093 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
AmplabJenkins commented on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573499095 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
AmplabJenkins removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573499095 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing

2020-01-12 Thread GitBox
SparkQA removed a comment on issue #27157: [SPARK-30475][SQL] File source V2: Push data filters for file listing URL: https://github.com/apache/spark/pull/27157#issuecomment-573472013 **[Test build #116575 has

<    1   2   3   4   5   6   7   8   9   10   >