[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498058470 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498058466 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
dongjoon-hyun commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498058355 Retest this please. This is an automated message

[GitHub] [spark] hvanhovell commented on a change in pull request #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
hvanhovell commented on a change in pull request #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#discussion_r289654733 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498060740 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency

2019-06-02 Thread GitBox
skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency URL: https://github.com/apache/spark/pull/24748#issuecomment-498066570 @felixcheung that is true yet the driver needs to create certain resources so it needs some privileges. So DoS

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498073566 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally`

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally` URL: https://github.com/apache/spark/pull/24747#issuecomment-498073571 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally`

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally` URL: https://github.com/apache/spark/pull/24747#issuecomment-498073571 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally`

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally` URL: https://github.com/apache/spark/pull/24747#issuecomment-498073569 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498073565 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498073565 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally`

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally` URL: https://github.com/apache/spark/pull/24747#issuecomment-498073569 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498073566 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498074647 Test FAILed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins removed a comment on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498074646 Merged build finished. Test FAILed.

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24723: [SPARK-27857][SQL] Move ALTER TABLE parsing into Catalyst URL: https://github.com/apache/spark/pull/24723#discussion_r289662569 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081665 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081667 Test PASSed. Refer to this link for build results (access

[GitHub] [spark] HyukjinKwon commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
HyukjinKwon commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081778 Let me open a umbrella JIRA to add UDF specific tests based on this test

[GitHub] [spark] HyukjinKwon commented on issue #24700: [SPARK-27834][SQL][R][PYTHON] Make separate PySpark/SparkR vectorization configurations

2019-06-02 Thread GitBox
HyukjinKwon commented on issue #24700: [SPARK-27834][SQL][R][PYTHON] Make separate PySpark/SparkR vectorization configurations URL: https://github.com/apache/spark/pull/24700#issuecomment-498081638 I am merging this - looks like we're positive on this in general and no notable comments.

[GitHub] [spark] AmplabJenkins commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081667 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] HyukjinKwon closed pull request #24757: [SPARK-27873][SQL] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

2019-06-02 Thread GitBox
HyukjinKwon closed pull request #24757: [SPARK-27873][SQL] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24757 This

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-06-02 Thread GitBox
maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r289677903 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498101510 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498101508 Merged build finished. Test PASSed. This

[GitHub] [spark] attilapiros commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host

2019-06-02 Thread GitBox
attilapiros commented on issue #24554: [SPARK-27622][Core] Avoiding the network when block manager fetches disk persisted RDD blocks from the same host URL: https://github.com/apache/spark/pull/24554#issuecomment-498101397 Jenkins retest this please

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#discussion_r289681359 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106763 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106767 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
SparkQA removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498082613 **[Test build #106078 has

[GitHub] [spark] dongjoon-hyun commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
dongjoon-hyun commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106650 Merged to master. This is an

[GitHub] [spark] SparkQA commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
SparkQA commented on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106537 **[Test build #106078 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106767 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#issuecomment-498106763 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498111656 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498111613 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498111656 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498111642 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498111619 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498111644 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498111644 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498111655 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498111619 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498111642 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498111613 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498111655 Merged build finished. Test PASSed. This

[GitHub] [spark] cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions

2019-06-02 Thread GitBox
cryeo commented on issue #24335: [SPARK-27425][SQL] Add count_if functions URL: https://github.com/apache/spark/pull/24335#issuecomment-498111390 @HyukjinKwon I just modified based on your review. Could you review it again?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498116156 Merged build finished. Test PASSed. This is an

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala

2019-06-02 Thread GitBox
HyukjinKwon commented on a change in pull request #24772: [MINOR][BRANCH-2.4] Avoid hardcoded py4j-0.10.7-src.zip in Scala URL: https://github.com/apache/spark/pull/24772#discussion_r289690508 ## File path: core/src/main/scala/org/apache/spark/api/python/PythonUtils.scala

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289690629 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#discussion_r289690629 ## File path:

[GitHub] [spark] dongjoon-hyun commented on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup

2019-06-02 Thread GitBox
dongjoon-hyun commented on issue #24773: [SPARK-24544][SQL][FOLLOWUP] Remove a wrong warning on Hive fallback lookup URL: https://github.com/apache/spark/pull/24773#issuecomment-498116708 Thank you for review and approval, @felixcheung .

[GitHub] [spark] gatorsmile commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax

2019-06-02 Thread GitBox
gatorsmile commented on issue #24472: [SPARK-27578][SQL] Support INTERVAL ... HOUR TO SECOND syntax URL: https://github.com/apache/spark/pull/24472#issuecomment-498120829 In the next one month, Wenchen might not be able to respond your pings very soon. Normally, when we add a support like

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring URL: https://github.com/apache/spark/pull/24747#discussion_r289655473 ## File path: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala ## @@

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring URL: https://github.com/apache/spark/pull/24747#discussion_r289655473 ## File path: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498060038 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498060040 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24747: [SPARK-27772][SQL][TEST] SQLTestUtils Refactoring URL: https://github.com/apache/spark/pull/24747#discussion_r289655473 ## File path: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala ## @@

[GitHub] [spark] SparkQA commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
SparkQA commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498060170 **[Test build #106071 has

[GitHub] [spark] dongjoon-hyun commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens

2019-06-02 Thread GitBox
dongjoon-hyun commented on issue #24749: [SPARK-27890][SQL] Improve SQL parser error message for identifier with hyphens URL: https://github.com/apache/spark/pull/24749#issuecomment-498061595 Retest this please. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-498065538 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-498065541 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-498065538 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #23850: [SPARK-26949][SS] Prevent 'purge' to remove needed batch files in CompactibleFileStreamLog URL: https://github.com/apache/spark/pull/23850#issuecomment-498065541 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] skonto commented on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency

2019-06-02 Thread GitBox
skonto commented on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency URL: https://github.com/apache/spark/pull/24748#issuecomment-498066809 @liyinan926 the initial PR was following @erikerlandson suggestion to make it configurable, but `default` is or driver's

[GitHub] [spark] skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency

2019-06-02 Thread GitBox
skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency URL: https://github.com/apache/spark/pull/24748#issuecomment-498066809 @liyinan926 the initial PR was following @erikerlandson suggestion to make it configurable, but `default` or

[GitHub] [spark] skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency

2019-06-02 Thread GitBox
skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency URL: https://github.com/apache/spark/pull/24748#issuecomment-498066570 @felixcheung that is true yet the driver needs to create certain resources so it needs some privileges. So DoS

[GitHub] [spark] skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency

2019-06-02 Thread GitBox
skonto edited a comment on issue #24748: [SPARK-27872][K8s] Fix executor service account inconsistency URL: https://github.com/apache/spark/pull/24748#issuecomment-498066570 @felixcheung that is true yet the driver needs to create certain resources so it needs some privileges. So DoS

[GitHub] [spark] SparkQA commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect

2019-06-02 Thread GitBox
SparkQA commented on issue #24766: [SPARK-27917][SQL] canonical form of CaseWhen object is incorrect URL: https://github.com/apache/spark/pull/24766#issuecomment-498071134 **[Test build #106069 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498075904 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498075904 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498075901 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498075901 Merged build finished. Test PASSed. This is an

[GitHub] [spark] dongjoon-hyun commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally`

2019-06-02 Thread GitBox
dongjoon-hyun commented on issue #24747: [SPARK-27772][SQL][TEST] Refactor SQLTestUtils to use `tryWithSafeFinally` URL: https://github.com/apache/spark/pull/24747#issuecomment-498075923 @William1104 . May I ask three things in the PR description? - I think we can remove the following

[GitHub] [spark] SparkQA commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files

2019-06-02 Thread GitBox
SparkQA commented on issue #24752: [SPARK-27893][SQL][PYTHON] Create an integrated test base for Python, Scalar Pandas, Scala UDF by sql files URL: https://github.com/apache/spark/pull/24752#issuecomment-498081840 **[Test build #106077 has

[GitHub] [spark] HyukjinKwon closed pull request #24700: [SPARK-27834][SQL][R][PYTHON] Make separate PySpark/SparkR vectorization configurations

2019-06-02 Thread GitBox
HyukjinKwon closed pull request #24700: [SPARK-27834][SQL][R][PYTHON] Make separate PySpark/SparkR vectorization configurations URL: https://github.com/apache/spark/pull/24700 This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#discussion_r289673016 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
HyukjinKwon commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498092577 Can't we add a configuration to control this buffer size,

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function

2019-06-02 Thread GitBox
dongjoon-hyun commented on a change in pull request #24769: [SPARK-27920][SQL][TEST] Add `interceptParseException` test utility function URL: https://github.com/apache/spark/pull/24769#discussion_r289673016 ## File path:

[GitHub] [spark] SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
SparkQA commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498100716 **[Test build #106083 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498100459 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-06-02 Thread GitBox
SparkQA commented on issue #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#issuecomment-498100750 **[Test build #106084 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498100453 Merged build finished. Test PASSed.

[GitHub] [spark] maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL

2019-06-02 Thread GitBox
maryannxue commented on a change in pull request #24706: [SPARK-23128][SQL] A new approach to do adaptive execution in Spark SQL URL: https://github.com/apache/spark/pull/24706#discussion_r289678641 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498100453 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline)

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24734: [SPARK-27870][SQL][PySpark] Flush each batch for pandas UDF (for improving pandas UDFs pipeline) URL: https://github.com/apache/spark/pull/24734#issuecomment-498100459 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] dongjoon-hyun closed pull request #24751: [SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency

2019-06-02 Thread GitBox
dongjoon-hyun closed pull request #24751: [SPARK-27831][SQL][TEST] Move Hive test jars to maven dependency URL: https://github.com/apache/spark/pull/24751 This is an automated message from the Apache Git Service. To respond

[GitHub] [spark] SparkQA commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
SparkQA commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498103736 **[Test build #106086 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceS

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498103511 Test PASSed. Refer to this

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498103530 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498103533 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceS

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498103507 Merged build finished. Test

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498103530 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24490: [SPARK-27300][GRAPH] Add Spark Graph modules and dependencies URL: https://github.com/apache/spark/pull/24490#issuecomment-498103533 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498103511 Test PASSed. Refer to this link

[GitHub] [spark] AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema

2019-06-02 Thread GitBox
AmplabJenkins commented on issue #24771: [SPARK-27873][SQL][BRANCH-2.4] columnNameOfCorruptRecord should not be checked with column names in CSV header when disabling enforceSchema URL: https://github.com/apache/spark/pull/24771#issuecomment-498103507 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2

2019-06-02 Thread GitBox
AmplabJenkins removed a comment on issue #24327: [SPARK-27418][SQL] Migrate Parquet to File Data Source V2 URL: https://github.com/apache/spark/pull/24327#issuecomment-498108630 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24770: [MINOR] Avoid hardcoded py4j-0.10.8.1-src.zip in Scala

2019-06-02 Thread GitBox
HyukjinKwon commented on issue #24770: [MINOR] Avoid hardcoded py4j-0.10.8.1-src.zip in Scala URL: https://github.com/apache/spark/pull/24770#issuecomment-498112929 Thanks. Yea will do. This is an automated message from the

  1   2   3   4   5   >