[GitHub] spark issue #19616: [SPARK-22404][YARN] Provide an option to use unmanaged A...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19616 Build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-

[GitHub] spark pull request #20616: [SPARK-23434][SQL] Spark should not warn `metadat...

2018-02-14 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/20616 [SPARK-23434][SQL] Spark should not warn `metadata directory` for a HDFS file path ## What changes were proposed in this pull request? When Spark reads a file path (e.g. `people.json

[GitHub] spark issue #20616: [SPARK-23434][SQL] Spark should not warn `metadata direc...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20616 **[Test build #87469 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87469/testReport)** for PR 20616 at commit [`a14ff69`](https://github.com/apache/spark/commit/a1

[GitHub] spark issue #20616: [SPARK-23434][SQL] Spark should not warn `metadata direc...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20616 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20616: [SPARK-23434][SQL] Spark should not warn `metadata direc...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20616 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/910/ Test

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20554 **[Test build #87465 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87465/testReport)** for PR 20554 at commit [`66f3ef2`](https://github.com/apache/spark/commit/6

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20554 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20554 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87465/ Test PASSed. ---

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20614 Saw the history. Our UTF-16 support is pretty weak. Let me revert the test case. --- - To unsubscribe, e-mail: reviews-unsubs

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/911/ Test

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20614 **[Test build #87470 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87470/testReport)** for PR 20614 at commit [`86c88ae`](https://github.com/apache/spark/commit/86

[GitHub] spark issue #20568: [SPARK-23381][CORE] Murmur3 hash generates a different v...

2018-02-14 Thread mrkm4ntr
Github user mrkm4ntr commented on the issue: https://github.com/apache/spark/pull/20568 @hvanhovell I added a method and changed it so that we call it only from FeatureHasher. --- - To unsubscribe, e-mail: reviews-u

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20554 **[Test build #87466 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87466/testReport)** for PR 20554 at commit [`ba4724b`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20554 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87466/ Test PASSed. ---

[GitHub] spark issue #20554: [SPARK-23362][SS] Migrate Kafka Microbatch source to v2

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20554 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20610 **[Test build #87468 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87468/testReport)** for PR 20610 at commit [`183ec21`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20610 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20610 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87468/ Test FAILed. ---

[GitHub] spark issue #20567: [SPARK-23380][PYTHON] Make toPandas fallback to non-Arro...

2018-02-14 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20567 There is one more thing - https://github.com/apache/spark/pull/20567#issuecomment-364639922 We didn't complete binary type support yet in Python side but there is a hole here .. --- -

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20610 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: rev

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20610 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20610 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/912/ Test

[GitHub] spark issue #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disable PPD f...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20610 **[Test build #87471 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87471/testReport)** for PR 20610 at commit [`183ec21`](https://github.com/apache/spark/commit/18

[GitHub] spark issue #20537: [SPARK-23314][PYTHON] Add ambiguous=False when localizin...

2018-02-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/20537 thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spar

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20614 **[Test build #87467 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87467/testReport)** for PR 20614 at commit [`d4015d0`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/87467/ Test PASSed. ---

[GitHub] spark issue #20568: [SPARK-23381][CORE] Murmur3 hash generates a different v...

2018-02-14 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/20568 Jenkins, test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20571: [SPARK-23383][Build][Minor]Make a distribution sh...

2018-02-14 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/20571#discussion_r168389419 --- Diff: dev/make-distribution.sh --- @@ -72,9 +76,19 @@ while (( "$#" )); do --help) exit_with_usage ;; -*)

[GitHub] spark issue #20568: [SPARK-23381][CORE] Murmur3 hash generates a different v...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20568 **[Test build #87472 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87472/testReport)** for PR 20568 at commit [`336bce0`](https://github.com/apache/spark/commit/33

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20614 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/913/ Test

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20614 **[Test build #87473 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/87473/testReport)** for PR 20614 at commit [`0bb86c6`](https://github.com/apache/spark/commit/0b

[GitHub] spark pull request #20610: [SPARK-23426][SQL] Use `hive` ORC impl and disabl...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20610#discussion_r168395230 --- Diff: docs/sql-programming-guide.md --- @@ -1004,6 +1004,29 @@ Configuration of Parquet can be done using the `setConf` method on `SparkSession

[GitHub] spark issue #20567: [SPARK-23380][PYTHON] Make toPandas fallback to non-Arro...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20567 What is the root cause? Do we have a trivial fix to resolve/block it? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.

[GitHub] spark issue #20606: [SPARK-23421] [SQL] Document the behavior change in SPAR...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20606 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mai

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20614 Since this is just to remove the file and the previous test already passed, I would merge it to master/2.3. Thanks! --- - To

[GitHub] spark issue #20614: Revert [SPARK-23094] Fix invalid character handling in J...

2018-02-14 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/20614 BTW, the ongoing test will be killed by -9 at midnight --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20606: [SPARK-23421] [SQL] Document the behavior change ...

2018-02-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20606 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20614: Revert [SPARK-23094] Fix invalid character handli...

2018-02-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20614 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

<    1   2   3   4