[GitHub] [spark] SparkQA removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
SparkQA removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502569334 **[Test build #106577 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106577/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502637465 **[Test build #106581 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106581/testReport)**

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502636878 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502636869 Merged build finished. Test PASSed. This is an

[GitHub] [spark] viirya commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#discussion_r294256166 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@

[GitHub] [spark] AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502528497 Can one of the admins verify this patch? This is an

[GitHub] [spark] srowen commented on issue #24884: [SPARK-28066][CORE] Optimize UTF8String.trim() for common case of no whitespace

2019-06-17 Thread GitBox
srowen commented on issue #24884: [SPARK-28066][CORE] Optimize UTF8String.trim() for common case of no whitespace URL: https://github.com/apache/spark/pull/24884#issuecomment-502685764 Do we want to describe the implementation in the docs? the caller doesn't necessarily care or need to

[GitHub] [spark] emanuelebardelli commented on a change in pull request #24780: [SPARK-26388][SQL][WIP]_implement_hive_ddl_alter_table_replace_columns

2019-06-17 Thread GitBox
emanuelebardelli commented on a change in pull request #24780: [SPARK-26388][SQL][WIP]_implement_hive_ddl_alter_table_replace_columns URL: https://github.com/apache/spark/pull/24780#discussion_r294314978 ## File path:

[GitHub] [spark] emanuelebardelli commented on a change in pull request #24780: [SPARK-26388][SQL][WIP]_implement_hive_ddl_alter_table_replace_columns

2019-06-17 Thread GitBox
emanuelebardelli commented on a change in pull request #24780: [SPARK-26388][SQL][WIP]_implement_hive_ddl_alter_table_replace_columns URL: https://github.com/apache/spark/pull/24780#discussion_r294315098 ## File path:

[GitHub] [spark] xuanyuanking opened a new pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
xuanyuanking opened a new pull request #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892 After the newly added shuffle block fetching protocol in #24565, we can keep this work by extending

[GitHub] [spark] wangyum commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
wangyum commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502708285 Yes. It is a fix to the implementation. This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-502707806 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-502707818 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r294340035 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502722900 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502722906 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#discussion_r294263527 ## File path: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ##

[GitHub] [spark] viirya commented on a change in pull request #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#discussion_r294263527 ## File path: core/src/test/scala/org/apache/spark/rdd/RDDSuite.scala ##

[GitHub] [spark] SparkQA commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
SparkQA commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502677447 **[Test build #106582 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106582/testReport)** for PR

[GitHub] [spark] SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages

2019-06-17 Thread GitBox
SparkQA commented on issue #24497: [SPARK-27630][CORE] Properly handle task end events from completed stages URL: https://github.com/apache/spark/pull/24497#issuecomment-502691152 **[Test build #106586 has

[GitHub] [spark] srowen commented on a change in pull request #24814: set Int MaxValue

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24814: set Int MaxValue URL: https://github.com/apache/spark/pull/24814#discussion_r294333691 ## File path: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala ## @@ -233,7 +233,7 @@ class Word2Vec extends

[GitHub] [spark] srowen closed pull request #24814: set Int MaxValue

2019-06-17 Thread GitBox
srowen closed pull request #24814: set Int MaxValue URL: https://github.com/apache/spark/pull/24814 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] srowen commented on a change in pull request #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec URL: https://github.com/apache/spark/pull/24893#discussion_r294333963 ## File path: mllib/src/main/scala/org/apache/spark/mllib/feature/Word2Vec.scala ## @@ -268,6

[GitHub] [spark] srowen opened a new pull request #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec

2019-06-17 Thread GitBox
srowen opened a new pull request #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec URL: https://github.com/apache/spark/pull/24893 ## What changes were proposed in this pull request? The word2vec logic fails if a corpora has a word with count > 1e9. We should be able

[GitHub] [spark] srowen commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
srowen commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502717826 OK, can you clarify the PR / JIRA? it sounds like this already works to some degree. It'd be good to know what isn't working and what you're

[GitHub] [spark] AmplabJenkins removed a comment on issue #24895: [DOC] Fix python variance() documentation

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24895: [DOC] Fix python variance() documentation URL: https://github.com/apache/spark/pull/24895#issuecomment-502718781 Can one of the admins verify this patch? This is an automated

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294343007 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294343515 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502717482 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294343608 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294341142 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294342741 ## File path:

[GitHub] [spark] srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24868: [SPARK-28044][ML][PYTHON] MulticlassClassificationEvaluator support more metrics URL: https://github.com/apache/spark/pull/24868#discussion_r294342082 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502727912 Merged build finished. Test PASSed. This is

[GitHub] [spark] viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#discussion_r294351908 ## File path: python/pyspark/sql/readwriter.py ## @@ -441,7 +441,12 @@

[GitHub] [spark] AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502727975 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502632037 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502632027 Merged build finished. Test PASSed. This is an automated message from

[GitHub] [spark] SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
SparkQA removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502586972 **[Test build #106580 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106580/testReport)** for

[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502648546 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502648552 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502648552 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502648546 Merged build finished. Test PASSed. This is an automated message

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502667735 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502667727 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502675495 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502675505 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502675505 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
HyukjinKwon commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#discussion_r294288972 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ##

[GitHub] [spark] AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502675495 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on a change in pull request #24889: [SPARK-28072][SQL] Use `Iso8601TimestampFormatter` in `FromUnixTime` codegen to fix ICCE in JDK9+

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24889: [SPARK-28072][SQL] Use `Iso8601TimestampFormatter` in `FromUnixTime` codegen to fix ICCE in JDK9+ URL: https://github.com/apache/spark/pull/24889#discussion_r294298984 ## File path:

[GitHub] [spark] SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming

2019-06-17 Thread GitBox
SparkQA commented on issue #22282: [SPARK-23539][SS] Add support for Kafka headers in Structured Streaming URL: https://github.com/apache/spark/pull/22282#issuecomment-502694496 **[Test build #106587 has

[GitHub] [spark] jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

2019-06-17 Thread GitBox
jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r294316780 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec URL: https://github.com/apache/spark/pull/24893#issuecomment-502715135 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24893: [SPARK-28081][ML] Handle large vocab counts in word2vec URL: https://github.com/apache/spark/pull/24893#issuecomment-502715150 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya opened a new pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
viirya opened a new pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894 ## What changes were proposed in this pull request? When using `DROPMALFORMED` mode, corrupted records aren't

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
HyukjinKwon commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#discussion_r294350158 ## File path: python/pyspark/sql/readwriter.py ## @@ -441,7

[GitHub] [spark] viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#discussion_r294353867 ## File path: python/pyspark/sql/readwriter.py ## @@ -441,7 +441,12 @@

[GitHub] [spark] SparkQA commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
SparkQA commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502631487 **[Test build #106577 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106577/testReport)** for PR 24891 at

[GitHub] [spark] SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-06-17 Thread GitBox
SparkQA commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-502648058 **[Test build #106580 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106580/testReport)** for PR

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502684122 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502684138 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502684138 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502684122 Merged build finished. Test PASSed. This is

[GitHub] [spark] srowen commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
srowen commented on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502687174 Interesting, it looks like Spark SQL already tries to support this? is this more of a fix to the implementation?

[GitHub] [spark] SparkQA commented on issue #24861: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG

2019-06-17 Thread GitBox
SparkQA commented on issue #24861: [SPARK-26985][CORE] Fix "access only some column of the all of columns " for big endian architecture BUG URL: https://github.com/apache/spark/pull/24861#issuecomment-502686733 **[Test build #4798 has

[GitHub] [spark] jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

2019-06-17 Thread GitBox
jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r294319256 ## File path:

[GitHub] [spark] jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

2019-06-17 Thread GitBox
jlpedrosa commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r294319190 ## File path:

[GitHub] [spark] SparkQA commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
SparkQA commented on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-502708682 **[Test build #106588 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-502707806 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24892: [SPARK-25341][Core] Support rolling back a shuffle map stage and re-generate the shuffle files URL: https://github.com/apache/spark/pull/24892#issuecomment-502707818 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502719004 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
SparkQA removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502716204 **[Test build #106589 has

[GitHub] [spark] AmplabJenkins commented on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502718997 Merged build finished. Test PASSed.

[GitHub] [spark] srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24702: [SPARK-27989] [Kubernetes] [Core] Added retries on the connection to the driver for k8s URL: https://github.com/apache/spark/pull/24702#discussion_r294340743 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502719004 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502717469 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#issuecomment-502718997 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24895: [DOC] Fix python variance() documentation

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24895: [DOC] Fix python variance() documentation URL: https://github.com/apache/spark/pull/24895#issuecomment-502718781 Can one of the admins verify this patch? This is an automated message

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502727694 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24699: [SPARK-27666][CORE] Do not release lock while TaskContext already completed URL: https://github.com/apache/spark/pull/24699#issuecomment-502727704 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
HyukjinKwon commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#discussion_r294351448 ## File path: python/pyspark/sql/readwriter.py ## @@ -441,7

[GitHub] [spark] SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression

2019-06-17 Thread GitBox
SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports struct type foldable expression URL: https://github.com/apache/spark/pull/24846#issuecomment-502727318 **[Test build #106585 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502632027 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24891: [SPARK-28075][SQL] Enhance TRIM function URL: https://github.com/apache/spark/pull/24891#issuecomment-502632037 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] Ngone51 commented on a change in pull request #24848: [SPARK-28014][core] All waiting apps will be changed to the wrong state of Running after master changed.

2019-06-17 Thread GitBox
Ngone51 commented on a change in pull request #24848: [SPARK-28014][core] All waiting apps will be changed to the wrong state of Running after master changed. URL: https://github.com/apache/spark/pull/24848#discussion_r294247023 ## File path:

[GitHub] [spark] DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql

2019-06-17 Thread GitBox
DylanGuedes commented on issue #24881: [SPARK-23160][SQL][TEST] Port window.sql URL: https://github.com/apache/spark/pull/24881#issuecomment-502659861 Hmm I was always generating them, I think that at the end I made a minor change and forgot to rerun then because I just changed a comment.

[GitHub] [spark] SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
SparkQA commented on issue #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#issuecomment-502667292 **[Test build #106581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/106581/testReport)**

[GitHub] [spark] srowen commented on a change in pull request #24845: Map ByteType to SMALLINT when using JDBC with PostgreSQL

2019-06-17 Thread GitBox
srowen commented on a change in pull request #24845: Map ByteType to SMALLINT when using JDBC with PostgreSQL URL: https://github.com/apache/spark/pull/24845#discussion_r294304186 ## File path: sql/core/src/main/scala/org/apache/spark/sql/jdbc/PostgresDialect.scala ## @@

[GitHub] [spark] viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning

2019-06-17 Thread GitBox
viirya commented on a change in pull request #24894: [SPARK-28058][DOC] Add a note to DROPMALFORMED mode of CSV for column pruning URL: https://github.com/apache/spark/pull/24894#discussion_r294337292 ## File path: python/pyspark/sql/readwriter.py ## @@ -441,7 +441,12 @@

[GitHub] [spark] cxzl25 commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type

2019-06-17 Thread GitBox
cxzl25 commented on a change in pull request #24846: [SPARK-28012][SQL] Hive UDF supports literal struct type URL: https://github.com/apache/spark/pull/24846#discussion_r294242635 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveInspectors.scala ## @@

[GitHub] [spark] SparkQA commented on issue #24889: [SPARK-28072][SQL] Use `Iso8601TimestampFormatter` in `FromUnixTime` codegen to fix ICCE in JDK9+

2019-06-17 Thread GitBox
SparkQA commented on issue #24889: [SPARK-28072][SQL] Use `Iso8601TimestampFormatter` in `FromUnixTime` codegen to fix ICCE in JDK9+ URL: https://github.com/apache/spark/pull/24889#issuecomment-502635006 **[Test build #106578 has

[GitHub] [spark] WeichenXu123 commented on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource

2019-06-17 Thread GitBox
WeichenXu123 commented on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource URL: https://github.com/apache/spark/pull/24830#issuecomment-502670813 Jenkins, retest this please. This

[GitHub] [spark] WeichenXu123 removed a comment on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource

2019-06-17 Thread GitBox
WeichenXu123 removed a comment on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource URL: https://github.com/apache/spark/pull/24830#issuecomment-502580511 Jenkins, retest this. This

[GitHub] [spark] HyukjinKwon commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
HyukjinKwon commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502670781 ok to test This is an automated message from the Apache Git

[GitHub] [spark] AmplabJenkins commented on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource URL: https://github.com/apache/spark/pull/24830#issuecomment-502672839 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502672801 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
AmplabJenkins commented on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502672788 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24888: [SPARK-28040][SPARK-28070][R] Write type object s3 URL: https://github.com/apache/spark/pull/24888#issuecomment-502672788 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource

2019-06-17 Thread GitBox
AmplabJenkins removed a comment on issue #24830: [SPARK-27990][SQL][ML] Provide a way to recursively load data from datasource URL: https://github.com/apache/spark/pull/24830#issuecomment-502672839 Merged build finished. Test PASSed.

  1   2   3   4   5   6   >