[jira] [Commented] (SPARK-20808) External Table unnecessarily not create in Hive-compatible way

[ https://issues.apache.org/jira/browse/SPARK-20808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16017108#comment-16017108 ] Joachim Hereth commented on SPARK-20808: The warning is caused by an Exeption raised by a call to

[jira] [Updated] (SPARK-20808) External Table unnecessarily not created in Hive-compatible way

[ https://issues.apache.org/jira/browse/SPARK-20808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-20808: --- Summary: External Table unnecessarily not created in Hive-compatible way (was: External

[jira] [Created] (SPARK-20808) External Table unnecessarily not create in Hive-compatible way

Joachim Hereth created SPARK-20808: -- Summary: External Table unnecessarily not create in Hive-compatible way Key: SPARK-20808 URL: https://issues.apache.org/jira/browse/SPARK-20808 Project: Spark

[jira] [Commented] (SPARK-20808) External Table unnecessarily not created in Hive-compatible way

[ https://issues.apache.org/jira/browse/SPARK-20808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16019667#comment-16019667 ] Joachim Hereth commented on SPARK-20808: Thanks! As you suggested, the bug was already fixed.

[jira] [Commented] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16460870#comment-16460870 ] Joachim Hereth commented on SPARK-24067: It would be great if this fix could go into 2.3.1. Any

[jira] [Updated] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Fix Version/s: (was: 2.4.0) > Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10

[jira] [Updated] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Affects Version/s: (was: 2.0.0) 2.3.0 > Backport SPARK-17147 to

[jira] [Updated] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Description: SPARK-17147 fixes a problem with non-consecutive Kafka Offsets. The  [PR

[jira] [Updated] (SPARK-24067) Backport SPARK-17147 to 2.3

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Summary: Backport SPARK-17147 to 2.3 (was: Spark 2.3 Streaming Kafka 0.10 Consumer Can't

[jira] [Updated] (SPARK-24067) Spark 2.3 Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Description: Spark 2.3 Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets

[jira] [Created] (SPARK-24067) Spark 2.3 Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

Joachim Hereth created SPARK-24067: -- Summary: Spark 2.3 Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction) Key: SPARK-24067 URL:

[jira] [Updated] (SPARK-24067) Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction))

[ https://issues.apache.org/jira/browse/SPARK-24067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joachim Hereth updated SPARK-24067: --- Summary: Backport SPARK-17147 to 2.3 (Spark Streaming Kafka 0.10 Consumer Can't Handle

[jira] [Commented] (SPARK-29748) Remove sorting of fields in PySpark SQL Row creation

[ https://issues.apache.org/jira/browse/SPARK-29748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16974821#comment-16974821 ] Joachim Hereth commented on SPARK-29748: [~bryanc] With simply removing sorting we change the

[jira] [Comment Edited] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951417#comment-16951417 ] Joachim Hereth edited comment on SPARK-24915 at 10/15/19 8:58 PM: -- this

[jira] [Comment Edited] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951417#comment-16951417 ] Joachim Hereth edited comment on SPARK-24915 at 10/15/19 8:58 PM: -- this

[jira] [Comment Edited] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951417#comment-16951417 ] Joachim Hereth edited comment on SPARK-24915 at 10/15/19 8:25 PM: -- this

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16951417#comment-16951417 ] Joachim Hereth commented on SPARK-24915: this is fixed by

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17013591#comment-17013591 ] Joachim Hereth commented on SPARK-24915: [~bryanc]Is there any chance that SPARK-29748 will be

[jira] [Commented] (SPARK-24915) Calling SparkSession.createDataFrame with schema can throw exception

[ https://issues.apache.org/jira/browse/SPARK-24915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014870#comment-17014870 ] Joachim Hereth commented on SPARK-24915: [~bryanc]  Thanks! The PR was against master and can