[jira] [Commented] (SPARK-23427) spark.sql.autoBroadcastJoinThreshold causing OOM exception in the driver

[ https://issues.apache.org/jira/browse/SPARK-23427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517326#comment-16517326 ] Dean Wampler commented on SPARK-23427: -- Hi, Kazuaki. Any update on this issue? Any pointers on what

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887342#comment-15887342 ] Dean Wampler commented on SPARK-17147: -- Cody, thanks for the suggestion. We'll try to test it and

[jira] [Commented] (SPARK-17147) Spark Streaming Kafka 0.10 Consumer Can't Handle Non-consecutive Offsets (i.e. Log Compaction)

[ https://issues.apache.org/jira/browse/SPARK-17147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882778#comment-15882778 ] Dean Wampler commented on SPARK-17147: -- We're interested in this enhancement. Anyone know if and one

[jira] [Comment Edited] (SPARK-16239) SQL issues with cast from date to string around daylight savings time

[ https://issues.apache.org/jira/browse/SPARK-16239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478438#comment-15478438 ] Dean Wampler edited comment on SPARK-16239 at 9/9/16 10:20 PM: --- I

[jira] [Commented] (SPARK-16239) SQL issues with cast from date to string around daylight savings time

[ https://issues.apache.org/jira/browse/SPARK-16239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15478438#comment-15478438 ] Dean Wampler commented on SPARK-16239: -- I invested this a bit today for a customer. I could not

[jira] [Created] (SPARK-16684) Standalone mode local dirs not properly cleaned if job is killed

Dean Wampler created SPARK-16684: Summary: Standalone mode local dirs not properly cleaned if job is killed Key: SPARK-16684 URL: https://issues.apache.org/jira/browse/SPARK-16684 Project: Spark

[jira] [Commented] (SPARK-12177) Update KafkaDStreams to new Kafka 0.9 Consumer API

[ https://issues.apache.org/jira/browse/SPARK-12177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15058856#comment-15058856 ] Dean Wampler commented on SPARK-12177: -- Since the new Kafka 0.9 consumer API supports SSL, would

[jira] [Created] (SPARK-12105) Add a DataFrame.show() with argument for output PrintStream

Dean Wampler created SPARK-12105: Summary: Add a DataFrame.show() with argument for output PrintStream Key: SPARK-12105 URL: https://issues.apache.org/jira/browse/SPARK-12105 Project: Spark

[jira] [Created] (SPARK-12052) DataFrame with self-join fails unless toDF() column aliases provided

Dean Wampler created SPARK-12052: Summary: DataFrame with self-join fails unless toDF() column aliases provided Key: SPARK-12052 URL: https://issues.apache.org/jira/browse/SPARK-12052 Project: Spark

[jira] [Commented] (SPARK-11700) Memory leak at SparkContext jobProgressListener stageIdToData map

[ https://issues.apache.org/jira/browse/SPARK-11700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022455#comment-15022455 ] Dean Wampler commented on SPARK-11700: -- Actually, memory leaks like this aren't acceptable, IMHO.

[jira] [Created] (SPARK-9409) make-distribution.sh should copy all files in conf, so that it's easy to create a distro with custom configuration and property settings

Dean Wampler created SPARK-9409: --- Summary: make-distribution.sh should copy all files in conf, so that it's easy to create a distro with custom configuration and property settings Key: SPARK-9409 URL:

[jira] [Created] (SPARK-4564) SchemaRDD.groupBy(groupingExprs)(aggregateExprs) doesn't return the groupingExprs as part of the output schema

Dean Wampler created SPARK-4564: --- Summary: SchemaRDD.groupBy(groupingExprs)(aggregateExprs) doesn't return the groupingExprs as part of the output schema Key: SPARK-4564 URL:

[jira] [Commented] (SPARK-4564) SchemaRDD.groupBy(groupingExprs)(aggregateExprs) doesn't return the groupingExprs as part of the output schema

[ https://issues.apache.org/jira/browse/SPARK-4564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222409#comment-14222409 ] Dean Wampler commented on SPARK-4564: - As soon as I reported this, I thought of a way