[jira] [Updated] (SPARK-18413) Add a property to control the number of partitions when save a jdbc rdd

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18413: -- Assignee: Dongjoon Hyun Priority: Minor (was: Major) Issue Type: Improvement (was: Wish)

[jira] [Resolved] (SPARK-18413) Add a property to control the number of partitions when save a jdbc rdd

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18413. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 15868

[jira] [Resolved] (SPARK-18398) Fix nullabilities of MapObjects and optimize not to check null if lambda is not nullable.

2016-11-21 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18398. --- Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.1.0 > Fix

[jira] [Updated] (SPARK-18520) Add missing setXXXCol methods for BisectingKMeansModel and GaussianMixtureModel

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18520: -- Priority: Minor (was: Major) > Add missing setXXXCol methods for BisectingKMeansModel and >

[jira] [Resolved] (SPARK-18524) Cannot create dataframe on jdbc data source from spark 2.0.2

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18524. --- Resolution: Not A Problem This is an Hadoop + Windows env problem. It looks like you don't have

[jira] [Commented] (SPARK-18073) Migrate wiki to spark.apache.org web site

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683399#comment-15683399 ] Sean Owen commented on SPARK-18073: --- For anyone following along, I'm going to merge the change above

[jira] [Commented] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683382#comment-15683382 ] Apache Spark commented on SPARK-18526: -- User 'ScrapCodes' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18526: Assignee: Apache Spark > [Kafka] The property max.poll.records is set to a very low non

[jira] [Assigned] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18526: Assignee: (was: Apache Spark) > [Kafka] The property max.poll.records is set to a

[jira] [Created] (SPARK-18526) [Kafka] The property max.poll.records is set to a very low non overridable default.

2016-11-21 Thread Prashant Sharma (JIRA)
Prashant Sharma created SPARK-18526: --- Summary: [Kafka] The property max.poll.records is set to a very low non overridable default. Key: SPARK-18526 URL: https://issues.apache.org/jira/browse/SPARK-18526

[jira] [Assigned] (SPARK-18523) OOM killer may leave SparkContext in broken state causing Connection Refused errors

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18523: Assignee: Apache Spark > OOM killer may leave SparkContext in broken state causing

[jira] [Commented] (SPARK-18523) OOM killer may leave SparkContext in broken state causing Connection Refused errors

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683200#comment-15683200 ] Apache Spark commented on SPARK-18523: -- User 'kxepal' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18523) OOM killer may leave SparkContext in broken state causing Connection Refused errors

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18523: Assignee: (was: Apache Spark) > OOM killer may leave SparkContext in broken state

[jira] [Created] (SPARK-18525) Kafka DirectInputStream cannot be aware of new partition

2016-11-21 Thread Zhiwen Sun (JIRA)
Zhiwen Sun created SPARK-18525: -- Summary: Kafka DirectInputStream cannot be aware of new partition Key: SPARK-18525 URL: https://issues.apache.org/jira/browse/SPARK-18525 Project: Spark Issue

[jira] [Commented] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

2016-11-21 Thread Mikhail Shiryaev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683194#comment-15683194 ] Mikhail Shiryaev commented on SPARK-16377: -- Yes, you can close it. The original problem has been

[jira] [Comment Edited] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

2016-11-21 Thread Mikhail Shiryaev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683194#comment-15683194 ] Mikhail Shiryaev edited comment on SPARK-16377 at 11/21/16 10:55 AM: -

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2016-11-21 Thread Christian Zorneck (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15683172#comment-15683172 ] Christian Zorneck commented on SPARK-18134: --- I can't use arrays of structs. I have maps with

[jira] [Created] (SPARK-18524) Cannot create dataframe on jdbc data source from spark 2.0.2

2016-11-21 Thread Som K (JIRA)
Som K created SPARK-18524: - Summary: Cannot create dataframe on jdbc data source from spark 2.0.2 Key: SPARK-18524 URL: https://issues.apache.org/jira/browse/SPARK-18524 Project: Spark Issue Type:

[jira] [Created] (SPARK-18523) OOM killer may leave SparkContext in broken state causing Connection Refused errors

2016-11-21 Thread Alexander Shorin (JIRA)
Alexander Shorin created SPARK-18523: Summary: OOM killer may leave SparkContext in broken state causing Connection Refused errors Key: SPARK-18523 URL: https://issues.apache.org/jira/browse/SPARK-18523

[jira] [Commented] (SPARK-18004) DataFrame filter Predicate push-down fails for Oracle Timestamp type columns

2016-11-21 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682989#comment-15682989 ] Takeshi Yamamuro commented on SPARK-18004: -- The current spark Jdbc interface (JdbcDialect)

[jira] [Resolved] (SPARK-16377) Spark MLlib: MultilayerPerceptronClassifier - error while training

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-16377. --- Resolution: Cannot Reproduce > Spark MLlib: MultilayerPerceptronClassifier - error while training >

[jira] [Commented] (SPARK-18475) Be able to provide higher parallelization for StructuredStreaming Kafka Source

2016-11-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682903#comment-15682903 ] Sean Owen commented on SPARK-18475: --- I tend to agree that this is the wrong way to address this

[jira] [Comment Edited] (SPARK-18249) StackOverflowError when saving dataset to parquet

2016-11-21 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893 ] Damian Momot edited comment on SPARK-18249 at 11/21/16 8:37 AM: Hi, nope

[jira] [Commented] (SPARK-18249) StackOverflowError when saving dataset to parquet

2016-11-21 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893 ] Damian Momot commented on SPARK-18249: -- Hi, nope it's simple case class, exactly this: {code} case

[jira] [Comment Edited] (SPARK-18249) StackOverflowError when saving dataset to parquet

2016-11-21 Thread Damian Momot (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682893#comment-15682893 ] Damian Momot edited comment on SPARK-18249 at 11/21/16 8:35 AM: Hi, nope

[jira] [Assigned] (SPARK-18521) Add `NoRedundantStringInterpolator` Scala rule

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18521: Assignee: Apache Spark > Add `NoRedundantStringInterpolator` Scala rule >

[jira] [Assigned] (SPARK-18521) Add `NoRedundantStringInterpolator` Scala rule

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18521: Assignee: (was: Apache Spark) > Add `NoRedundantStringInterpolator` Scala rule >

[jira] [Commented] (SPARK-18521) Add `NoRedundantStringInterpolator` Scala rule

2016-11-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682866#comment-15682866 ] Apache Spark commented on SPARK-18521: -- User 'weiqingy' has created a pull request for this issue:

[jira] [Commented] (SPARK-18134) SQL: MapType in Group BY and Joins not working

2016-11-21 Thread Christian Zorneck (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15682855#comment-15682855 ] Christian Zorneck commented on SPARK-18134: --- I also do not see why this feature was removed,

<    1   2