[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570617#comment-16570617 ] Dongjoon Hyun commented on SPARK-24924: --- Thank you for confirming and giving the r

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-06 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570586#comment-16570586 ] Thomas Graves commented on SPARK-24924: --- For compatibility we can't remove it unle

[jira] [Assigned] (SPARK-24822) Python support for barrier execution mode

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24822: Assignee: Apache Spark > Python support for barrier execution mode >

[jira] [Assigned] (SPARK-24822) Python support for barrier execution mode

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24822: Assignee: (was: Apache Spark) > Python support for barrier execution mode > -

[jira] [Commented] (SPARK-24822) Python support for barrier execution mode

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570576#comment-16570576 ] Apache Spark commented on SPARK-24822: -- User 'jiangxb1987' has created a pull reque

[jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570573#comment-16570573 ] Apache Spark commented on SPARK-21436: -- User 'holdenk' has created a pull request f

[jira] [Assigned] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21436: Assignee: (was: Apache Spark) > Take advantage of known partioner for distinct on RDD

[jira] [Commented] (SPARK-23932) High-order function: zip_with(array, array, function) → array

2018-08-06 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-23932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570575#comment-16570575 ] Carlos Peña commented on SPARK-23932: - Hi [~ueshin] ! Sorry for the delay. Thanks f

[jira] [Assigned] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-21436: Assignee: Apache Spark > Take advantage of known partioner for distinct on RDDs > ---

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-06 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570562#comment-16570562 ] Dongjoon Hyun commented on SPARK-24924: --- Sorry for the late responses, [~tgraves]

[jira] [Commented] (SPARK-25024) Update mesos documentation to be clear about security supported

2018-08-06 Thread Susan X. Huynh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570550#comment-16570550 ] Susan X. Huynh commented on SPARK-25024: Yes, I agree, the "Running on Mesos" pa

[jira] [Updated] (SPARK-25035) Replicating disk-stored blocks should avoid memory mapping

2018-08-06 Thread Imran Rashid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Imran Rashid updated SPARK-25035: - Summary: Replicating disk-stored blocks should avoid memory mapping (was: Replication disk-stor

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:31 PM: -

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:22 PM: -

[jira] [Created] (SPARK-25035) Replication disk-stored blocks should avoid memory mapping

2018-08-06 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-25035: Summary: Replication disk-stored blocks should avoid memory mapping Key: SPARK-25035 URL: https://issues.apache.org/jira/browse/SPARK-25035 Project: Spark Is

[jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570517#comment-16570517 ] holdenk commented on SPARK-21436: - @[~podongfeng]  So distinct triggers a `map` first (

[jira] [Comment Edited] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570517#comment-16570517 ] holdenk edited comment on SPARK-21436 at 8/6/18 5:19 PM: - @[~pod

[jira] [Assigned] (SPARK-24882) data source v2 API improvement

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24882: Assignee: Apache Spark (was: Wenchen Fan) > data source v2 API improvement > ---

[jira] [Assigned] (SPARK-24882) data source v2 API improvement

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24882: Assignee: Wenchen Fan (was: Apache Spark) > data source v2 API improvement > ---

[jira] [Commented] (SPARK-24882) data source v2 API improvement

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570510#comment-16570510 ] Apache Spark commented on SPARK-24882: -- User 'cloud-fan' has created a pull request

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:11 PM: -

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:10 PM: -

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:09 PM: -

[jira] [Comment Edited] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Matthew Normyle (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16568893#comment-16568893 ] Matthew Normyle edited comment on SPARK-24928 at 8/6/18 5:05 PM: -

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 5:00 PM: -

[jira] [Created] (SPARK-25034) possible triple memory consumption in fetchBlockSync()

2018-08-06 Thread Vincent (JIRA)
Vincent created SPARK-25034: --- Summary: possible triple memory consumption in fetchBlockSync() Key: SPARK-25034 URL: https://issues.apache.org/jira/browse/SPARK-25034 Project: Spark Issue Type: Impr

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 4:41 PM: -

[jira] [Comment Edited] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos edited comment on SPARK-25029 at 8/6/18 4:40 PM: -

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570450#comment-16570450 ] Stavros Kontopoulos commented on SPARK-25029: - Yes, you need something simil

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570440#comment-16570440 ] Kazuaki Ishizaki commented on SPARK-25029: -- [~srowen][~skonto] Thank you for yo

[jira] [Assigned] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24928: Assignee: Apache Spark > spark sql cross join running time too long > ---

[jira] [Commented] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570437#comment-16570437 ] Apache Spark commented on SPARK-24928: -- User 'mgaido91' has created a pull request

[jira] [Assigned] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-24928: Assignee: (was: Apache Spark) > spark sql cross join running time too long >

[jira] [Comment Edited] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570289#comment-16570289 ] Marco Gaido edited comment on SPARK-24928 at 8/6/18 4:13 PM: -

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570413#comment-16570413 ] Sean Owen commented on SPARK-25029: --- If that's the issue, it's sort of bad news in tha

[jira] [Commented] (SPARK-25029) Scala 2.12 issues: TaskNotSerializable and Janino "Two non-abstract methods ..." errors

2018-08-06 Thread Stavros Kontopoulos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570397#comment-16570397 ] Stavros Kontopoulos commented on SPARK-25029: - [~srowen] yes it seems so, [

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

2018-08-06 Thread Dieter Vekeman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570375#comment-16570375 ] Dieter Vekeman commented on SPARK-25013: I am not sure but I guess it does. As

[jira] [Comment Edited] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570289#comment-16570289 ] Marco Gaido edited comment on SPARK-24928 at 8/6/18 2:45 PM: -

[jira] [Commented] (SPARK-24928) spark sql cross join running time too long

2018-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570289#comment-16570289 ] Marco Gaido commented on SPARK-24928: - [~matthewnormyle] the fix you are proposing d

[jira] [Resolved] (SPARK-23913) High-order function: array_intersect(x, y) → array

2018-08-06 Thread Takuya Ueshin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin resolved SPARK-23913. --- Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.4.0 Issue reso

[jira] [Commented] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570258#comment-16570258 ] Apache Spark commented on SPARK-25033: -- User 'Fokko' has created a pull request for

[jira] [Assigned] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25033: Assignee: Apache Spark > Bump Apache commons.{httpclient, httpcore} > ---

[jira] [Assigned] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25033: Assignee: (was: Apache Spark) > Bump Apache commons.{httpclient, httpcore} >

[jira] [Created] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

2018-08-06 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created SPARK-25033: Summary: Bump Apache commons.{httpclient, httpcore} Key: SPARK-25033 URL: https://issues.apache.org/jira/browse/SPARK-25033 Project: Spark Issue Type

[jira] [Resolved] (SPARK-24981) ShutdownHook timeout causes job to fail when succeeded when SparkContext stop() not called by user program

2018-08-06 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-24981. --- Resolution: Fixed Assignee: Hieu Tri Huynh Fix Version/s: 2.4.0 > ShutdownHo

[jira] [Commented] (SPARK-24924) Add mapping for built-in Avro data source

2018-08-06 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570220#comment-16570220 ] Thomas Graves commented on SPARK-24924: --- {quote}I have followed the changes in Avr

[jira] [Commented] (SPARK-25024) Update mesos documentation to be clear about security supported

2018-08-06 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570194#comment-16570194 ] Thomas Graves commented on SPARK-25024: --- We need to make it clear what mesos suppo

[jira] [Updated] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database

2018-08-06 Thread Ayush Anubhava (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Anubhava updated SPARK-25032: --- Component/s: (was: Spark Shell) SQL > Create table is failing, after dr

[jira] [Commented] (SPARK-23938) High-order function: map_zip_with(map, map, function) → map

2018-08-06 Thread Marek Novotny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-23938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570148#comment-16570148 ] Marek Novotny commented on SPARK-23938: --- I'm working on this. Thanks. > High-orde

[jira] [Commented] (SPARK-25012) dataframe creation results in matcherror

2018-08-06 Thread uwe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570144#comment-16570144 ] uwe commented on SPARK-25012: - as a side note: i could not make it crash when i replace  v

[jira] [Updated] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database

2018-08-06 Thread Ayush Anubhava (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Anubhava updated SPARK-25032: --- Description: *Launch spark-beeline for both the scenarios* *Scenario 1* create database cb

[jira] [Created] (SPARK-25032) Create table is failing, after dropping the database . It is not falling back to default database

2018-08-06 Thread Ayush Anubhava (JIRA)
Ayush Anubhava created SPARK-25032: -- Summary: Create table is failing, after dropping the database . It is not falling back to default database Key: SPARK-25032 URL: https://issues.apache.org/jira/browse/SPARK-25

[jira] [Commented] (SPARK-25031) The schema of MapType can not be printed correctly

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570078#comment-16570078 ] Apache Spark commented on SPARK-25031: -- User 'invkrh' has created a pull request fo

[jira] [Assigned] (SPARK-25031) The schema of MapType can not be printed correctly

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25031: Assignee: Apache Spark > The schema of MapType can not be printed correctly > ---

[jira] [Assigned] (SPARK-25031) The schema of MapType can not be printed correctly

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25031: Assignee: (was: Apache Spark) > The schema of MapType can not be printed correctly >

[jira] [Updated] (SPARK-25031) The schema of MapType can not be printed correctly

2018-08-06 Thread Hao Ren (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hao Ren updated SPARK-25031: Description: Something wrong with the function `buildFormattedString` in `MapType`   {code:java} import s

[jira] [Created] (SPARK-25031) The schema of MapType can not be printed correctly

2018-08-06 Thread Hao Ren (JIRA)
Hao Ren created SPARK-25031: --- Summary: The schema of MapType can not be printed correctly Key: SPARK-25031 URL: https://issues.apache.org/jira/browse/SPARK-25031 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT

2018-08-06 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-25025. - Resolution: Fixed Fix Version/s: 2.4.0 > Remove the default value of isAll in INTERSECT/EXCEPT >

[jira] [Commented] (SPARK-25012) dataframe creation results in matcherror

2018-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16570022#comment-16570022 ] Marco Gaido commented on SPARK-25012: - [~simm] you're right that the error message d

[jira] [Commented] (SPARK-25012) dataframe creation results in matcherror

2018-08-06 Thread uwe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569990#comment-16569990 ] uwe commented on SPARK-25012: - if it is an issue then the error messages do not allow to loc

[jira] [Updated] (SPARK-24987) Kafka Cached Consumer Leaking File Descriptors

2018-08-06 Thread Yuval Itzchakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuval Itzchakov updated SPARK-24987: Fix Version/s: 2.3.2 > Kafka Cached Consumer Leaking File Descriptors > --

[jira] [Commented] (SPARK-25012) dataframe creation results in matcherror

2018-08-06 Thread Marco Gaido (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569960#comment-16569960 ] Marco Gaido commented on SPARK-25012: - Seems the same as SPARK-24366. Seems anyway a

[jira] [Created] (SPARK-25030) SparkSubmit will not return result if the mainClass submitted creates a Timer()

2018-08-06 Thread Jiang Xingbo (JIRA)
Jiang Xingbo created SPARK-25030: Summary: SparkSubmit will not return result if the mainClass submitted creates a Timer() Key: SPARK-25030 URL: https://issues.apache.org/jira/browse/SPARK-25030 Proje

[jira] [Commented] (SPARK-16817) Enable storing of shuffle data in Alluxio

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569904#comment-16569904 ] Apache Spark commented on SPARK-16817: -- User 'Chopinxb' has created a pull request

[jira] [Updated] (SPARK-24857) required the sample code test the spark steaming job in kubernates and write the data in remote hdfs file system

2018-08-06 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-24857: - Issue Type: Bug (was: Test) > required the sample code test the spark steaming job in kubernate

[jira] [Commented] (SPARK-9478) Add sample weights to Random Forest

2018-08-06 Thread Julian King (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569855#comment-16569855 ] Julian King commented on SPARK-9478: Has there been any progress on this in recent ti

[jira] [Resolved] (SPARK-24991) use InternalRow in DataSourceWriter

2018-08-06 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-24991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24991. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 21948 [https://gith

[jira] [Commented] (SPARK-25013) JDBC urls with jdbc:mariadb don't work as expected

2018-08-06 Thread Takeshi Yamamuro (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569811#comment-16569811 ] Takeshi Yamamuro commented on SPARK-25013: -- Spark currently doesn't have a dial

<    1   2