[jira] [Commented] (SPARK-25020) Unable to Perform Graceful Shutdown in Spark Streaming with Hadoop 2.8

[ https://issues.apache.org/jira/browse/SPARK-25020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577846#comment-16577846 ] Saisai Shao commented on SPARK-25020: - Yes, we also met the same issue. This is more like a Hadoop

[jira] [Assigned] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25096: Assignee: Apache Spark > Loosen nullability if the cast is force-nullable. >

[jira] [Assigned] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25096: Assignee: (was: Apache Spark) > Loosen nullability if the cast is force-nullable. >

[jira] [Commented] (SPARK-25096) Loosen nullability if the cast is force-nullable.

[ https://issues.apache.org/jira/browse/SPARK-25096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577793#comment-16577793 ] Apache Spark commented on SPARK-25096: -- User 'ueshin' has created a pull request for this issue:

[jira] [Created] (SPARK-25096) Loosen nullability if the cast is force-nullable.

Takuya Ueshin created SPARK-25096: - Summary: Loosen nullability if the cast is force-nullable. Key: SPARK-25096 URL: https://issues.apache.org/jira/browse/SPARK-25096 Project: Spark Issue

[jira] [Commented] (SPARK-25094) proccesNext() failed to compile size is over 64kb

[ https://issues.apache.org/jira/browse/SPARK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577763#comment-16577763 ] Hyukjin Kwon commented on SPARK-25094: -- [~igreenfi], mind adding a reproducer so that we can verify

[jira] [Updated] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files

[ https://issues.apache.org/jira/browse/SPARK-25086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-25086: - Component/s: (was: Spark Core) SQL > Incorrect Default Value For "escape"

[jira] [Commented] (SPARK-25086) Incorrect Default Value For "escape" For CSV Files

[ https://issues.apache.org/jira/browse/SPARK-25086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577761#comment-16577761 ] Hyukjin Kwon commented on SPARK-25086: -- I think this is a duplicate of SPARK-22236 > Incorrect

[jira] [Assigned] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25033: Assignee: Fokko Driesprong > Bump Apache commons.{httpclient, httpcore} >

[jira] [Resolved] (SPARK-25033) Bump Apache commons.{httpclient, httpcore}

[ https://issues.apache.org/jira/browse/SPARK-25033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25033. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22007

[jira] [Assigned] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-25090: Assignee: Marco Gaido > java.lang.ClassCastException when using a CrossValidator >

[jira] [Resolved] (SPARK-25090) java.lang.ClassCastException when using a CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-25090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-25090. -- Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22076

[jira] [Assigned] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-25069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-25069: --- Assignee: eaton > Using UnsafeAlignedOffset to make the entire record of 8 byte Items

[jira] [Resolved] (SPARK-25069) Using UnsafeAlignedOffset to make the entire record of 8 byte Items aligned like which is used in UnsafeExternalSorter

[ https://issues.apache.org/jira/browse/SPARK-25069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-25069. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22053

[jira] [Updated] (SPARK-25084) "distribute by" on multiple columns may lead to codegen issue

[ https://issues.apache.org/jira/browse/SPARK-25084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-25084: Fix Version/s: 2.3.2 > "distribute by" on multiple columns may lead to codegen issue >

[jira] [Resolved] (SPARK-24774) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-24774. - Resolution: Fixed Fix Version/s: 2.4.0 Issue resolved by pull request 22037

[jira] [Assigned] (SPARK-24774) support reading AVRO logical types - Decimal

[ https://issues.apache.org/jira/browse/SPARK-24774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-24774: --- Assignee: Gengliang Wang > support reading AVRO logical types - Decimal >

[jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577741#comment-16577741 ] Mateusz Jukiewicz commented on SPARK-23298: --- [~tgraves] I edited the issue description and

[jira] [Updated] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Jukiewicz updated SPARK-23298: -- Description: This is what happens (EDIT - managed to get a reproducible example):

[jira] [Commented] (SPARK-23298) distinct.count on Dataset/DataFrame yields non-deterministic results

[ https://issues.apache.org/jira/browse/SPARK-23298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577734#comment-16577734 ] Mateusz Jukiewicz commented on SPARK-23298: --- [~tgraves] I have not yet tried to reproduce on

[jira] [Assigned] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25026: Assignee: Apache Spark (was: Sean Owen) > Binary releases should contain some copy of

[jira] [Commented] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577685#comment-16577685 ] Apache Spark commented on SPARK-25026: -- User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25026) Binary releases should contain some copy of compiled external integration modules

[ https://issues.apache.org/jira/browse/SPARK-25026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25026: Assignee: Sean Owen (was: Apache Spark) > Binary releases should contain some copy of

[jira] [Issue Comment Deleted] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT

[ https://issues.apache.org/jira/browse/SPARK-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-25025: -- Comment: was deleted (was: User 'srowen' has created a pull request for this issue:

[jira] [Assigned] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25095: Assignee: Apache Spark > Python support for BarrierTaskContext >

[jira] [Assigned] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-25095: Assignee: (was: Apache Spark) > Python support for BarrierTaskContext >

[jira] [Commented] (SPARK-25095) Python support for BarrierTaskContext

[ https://issues.apache.org/jira/browse/SPARK-25095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577639#comment-16577639 ] Apache Spark commented on SPARK-25095: -- User 'jiangxb1987' has created a pull request for this

[jira] [Commented] (SPARK-25025) Remove the default value of isAll in INTERSECT/EXCEPT

[ https://issues.apache.org/jira/browse/SPARK-25025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577623#comment-16577623 ] Apache Spark commented on SPARK-25025: -- User 'srowen' has created a pull request for this issue:

[jira] [Commented] (SPARK-25094) proccesNext() failed to compile size is over 64kb

[ https://issues.apache.org/jira/browse/SPARK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577593#comment-16577593 ] Marco Gaido commented on SPARK-25094: - This is a duplicate of many. Unfortunately this problem has

[jira] [Created] (SPARK-25095) Python support for BarrierTaskContext

Jiang Xingbo created SPARK-25095: Summary: Python support for BarrierTaskContext Key: SPARK-25095 URL: https://issues.apache.org/jira/browse/SPARK-25095 Project: Spark Issue Type: Task

[jira] [Comment Edited] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577502#comment-16577502 ] Yuming Wang edited comment on SPARK-24631 at 8/12/18 11:18 AM: --- I hit this

[jira] [Commented] (SPARK-24631) Cannot up cast column from bigint to smallint as it may truncate

[ https://issues.apache.org/jira/browse/SPARK-24631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577502#comment-16577502 ] Yuming Wang commented on SPARK-24631: - I hit this issue. fixed it by recreate table/view. Can you

[jira] [Comment Edited] (SPARK-25051) where clause on dataset gives AnalysisException

[ https://issues.apache.org/jira/browse/SPARK-25051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577401#comment-16577401 ] Yuming Wang edited comment on SPARK-25051 at 8/12/18 10:51 AM: --- Can you

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:22 AM: [~jodersky] I

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:21 AM: [~jodersky] I

[jira] [Comment Edited] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577449#comment-16577449 ] Minh Thai edited comment on SPARK-17368 at 8/12/18 8:21 AM: [~jodersky] I

[jira] [Commented] (SPARK-17368) Scala value classes create encoder problems and break at runtime

[ https://issues.apache.org/jira/browse/SPARK-17368?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577449#comment-16577449 ] Minh Thai commented on SPARK-17368: --- [~jodersky] I know that this is an old ticket but I still want to

[jira] [Created] (SPARK-25094) proccesNext() failed to compile size is over 64kb

Izek Greenfield created SPARK-25094: --- Summary: proccesNext() failed to compile size is over 64kb Key: SPARK-25094 URL: https://issues.apache.org/jira/browse/SPARK-25094 Project: Spark

[jira] [Created] (SPARK-25093) CodeFormatter could avoid creating regex object again and again

Izek Greenfield created SPARK-25093: --- Summary: CodeFormatter could avoid creating regex object again and again Key: SPARK-25093 URL: https://issues.apache.org/jira/browse/SPARK-25093 Project: Spark