[jira] [Created] (SPARK-1380) Add sort-merge based cogroup/joins.

Takuya Ueshin created SPARK-1380: Summary: Add sort-merge based cogroup/joins. Key: SPARK-1380 URL: https://issues.apache.org/jira/browse/SPARK-1380 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-1380) Add sort-merge based cogroup/joins.

[ https://issues.apache.org/jira/browse/SPARK-1380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13956313#comment-13956313 ] Takuya Ueshin commented on SPARK-1380: -- Pull-requested:

[jira] [Commented] (SPARK-1608) Cast.nullable should be true when cast from StringType to NumericType/TimestampType

[ https://issues.apache.org/jira/browse/SPARK-1608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979559#comment-13979559 ] Takuya Ueshin commented on SPARK-1608: -- Pull-requested:

[jira] [Commented] (SPARK-1610) Cast from BooleanType to NumericType should use exact type value.

[ https://issues.apache.org/jira/browse/SPARK-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979618#comment-13979618 ] Takuya Ueshin commented on SPARK-1610: -- Pull-requested:

[jira] [Commented] (SPARK-1778) Add 'limit' transformation to SchemaRDD.

[ https://issues.apache.org/jira/browse/SPARK-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993461#comment-13993461 ] Takuya Ueshin commented on SPARK-1778: -- Pull-requested:

[jira] [Created] (SPARK-1778) Add 'limit' transformation to SchemaRDD.

Takuya Ueshin created SPARK-1778: Summary: Add 'limit' transformation to SchemaRDD. Key: SPARK-1778 URL: https://issues.apache.org/jira/browse/SPARK-1778 Project: Spark Issue Type:

[jira] [Created] (SPARK-1819) Fix GetField.nullable.

Takuya Ueshin created SPARK-1819: Summary: Fix GetField.nullable. Key: SPARK-1819 URL: https://issues.apache.org/jira/browse/SPARK-1819 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-1819) Fix GetField.nullable.

[ https://issues.apache.org/jira/browse/SPARK-1819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13996201#comment-13996201 ] Takuya Ueshin commented on SPARK-1819: -- Pull-requested:

[jira] [Commented] (SPARK-1845) Use AllScalaRegistrar for SparkSqlSerializer to register serializers of Scala collections.

[ https://issues.apache.org/jira/browse/SPARK-1845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998680#comment-13998680 ] Takuya Ueshin commented on SPARK-1845: -- Pull-requested:

[jira] [Created] (SPARK-1845) Use AllScalaRegistrar for SparkSqlSerializer to register serializers of Scala collections.

Takuya Ueshin created SPARK-1845: Summary: Use AllScalaRegistrar for SparkSqlSerializer to register serializers of Scala collections. Key: SPARK-1845 URL: https://issues.apache.org/jira/browse/SPARK-1845

[jira] [Updated] (SPARK-1880) Eliminate unnecessary job executions.

[ https://issues.apache.org/jira/browse/SPARK-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-1880: - Description: There are unnecessary job executions in {{BroadcastNestedLoopJoin}}. When

[jira] [Created] (SPARK-1914) Simplify CountFunction not to traverse to evaluate all child expressions.

Takuya Ueshin created SPARK-1914: Summary: Simplify CountFunction not to traverse to evaluate all child expressions. Key: SPARK-1914 URL: https://issues.apache.org/jira/browse/SPARK-1914 Project:

[jira] [Updated] (SPARK-1914) Simplify CountFunction not to traverse to evaluate all child expressions.

[ https://issues.apache.org/jira/browse/SPARK-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-1914: - Description: {{CountFunction}} should count up only if the child's evaluated value is not null.

[jira] [Commented] (SPARK-1914) Simplify CountFunction not to traverse to evaluate all child expressions.

[ https://issues.apache.org/jira/browse/SPARK-1914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007033#comment-14007033 ] Takuya Ueshin commented on SPARK-1914: -- Pull-requested:

[jira] [Commented] (SPARK-1915) AverageFunction should not count if the evaluated value is null.

[ https://issues.apache.org/jira/browse/SPARK-1915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007136#comment-14007136 ] Takuya Ueshin commented on SPARK-1915: -- Pull-requested:

[jira] [Commented] (SPARK-1926) Nullability of Max/Min/First should be true.

[ https://issues.apache.org/jira/browse/SPARK-1926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14008631#comment-14008631 ] Takuya Ueshin commented on SPARK-1926: -- PRed:

[jira] [Created] (SPARK-1938) ApproxCountDistinctMergeFunction should return Int value.

Takuya Ueshin created SPARK-1938: Summary: ApproxCountDistinctMergeFunction should return Int value. Key: SPARK-1938 URL: https://issues.apache.org/jira/browse/SPARK-1938 Project: Spark

[jira] [Commented] (SPARK-1938) ApproxCountDistinctMergeFunction should return Int value.

[ https://issues.apache.org/jira/browse/SPARK-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14009555#comment-14009555 ] Takuya Ueshin commented on SPARK-1938: -- PRed:

[jira] [Commented] (SPARK-1947) Child of SumDistinct or Average should be widened to prevent overflows the same as Sum.

[ https://issues.apache.org/jira/browse/SPARK-1947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010945#comment-14010945 ] Takuya Ueshin commented on SPARK-1947: -- PRed:

[jira] [Created] (SPARK-2029) Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT.

Takuya Ueshin created SPARK-2029: Summary: Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT. Key: SPARK-2029 URL: https://issues.apache.org/jira/browse/SPARK-2029 Project: Spark

[jira] [Commented] (SPARK-2029) Bump pom.xml version number of master branch to 1.1.0-SNAPSHOT.

[ https://issues.apache.org/jira/browse/SPARK-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018492#comment-14018492 ] Takuya Ueshin commented on SPARK-2029: -- PRed:

[jira] [Created] (SPARK-2030) Bump SparkBuild.scala version number of branch-1.0 to 1.0.1-SNAPSHOT.

Takuya Ueshin created SPARK-2030: Summary: Bump SparkBuild.scala version number of branch-1.0 to 1.0.1-SNAPSHOT. Key: SPARK-2030 URL: https://issues.apache.org/jira/browse/SPARK-2030 Project: Spark

[jira] [Commented] (SPARK-2030) Bump SparkBuild.scala version number of branch-1.0 to 1.0.1-SNAPSHOT.

[ https://issues.apache.org/jira/browse/SPARK-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018493#comment-14018493 ] Takuya Ueshin commented on SPARK-2030: -- PRed:

[jira] [Created] (SPARK-2036) CaseConversionExpression should check if the evaluated value is null.

Takuya Ueshin created SPARK-2036: Summary: CaseConversionExpression should check if the evaluated value is null. Key: SPARK-2036 URL: https://issues.apache.org/jira/browse/SPARK-2036 Project: Spark

[jira] [Commented] (SPARK-2036) CaseConversionExpression should check if the evaluated value is null.

[ https://issues.apache.org/jira/browse/SPARK-2036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14018928#comment-14018928 ] Takuya Ueshin commented on SPARK-2036: -- PRed:

[jira] [Created] (SPARK-2052) Add optimization for CaseConversionExpression's.

Takuya Ueshin created SPARK-2052: Summary: Add optimization for CaseConversionExpression's. Key: SPARK-2052 URL: https://issues.apache.org/jira/browse/SPARK-2052 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2052) Add optimization for CaseConversionExpression's.

[ https://issues.apache.org/jira/browse/SPARK-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14019578#comment-14019578 ] Takuya Ueshin commented on SPARK-2052: -- PRed:

[jira] [Created] (SPARK-2093) NullPropagation should use exact type value.

Takuya Ueshin created SPARK-2093: Summary: NullPropagation should use exact type value. Key: SPARK-2093 URL: https://issues.apache.org/jira/browse/SPARK-2093 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2093) NullPropagation should use exact type value.

[ https://issues.apache.org/jira/browse/SPARK-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026232#comment-14026232 ] Takuya Ueshin commented on SPARK-2093: -- PRed:

[jira] [Created] (SPARK-2196) Fix nullability of CaseWhen.

Takuya Ueshin created SPARK-2196: Summary: Fix nullability of CaseWhen. Key: SPARK-2196 URL: https://issues.apache.org/jira/browse/SPARK-2196 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2196) Fix nullability of CaseWhen.

[ https://issues.apache.org/jira/browse/SPARK-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-2196: - Description: {{CaseWhen}} should use {{branches.length}} to check if {{elseValue}} is provided

[jira] [Commented] (SPARK-2196) Fix nullability of CaseWhen.

[ https://issues.apache.org/jira/browse/SPARK-2196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14037189#comment-14037189 ] Takuya Ueshin commented on SPARK-2196: -- PRed:

[jira] [Created] (SPARK-2254) ScalaRefection should mark primitive types as non-nullable.

Takuya Ueshin created SPARK-2254: Summary: ScalaRefection should mark primitive types as non-nullable. Key: SPARK-2254 URL: https://issues.apache.org/jira/browse/SPARK-2254 Project: Spark

[jira] [Commented] (SPARK-2254) ScalaRefection should mark primitive types as non-nullable.

[ https://issues.apache.org/jira/browse/SPARK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14041837#comment-14041837 ] Takuya Ueshin commented on SPARK-2254: -- PRed:

[jira] [Created] (SPARK-2287) Make ScalaReflection be able to handle Generic case classes.

Takuya Ueshin created SPARK-2287: Summary: Make ScalaReflection be able to handle Generic case classes. Key: SPARK-2287 URL: https://issues.apache.org/jira/browse/SPARK-2287 Project: Spark

[jira] [Commented] (SPARK-2287) Make ScalaReflection be able to handle Generic case classes.

[ https://issues.apache.org/jira/browse/SPARK-2287?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044389#comment-14044389 ] Takuya Ueshin commented on SPARK-2287: -- PRed:

[jira] [Created] (SPARK-2295) Make JavaBeans nullability stricter.

Takuya Ueshin created SPARK-2295: Summary: Make JavaBeans nullability stricter. Key: SPARK-2295 URL: https://issues.apache.org/jira/browse/SPARK-2295 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-2295) Make JavaBeans nullability stricter.

[ https://issues.apache.org/jira/browse/SPARK-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14044950#comment-14044950 ] Takuya Ueshin commented on SPARK-2295: -- PRed:

[jira] [Commented] (SPARK-2327) Fix nullabilities of Join/Generate/Aggregate.

[ https://issues.apache.org/jira/browse/SPARK-2327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047495#comment-14047495 ] Takuya Ueshin commented on SPARK-2327: -- PRed:

[jira] [Created] (SPARK-2328) Add execution of `SHOW TABLES` before `TestHive.reset()`.

Takuya Ueshin created SPARK-2328: Summary: Add execution of `SHOW TABLES` before `TestHive.reset()`. Key: SPARK-2328 URL: https://issues.apache.org/jira/browse/SPARK-2328 Project: Spark

[jira] [Commented] (SPARK-2328) Add execution of `SHOW TABLES` before `TestHive.reset()`.

[ https://issues.apache.org/jira/browse/SPARK-2328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14047546#comment-14047546 ] Takuya Ueshin commented on SPARK-2328: -- PRed:

[jira] [Created] (SPARK-2366) Add column pruning for the right side of LeftSemi join.

Takuya Ueshin created SPARK-2366: Summary: Add column pruning for the right side of LeftSemi join. Key: SPARK-2366 URL: https://issues.apache.org/jira/browse/SPARK-2366 Project: Spark Issue

[jira] [Commented] (SPARK-2366) Add column pruning for the right side of LeftSemi join.

[ https://issues.apache.org/jira/browse/SPARK-2366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14052265#comment-14052265 ] Takuya Ueshin commented on SPARK-2366: -- PRed:

[jira] [Commented] (SPARK-2386) RowWriteSupport should use the exact types to cast.

[ https://issues.apache.org/jira/browse/SPARK-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14053537#comment-14053537 ] Takuya Ueshin commented on SPARK-2386: -- PRed:

[jira] [Created] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

Takuya Ueshin created SPARK-2415: Summary: RowWriteSupport should handle empty ArrayType correctly. Key: SPARK-2415 URL: https://issues.apache.org/jira/browse/SPARK-2415 Project: Spark Issue

[jira] [Commented] (SPARK-2415) RowWriteSupport should handle empty ArrayType correctly.

[ https://issues.apache.org/jira/browse/SPARK-2415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14055983#comment-14055983 ] Takuya Ueshin commented on SPARK-2415: -- PRed:

[jira] [Created] (SPARK-2428) Add except and intersect methods to SchemaRDD.

Takuya Ueshin created SPARK-2428: Summary: Add except and intersect methods to SchemaRDD. Key: SPARK-2428 URL: https://issues.apache.org/jira/browse/SPARK-2428 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2431) Refine StringComparison and related codes.

[ https://issues.apache.org/jira/browse/SPARK-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14057640#comment-14057640 ] Takuya Ueshin commented on SPARK-2431: -- PRed:

[jira] [Created] (SPARK-2446) Add BinaryType support to Parquet I/O.

Takuya Ueshin created SPARK-2446: Summary: Add BinaryType support to Parquet I/O. Key: SPARK-2446 URL: https://issues.apache.org/jira/browse/SPARK-2446 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-2504) Fix nullability of Substring expression.

Takuya Ueshin created SPARK-2504: Summary: Fix nullability of Substring expression. Key: SPARK-2504 URL: https://issues.apache.org/jira/browse/SPARK-2504 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2504) Fix nullability of Substring expression.

[ https://issues.apache.org/jira/browse/SPARK-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063028#comment-14063028 ] Takuya Ueshin commented on SPARK-2504: -- PRed:

[jira] [Commented] (SPARK-2509) Add optimization for Substring.

[ https://issues.apache.org/jira/browse/SPARK-2509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063084#comment-14063084 ] Takuya Ueshin commented on SPARK-2509: -- PRed:

[jira] [Created] (SPARK-2518) Fix foldability of Substring expression.

Takuya Ueshin created SPARK-2518: Summary: Fix foldability of Substring expression. Key: SPARK-2518 URL: https://issues.apache.org/jira/browse/SPARK-2518 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-2518) Fix foldability of Substring expression.

[ https://issues.apache.org/jira/browse/SPARK-2518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063212#comment-14063212 ] Takuya Ueshin commented on SPARK-2518: -- PRed:

[jira] [Created] (SPARK-2535) Add StringComparison case to NullPropagation.

Takuya Ueshin created SPARK-2535: Summary: Add StringComparison case to NullPropagation. Key: SPARK-2535 URL: https://issues.apache.org/jira/browse/SPARK-2535 Project: Spark Issue Type:

[jira] [Commented] (SPARK-2535) Add StringComparison case to NullPropagation.

[ https://issues.apache.org/jira/browse/SPARK-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14064381#comment-14064381 ] Takuya Ueshin commented on SPARK-2535: -- PR: https://github.com/apache/spark/pull/1451

[jira] [Created] (SPARK-2588) Add some more DSLs.

Takuya Ueshin created SPARK-2588: Summary: Add some more DSLs. Key: SPARK-2588 URL: https://issues.apache.org/jira/browse/SPARK-2588 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-2965) Fix HashOuterJoin output nullabilities.

Takuya Ueshin created SPARK-2965: Summary: Fix HashOuterJoin output nullabilities. Key: SPARK-2965 URL: https://issues.apache.org/jira/browse/SPARK-2965 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-2969) Make ScalaReflection be able to handle MapType.containsNull and MapType.valueContainsNull.

[ https://issues.apache.org/jira/browse/SPARK-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-2969: - Description: Make {{ScalaReflection}} be able to handle like: - Seq\[Int] as

[jira] [Created] (SPARK-2969) Make ScalaReflection be able to handle MapType.containsNull and MapType.valueContainsNull.

Takuya Ueshin created SPARK-2969: Summary: Make ScalaReflection be able to handle MapType.containsNull and MapType.valueContainsNull. Key: SPARK-2969 URL: https://issues.apache.org/jira/browse/SPARK-2969

[jira] [Updated] (SPARK-2969) Make ScalaReflection be able to handle ArrayType.containsNull and MapType.valueContainsNull.

[ https://issues.apache.org/jira/browse/SPARK-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-2969: - Summary: Make ScalaReflection be able to handle ArrayType.containsNull and

[jira] [Created] (SPARK-3036) Add MapType containing null value support to Parquet.

Takuya Ueshin created SPARK-3036: Summary: Add MapType containing null value support to Parquet. Key: SPARK-3036 URL: https://issues.apache.org/jira/browse/SPARK-3036 Project: Spark Issue

[jira] [Created] (SPARK-3063) ExistingRdd should convert Map to catalyst Map.

Takuya Ueshin created SPARK-3063: Summary: ExistingRdd should convert Map to catalyst Map. Key: SPARK-3063 URL: https://issues.apache.org/jira/browse/SPARK-3063 Project: Spark Issue Type:

[jira] [Commented] (SPARK-3036) Add MapType containing null value support to Parquet.

[ https://issues.apache.org/jira/browse/SPARK-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105012#comment-14105012 ] Takuya Ueshin commented on SPARK-3036: -- Ah, that's right. It was my mistake. Newer

[jira] [Created] (SPARK-3204) MaxOf would be foldable if both left and right are foldable.

Takuya Ueshin created SPARK-3204: Summary: MaxOf would be foldable if both left and right are foldable. Key: SPARK-3204 URL: https://issues.apache.org/jira/browse/SPARK-3204 Project: Spark

[jira] [Commented] (SPARK-3341) The dataType of Sqrt expression should be DoubleType.

[ https://issues.apache.org/jira/browse/SPARK-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14119273#comment-14119273 ] Takuya Ueshin commented on SPARK-3341: -- Hi, this issue's Fix Version should be the

[jira] [Created] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

Takuya Ueshin created SPARK-3764: Summary: Invalid dependencies of artifacts in Maven Central Repository. Key: SPARK-3764 URL: https://issues.apache.org/jira/browse/SPARK-3764 Project: Spark

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156576#comment-14156576 ] Takuya Ueshin commented on SPARK-3764: -- Ah, so, these artifacts are only for hadoop-2

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156578#comment-14156578 ] Takuya Ueshin commented on SPARK-3764: -- Now I found the instruction

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156588#comment-14156588 ] Takuya Ueshin commented on SPARK-3764: -- But there are some codes using

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156599#comment-14156599 ] Takuya Ueshin commented on SPARK-3764: -- Ah, I see that {{context.getTaskAttemptID}}

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157418#comment-14157418 ] Takuya Ueshin commented on SPARK-3764: -- {{AppendingParquetOutputFormat}} is using

[jira] [Created] (SPARK-3771) AppendingParquetOutputFormat should use reflection to prevent breaking binary-compatibility.

Takuya Ueshin created SPARK-3771: Summary: AppendingParquetOutputFormat should use reflection to prevent breaking binary-compatibility. Key: SPARK-3771 URL: https://issues.apache.org/jira/browse/SPARK-3771

[jira] [Commented] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14157447#comment-14157447 ] Takuya Ueshin commented on SPARK-3764: -- I filed a new issue SPARK-3771 and close

[jira] [Closed] (SPARK-3764) Invalid dependencies of artifacts in Maven Central Repository.

[ https://issues.apache.org/jira/browse/SPARK-3764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin closed SPARK-3764. Resolution: Fixed Invalid dependencies of artifacts in Maven Central Repository.

[jira] [Updated] (SPARK-3771) AppendingParquetOutputFormat should use reflection to prevent from breaking binary-compatibility.

[ https://issues.apache.org/jira/browse/SPARK-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-3771: - Summary: AppendingParquetOutputFormat should use reflection to prevent from breaking

[jira] [Created] (SPARK-3966) Fix nullabilities of Cast related to DateType.

Takuya Ueshin created SPARK-3966: Summary: Fix nullabilities of Cast related to DateType. Key: SPARK-3966 URL: https://issues.apache.org/jira/browse/SPARK-3966 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-3969) Optimizer should have a super class as an interface.

Takuya Ueshin created SPARK-3969: Summary: Optimizer should have a super class as an interface. Key: SPARK-3969 URL: https://issues.apache.org/jira/browse/SPARK-3969 Project: Spark Issue

[jira] [Created] (SPARK-3986) Fix package names to fit their directory names.

Takuya Ueshin created SPARK-3986: Summary: Fix package names to fit their directory names. Key: SPARK-3986 URL: https://issues.apache.org/jira/browse/SPARK-3986 Project: Spark Issue Type:

[jira] [Created] (SPARK-4193) Disable doclint in Java 8 to prevent from build error.

Takuya Ueshin created SPARK-4193: Summary: Disable doclint in Java 8 to prevent from build error. Key: SPARK-4193 URL: https://issues.apache.org/jira/browse/SPARK-4193 Project: Spark Issue

[jira] [Created] (SPARK-4245) Fix containsNull of the result ArrayType of CreateArray expression.

Takuya Ueshin created SPARK-4245: Summary: Fix containsNull of the result ArrayType of CreateArray expression. Key: SPARK-4245 URL: https://issues.apache.org/jira/browse/SPARK-4245 Project: Spark

[jira] [Created] (SPARK-4270) Fix Cast from DateType to DecimalType.

Takuya Ueshin created SPARK-4270: Summary: Fix Cast from DateType to DecimalType. Key: SPARK-4270 URL: https://issues.apache.org/jira/browse/SPARK-4270 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-4293) Make Cast be able to handle complex types.

Takuya Ueshin created SPARK-4293: Summary: Make Cast be able to handle complex types. Key: SPARK-4293 URL: https://issues.apache.org/jira/browse/SPARK-4293 Project: Spark Issue Type:

[jira] [Created] (SPARK-4318) Fix empty sum distinct.

Takuya Ueshin created SPARK-4318: Summary: Fix empty sum distinct. Key: SPARK-4318 URL: https://issues.apache.org/jira/browse/SPARK-4318 Project: Spark Issue Type: Bug Components:

[jira] [Created] (SPARK-4319) Enable an ignored test null count.

Takuya Ueshin created SPARK-4319: Summary: Enable an ignored test null count. Key: SPARK-4319 URL: https://issues.apache.org/jira/browse/SPARK-4319 Project: Spark Issue Type: Test

[jira] [Created] (SPARK-4420) Change nullability of Cast from DoubleType/FloatType to DecimalType.

Takuya Ueshin created SPARK-4420: Summary: Change nullability of Cast from DoubleType/FloatType to DecimalType. Key: SPARK-4420 URL: https://issues.apache.org/jira/browse/SPARK-4420 Project: Spark

[jira] [Created] (SPARK-4425) Handle NaN cast to Timestamp correctly

Takuya Ueshin created SPARK-4425: Summary: Handle NaN cast to Timestamp correctly Key: SPARK-4425 URL: https://issues.apache.org/jira/browse/SPARK-4425 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-4425) Handle NaN or Infinity cast to Timestamp correctly

[ https://issues.apache.org/jira/browse/SPARK-4425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin updated SPARK-4425: - Summary: Handle NaN or Infinity cast to Timestamp correctly (was: Handle NaN cast to Timestamp

[jira] [Created] (SPARK-4428) Use ${scala.binary.version} property for artifactId.

Takuya Ueshin created SPARK-4428: Summary: Use ${scala.binary.version} property for artifactId. Key: SPARK-4428 URL: https://issues.apache.org/jira/browse/SPARK-4428 Project: Spark Issue

[jira] [Created] (SPARK-4429) Build for Scala 2.11 using sbt fails.

Takuya Ueshin created SPARK-4429: Summary: Build for Scala 2.11 using sbt fails. Key: SPARK-4429 URL: https://issues.apache.org/jira/browse/SPARK-4429 Project: Spark Issue Type: Bug

[jira] [Closed] (SPARK-4418) Remove restriction of binary arithmetic operations for fixed-precision decimal.

[ https://issues.apache.org/jira/browse/SPARK-4418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takuya Ueshin closed SPARK-4418. Resolution: Not a Problem Remove restriction of binary arithmetic operations for fixed-precision

[jira] [Created] (SPARK-4720) Remainder should also return null if the divider is 0.

Takuya Ueshin created SPARK-4720: Summary: Remainder should also return null if the divider is 0. Key: SPARK-4720 URL: https://issues.apache.org/jira/browse/SPARK-4720 Project: Spark Issue

[jira] [Created] (SPARK-5457) Add missing DSL for ApproxCountDistinct.

Takuya Ueshin created SPARK-5457: Summary: Add missing DSL for ApproxCountDistinct. Key: SPARK-5457 URL: https://issues.apache.org/jira/browse/SPARK-5457 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8476) Setters inc/decDiskBytesSpilled in TaskMetrics should also be private.

Takuya Ueshin created SPARK-8476: Summary: Setters inc/decDiskBytesSpilled in TaskMetrics should also be private. Key: SPARK-8476 URL: https://issues.apache.org/jira/browse/SPARK-8476 Project: Spark

[jira] [Created] (SPARK-7826) Suppress extra calling getCacheLocs.

Takuya Ueshin created SPARK-7826: Summary: Suppress extra calling getCacheLocs. Key: SPARK-7826 URL: https://issues.apache.org/jira/browse/SPARK-7826 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-15915) CacheManager should use canonicalized plan for planToCache.

Takuya Ueshin created SPARK-15915: - Summary: CacheManager should use canonicalized plan for planToCache. Key: SPARK-15915 URL: https://issues.apache.org/jira/browse/SPARK-15915 Project: Spark

[jira] [Created] (SPARK-15870) DataFrame can't execute after uncacheTable.

Takuya Ueshin created SPARK-15870: - Summary: DataFrame can't execute after uncacheTable. Key: SPARK-15870 URL: https://issues.apache.org/jira/browse/SPARK-15870 Project: Spark Issue Type:

[jira] [Commented] (SPARK-14752) LazilyGenerateOrdering throws NullPointerException

[ https://issues.apache.org/jira/browse/SPARK-14752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312215#comment-15312215 ] Takuya Ueshin commented on SPARK-14752: --- I agree that we should avoid null checks or lazy vals.

[jira] [Created] (SPARK-16167) RowEncoder should preserve array/map type nullability.

Takuya Ueshin created SPARK-16167: - Summary: RowEncoder should preserve array/map type nullability. Key: SPARK-16167 URL: https://issues.apache.org/jira/browse/SPARK-16167 Project: Spark

[jira] [Created] (SPARK-15980) Add PushPredicateThroughObjectConsumer rule to Optimizer.

Takuya Ueshin created SPARK-15980: - Summary: Add PushPredicateThroughObjectConsumer rule to Optimizer. Key: SPARK-15980 URL: https://issues.apache.org/jira/browse/SPARK-15980 Project: Spark

  1   2   3   4   5   6   7   8   9   >