[jira] [Created] (SPARK-26644) Add documents for SQL metrics

Takeshi Yamamuro created SPARK-26644: Summary: Add documents for SQL metrics Key: SPARK-26644 URL: https://issues.apache.org/jira/browse/SPARK-26644 Project: Spark Issue Type:

[jira] [Updated] (SPARK-26576) Broadcast hint not applied to partitioned table

[ https://issues.apache.org/jira/browse/SPARK-26576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26576: - Fix Version/s: (was: 2.3.3) > Broadcast hint not applied to partitioned table >

[jira] [Commented] (SPARK-26644) Add documents for SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-26644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745011#comment-16745011 ] Takeshi Yamamuro commented on SPARK-26644: -- An example I made is: 

[jira] [Commented] (SPARK-26644) Add documents for SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-26644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16745777#comment-16745777 ] Takeshi Yamamuro commented on SPARK-26644: -- If nobody takes it, I will after v2.3.3 release

[jira] [Updated] (SPARK-26644) Add documents for SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-26644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26644: - Description: To make Spark users understand SQL metrics more, it would be nice to

[jira] [Created] (SPARK-26262) Run SQLQueryTestSuite with WHOLESTAGE_CODEGEN_ENABLED=false

Takeshi Yamamuro created SPARK-26262: Summary: Run SQLQueryTestSuite with WHOLESTAGE_CODEGEN_ENABLED=false Key: SPARK-26262 URL: https://issues.apache.org/jira/browse/SPARK-26262 Project: Spark

[jira] [Updated] (SPARK-26224) Results in stackOverFlowError when trying to add 3000 new columns using withColumn function of dataframe.

[ https://issues.apache.org/jira/browse/SPARK-26224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26224: - Component/s: (was: Spark Core) SQL > Results in stackOverFlowError

[jira] [Commented] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707095#comment-16707095 ] Takeshi Yamamuro commented on SPARK-26215: -- These reserved words should be handled inside

[jira] [Commented] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707099#comment-16707099 ] Takeshi Yamamuro commented on SPARK-26215: -- I found some useful documents about the reserved

[jira] [Reopened] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-23264: -- > Support interval values without INTERVAL clauses >

[jira] [Updated] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23264: - Issue Type: Sub-task (was: Improvement) Parent: SPARK-26217 > Support interval

[jira] [Commented] (SPARK-23264) Support interval values without INTERVAL clauses

[ https://issues.apache.org/jira/browse/SPARK-23264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707006#comment-16707006 ] Takeshi Yamamuro commented on SPARK-23264: -- Since the next release version is v3.0, I reopened.

[jira] [Updated] (SPARK-26182) Cost increases when optimizing scalaUDF

[ https://issues.apache.org/jira/browse/SPARK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26182: - Issue Type: Improvement (was: Bug) > Cost increases when optimizing scalaUDF >

[jira] [Commented] (SPARK-26182) Cost increases when optimizing scalaUDF

[ https://issues.apache.org/jira/browse/SPARK-26182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16711014#comment-16711014 ] Takeshi Yamamuro commented on SPARK-26182: -- This is an expected behaviour and a known issue,

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Description: For better test coverage, we need to run `SQLQueryTestSuite` on 4 mixed

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Summary: Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and

[jira] [Updated] (SPARK-26262) Runs SQLQueryTestSuite on mixed config sets: WHOLESTAGE_CODEGEN_ENABLED and CODEGEN_FACTORY_MODE

[ https://issues.apache.org/jira/browse/SPARK-26262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26262: - Description: For better test coverage, we need to run `SQLQueryTestSuite` on 4 mixed

[jira] [Commented] (SPARK-26077) Reserved SQL words are not escaped by JDBC writer for table name

[ https://issues.apache.org/jira/browse/SPARK-26077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692546#comment-16692546 ] Takeshi Yamamuro commented on SPARK-26077: -- Thanks for your reporting! It seems the master

[jira] [Issue Comment Deleted] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Comment: was deleted (was: This fix has been reverted by

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Fix Version/s: (was: 2.4.0) > Update nullability based on children's output in

[jira] [Reopened] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-21351: -- > Update nullability based on children's output in optimized logical plan >

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Affects Version/s: (was: 2.1.1) 2.2.2 > Update nullability

[jira] [Updated] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-21351: - Affects Version/s: 2.3.2 > Update nullability based on children's output in optimized

[jira] [Commented] (SPARK-21351) Update nullability based on children's output in optimized logical plan

[ https://issues.apache.org/jira/browse/SPARK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16739315#comment-16739315 ] Takeshi Yamamuro commented on SPARK-21351: -- This fix has been reverted by

[jira] [Resolved] (SPARK-26459) remove UpdateNullabilityInAttributeReferences

[ https://issues.apache.org/jira/browse/SPARK-26459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26459. -- Resolution: Fixed Fix Version/s: 3.0.0 Issue resolved by pull request 23390

[jira] [Updated] (SPARK-25853) Parts of spark components (DAG Visualizationand executors page) not available in Internet Explorer

[ https://issues.apache.org/jira/browse/SPARK-25853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25853: - Fix Version/s: (was: 2.3.3) > Parts of spark components (DAG Visualizationand

[jira] [Commented] (SPARK-25853) Parts of spark components (DAG Visualizationand executors page) not available in Internet Explorer

[ https://issues.apache.org/jira/browse/SPARK-25853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16741511#comment-16741511 ] Takeshi Yamamuro commented on SPARK-25853: -- Yea, thanks for pinging me. Dropped. > Parts of

[jira] [Created] (SPARK-25426) Handles subexpression elimination config inside CodeGeneratorWithInterpretedFallback

Takeshi Yamamuro created SPARK-25426: Summary: Handles subexpression elimination config inside CodeGeneratorWithInterpretedFallback Key: SPARK-25426 URL: https://issues.apache.org/jira/browse/SPARK-25426

[jira] [Updated] (SPARK-25426) Remove the duplicate fallback logic in UnsafeProjection

[ https://issues.apache.org/jira/browse/SPARK-25426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25426: - Summary: Remove the duplicate fallback logic in UnsafeProjection (was: Handles

[jira] [Resolved] (SPARK-25462) hive on spark - got a weird output when count(*) from this script

[ https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25462. -- Resolution: Invalid > hive on spark - got a weird output when count(*) from this

***UNCHECKED*** [jira] [Commented] (SPARK-25462) hive on spark - got a weird output when count(*) from this script

[ https://issues.apache.org/jira/browse/SPARK-25462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620460#comment-16620460 ] Takeshi Yamamuro commented on SPARK-25462: -- You should first ask in the spark-user mailing

***UNCHECKED*** [jira] [Commented] (SPARK-20937) Describe spark.sql.parquet.writeLegacyFormat property in Spark SQL, DataFrames and Datasets Guide

[ https://issues.apache.org/jira/browse/SPARK-20937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620468#comment-16620468 ] Takeshi Yamamuro commented on SPARK-20937: -- +1, too. Do you have time to write these docs?

[jira] [Commented] (SPARK-25374) SafeProjection supports fallback to an interpreted mode

[ https://issues.apache.org/jira/browse/SPARK-25374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16617437#comment-16617437 ] Takeshi Yamamuro commented on SPARK-25374: -- I do not have a strong opinion though, I feel it is

[jira] [Commented] (SPARK-25453) OracleIntegrationSuite IllegalArgumentException: Timestamp format must be yyyy-mm-dd hh:mm:ss[.fffffffff]

[ https://issues.apache.org/jira/browse/SPARK-25453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16619121#comment-16619121 ] Takeshi Yamamuro commented on SPARK-25453: -- oh, thanks. Can you fix this? >

[jira] [Updated] (SPARK-26745) Non-parsing Dataset.count() optimization causes inconsistent results for JSON inputs with empty lines

[ https://issues.apache.org/jira/browse/SPARK-26745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26745: - Labels: correctness (was: ) > Non-parsing Dataset.count() optimization causes

[jira] [Commented] (SPARK-26745) Non-parsing Dataset.count() optimization causes inconsistent results for JSON inputs with empty lines

[ https://issues.apache.org/jira/browse/SPARK-26745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753644#comment-16753644 ] Takeshi Yamamuro commented on SPARK-26745: -- I checked I could reproduce this in

[jira] [Created] (SPARK-26747) Makes GetMapValue nullability more precise

Takeshi Yamamuro created SPARK-26747: Summary: Makes GetMapValue nullability more precise Key: SPARK-26747 URL: https://issues.apache.org/jira/browse/SPARK-26747 Project: Spark Issue

[jira] [Commented] (SPARK-26709) OptimizeMetadataOnlyQuery does not correctly handle the files with zero record

[ https://issues.apache.org/jira/browse/SPARK-26709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753948#comment-16753948 ] Takeshi Yamamuro commented on SPARK-26709: -- Resolved by

[jira] [Resolved] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27170. -- Resolution: Not A Problem > Better error message for syntax error with extraneous

[jira] [Assigned] (SPARK-26894) Fix Alias handling in AggregateEstimation

[ https://issues.apache.org/jira/browse/SPARK-26894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reassigned SPARK-26894: Assignee: Venkata krishnan Sowrirajan > Fix Alias handling in

[jira] [Resolved] (SPARK-26894) Fix Alias handling in AggregateEstimation

[ https://issues.apache.org/jira/browse/SPARK-26894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26894. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by

[jira] [Resolved] (SPARK-27288) Pruning nested field in complex map key from object serializers

[ https://issues.apache.org/jira/browse/SPARK-27288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27288. -- Resolution: Fixed Assignee: Liang-Chi Hsieh Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-27266) Support ANALYZE TABLE to collect tables stats for cached catalog views

[ https://issues.apache.org/jira/browse/SPARK-27266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27266: - Description: The master doesn't support ANALYZE TABLE to collect tables stats for

[jira] [Created] (SPARK-27266) Support ANALYZE TABLE to collect tables stats for cached catalog views

Takeshi Yamamuro created SPARK-27266: Summary: Support ANALYZE TABLE to collect tables stats for cached catalog views Key: SPARK-27266 URL: https://issues.apache.org/jira/browse/SPARK-27266

[jira] [Updated] (SPARK-27251) SPARK-25196 Scala 2.11 maven build failure

[ https://issues.apache.org/jira/browse/SPARK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27251: - Summary: SPARK-25196 Scala 2.11 maven build failure (was: SPARK-25196 Scala 2.1.1

[jira] [Updated] (SPARK-27251) @volatile var cannot be defined in case class in Scala v2.11

[ https://issues.apache.org/jira/browse/SPARK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27251: - Summary: @volatile var cannot be defined in case class in Scala v2.11 (was:

[jira] [Updated] (SPARK-27251) @volatile var cannot be defined in case class in Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27251: - Summary: @volatile var cannot be defined in case class in Scala 2.11 (was: @volatile

[jira] [Commented] (SPARK-27251) @volatile var cannot be defined in case class in Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-27251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799469#comment-16799469 ] Takeshi Yamamuro commented on SPARK-27251: -- @volatile var cannot be defined in case class in

[jira] [Resolved] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-24239. -- Resolution: Fixed Assignee: Jungtaek Lim Fix Version/s: 2.3.4

[jira] [Commented] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772984#comment-16772984 ] Takeshi Yamamuro commented on SPARK-24239: -- I closed this cuz it seems these test failures

[jira] [Commented] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16772980#comment-16772980 ] Takeshi Yamamuro commented on SPARK-24211: -- I closed this cuz it seems these test failures

[jira] [Resolved] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-24211. -- Resolution: Fixed Assignee: Jungtaek Lim Fix Version/s: 2.3.4

[jira] [Resolved] (SPARK-26215) define reserved keywords after SQL standard

[ https://issues.apache.org/jira/browse/SPARK-26215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26215. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0

[jira] [Created] (SPARK-26976) Forbid reserved keywords as identifiers when ANSI mode is on

Takeshi Yamamuro created SPARK-26976: Summary: Forbid reserved keywords as identifiers when ANSI mode is on Key: SPARK-26976 URL: https://issues.apache.org/jira/browse/SPARK-26976 Project: Spark

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16782903#comment-16782903 ] Takeshi Yamamuro commented on SPARK-25863: -- Yea, returning 0 sounds reasonable to me, too. >

[jira] [Created] (SPARK-26965) Makes ElementAt nullability more precise

Takeshi Yamamuro created SPARK-26965: Summary: Makes ElementAt nullability more precise Key: SPARK-26965 URL: https://issues.apache.org/jira/browse/SPARK-26965 Project: Spark Issue Type:

[jira] [Commented] (SPARK-26942) spark v 2.3.2 test failure in hive module

[ https://issues.apache.org/jira/browse/SPARK-26942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774780#comment-16774780 ] Takeshi Yamamuro commented on SPARK-26942: -- Could you ask first in the spark mailing list? If

[jira] [Resolved] (SPARK-26942) spark v 2.3.2 test failure in hive module

[ https://issues.apache.org/jira/browse/SPARK-26942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26942. -- Resolution: Invalid > spark v 2.3.2 test failure in hive module >

[jira] [Comment Edited] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794429#comment-16794429 ] Takeshi Yamamuro edited comment on SPARK-27170 at 3/17/19 10:53 AM:

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794429#comment-16794429 ] Takeshi Yamamuro commented on SPARK-27170: -- Any other query with hard-to-read parsing error

[jira] [Commented] (SPARK-27170) Better error message for syntax error with extraneous comma in the SQL parser

[ https://issues.apache.org/jira/browse/SPARK-27170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794454#comment-16794454 ] Takeshi Yamamuro commented on SPARK-27170: -- yea, yes. The mode is available in v3.0. > Better

[jira] [Resolved] (SPARK-27161) improve the document of SQL keywords

[ https://issues.apache.org/jira/browse/SPARK-27161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27161. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by

[jira] [Resolved] (SPARK-26976) Forbid reserved keywords as identifiers when ANSI mode is on

[ https://issues.apache.org/jira/browse/SPARK-26976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26976. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by 

[jira] [Created] (SPARK-27148) Support CURRENT_TIME, LOCALTIME, and LOCALTIMESTAMP when ANSI mode enabled

Takeshi Yamamuro created SPARK-27148: Summary: Support CURRENT_TIME, LOCALTIME, and LOCALTIMESTAMP when ANSI mode enabled Key: SPARK-27148 URL: https://issues.apache.org/jira/browse/SPARK-27148

[jira] [Updated] (SPARK-27148) Support CURRENT_TIME and LOCALTIME when ANSI mode enabled

[ https://issues.apache.org/jira/browse/SPARK-27148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27148: - Summary: Support CURRENT_TIME and LOCALTIME when ANSI mode enabled (was: Support

[jira] [Reopened] (SPARK-7101) Spark SQL should support java.sql.Time

[ https://issues.apache.org/jira/browse/SPARK-7101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro reopened SPARK-7101: - I reopened because we need this type to follow the ANSI standard. > Spark SQL should

[jira] [Created] (SPARK-27151) Makes ClearCacheCommand case-object

Takeshi Yamamuro created SPARK-27151: Summary: Makes ClearCacheCommand case-object Key: SPARK-27151 URL: https://issues.apache.org/jira/browse/SPARK-27151 Project: Spark Issue Type:

[jira] [Updated] (SPARK-27151) ClearCacheCommand should be case-object to avoid copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27151: - Summary: ClearCacheCommand should be case-object to avoid copys (was: Makes

[jira] [Updated] (SPARK-27151) ClearCacheCommand should be case-object to avoid copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27151: - Priority: Trivial (was: Major) > ClearCacheCommand should be case-object to avoid

[jira] [Resolved] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-25863. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala:1

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-25863: - Fix Version/s: 2.4.2 2.3.4 >

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786512#comment-16786512 ] Takeshi Yamamuro commented on SPARK-25863: -- [~vfeldsher] Can you check if your query works well

[jira] [Created] (SPARK-27110) Moves some functions from AnalyzeColumnCommand to command/CommandUtils for reuse

Takeshi Yamamuro created SPARK-27110: Summary: Moves some functions from AnalyzeColumnCommand to command/CommandUtils for reuse Key: SPARK-27110 URL: https://issues.apache.org/jira/browse/SPARK-27110

[jira] [Updated] (SPARK-27110) Moves some functions from AnalyzeColumnCommand to command/CommandUtils for reuse

[ https://issues.apache.org/jira/browse/SPARK-27110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27110: - Description: To reuse some common logics for improving {{Analyze}} commands (See the

[jira] [Resolved] (SPARK-26004) InMemoryTable support StartsWith predicate push down

[ https://issues.apache.org/jira/browse/SPARK-26004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26004. -- Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 3.0.0 Resolved

[jira] [Commented] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786381#comment-16786381 ] Takeshi Yamamuro commented on SPARK-26868: -- Yea, you can do. > Duplicate error message for

[jira] [Resolved] (SPARK-27151) ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-27151. -- Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 3.0.0

[jira] [Updated] (SPARK-27151) ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27151: - Description: In SPARK-27011, we introduced IgnoreCahedData to avoid plan node copys in

[jira] [Updated] (SPARK-27151) ClearCacheCommand extends IgnoreCahedData to avoid plan node copys

[ https://issues.apache.org/jira/browse/SPARK-27151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-27151: - Summary: ClearCacheCommand extends IgnoreCahedData to avoid plan node copys (was:

[jira] [Created] (SPARK-27149) Support LOCALTIMESTAMP when ANSI mode enabled

Takeshi Yamamuro created SPARK-27149: Summary: Support LOCALTIMESTAMP when ANSI mode enabled Key: SPARK-27149 URL: https://issues.apache.org/jira/browse/SPARK-27149 Project: Spark Issue

[jira] [Commented] (SPARK-25863) java.lang.UnsupportedOperationException: empty.max at org.apache.spark.sql.catalyst.expressions.codegen.CodeGenerator$.updateAndGetCompilationStats(CodeGenerator.scala

[ https://issues.apache.org/jira/browse/SPARK-25863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788811#comment-16788811 ] Takeshi Yamamuro commented on SPARK-25863: -- Thanks alot! >

[jira] [Commented] (SPARK-27060) DDL Commands are accepting Keywords like create, drop as tableName

[ https://issues.apache.org/jira/browse/SPARK-27060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788813#comment-16788813 ] Takeshi Yamamuro commented on SPARK-27060: -- This issue is currently in-progress and plz see: 

[jira] [Updated] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24211: - Affects Version/s: (was: 2.4.0) 2.3.2 > Flaky test:

[jira] [Updated] (SPARK-23416) Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress test for failOnDataLoss=false

[ https://issues.apache.org/jira/browse/SPARK-23416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23416: - Fix Version/s: 2.3.4 > Flaky test: KafkaSourceStressForDontFailOnDataLossSuite.stress

[jira] [Updated] (SPARK-23491) continuous symptom

[ https://issues.apache.org/jira/browse/SPARK-23491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-23491: - Fix Version/s: 2.3.4 > continuous symptom > -- > > Key:

[jira] [Commented] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766756#comment-16766756 ] Takeshi Yamamuro commented on SPARK-24211: -- Based on the discussion

[jira] [Comment Edited] (SPARK-24211) Flaky test: StreamingOuterJoinSuite

[ https://issues.apache.org/jira/browse/SPARK-24211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766756#comment-16766756 ] Takeshi Yamamuro edited comment on SPARK-24211 at 2/13/19 4:10 AM: ---

[jira] [Updated] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-24239: - Affects Version/s: (was: 2.4.0) 2.3.2 > Flaky test:

[jira] [Commented] (SPARK-24239) Flaky test: KafkaContinuousSourceSuite.subscribing topic by name from earliest offsets

[ https://issues.apache.org/jira/browse/SPARK-24239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16766757#comment-16766757 ] Takeshi Yamamuro commented on SPARK-24239: -- Based on the discussion

[jira] [Resolved] (SPARK-26857) Return UnsafeArrayData for date/timestamp type in ColumnarArray.copy()

[ https://issues.apache.org/jira/browse/SPARK-26857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26857. -- Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 3.0.0

[jira] [Created] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

Takeshi Yamamuro created SPARK-26868: Summary: Duplicate error message for implicit cartesian product in verbose explain Key: SPARK-26868 URL: https://issues.apache.org/jira/browse/SPARK-26868

[jira] [Commented] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767912#comment-16767912 ] Takeshi Yamamuro commented on SPARK-26868: -- Thanks, [~dongjoon]! I might misunderstand the

[jira] [Commented] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767915#comment-16767915 ] Takeshi Yamamuro commented on SPARK-26868: -- Thanks, [~dongjoon]! I just set that number cuz I

[jira] [Issue Comment Deleted] (SPARK-26868) Duplicate error message for implicit cartesian product in verbose explain

[ https://issues.apache.org/jira/browse/SPARK-26868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro updated SPARK-26868: - Comment: was deleted (was: Thanks, [~dongjoon]! I might misunderstand the affected

[jira] [Resolved] (SPARK-26572) Join on distinct column with monotonically_increasing_id produces wrong output

[ https://issues.apache.org/jira/browse/SPARK-26572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26572. -- Resolution: Fixed Assignee: Peter Toth Fix Version/s: 3.0.0

[jira] [Resolved] (SPARK-26798) HandleNullInputsForUDF should trust nullability

[ https://issues.apache.org/jira/browse/SPARK-26798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Takeshi Yamamuro resolved SPARK-26798. -- Resolution: Fixed Fix Version/s: 3.0.0 Resolved by 

[jira] [Commented] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764662#comment-16764662 ] Takeshi Yamamuro commented on SPARK-26855: -- Aha, good catch. I always run the tests after

[jira] [Comment Edited] (SPARK-26855) SparkSubmitSuite fails on a clean build

[ https://issues.apache.org/jira/browse/SPARK-26855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16764662#comment-16764662 ] Takeshi Yamamuro edited comment on SPARK-26855 at 2/11/19 4:47 AM: ---

[jira] [Created] (SPARK-26897) Update Spark 2.3.x testing from HiveExternalCatalogVersionsSuite

Takeshi Yamamuro created SPARK-26897: Summary: Update Spark 2.3.x testing from HiveExternalCatalogVersionsSuite Key: SPARK-26897 URL: https://issues.apache.org/jira/browse/SPARK-26897 Project:

[jira] [Commented] (SPARK-26732) Flaky test: SparkContextInfoSuite.getRDDStorageInfo only reports on RDDs that actually persist data

[ https://issues.apache.org/jira/browse/SPARK-26732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755515#comment-16755515 ] Takeshi Yamamuro commented on SPARK-26732: -- Thanks for pinging me, dongjoon! > Flaky test:

<    5   6   7   8   9   10   11   12   13   14   >