[jira] [Assigned] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21871: --- Assignee: Takeshi Yamamuro > Check actual bytecode size when compiling generated code >

[jira] [Resolved] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21871. - Resolution: Fixed Fix Version/s: 2.3.0 > Check actual bytecode size when compiling generated code

[jira] [Updated] (SPARK-21871) Check actual bytecode size when compiling generated code

[ https://issues.apache.org/jira/browse/SPARK-21871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21871: Priority: Critical (was: Minor) > Check actual bytecode size when compiling generated code > -

[jira] [Commented] (SPARK-18131) Support returning Vector/Dense Vector from backend

[ https://issues.apache.org/jira/browse/SPARK-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16193916#comment-16193916 ] Xiao Li commented on SPARK-18131: - cc [~WeichenXu123] > Support returning Vector/Dense

[jira] [Resolved] (SPARK-22214) Refactor the list hive partitions code

[ https://issues.apache.org/jira/browse/SPARK-22214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22214. - Resolution: Fixed Assignee: Jiang Xingbo Fix Version/s: 2.3.0 > Refactor the list hive pa

[jira] [Updated] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

[ https://issues.apache.org/jira/browse/SPARK-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22170: Issue Type: Improvement (was: Bug) > Broadcast join holds an extra copy of rows in driver memory > ---

[jira] [Resolved] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

[ https://issues.apache.org/jira/browse/SPARK-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22170. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 2.3.0 > Broadcast join holds an extr

[jira] [Resolved] (SPARK-22222) Fix the ARRAY_MAX in BufferHolder and add a test

[ https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-2. - Resolution: Fixed Assignee: Feng Liu Fix Version/s: 2.3.0 > Fix the ARRAY_MAX in BufferHo

[jira] [Resolved] (SPARK-19558) Provide a config option to attach QueryExecutionListener to SparkSession

[ https://issues.apache.org/jira/browse/SPARK-19558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19558. - Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 > Provide a config option

[jira] [Resolved] (SPARK-21751) CodeGeneraor.splitExpressions counts code size more precisely

[ https://issues.apache.org/jira/browse/SPARK-21751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21751. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0 > CodeGeneraor.splitExp

[jira] [Resolved] (SPARK-22208) Improve percentile_approx by not rounding up targetError and starting from index 0

[ https://issues.apache.org/jira/browse/SPARK-22208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22208. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.3.0 > Improve percentile_approx

[jira] [Resolved] (SPARK-22263) Refactor deterministic as lazy value

[ https://issues.apache.org/jira/browse/SPARK-22263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22263. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > Refactor deterministic

[jira] [Updated] (SPARK-22263) Refactor deterministic as lazy value

[ https://issues.apache.org/jira/browse/SPARK-22263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22263: Priority: Major (was: Critical) > Refactor deterministic as lazy value > -

[jira] [Updated] (SPARK-22252) FileFormatWriter should respect the input query schema

[ https://issues.apache.org/jira/browse/SPARK-22252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22252: Fix Version/s: 2.2.1 > FileFormatWriter should respect the input query schema > ---

[jira] [Resolved] (SPARK-22257) Reserve all non-deterministic expressions in ExpressionSet.

[ https://issues.apache.org/jira/browse/SPARK-22257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22257. - Resolution: Fixed Assignee: Gengliang Wang Fix Version/s: 2.3.0 > Reserve all non-determi

[jira] [Resolved] (SPARK-21762) FileFormatWriter/BasicWriteTaskStatsTracker metrics collection fails if a new file isn't yet visible

[ https://issues.apache.org/jira/browse/SPARK-21762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21762. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 2.3.0 > FileFormatWriter/BasicW

[jira] [Resolved] (SPARK-22273) Fix key/value schema field names in HashMapGenerators.

[ https://issues.apache.org/jira/browse/SPARK-22273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22273. - Resolution: Fixed Assignee: Takuya Ueshin Fix Version/s: 2.3.0 2.2.1

[jira] [Resolved] (SPARK-22282) Rename OrcRelation to OrcFileFormat and remove ORC_COMPRESSION

[ https://issues.apache.org/jira/browse/SPARK-22282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22282. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Rename OrcRelation to Or

[jira] [Resolved] (SPARK-22280) Improve StatisticsSuite to test `convertMetastore` properly

[ https://issues.apache.org/jira/browse/SPARK-22280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22280. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Improve StatisticsSuite

[jira] [Updated] (SPARK-22249) UnsupportedOperationException: empty.reduceLeft when caching a dataframe

[ https://issues.apache.org/jira/browse/SPARK-22249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22249: Component/s: (was: PySpark) SQL > UnsupportedOperationException: empty.reduceLeft when

[jira] [Resolved] (SPARK-22271) Describe results in "null" for the value of "mean" of a numeric variable

[ https://issues.apache.org/jira/browse/SPARK-22271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22271. - Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 2.3.0 2.2.1 > De

[jira] [Resolved] (SPARK-22026) data source v2 write path

[ https://issues.apache.org/jira/browse/SPARK-22026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22026. - Resolution: Fixed Fix Version/s: 2.3.0 > data source v2 write path > - > >

[jira] [Resolved] (SPARK-21055) Support grouping__id

[ https://issues.apache.org/jira/browse/SPARK-21055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21055. - Resolution: Fixed Assignee: cen yuhai Fix Version/s: 2.3.0 > Support grouping__id > -

[jira] [Resolved] (SPARK-22326) Remove unnecessary hashCode and equals methods

[ https://issues.apache.org/jira/browse/SPARK-22326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22326. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.3.0 > Remove unnecessary hashCo

[jira] [Resolved] (SPARK-22303) [SQL] Getting java.sql.SQLException: Unsupported type 101 for BINARY_DOUBLE

[ https://issues.apache.org/jira/browse/SPARK-22303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22303. - Resolution: Fixed Assignee: Kohki Nishio Fix Version/s: 2.3.0 > [SQL] Getting java.sql.SQ

[jira] [Resolved] (SPARK-21929) Support `ALTER TABLE table_name ADD COLUMNS(..)` for ORC data source

[ https://issues.apache.org/jira/browse/SPARK-21929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21929. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 > Support `ALTER TABLE tab

[jira] [Resolved] (SPARK-22301) Add rule to Optimizer for In with empty list of values

[ https://issues.apache.org/jira/browse/SPARK-22301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22301. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.3.0 > Add rule to Optimizer for

[jira] [Resolved] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21101. - Resolution: Fixed Fix Version/s: 2.3.0 > Error running Hive temporary UDTF on latest Spark 2.2 > -

[jira] [Assigned] (SPARK-21101) Error running Hive temporary UDTF on latest Spark 2.2

[ https://issues.apache.org/jira/browse/SPARK-21101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-21101: --- Assignee: Yuming Wang > Error running Hive temporary UDTF on latest Spark 2.2 >

[jira] [Assigned] (SPARK-13947) The error message from using an invalid table reference is not clear

[ https://issues.apache.org/jira/browse/SPARK-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-13947: --- Assignee: Ruben Berenguel > The error message from using an invalid table reference is not clear > -

[jira] [Resolved] (SPARK-13947) The error message from using an invalid table reference is not clear

[ https://issues.apache.org/jira/browse/SPARK-13947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-13947. - Resolution: Fixed Fix Version/s: 2.3.0 > The error message from using an invalid table reference i

[jira] [Resolved] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22308. - Resolution: Fixed Assignee: Nathan Kronenfeld Fix Version/s: 2.3.0 > Support unit tests o

[jira] [Resolved] (SPARK-22356) data source table should support overlapped columns between data and partition schema

[ https://issues.apache.org/jira/browse/SPARK-22356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22356. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > data source table should support

[jira] [Resolved] (SPARK-22355) Dataset.collect is not threadsafe

[ https://issues.apache.org/jira/browse/SPARK-22355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22355. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Dataset.collect is not threadsaf

[jira] [Resolved] (SPARK-21375) Add date and timestamp support to ArrowConverters for toPandas() collection

[ https://issues.apache.org/jira/browse/SPARK-21375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21375. - Resolution: Fixed Assignee: Bryan Cutler Fix Version/s: 2.3.0 > Add date and timestamp su

[jira] [Updated] (SPARK-22335) Union for DataSet uses column order instead of types for union

[ https://issues.apache.org/jira/browse/SPARK-22335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22335: Issue Type: Documentation (was: Bug) > Union for DataSet uses column order instead of types for union > --

[jira] [Resolved] (SPARK-22226) splitExpression can create too many method calls (generating a Constant Pool limit error)

[ https://issues.apache.org/jira/browse/SPARK-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-6. - Resolution: Fixed Assignee: Marco Gaido Fix Version/s: 2.3.0 > splitExpression can create

[jira] [Resolved] (SPARK-22181) ReplaceExceptWithFilter if one or both of the datasets are fully derived out of Filters from a same parent

[ https://issues.apache.org/jira/browse/SPARK-22181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22181. - Resolution: Fixed Assignee: Sathiya Kumar Fix Version/s: 2.3.0 > ReplaceExceptWithFilter

[jira] [Resolved] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22333. - Resolution: Fixed Assignee: Feng Zhu Fix Version/s: 2.3.0 > ColumnReference should get hi

[jira] [Resolved] (SPARK-21619) Fail the execution of canonicalized plans explicitly

[ https://issues.apache.org/jira/browse/SPARK-21619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21619. - Resolution: Fixed Fix Version/s: 2.3.0 > Fail the execution of canonicalized plans explicitly > --

[jira] [Created] (SPARK-22396) Unresolved operator InsertIntoDir for Hive format when Hive Support is not enabled

Xiao Li created SPARK-22396: --- Summary: Unresolved operator InsertIntoDir for Hive format when Hive Support is not enabled Key: SPARK-22396 URL: https://issues.apache.org/jira/browse/SPARK-22396 Project: Spa

[jira] [Resolved] (SPARK-22396) Unresolved operator InsertIntoDir for Hive format when Hive Support is not enabled

[ https://issues.apache.org/jira/browse/SPARK-22396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22396. - Resolution: Fixed Fix Version/s: 2.3.0 > Unresolved operator InsertIntoDir for Hive format when Hi

[jira] [Resolved] (SPARK-22400) rename some APIs and classes to make their meaning clearer

[ https://issues.apache.org/jira/browse/SPARK-22400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22400. - Resolution: Fixed Assignee: Zhenhua Wang Fix Version/s: 2.3.0 > rename some APIs and clas

[jira] [Updated] (SPARK-22333) ColumnReference should get higher priority than timeFunctionCall(CURRENT_DATE, CURRENT_TIMESTAMP)

[ https://issues.apache.org/jira/browse/SPARK-22333?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22333: Fix Version/s: 2.2.1 > ColumnReference should get higher priority than > timeFunctionCall(CURRENT_DATE, CU

[jira] [Updated] (SPARK-17556) Executor side broadcast for broadcast joins

[ https://issues.apache.org/jira/browse/SPARK-17556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17556: Target Version/s: (was: 2.3.0) > Executor side broadcast for broadcast joins > --

[jira] [Created] (SPARK-22418) Add test cases for NULL Handling

Xiao Li created SPARK-22418: --- Summary: Add test cases for NULL Handling Key: SPARK-22418 URL: https://issues.apache.org/jira/browse/SPARK-22418 Project: Spark Issue Type: Test Components:

[jira] [Commented] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237133#comment-16237133 ] Xiao Li commented on SPARK-22211: - Will submit a PR based on my previous PR https://gith

[jira] [Updated] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22211: Target Version/s: 2.2.1, 2.3.0 > LimitPushDown optimization for FullOuterJoin generates wrong results > ---

[jira] [Commented] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237797#comment-16237797 ] Xiao Li commented on SPARK-22211: - The Join operator should be limit aware. Anyway, we ca

[jira] [Commented] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16237825#comment-16237825 ] Xiao Li commented on SPARK-22211: - We should merge it to the master and the previous rele

[jira] [Resolved] (SPARK-22418) Add test cases for NULL Handling

[ https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22418. - Resolution: Fixed Fix Version/s: 2.3.0 > Add test cases for NULL Handling > --

[jira] [Assigned] (SPARK-22418) Add test cases for NULL Handling

[ https://issues.apache.org/jira/browse/SPARK-22418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-22418: --- Assignee: Marco Gaido > Add test cases for NULL Handling > > >

[jira] [Assigned] (SPARK-22254) clean up the implementation of `growToSize` in CompactBuffer

[ https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-22254: --- Assignee: Kazuaki Ishizaki > clean up the implementation of `growToSize` in CompactBuffer >

[jira] [Resolved] (SPARK-22254) clean up the implementation of `growToSize` in CompactBuffer

[ https://issues.apache.org/jira/browse/SPARK-22254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22254. - Resolution: Fixed Fix Version/s: 2.3.0 > clean up the implementation of `growToSize` in CompactBuf

[jira] [Resolved] (SPARK-22412) Fix incorrect comment in DataSourceScanExec

[ https://issues.apache.org/jira/browse/SPARK-22412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22412. - Resolution: Fixed Assignee: Vinitha Reddy Gankidi Fix Version/s: 2.3.0 > Fix incorrect co

[jira] [Resolved] (SPARK-22411) Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22411. - Resolution: Fixed Assignee: Vinitha Reddy Gankidi Fix Version/s: 2.3.0 > Heuristic to com

[jira] [Reopened] (SPARK-22411) Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic allocation is enabled

[ https://issues.apache.org/jira/browse/SPARK-22411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-22411: - > Heuristic to combine splits in DataSourceScanExec isn't accurate when dynamic > allocation is enabled > --

[jira] [Resolved] (SPARK-22211) LimitPushDown optimization for FullOuterJoin generates wrong results

[ https://issues.apache.org/jira/browse/SPARK-22211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22211. - Resolution: Fixed Assignee: Henry Robinson Fix Version/s: 2.3.0 2.2.1

[jira] [Resolved] (SPARK-22378) Redundant nullcheck is generated for extracting value in complex types

[ https://issues.apache.org/jira/browse/SPARK-22378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22378. - Resolution: Fixed Assignee: Kazuaki Ishizaki Fix Version/s: 2.3.0 > Redundant nullcheck i

[jira] [Resolved] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22443. - Resolution: Fixed Assignee: Huaxin Gao Fix Version/s: 2.3.0 > AggregatedDialect doesn't o

[jira] [Commented] (SPARK-22443) AggregatedDialect doesn't override quoteIdentifier and other methods in JdbcDialects

[ https://issues.apache.org/jira/browse/SPARK-22443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16239418#comment-16239418 ] Xiao Li commented on SPARK-22443: - It sounds your custom dialect is a good solution for y

[jira] [Resolved] (SPARK-21625) Add incompatible Hive UDF describe to DOC

[ https://issues.apache.org/jira/browse/SPARK-21625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21625. - Resolution: Fixed Assignee: Yuming Wang Fix Version/s: 2.3.0 > Add incompatible Hive UDF

[jira] [Created] (SPARK-22464) <=> is not supported by Hive metastore partition predicate pushdown

Xiao Li created SPARK-22464: --- Summary: <=> is not supported by Hive metastore partition predicate pushdown Key: SPARK-22464 URL: https://issues.apache.org/jira/browse/SPARK-22464 Project: Spark Is

[jira] [Resolved] (SPARK-22308) Support unit tests of spark code using ScalaTest using suites other than FunSuite

[ https://issues.apache.org/jira/browse/SPARK-22308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22308. - Resolution: Fixed Fix Version/s: 2.3.0 > Support unit tests of spark code using ScalaTest using su

[jira] [Created] (SPARK-22488) The view resolution in the SparkSession internal table() API

Xiao Li created SPARK-22488: --- Summary: The view resolution in the SparkSession internal table() API Key: SPARK-22488 URL: https://issues.apache.org/jira/browse/SPARK-22488 Project: Spark Issue Ty

[jira] [Updated] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22472: Target Version/s: 2.2.1, 2.3.0 (was: 2.2.1) > Datasets generate random values for null primitive types > -

[jira] [Assigned] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-22472: --- Assignee: Wenchen Fan Target Version/s: 2.2.1 > Datasets generate random values for null

[jira] [Updated] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22472: Labels: release-notes (was: ) > Datasets generate random values for null primitive types > ---

[jira] [Resolved] (SPARK-22472) Datasets generate random values for null primitive types

[ https://issues.apache.org/jira/browse/SPARK-22472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22472. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Datasets generate random values

[jira] [Created] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

Xiao Li created SPARK-22490: --- Summary: PySpark doc has misleading string for SparkSession.builder Key: SPARK-22490 URL: https://issues.apache.org/jira/browse/SPARK-22490 Project: Spark Issue Type:

[jira] [Created] (SPARK-22510) 64KB JVM bytecode limit

Xiao Li created SPARK-22510: --- Summary: 64KB JVM bytecode limit Key: SPARK-22510 URL: https://issues.apache.org/jira/browse/SPARK-22510 Project: Spark Issue Type: Umbrella Components: SQL

[jira] [Updated] (SPARK-22501) 64KB JVM bytecode limit problem with in

[ https://issues.apache.org/jira/browse/SPARK-22501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22501: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit problem with in > --

[jira] [Updated] (SPARK-22508) 64KB JVM bytecode limit problem with GenerateUnsafeRowJoiner.create()

[ https://issues.apache.org/jira/browse/SPARK-22508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22508: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit problem with Generat

[jira] [Updated] (SPARK-22499) 64KB JVM bytecode limit problem with least and greatest

[ https://issues.apache.org/jira/browse/SPARK-22499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22499: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit problem with least a

[jira] [Updated] (SPARK-22500) 64KB JVM bytecode limit problem with cast

[ https://issues.apache.org/jira/browse/SPARK-22500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22500: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit problem with cast >

[jira] [Updated] (SPARK-22510) Exceptions caused by 64KB JVM bytecode limit

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22510: Summary: Exceptions caused by 64KB JVM bytecode limit (was: 64KB JVM bytecode limit ) > Exceptions cause

[jira] [Updated] (SPARK-22498) 64KB JVM bytecode limit problem with concat and concat_ws

[ https://issues.apache.org/jira/browse/SPARK-22498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22498: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > 64KB JVM bytecode limit problem with concat

[jira] [Updated] (SPARK-22494) Coalesce and AtLeastNNonNulls can cause 64KB JVM bytecode limit exception

[ https://issues.apache.org/jira/browse/SPARK-22494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22494: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Coalesce and AtLeastNNonNulls can cause 64KB

[jira] [Updated] (SPARK-21720) Filter predicate with many conditions throw stackoverflow error

[ https://issues.apache.org/jira/browse/SPARK-21720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21720: Issue Type: Sub-task (was: Bug) Parent: SPARK-22510 > Filter predicate with many conditions throw

[jira] [Commented] (SPARK-22510) Exceptions caused by 64KB JVM bytecode limit

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250292#comment-16250292 ] Xiao Li commented on SPARK-22510: - [~kiszk] Could you just add the new subtasks under thi

[jira] [Comment Edited] (SPARK-22510) Exceptions caused by 64KB JVM bytecode limit

[ https://issues.apache.org/jira/browse/SPARK-22510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16250292#comment-16250292 ] Xiao Li edited comment on SPARK-22510 at 11/13/17 9:42 PM: --- [~k

[jira] [Updated] (SPARK-21646) Add new type coercion rules to compatible with Hive

[ https://issues.apache.org/jira/browse/SPARK-21646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21646: Target Version/s: 2.3.0 > Add new type coercion rules to compatible with Hive > ---

[jira] [Resolved] (SPARK-22490) PySpark doc has misleading string for SparkSession.builder

[ https://issues.apache.org/jira/browse/SPARK-22490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22490. - Resolution: Fixed Assignee: Dongjoon Hyun Fix Version/s: 2.3.0 2.2.1 >

[jira] [Assigned] (SPARK-22469) Accuracy problem in comparison with string and numeric

[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-22469: --- Assignee: Lijia Liu > Accuracy problem in comparison with string and numeric >

[jira] [Resolved] (SPARK-22469) Accuracy problem in comparison with string and numeric

[ https://issues.apache.org/jira/browse/SPARK-22469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22469. - Resolution: Fixed Fix Version/s: 2.3.0 > Accuracy problem in comparison with string and numeric >

[jira] [Resolved] (SPARK-22542) remove unused features in ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-22542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22542. - Resolution: Fixed Fix Version/s: 2.3.0 > remove unused features in ColumnarBatch > ---

[jira] [Created] (SPARK-22569) Clean up caller of splitExpressions and addMutableState

Xiao Li created SPARK-22569: --- Summary: Clean up caller of splitExpressions and addMutableState Key: SPARK-22569 URL: https://issues.apache.org/jira/browse/SPARK-22569 Project: Spark Issue Type: Imp

[jira] [Resolved] (SPARK-22548) Incorrect nested AND expression pushed down to JDBC data source

[ https://issues.apache.org/jira/browse/SPARK-22548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22548. - Resolution: Fixed Assignee: Jia Li Fix Version/s: 2.3.0 2.2.1

[jira] [Updated] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22543: Target Version/s: 2.3.0 (was: 2.2.1, 2.3.0) > fix java 64kb compile error for deeply nested expressions >

[jira] [Assigned] (SPARK-19580) Support for avro.schema.url while writing to hive table

[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19580: --- Assignee: Vinod KC > Support for avro.schema.url while writing to hive table > -

[jira] [Resolved] (SPARK-17920) HiveWriterContainer passes null configuration to serde.initialize, causing NullPointerException in AvroSerde when using avro.schema.url

[ https://issues.apache.org/jira/browse/SPARK-17920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-17920. - Resolution: Fixed Assignee: Vinod KC Fix Version/s: 2.3.0 2.2.1 > Hive

[jira] [Assigned] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-19878: --- Assignee: Vinod KC > Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

[jira] [Resolved] (SPARK-19878) Add hive configuration when initialize hive serde in InsertIntoHiveTable.scala

[ https://issues.apache.org/jira/browse/SPARK-19878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19878. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Add hive configuration when init

[jira] [Resolved] (SPARK-19580) Support for avro.schema.url while writing to hive table

[ https://issues.apache.org/jira/browse/SPARK-19580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19580. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Support for avro.schema.url whil

[jira] [Resolved] (SPARK-22543) fix java 64kb compile error for deeply nested expressions

[ https://issues.apache.org/jira/browse/SPARK-22543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22543. - Resolution: Fixed Fix Version/s: 2.3.0 > fix java 64kb compile error for deeply nested expressions

[jira] [Updated] (SPARK-22395) Fix the behavior of timestamp values for Pandas to respect session timezone

[ https://issues.apache.org/jira/browse/SPARK-22395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22395: Labels: release-notes (was: ) > Fix the behavior of timestamp values for Pandas to respect session timezon

[jira] [Commented] (SPARK-22553) Drop FROM in nonReserved

[ https://issues.apache.org/jira/browse/SPARK-22553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16263712#comment-16263712 ] Xiao Li commented on SPARK-22553: - We need a COMPATIBILITY config like https://www.ibm.c

[jira] [Updated] (SPARK-22431) Creating Permanent view with illegal type

[ https://issues.apache.org/jira/browse/SPARK-22431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22431: Target Version/s: 2.3.0 > Creating Permanent view with illegal type > -

[jira] [Resolved] (SPARK-22592) cleanup filter converting for hive

[ https://issues.apache.org/jira/browse/SPARK-22592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22592. - Resolution: Fixed Fix Version/s: 2.3.0 > cleanup filter converting for hive >

[jira] [Resolved] (SPARK-22604) remove the get address methods from ColumnVector

[ https://issues.apache.org/jira/browse/SPARK-22604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22604. - Resolution: Fixed Fix Version/s: 2.3.0 > remove the get address methods from ColumnVector > --

<    1   2   3   4   5   6   7   8   9   10   >