[jira] [Resolved] (SPARK-17058) Add maven snapshots-and-staging profile to build/test against staging artifacts

[ https://issues.apache.org/jira/browse/SPARK-17058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17058. - Resolution: Fixed Assignee: Steve Loughran Fix Version/s: 2.2.0 > Add maven

[jira] [Commented] (SPARK-18086) Regression: Hive variables no longer work in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630057#comment-15630057 ] Reynold Xin commented on SPARK-18086: - [~rdblue] There are two separate issues here I believe: 1.

[jira] [Updated] (SPARK-17058) Add maven snapshots-and-staging profile to build/test against staging artifacts

[ https://issues.apache.org/jira/browse/SPARK-17058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17058: Fix Version/s: 2.1.0 > Add maven snapshots-and-staging profile to build/test against staging >

[jira] [Updated] (SPARK-18111) Wrong ApproximatePercentile answer when multiple records have the minimum value

[ https://issues.apache.org/jira/browse/SPARK-18111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18111: Fix Version/s: 2.0.3 > Wrong ApproximatePercentile answer when multiple records have the minimum

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630023#comment-15630023 ] Reynold Xin commented on SPARK-18209: - Yea it's definitely much harder to make logical plan stable

[jira] [Updated] (SPARK-18217) Disallow creating permanent views based on temporary views or UDFs

[ https://issues.apache.org/jira/browse/SPARK-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18217: Summary: Disallow creating permanent views based on temporary views or UDFs (was: Disallow

[jira] [Updated] (SPARK-18217) Disallow creating permanent views based on temporary views or UDFs

[ https://issues.apache.org/jira/browse/SPARK-18217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18217: Description: See the discussion in the parent ticket SPARK-18209. It doesn't really make sense to

[jira] [Commented] (SPARK-13417) SQL subquery support

[ https://issues.apache.org/jira/browse/SPARK-13417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630019#comment-15630019 ] Reynold Xin commented on SPARK-13417: - Yup good to track bugs elsewhere. > SQL subquery support >

[jira] [Resolved] (SPARK-13417) SQL subquery support

[ https://issues.apache.org/jira/browse/SPARK-13417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13417. - Resolution: Fixed Fix Version/s: 2.1.0 > SQL subquery support > > >

[jira] [Resolved] (SPARK-14393) values generated by non-deterministic functions shouldn't change after coalesce or union

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-14393. - Resolution: Fixed Fix Version/s: 2.1.0 > values generated by non-deterministic functions

[jira] [Updated] (SPARK-14393) values generated by non-deterministic functions shouldn't change after coalesce or union

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14393: Summary: values generated by non-deterministic functions shouldn't change after coalesce or union

[jira] [Updated] (SPARK-14393) values generated by non-deterministic functions shouldn't change after coalesce or union

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14393: Labels: correctness releasenotes (was: correctness) > values generated by non-deterministic

[jira] [Resolved] (SPARK-17895) Improve documentation of "rowsBetween" and "rangeBetween"

[ https://issues.apache.org/jira/browse/SPARK-17895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17895. - Resolution: Fixed Assignee: Weiluo Ren Fix Version/s: 2.1.0 > Improve

[jira] [Resolved] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17683. - Resolution: Fixed Fix Version/s: 2.1.0 This was merged -- the patch accepts Array[_] (not

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628117#comment-15628117 ] Reynold Xin commented on SPARK-18209: - No. > More robust view canonicalization without full SQL

[jira] [Created] (SPARK-18219) Move commit protocol API from sql to core module

Reynold Xin created SPARK-18219: --- Summary: Move commit protocol API from sql to core module Key: SPARK-18219 URL: https://issues.apache.org/jira/browse/SPARK-18219 Project: Spark Issue Type:

[jira] [Updated] (SPARK-18215) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18215: Fix Version/s: 2.1.0 > Make Column.expr public > --- > > Key:

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15628084#comment-15628084 ] Reynold Xin commented on SPARK-18209: - UDFs should be valid -- temp UDFs should not be? > More

[jira] [Updated] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17683: Target Version/s: 2.1.0 > Support ArrayType in Literal.apply > --

[jira] [Updated] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17683: Fix Version/s: (was: 2.1.0) > Support ArrayType in Literal.apply >

[jira] [Reopened] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reopened SPARK-17683: - > Support ArrayType in Literal.apply > -- > > Key:

[jira] [Resolved] (SPARK-17683) Support ArrayType in Literal.apply

[ https://issues.apache.org/jira/browse/SPARK-17683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17683. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.1.0 > Support

[jira] [Resolved] (SPARK-17532) Add thread lock information from JMX to thread dump UI

[ https://issues.apache.org/jira/browse/SPARK-17532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17532. - Resolution: Fixed Assignee: Ryan Blue Fix Version/s: 2.1.0 > Add thread lock

[jira] [Resolved] (SPARK-18192) Support all file formats in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18192. - Resolution: Fixed Fix Version/s: 2.1.0 > Support all file formats in structured streaming

[jira] [Resolved] (SPARK-15472) Add support for writing partitioned `csv`, `json`, `text` formats in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-15472. - Resolution: Fixed Fix Version/s: 2.1.0 > Add support for writing partitioned `csv`,

[jira] [Updated] (SPARK-16575) partition calculation mismatch with sc.binaryFiles

[ https://issues.apache.org/jira/browse/SPARK-16575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16575: Target Version/s: 2.1.0 > partition calculation mismatch with sc.binaryFiles >

[jira] [Updated] (SPARK-13184) Support minPartitions parameter for JSON and CSV datasources as options

[ https://issues.apache.org/jira/browse/SPARK-13184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13184: Target Version/s: 2.2.0 (was: 2.1.0) > Support minPartitions parameter for JSON and CSV

[jira] [Updated] (SPARK-14878) Support Trim characters in the string trim function

[ https://issues.apache.org/jira/browse/SPARK-14878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14878: Target Version/s: 2.2.0 (was: 2.1.0) > Support Trim characters in the string trim function >

[jira] [Updated] (SPARK-14878) Support Trim characters in the string trim function

[ https://issues.apache.org/jira/browse/SPARK-14878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14878: Description: The current Spark SQL does not support the trim characters in the string trim

[jira] [Closed] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16972. --- Resolution: Won't Fix Closing this as won't fix for now given the comments on the pull request. The

[jira] [Updated] (SPARK-16972) Move DriverEndpoint out of CoarseGrainedSchedulerBackend

[ https://issues.apache.org/jira/browse/SPARK-16972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16972: Target Version/s: (was: 2.1.0) > Move DriverEndpoint out of CoarseGrainedSchedulerBackend >

[jira] [Commented] (SPARK-14960) Don't perform treeAggregation in local mode

[ https://issues.apache.org/jira/browse/SPARK-14960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627902#comment-15627902 ] Reynold Xin commented on SPARK-14960: - [~joshrosen] any reason why you closed the pull request? >

[jira] [Updated] (SPARK-17058) Add maven snapshots-and-staging profile to build/test against staging artifacts

[ https://issues.apache.org/jira/browse/SPARK-17058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17058: Target Version/s: (was: 2.1.0) > Add maven snapshots-and-staging profile to build/test against

[jira] [Updated] (SPARK-17267) Long running structured streaming requirements

[ https://issues.apache.org/jira/browse/SPARK-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17267: Assignee: Peter Lee > Long running structured streaming requirements >

[jira] [Resolved] (SPARK-17475) HDFSMetadataLog should not leak CRC files

[ https://issues.apache.org/jira/browse/SPARK-17475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17475. - Resolution: Fixed Fix Version/s: 2.1.0 > HDFSMetadataLog should not leak CRC files >

[jira] [Resolved] (SPARK-17267) Long running structured streaming requirements

[ https://issues.apache.org/jira/browse/SPARK-17267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17267. - Resolution: Fixed Fix Version/s: 2.1.0 > Long running structured streaming requirements >

[jira] [Comment Edited] (SPARK-15420) Repartition and sort before Parquet writes

[ https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627859#comment-15627859 ] Reynold Xin edited comment on SPARK-15420 at 11/2/16 5:57 AM: -- Ryan I looked

[jira] [Commented] (SPARK-15420) Repartition and sort before Parquet writes

[ https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627859#comment-15627859 ] Reynold Xin commented on SPARK-15420: - Ryan I looked at this just now (sorry not looking earlier). I

[jira] [Updated] (SPARK-15420) Repartition and sort before Parquet writes

[ https://issues.apache.org/jira/browse/SPARK-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15420: Target Version/s: 2.2.0 (was: 2.1.0) > Repartition and sort before Parquet writes >

[jira] [Updated] (SPARK-17868) Do not use bitmasks during parsing and analysis of CUBE/ROLLUP/GROUPING SETS

[ https://issues.apache.org/jira/browse/SPARK-17868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17868: Target Version/s: 2.2.0 (was: 2.1.0) > Do not use bitmasks during parsing and analysis of

[jira] [Closed] (SPARK-17402) separate the management of temp views and metastore tables/views in SessionCatalog

[ https://issues.apache.org/jira/browse/SPARK-17402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-17402. --- Resolution: Fixed > separate the management of temp views and metastore tables/views in >

[jira] [Resolved] (SPARK-17992) HiveClient.getPartitionsByFilter throws an exception for some unsupported filters when hive.metastore.try.direct.sql=false

[ https://issues.apache.org/jira/browse/SPARK-17992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17992. - Resolution: Fixed Assignee: Michael Allman Fix Version/s: 2.1.0 >

[jira] [Closed] (SPARK-6825) Data sources implementation to support `sequenceFile`

[ https://issues.apache.org/jira/browse/SPARK-6825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-6825. -- Resolution: Won't Fix I'm marking this as won't fix for now. It's unclear how the interface would look

[jira] [Created] (SPARK-18217) Disallow creating permanent views based on temporary views

Reynold Xin created SPARK-18217: --- Summary: Disallow creating permanent views based on temporary views Key: SPARK-18217 URL: https://issues.apache.org/jira/browse/SPARK-18217 Project: Spark

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627710#comment-15627710 ] Reynold Xin commented on SPARK-18209: - Actually I'd consider it a "bug" and fix this bug first in

[jira] [Commented] (SPARK-17967) Support for list or other types as an option for datasources

[ https://issues.apache.org/jira/browse/SPARK-17967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627698#comment-15627698 ] Reynold Xin commented on SPARK-17967: - +1 on json arrays. > Support for list or other types as an

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627679#comment-15627679 ] Reynold Xin commented on SPARK-18209: - Yes, both global and local temp views. The issue with temp

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627664#comment-15627664 ] Reynold Xin commented on SPARK-18209: - Yup - we will have to disallow it, for good reasons actually.

[jira] [Resolved] (SPARK-18216) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18216. - Resolution: Fixed Fix Version/s: 2.1.0 > Make Column.expr public >

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627628#comment-15627628 ] Reynold Xin commented on SPARK-18209: - That's what [~vssrinath] pointed out isn't that? Good point

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627502#comment-15627502 ] Reynold Xin commented on SPARK-18209: - The pr is still useful -- the only thing that made it very

[jira] [Updated] (SPARK-18192) Support all file formats in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-18192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18192: Component/s: Structured Streaming > Support all file formats in structured streaming >

[jira] [Closed] (SPARK-18215) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-18215. --- Resolution: Duplicate Target Version/s: (was: 2.1.0) > Make Column.expr public >

[jira] [Assigned] (SPARK-18216) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-18216: --- Assignee: Reynold Xin > Make Column.expr public > --- > >

[jira] [Assigned] (SPARK-18215) Make Column.expr public

[ https://issues.apache.org/jira/browse/SPARK-18215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-18215: --- Assignee: Reynold Xin > Make Column.expr public > --- > >

[jira] [Created] (SPARK-18215) Make Column.expr public

Reynold Xin created SPARK-18215: --- Summary: Make Column.expr public Key: SPARK-18215 URL: https://issues.apache.org/jira/browse/SPARK-18215 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18216) Make Column.expr public

Reynold Xin created SPARK-18216: --- Summary: Make Column.expr public Key: SPARK-18216 URL: https://issues.apache.org/jira/browse/SPARK-18216 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-18214) Simplify RuntimeReplaceable type coercion

Reynold Xin created SPARK-18214: --- Summary: Simplify RuntimeReplaceable type coercion Key: SPARK-18214 URL: https://issues.apache.org/jira/browse/SPARK-18214 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-16609) Single function for parsing timestamps/dates

[ https://issues.apache.org/jira/browse/SPARK-16609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-16609: --- Assignee: Reynold Xin > Single function for parsing timestamps/dates >

[jira] [Updated] (SPARK-18208) Executor OOM due to a memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-18208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18208: Description: While running a Spark job, we see that the job fails because of executor OOM with

[jira] [Resolved] (SPARK-18182) Expose ReplayListenerBus.replay() overload which accepts Iterator

[ https://issues.apache.org/jira/browse/SPARK-18182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18182. - Resolution: Fixed Fix Version/s: 2.1.0 > Expose ReplayListenerBus.replay() overload which

[jira] [Updated] (SPARK-18208) Executor OOM due to a memory leak in BytesToBytesMap

[ https://issues.apache.org/jira/browse/SPARK-18208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18208: Target Version/s: 2.1.0 > Executor OOM due to a memory leak in BytesToBytesMap >

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627085#comment-15627085 ] Reynold Xin commented on SPARK-18209: - Yes - that is even simpler and wouldn't require us to support

[jira] [Commented] (SPARK-10816) EventTime based sessionization

[ https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15627075#comment-15627075 ] Reynold Xin commented on SPARK-10816: - Sounds good! > EventTime based sessionization >

[jira] [Resolved] (SPARK-17350) Disable default use of KryoSerializer in Thrift Server

[ https://issues.apache.org/jira/browse/SPARK-17350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17350. - Resolution: Fixed Fix Version/s: 2.1.0 > Disable default use of KryoSerializer in Thrift

[jira] [Commented] (SPARK-15867) TABLESAMPLE BUCKET semantics don't match Hive's

[ https://issues.apache.org/jira/browse/SPARK-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626947#comment-15626947 ] Reynold Xin commented on SPARK-15867: - cc [~tejasp] My guess is that your Facebook gang would be

[jira] [Updated] (SPARK-15867) TABLESAMPLE BUCKET semantics don't match Hive's

[ https://issues.apache.org/jira/browse/SPARK-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15867: Target Version/s: 2.2.0 (was: 2.1.0) > TABLESAMPLE BUCKET semantics don't match Hive's >

[jira] [Updated] (SPARK-14273) Add FileFormat.isSplittable to indicate whether a format is splittable

[ https://issues.apache.org/jira/browse/SPARK-14273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14273: Target Version/s: (was: 2.1.0) > Add FileFormat.isSplittable to indicate whether a format is

[jira] [Updated] (SPARK-17799) InterfaceStability annotation

[ https://issues.apache.org/jira/browse/SPARK-17799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17799: Target Version/s: 2.2.0 (was: 2.1.0) > InterfaceStability annotation >

[jira] [Comment Edited] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626838#comment-15626838 ] Reynold Xin edited comment on SPARK-18209 at 11/1/16 10:29 PM: --- A practical

[jira] [Updated] (SPARK-16026) Cost-based Optimizer framework

[ https://issues.apache.org/jira/browse/SPARK-16026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16026: Target Version/s: 2.2.0 (was: 2.1.0) > Cost-based Optimizer framework >

[jira] [Updated] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18209: Priority: Critical (was: Major) > More robust view canonicalization without full SQL expansion >

[jira] [Closed] (SPARK-16576) Move plan SQL generation code from SQLBuilder into logical operators

[ https://issues.apache.org/jira/browse/SPARK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16576. --- Resolution: Won't Fix I'm marking this as won't fix since we can do it better using the approach

[jira] [Updated] (SPARK-16576) Move plan SQL generation code from SQLBuilder into logical operators

[ https://issues.apache.org/jira/browse/SPARK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16576: Target Version/s: (was: 2.2.0) > Move plan SQL generation code from SQLBuilder into logical

[jira] [Closed] (SPARK-16756) Add `sql` function to LogicalPlan and `NonSQLPlan` trait

[ https://issues.apache.org/jira/browse/SPARK-16756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16756. --- Resolution: Won't Fix I'm marking this as won't fix, since I think we can do it much better without

[jira] [Updated] (SPARK-16576) Move plan SQL generation code from SQLBuilder into logical operators

[ https://issues.apache.org/jira/browse/SPARK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16576: Affects Version/s: 2.0.1 > Move plan SQL generation code from SQLBuilder into logical operators >

[jira] [Updated] (SPARK-16576) Move plan SQL generation code from SQLBuilder into logical operators

[ https://issues.apache.org/jira/browse/SPARK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16576: Affects Version/s: (was: 2.0.1) 2.0.0 > Move plan SQL generation code

[jira] [Updated] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18209: Description: Spark SQL currently stores views by analyzing the provided SQL and then generating

[jira] [Created] (SPARK-18209) More robust view canonicalization without full SQL expansion

Reynold Xin created SPARK-18209: --- Summary: More robust view canonicalization without full SQL expansion Key: SPARK-18209 URL: https://issues.apache.org/jira/browse/SPARK-18209 Project: Spark

[jira] [Updated] (SPARK-16483) Unifying struct fields and columns

[ https://issues.apache.org/jira/browse/SPARK-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16483: Target Version/s: 2.2.0 > Unifying struct fields and columns > --

[jira] [Updated] (SPARK-16237) PySpark gapply

[ https://issues.apache.org/jira/browse/SPARK-16237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16237: Target Version/s: (was: 2.1.0) > PySpark gapply > -- > > Key:

[jira] [Updated] (SPARK-16576) Move plan SQL generation code from SQLBuilder into logical operators

[ https://issues.apache.org/jira/browse/SPARK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16576: Target Version/s: 2.2.0 (was: 2.1.0) > Move plan SQL generation code from SQLBuilder into logical

[jira] [Updated] (SPARK-16397) make CatalogTable more general and less hive specific

[ https://issues.apache.org/jira/browse/SPARK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16397: Target Version/s: (was: 2.1.0) > make CatalogTable more general and less hive specific >

[jira] [Closed] (SPARK-16397) make CatalogTable more general and less hive specific

[ https://issues.apache.org/jira/browse/SPARK-16397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-16397. --- Resolution: Won't Fix > make CatalogTable more general and less hive specific >

[jira] [Updated] (SPARK-16483) Unifying struct fields and columns

[ https://issues.apache.org/jira/browse/SPARK-16483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16483: Target Version/s: (was: 2.1.0) > Unifying struct fields and columns >

[jira] [Updated] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15799: Target Version/s: 2.2.0 (was: 2.1.0) > Release SparkR on CRAN > -- > >

[jira] [Closed] (SPARK-17179) Consider improving partition pruning in HiveMetastoreCatalog

[ https://issues.apache.org/jira/browse/SPARK-17179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-17179. --- Resolution: Duplicate Fix Version/s: 2.1.0 > Consider improving partition pruning in

[jira] [Commented] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15626684#comment-15626684 ] Reynold Xin commented on SPARK-17822: - cc [~felixcheung], [~shivaram] can one of the R guys take

[jira] [Resolved] (SPARK-16007) Empty DataFrame created with spark.read.csv() does not respect user specified schema

[ https://issues.apache.org/jira/browse/SPARK-16007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-16007. - Resolution: Fixed Fix Version/s: 2.1.0 > Empty DataFrame created with spark.read.csv()

[jira] [Closed] (SPARK-13421) Make output of a SparkPlan configurable

[ https://issues.apache.org/jira/browse/SPARK-13421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-13421. --- Resolution: Later > Make output of a SparkPlan configurable >

[jira] [Closed] (SPARK-15309) Bump master to version 2.1.0-SNAPSHOT

[ https://issues.apache.org/jira/browse/SPARK-15309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-15309. --- Resolution: Not A Problem > Bump master to version 2.1.0-SNAPSHOT >

[jira] [Updated] (SPARK-16323) Avoid unnecessary cast when doing integral divide

[ https://issues.apache.org/jira/browse/SPARK-16323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16323: Target Version/s: 2.2.0 (was: 2.1.0) > Avoid unnecessary cast when doing integral divide >

[jira] [Updated] (SPARK-17982) Spark 2.0.0 CREATE VIEW statement fails :: java.lang.RuntimeException: Failed to analyze the canonicalized SQL. It is possible there is a bug in Spark.

[ https://issues.apache.org/jira/browse/SPARK-17982?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17982: Priority: Blocker (was: Major) > Spark 2.0.0 CREATE VIEW statement fails ::

[jira] [Updated] (SPARK-14438) Cross-publish Breeze for Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14438: Target Version/s: (was: 2.1.0) > Cross-publish Breeze for Scala 2.12 >

[jira] [Updated] (SPARK-14221) Cross-publish Chill for Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14221: Target Version/s: (was: 2.1.0) > Cross-publish Chill for Scala 2.12 >

[jira] [Updated] (SPARK-12661) Drop Python 2.6 support in PySpark

[ https://issues.apache.org/jira/browse/SPARK-12661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12661: Target Version/s: 2.2.0 (was: 2.1.0) > Drop Python 2.6 support in PySpark >

[jira] [Updated] (SPARK-14222) Cross-publish jackson-module-scala for Scala 2.12

[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-14222: Target Version/s: (was: 2.1.0) > Cross-publish jackson-module-scala for Scala 2.12 >

[jira] [Updated] (SPARK-17949) Introduce a JVM object based aggregate operator

[ https://issues.apache.org/jira/browse/SPARK-17949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17949: Target Version/s: 2.2.0 (was: 2.1.0) > Introduce a JVM object based aggregate operator >

[jira] [Updated] (SPARK-12978) Skip unnecessary final group-by when input data already clustered with group-by keys

[ https://issues.apache.org/jira/browse/SPARK-12978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-12978: Target Version/s: (was: 2.1.0) > Skip unnecessary final group-by when input data already

[jira] [Updated] (SPARK-16390) Dataset API improvements

[ https://issues.apache.org/jira/browse/SPARK-16390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-16390: Target Version/s: 2.2.0 (was: 2.1.0) > Dataset API improvements > > >

<    4   5   6   7   8   9   10   11   12   13   >