[jira] [Updated] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13772: --- Target Version/s: 1.6.2 > DataType mismatch about decimal > --- > >

[jira] [Updated] (SPARK-13772) DataType mismatch about decimal

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13772: --- Description: Code snippet to reproduce this issue using 1.6.0: {code} select if(1=1, cast(1 as

[jira] [Resolved] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13774. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11775

[jira] [Updated] (SPARK-13774) IllegalArgumentException: Can not create a Path from an empty string for incorrect file path

2016-03-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13774: --- Assignee: Sunitha Kambhampati > IllegalArgumentException: Can not create a Path from an empty string

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Description: Release note update: {quote} Starting from 2.0.0, Spark SQL handles views natively by

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Labels: releasenotes (was: ) > Enable native view by default > - > >

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Affects Version/s: 2.0.0 Target Version/s: 2.0.0 > Enable native view by default >

[jira] [Updated] (SPARK-14038) Enable native view by default

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14038: --- Assignee: Wenchen Fan > Enable native view by default > - > >

[jira] [Resolved] (SPARK-14000) case class with a tuple field can't work in Dataset

2016-03-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14000. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11816

[jira] [Resolved] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-20 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14004. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11820

[jira] [Updated] (SPARK-13972) hive tests should fail if SQL generation failed

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13972: --- Assignee: Wenchen Fan > hive tests should fail if SQL generation failed >

[jira] [Updated] (SPARK-14001) support multi-children Union in SQLBuilder

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14001: --- Assignee: Wenchen Fan > support multi-children Union in SQLBuilder >

[jira] [Updated] (SPARK-12719) SQL generation support for generators (including UDTF)

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12719: --- Assignee: Wenchen Fan > SQL generation support for generators (including UDTF) >

[jira] [Resolved] (SPARK-14002) SQLBuilder should add subquery to Aggregate child when necessary

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14002. Resolution: Duplicate Fix Version/s: 2.0.0 This issue is actually covered by SPARK-13976.

[jira] [Updated] (SPARK-13974) sub-query names do not need to be globally unique while generate SQL

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13974: --- Assignee: Wenchen Fan > sub-query names do not need to be globally unique while generate SQL >

[jira] [Updated] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14004: --- Priority: Minor (was: Major) > AttributeReference and Alias should only use their first qualifier

[jira] [Created] (SPARK-14004) AttributeReference and Alias should only use their first qualifier to build SQL representations

2016-03-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14004: -- Summary: AttributeReference and Alias should only use their first qualifier to build SQL representations Key: SPARK-14004 URL: https://issues.apache.org/jira/browse/SPARK-14004

[jira] [Created] (SPARK-14002) SQLBuilder should add subquery to Aggregate child when necessary

2016-03-19 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14002: -- Summary: SQLBuilder should add subquery to Aggregate child when necessary Key: SPARK-14002 URL: https://issues.apache.org/jira/browse/SPARK-14002 Project: Spark

[jira] [Resolved] (SPARK-14001) support multi-children Union in SQLBuilder

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14001. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11818

[jira] [Resolved] (SPARK-13972) hive tests should fail if SQL generation failed

2016-03-19 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13972. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11782

[jira] [Comment Edited] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian edited comment on SPARK-13911 at 3/15/16 6:15 PM: - Another problem

[jira] [Commented] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15195821#comment-15195821 ] Cheng Lian commented on SPARK-13911: Another problem related to the {{ResolveAggregateFunctions}}

[jira] [Created] (SPARK-13911) Having condition and order by cannot both have aggregate functions

2016-03-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13911: -- Summary: Having condition and order by cannot both have aggregate functions Key: SPARK-13911 URL: https://issues.apache.org/jira/browse/SPARK-13911 Project: Spark

[jira] [Created] (SPARK-13910) Should provide a factory method for constructing DataFrames using unresolved logical plan

2016-03-15 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13910: -- Summary: Should provide a factory method for constructing DataFrames using unresolved logical plan Key: SPARK-13910 URL: https://issues.apache.org/jira/browse/SPARK-13910

[jira] [Updated] (SPARK-12718) SQL generation support for window functions

2016-03-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12718: --- Assignee: Wenchen Fan (was: Xiao Li) > SQL generation support for window functions >

[jira] [Resolved] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

2016-03-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13841. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11678

[jira] [Created] (SPARK-13841) Remove Dataset.collectRows() and Dataset.takeRows()

2016-03-12 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13841: -- Summary: Remove Dataset.collectRows() and Dataset.takeRows() Key: SPARK-13841 URL: https://issues.apache.org/jira/browse/SPARK-13841 Project: Spark Issue Type:

[jira] [Created] (SPARK-13828) QueryExecution's assertAnalyzed needs to preserve the stacktrace

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13828: -- Summary: QueryExecution's assertAnalyzed needs to preserve the stacktrace Key: SPARK-13828 URL: https://issues.apache.org/jira/browse/SPARK-13828 Project: Spark

[jira] [Created] (SPARK-13826) Revise ScalaDoc of the new Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13826: -- Summary: Revise ScalaDoc of the new Dataset API Key: SPARK-13826 URL: https://issues.apache.org/jira/browse/SPARK-13826 Project: Spark Issue Type: Sub-task

[jira] [Resolved] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13817. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11656

[jira] [Updated] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13817: --- Issue Type: Sub-task (was: Test) Parent: SPARK-13822 > Re-enable MiMA check after unifying

[jira] [Created] (SPARK-13822) Follow-ups of DataFrame/Dataset API unification

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13822: -- Summary: Follow-ups of DataFrame/Dataset API unification Key: SPARK-13822 URL: https://issues.apache.org/jira/browse/SPARK-13822 Project: Spark Issue Type:

[jira] [Deleted] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13565: --- > Migrate DataFrameReader/DataFrameWriter to Dataset API >

[jira] [Deleted] (SPARK-13561) Migrate Dataset untyped aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13561: --- > Migrate Dataset untyped aggregations > > > Key:

[jira] [Deleted] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13563: --- > Migrate DataFrameNaFunctions to Dataset > --- > >

[jira] [Deleted] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13564: --- > Migrate DataFrameStatFunctions to Dataset > - > >

[jira] [Deleted] (SPARK-13562) Migrate Dataset typed aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13562: --- > Migrate Dataset typed aggregations > -- > > Key:

[jira] [Created] (SPARK-13817) Re-enable MiMA check after unifying DataFrame and Dataset API

2016-03-11 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13817: -- Summary: Re-enable MiMA check after unifying DataFrame and Dataset API Key: SPARK-13817 URL: https://issues.apache.org/jira/browse/SPARK-13817 Project: Spark

[jira] [Deleted] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13560: --- > Migrate GroupedDataset pivoting methods > --- > >

[jira] [Deleted] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13559: --- > Migrate common GroupedDataset aggregations > -- > >

[jira] [Deleted] (SPARK-13558) Migrate basic GroupedDataset methods

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13558: --- > Migrate basic GroupedDataset methods > > > Key:

[jira] [Deleted] (SPARK-13557) Migrate gather-to-driver actions

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13557: --- > Migrate gather-to-driver actions > > > Key:

[jira] [Deleted] (SPARK-13555) Migrate untyped relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13555: --- > Migrate untyped relational operations > - > >

[jira] [Deleted] (SPARK-13556) Migrate untyped joins

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13556: --- > Migrate untyped joins > - > > Key: SPARK-13556 >

[jira] [Deleted] (SPARK-13554) Migrate typed relational operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13554: --- > Migrate typed relational operations > --- > > Key:

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key:

[jira] [Deleted] (SPARK-13553) Migrate basic inspection operations

2016-03-11 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian deleted SPARK-13553: --- > Migrate basic inspection operations > --- > > Key:

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Fix Version/s: 2.0.0 > SQL generation support for cube, rollup, and grouping set >

[jira] [Resolved] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-03-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12720. Resolution: Fixed Resolved by https://github.com/apache/spark/pull/11283 > SQL generation support

[jira] [Resolved] (SPARK-13603) SQL generation for subquery

2016-03-04 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13603. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11453

[jira] [Commented] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1510#comment-1510 ] Cheng Lian commented on SPARK-13649: cc [~cloud_fan] > Move CalendarInterval out of unsafe package >

[jira] [Created] (SPARK-13649) Move CalendarInterval out of unsafe package

2016-03-03 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13649: -- Summary: Move CalendarInterval out of unsafe package Key: SPARK-13649 URL: https://issues.apache.org/jira/browse/SPARK-13649 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15173249#comment-15173249 ] Cheng Lian commented on SPARK-13589: [~nongli] Is SPARK-13533 related to this one? > Flaky test:

[jira] [Created] (SPARK-13589) Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13589: -- Summary: Flaky test: ParquetHadoopFsRelationSuite.test all data types - ByteType Key: SPARK-13589 URL: https://issues.apache.org/jira/browse/SPARK-13589 Project: Spark

[jira] [Resolved] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13540. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11421

[jira] [Updated] (SPARK-13561) Migrate Dataset untyped aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13561: --- Assignee: (was: Cheng Lian) > Migrate Dataset untyped aggregations >

[jira] [Updated] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13560: --- Assignee: (was: Cheng Lian) > Migrate GroupedDataset pivoting methods >

[jira] [Updated] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13559: --- Assignee: (was: Cheng Lian) > Migrate common GroupedDataset aggregations >

[jira] [Updated] (SPARK-13562) Migrate Dataset typed aggregations

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13562: --- Assignee: (was: Cheng Lian) > Migrate Dataset typed aggregations >

[jira] [Updated] (SPARK-13557) Migrate gather-to-driver actions

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13557: --- Assignee: (was: Cheng Lian) > Migrate gather-to-driver actions >

[jira] [Created] (SPARK-13565) Migrate DataFrameReader/DataFrameWriter to Dataset API

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13565: -- Summary: Migrate DataFrameReader/DataFrameWriter to Dataset API Key: SPARK-13565 URL: https://issues.apache.org/jira/browse/SPARK-13565 Project: Spark Issue

[jira] [Updated] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13563: --- Description: After the migration, we should have a separate namespace {{Dataset.na}}, just like

[jira] [Created] (SPARK-13564) Migrate DataFrameStatFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13564: -- Summary: Migrate DataFrameStatFunctions to Dataset Key: SPARK-13564 URL: https://issues.apache.org/jira/browse/SPARK-13564 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13563) Migrate DataFrameNaFunctions to Dataset

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13563: -- Summary: Migrate DataFrameNaFunctions to Dataset Key: SPARK-13563 URL: https://issues.apache.org/jira/browse/SPARK-13563 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13562) Migrate Dataset typed aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13562: -- Summary: Migrate Dataset typed aggregations Key: SPARK-13562 URL: https://issues.apache.org/jira/browse/SPARK-13562 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13561) Migrate Dataset untyped aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13561: -- Summary: Migrate Dataset untyped aggregations Key: SPARK-13561 URL: https://issues.apache.org/jira/browse/SPARK-13561 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13560) Migrate GroupedDataset pivoting methods

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13560: -- Summary: Migrate GroupedDataset pivoting methods Key: SPARK-13560 URL: https://issues.apache.org/jira/browse/SPARK-13560 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13558) Migrate basic GroupedDataset methods

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13558: -- Summary: Migrate basic GroupedDataset methods Key: SPARK-13558 URL: https://issues.apache.org/jira/browse/SPARK-13558 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13559) Migrate common GroupedDataset aggregations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13559: -- Summary: Migrate common GroupedDataset aggregations Key: SPARK-13559 URL: https://issues.apache.org/jira/browse/SPARK-13559 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13557) Migrate gather-to-driver actions

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13557: -- Summary: Migrate gather-to-driver actions Key: SPARK-13557 URL: https://issues.apache.org/jira/browse/SPARK-13557 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13556) Migrate untyped joins

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13556: -- Summary: Migrate untyped joins Key: SPARK-13556 URL: https://issues.apache.org/jira/browse/SPARK-13556 Project: Spark Issue Type: Sub-task Components:

[jira] [Created] (SPARK-13555) Migrate untyped relational operations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13555: -- Summary: Migrate untyped relational operations Key: SPARK-13555 URL: https://issues.apache.org/jira/browse/SPARK-13555 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13554) Migrate typed relational operations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13554: -- Summary: Migrate typed relational operations Key: SPARK-13554 URL: https://issues.apache.org/jira/browse/SPARK-13554 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-13553) Migrate basic inspection operations

2016-02-29 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13553: -- Summary: Migrate basic inspection operations Key: SPARK-13553 URL: https://issues.apache.org/jira/browse/SPARK-13553 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-13540) Nested classes within Scala objects can't be used as Dataset element type

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Summary: Nested classes within Scala objects can't be used as Dataset element type (was: Scala

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Description: Add the following test case to {{DatasetSuite}} to reproduce this issue: {code} object

[jira] [Updated] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13540: --- Assignee: Cheng Lian Affects Version/s: 2.0.0 Target Version/s: 2.0.0

[jira] [Created] (SPARK-13540) Scala object can't be added to OuterScopes

2016-02-28 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13540: -- Summary: Scala object can't be added to OuterScopes Key: SPARK-13540 URL: https://issues.apache.org/jira/browse/SPARK-13540 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13457) Remove DataFrame RDD operations

2016-02-26 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13457. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11388

[jira] [Resolved] (SPARK-13486) Move SQLConf into an internal package

2016-02-25 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13486. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11363

[jira] [Updated] (SPARK-13473) Predicate can't be pushed through project with nondeterministic field

2016-02-24 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13473: --- Assignee: Cheng Lian Affects Version/s: 2.0.0 1.5.2

[jira] [Created] (SPARK-13473) Predicate can't be pushed through project with nondeterministic field

2016-02-24 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13473: -- Summary: Predicate can't be pushed through project with nondeterministic field Key: SPARK-13473 URL: https://issues.apache.org/jira/browse/SPARK-13473 Project: Spark

[jira] [Created] (SPARK-13457) Remove DataFrame RDD operations

2016-02-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13457: -- Summary: Remove DataFrame RDD operations Key: SPARK-13457 URL: https://issues.apache.org/jira/browse/SPARK-13457 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13456) Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11

2016-02-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13456: -- Summary: Cannot create encoders for case classes defined in Spark shell after upgrading to Scala 2.11 Key: SPARK-13456 URL: https://issues.apache.org/jira/browse/SPARK-13456

[jira] [Commented] (SPARK-13454) Cannot drop table whose name starts with underscore

2016-02-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15158930#comment-15158930 ] Cheng Lian commented on SPARK-13454: cc [~yhuai] > Cannot drop table whose name starts with

[jira] [Created] (SPARK-13454) Cannot drop table whose name starts with underscore

2016-02-23 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13454: -- Summary: Cannot drop table whose name starts with underscore Key: SPARK-13454 URL: https://issues.apache.org/jira/browse/SPARK-13454 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13263) SQL generation support for tablesample

2016-02-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13263. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11148

[jira] [Updated] (SPARK-13263) SQL generation support for tablesample

2016-02-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13263: --- Assignee: Xiao Li > SQL generation support for tablesample > --

[jira] [Resolved] (SPARK-13236) SQL generation support for Set Operations

2016-02-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13236. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11195

[jira] [Updated] (SPARK-13236) SQL generation support for Set Operations

2016-02-22 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13236: --- Assignee: Xiao Li > SQL generation support for Set Operations >

[jira] [Commented] (SPARK-13418) SQL generation for uncorrelated scalar subqueries

2016-02-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15156534#comment-15156534 ] Cheng Lian commented on SPARK-13418: Summary of offline discussion with [~rxin]: Moving {{.sql}} to

[jira] [Resolved] (SPARK-12799) Simplify various string output for expressions

2016-02-21 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12799. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10757

[jira] [Created] (SPARK-13370) Lexer not handling whitespaces properly

2016-02-17 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13370: -- Summary: Lexer not handling whitespaces properly Key: SPARK-13370 URL: https://issues.apache.org/jira/browse/SPARK-13370 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-13314) Malformed WholeStageCodegen tree string

2016-02-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13314. Resolution: Not A Problem I didn't realize that the extra vertical lines are used to indicate

[jira] [Updated] (SPARK-12720) SQL generation support for cube, rollup, and grouping set

2016-02-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-12720: --- Assignee: Xiao Li > SQL generation support for cube, rollup, and grouping set >

[jira] [Created] (SPARK-13314) Malformed WholeStageCodegen tree string

2016-02-14 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-13314: -- Summary: Malformed WholeStageCodegen tree string Key: SPARK-13314 URL: https://issues.apache.org/jira/browse/SPARK-13314 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-13314) Malformed WholeStageCodegen tree string

2016-02-14 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian reassigned SPARK-13314: -- Assignee: Cheng Lian > Malformed WholeStageCodegen tree string >

[jira] [Resolved] (SPARK-12725) SQL generation suffers from name conficts introduced by some analysis rules

2016-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-12725. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11050

[jira] [Updated] (SPARK-13205) SQL generation support for self join

2016-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-13205: --- Assignee: Xiao Li > SQL generation support for self join > > >

[jira] [Resolved] (SPARK-13205) SQL generation support for self join

2016-02-10 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-13205. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11084

<    1   2   3   4   5   6   7   8   9   10   >