[GitHub] spark pull request: [SPARK-15253] [SQL] Support old table schema c...

2016-05-12 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/13073#issuecomment-218840729 @devaraj-kavali Thanks, fixed --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: fix spark-15253

2016-05-12 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/13073 fix spark-15253 ## What changes were proposed in this pull request? Originally, we used spark.sql.sources.schema to store the schema of a data source table. After SPARK-6024, we

[GitHub] spark pull request: [SPARK-15171][SQL]Deprecate registerTempTable ...

2016-05-11 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12945#discussion_r62802730 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/catalog/Catalog.scala --- @@ -175,13 +175,37 @@ abstract class Catalog { options: Map

[GitHub] spark pull request: [SPARK-15171][SQL]Deprecate registerTempTable ...

2016-05-11 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-218374422 Rebased on latest trunk. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-218351169 @davies, Updated. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-218241829 For load: ``` scala> spark.read.format("json").load("/home/xzhong10/people.json") res5: org.apache.spark.sql.DataFrame = [ag

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-21892 Something like "Scan parquet" , but without table name suffix. I will show you an example. --- If your project is set up for it, you can reply to this emai

[GitHub] spark pull request: [SPARK-15171][SQL]Deprecate registerTempTable ...

2016-05-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-218215578 There will be additional PRs to replace the reference of deprecated API. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-10 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-218115976 How is the new UI? ![fix_display_name](https://cloud.githubusercontent.com/assets/2595532/15143161/e6dec104-16da-11e6-9ee3-1dbc231c24b0.png

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-10 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12945#discussion_r62618388 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2306,8 +2306,37 @@ class Dataset[T] private[sql]( * @group basic

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-10 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12945#discussion_r62617764 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -2306,8 +2306,37 @@ class Dataset[T] private[sql]( * @group basic

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-09 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-218040784 @yhuai Thanks for the reminder, the css has been updated for the long tooltip. ![fix_long_string](https://cloud.githubusercontent.com/assets/2595532/15133566

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improve the physical p...

2016-05-06 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217598830 @yhuai This PR truncate the long path by 100 chars https://github.com/apache/spark/pull/12947/files#diff-4b3d7a5ee80fb01203fcd345c073ae46R186

[GitHub] spark pull request: [SPARK-14476][SQL][WIP] Improves the output of...

2016-05-06 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12947#issuecomment-217445675 @davies I made some changes in UI, please check whether it is better now? ``` scala> spark.sql("select * from tt").explain() ==

[GitHub] spark pull request: [SPARK-15171][SQL][WIP]Deprecate registerTempT...

2016-05-06 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12945#issuecomment-217424914 There are two places I am not very sure: 1. Should we also deprecate the python and R api registerTempTable? 2. Which we allow replacing table or not for API

[GitHub] spark pull request: [SPARK-14476][SQL] Improves the output of data...

2016-05-05 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/12947 [SPARK-14476][SQL] Improves the output of dataset.explain by adding source table names and file paths. ## What changes were proposed in this pull request? Improve the physical plan

[GitHub] spark pull request: [SPARK-15171][SQL]Deprecate registerTempTable ...

2016-05-05 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/12945 [SPARK-15171][SQL]Deprecate registerTempTable and add dataset.createTempView ## What changes were proposed in this pull request? Deprecates registerTempTable and add

[GitHub] spark pull request: [SPARK-6339][SQL] Supports create CREATE TEMPO...

2016-05-04 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12872#discussion_r62031532 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -71,27 +81,69 @@ case class CreateViewCommand( require

[GitHub] spark pull request: [SPARK-6339][SQL] Supports create CREATE TEMPO...

2016-05-04 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12872#discussion_r62026708 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewSuite.scala --- @@ -69,18 +108,71 @@ class SQLViewSuite extends QueryTest

[GitHub] spark pull request: [SPARK-6339][SQL][WIP] Supports create CREATE ...

2016-05-03 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12872#discussion_r61987856 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -71,27 +81,69 @@ case class CreateViewCommand( require

[GitHub] spark pull request: [SPARK-6339][SQL][WIP] Supports create CREATE ...

2016-05-03 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12872#discussion_r61986232 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -55,13 +60,18 @@ case class CreateViewCommand( require

[GitHub] spark pull request: [SPARK-6339][SQL][WIP] Supports create CREATE ...

2016-05-03 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/12872#discussion_r61984365 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -71,27 +81,69 @@ case class CreateViewCommand( require

[GitHub] spark pull request: [SPARK-6339][SQL] Supports create CREATE TEMPO...

2016-05-03 Thread clockfly
Github user clockfly commented on the pull request: https://github.com/apache/spark/pull/12872#issuecomment-216576674 work in progress. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-6339][SQL] Supports create CREATE TEMPO...

2016-05-03 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/12872 [SPARK-6339][SQL] Supports create CREATE TEMPORARY VIEW tableIdentifier AS query ## What changes were proposed in this pull request? This PR support new SQL syntax CREATE TEMPORARY VIEW

[GitHub] spark pull request: * [SPARK-6339][SQL] Supports create CREATE TEM...

2016-05-02 Thread clockfly
Github user clockfly closed the pull request at: https://github.com/apache/spark/pull/12859 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark pull request: * [SPARK-6339][SQL] Supports create CREATE TEM...

2016-05-02 Thread clockfly
GitHub user clockfly opened a pull request: https://github.com/apache/spark/pull/12859 * [SPARK-6339][SQL] Supports create CREATE TEMPORARY VIEW You can merge this pull request into a Git repository by running: $ git pull https://github.com/clockfly/spark spark-6399

<    1   2   3   4