[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-29 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-44593628 First merge as a committer :) Thanks for doing this! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-29 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-44415302 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-44415308 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15251/ --- If your project

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-44405885 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-44405869 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-19 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43562306 @marmbrus Updated `HiveComparisonTest` and removed `SortedOperation`, how about this version? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43440123 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15069/ --- If your project

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43440122 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43438593 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43438588 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-16 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43180729 @marmbrus I worked around the test failure by adding a `SortedOperation` pattern that conservatively matches *some* definitely sorted operations (false negative rather t

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43178500 All automated tests passed. Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/15017/ --- If your project

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-16 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43178499 Merged build finished. All automated tests passed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-16 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43242728 > @marmbrus I worked around the test failure by adding a SortedOperation pattern that conservatively matches some definitely sorted operations (false negative rather than

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43173426 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-43173435 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12617940 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42990418 Merged build finished. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42990425 Refer to this link for build results: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/14941/ --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598783 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42991927 Nice speed up! :) I looked at the test failure. Looks like [this TODO](https://github.com/apache/spark/blob/master/sql/hive/src/test/scala/org/apache/spark/sql/hi

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598829 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598706 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598965 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -102,16 +105,55 @@ case class HiveTableScan( .getOrElse(

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/758#discussion_r12598841 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/hiveOperators.scala --- @@ -143,20 +185,35 @@ case class HiveTableScan( } def

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread liancheng
GitHub user liancheng opened a pull request: https://github.com/apache/spark/pull/758 [SPARK-1368][SQL] Optimized HiveTableScan JIRA issue: [SPARK-1368](https://issues.apache.org/jira/browse/SPARK-1368) This PR introduces two major updates: - Replaced FP style code

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42981451 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-1368][SQL] Optimized HiveTableScan

2014-05-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/758#issuecomment-42981436 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha