Repository: spark
Updated Branches:
refs/heads/master ba667935f - 50820f152
[SPARK-1805] [EC2] Validate instance types
Addresses [SPARK-1805](https://issues.apache.org/jira/browse/SPARK-1805),
though doesn't resolve it completely.
Error out quickly if the user asks for the master and slaves
Repository: spark
Updated Branches:
refs/heads/branch-1.3 445dbc721 - 8e75b0ed0
[SPARK-5493] [core] Add option to impersonate user.
Hadoop has a feature that allows users to impersonate other users
when submitting applications or talking to HDFS, for example. These
impersonated users are
Repository: spark
Updated Branches:
refs/heads/master aaf50d05c - 6195e2473
[SQL] Add an exception for analysis errors.
Also start from the bottom so we show the first error instead of the top error.
Author: Michael Armbrust mich...@databricks.com
Closes #4439 from
Repository: spark
Updated Branches:
refs/heads/master 1cb377007 - b96918265
[SPARK-5729] Potential NPE in standalone REST API
If the user specifies a bad REST URL, the server will throw an NPE instead of
propagating the error back. This is because the default `ErrorServlet` has the
wrong
Repository: spark
Updated Branches:
refs/heads/branch-1.3 79cd59cde - 1bc75b0a8
[SPARK-5729] Potential NPE in standalone REST API
If the user specifies a bad REST URL, the server will throw an NPE instead of
propagating the error back. This is because the default `ErrorServlet` has the
Repository: spark
Updated Branches:
refs/heads/master b96918265 - b8f88d327
[SPARK-5702][SQL] Allow short names for built-in data sources.
Also took the chance to fixed up some style ...
Author: Reynold Xin r...@databricks.com
Closes #4489 from rxin/SPARK-5702 and squashes the following
Repository: spark
Updated Branches:
refs/heads/branch-1.3 a21090ebe - 748cdc15e
[SQL] Add an exception for analysis errors.
Also start from the bottom so we show the first error instead of the top error.
Author: Michael Armbrust mich...@databricks.com
Closes #4439 from
Repository: spark
Updated Branches:
refs/heads/branch-1.3 748cdc15e - fc0446f66
[SPARK-5683] [SQL] Avoid multiple json generator created
Author: Cheng Hao hao.ch...@intel.com
Closes #4468 from chenghao-intel/json and squashes the following commits:
aeb7801 [Cheng Hao] avoid multiple json
Repository: spark
Updated Branches:
refs/heads/master 45df77b84 - 7e24249af
[SQL][DataFrame] Fix column computability bug.
Do not recursively strip out projects. Only strip the first level project.
```scala
df(colA) + df(colB).as(colC)
```
Previously, the above would construct an invalid
Repository: spark
Updated Branches:
refs/heads/branch-1.3 e477e91e3 - 79cd59cde
[SPARK-4879] Use driver to coordinate Hadoop output committing for speculative
tasks
Previously, SparkHadoopWriter always committed its tasks without question. The
problem is that when speculation is enabled
Repository: spark
Updated Branches:
refs/heads/branch-1.3 7fa0d5f5c - e477e91e3
[SQL][DataFrame] Fix column computability bug.
Do not recursively strip out projects. Only strip the first level project.
```scala
df(colA) + df(colB).as(colC)
```
Previously, the above would construct an
Repository: spark
Updated Branches:
refs/heads/master ed167e70c - aaf50d05c
http://git-wip-us.apache.org/repos/asf/spark/blob/aaf50d05/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
--
diff --git
Repository: spark
Updated Branches:
refs/heads/branch-1.3 8e75b0ed0 - a21090ebe
http://git-wip-us.apache.org/repos/asf/spark/blob/a21090eb/sql/hive/src/main/scala/org/apache/spark/sql/hive/TestHive.scala
--
diff --git
[SPARK-5658][SQL] Finalize DDL and write support APIs
https://issues.apache.org/jira/browse/SPARK-5658
Author: Yin Huai yh...@databricks.com
This patch had conflicts when merged, resolved by
Committer: Michael Armbrust mich...@databricks.com
Closes #4446 from yhuai/writeSupportFollowup and
[SPARK-5658][SQL] Finalize DDL and write support APIs
https://issues.apache.org/jira/browse/SPARK-5658
Author: Yin Huai yh...@databricks.com
This patch had conflicts when merged, resolved by
Committer: Michael Armbrust mich...@databricks.com
Closes #4446 from yhuai/writeSupportFollowup and
Repository: spark
Updated Branches:
refs/heads/branch-1.3 fc0446f66 - 1056c5b1f
[SPARK-5704] [SQL] [PySpark] createDataFrame from RDD with columns
Deprecate inferSchema() and applySchema(), use createDataFrame() instead, which
could take an optional `schema` to create an DataFrame from an
Repository: spark
Updated Branches:
refs/heads/master ea6028409 - 45df77b84
[SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose
Author: Cheng Hao hao.ch...@intel.com
Closes #4496 from chenghao-intel/df_explain and squashes the following commits:
552aa58 [Cheng Hao]
Repository: spark
Updated Branches:
refs/heads/branch-1.3 1056c5b1f - 7fa0d5f5c
[SPARK-5709] [SQL] Add EXPLAIN support in DataFrame API for debugging purpose
Author: Cheng Hao hao.ch...@intel.com
Closes #4496 from chenghao-intel/df_explain and squashes the following commits:
552aa58 [Cheng
Repository: spark
Updated Branches:
refs/heads/master 7e24249af - 1cb377007
[SPARK-4879] Use driver to coordinate Hadoop output committing for speculative
tasks
Previously, SparkHadoopWriter always committed its tasks without question. The
problem is that when speculation is enabled
Repository: spark
Updated Branches:
refs/heads/master 50820f152 - 6cc96cf0c
[Spark-5717] [MLlib] add stop and reorganize import
Trivial. add sc stop and reorganize import
https://issues.apache.org/jira/browse/SPARK-5717
Author: JqueryFan fir...@126.com
Author: Yuhao Yang hhb...@gmail.com
Repository: spark
Updated Branches:
refs/heads/branch-1.3 d6f31e0c7 - b32f5535d
[Spark-5717] [MLlib] add stop and reorganize import
Trivial. add sc stop and reorganize import
https://issues.apache.org/jira/browse/SPARK-5717
Author: JqueryFan fir...@126.com
Author: Yuhao Yang hhb...@gmail.com
Repository: spark
Updated Branches:
refs/heads/branch-1.3 281614d7c - 4cfc02531
SPARK-5239 [CORE] JdbcRDD throws java.lang.AbstractMethodError:
oracle.jdbc.driver.xx.isClosed()Z
This is a completion of https://github.com/apache/spark/pull/4033 which was
withdrawn for some reason.
Repository: spark
Updated Branches:
refs/heads/master c15134632 - 2d1e91673
SPARK-5239 [CORE] JdbcRDD throws java.lang.AbstractMethodError:
oracle.jdbc.driver.xx.isClosed()Z
This is a completion of https://github.com/apache/spark/pull/4033 which was
withdrawn for some reason.
Author:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 4cfc02531 - d6f31e0c7
[SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4
profiles
This is a follow-up PR for #4454 and #4484. JetS3t 0.9.2 contains a
log4j.properties file inside the artifact and breaks
Repository: spark
Updated Branches:
refs/heads/master 2d1e91673 - ba667935f
[SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4
profiles
This is a follow-up PR for #4454 and #4484. JetS3t 0.9.2 contains a
log4j.properties file inside the artifact and breaks our
Author: pwendell
Date: Tue Feb 10 18:51:07 2015
New Revision: 1658778
URL: http://svn.apache.org/r1658778
Log:
Fixing latest doc link to point to 1.2.1
Modified:
spark/_layouts/global.html
spark/site/community.html
spark/site/documentation.html
spark/site/downloads.html
Repository: spark
Updated Branches:
refs/heads/master 6cc96cf0c - c7ad80ae4
[SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl
Author: Daoyuan Wang daoyuan.w...@intel.com
Closes #4502 from adrian-wang/utf8 and squashes the following commits:
4d7b0ee [Daoyuan Wang] remove useless import
Repository: spark
Updated Branches:
refs/heads/master c7ad80ae4 - 69bc3bb6c
SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when
no longer needed
This takes advantage of the changes made in SPARK-4337 to cancel pending
requests to YARN when they are no longer
Repository: spark
Updated Branches:
refs/heads/branch-1.3 e508237f3 - e53da215c
SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when
no longer needed
This takes advantage of the changes made in SPARK-4337 to cancel pending
requests to YARN when they are no longer
Repository: spark
Updated Branches:
refs/heads/branch-1.3 b32f5535d - e508237f3
[SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl
Author: Daoyuan Wang daoyuan.w...@intel.com
Closes #4502 from adrian-wang/utf8 and squashes the following commits:
4d7b0ee [Daoyuan Wang] remove useless
Repository: spark
Updated Branches:
refs/heads/master 69bc3bb6c - b640c841f
[HOTFIX][SPARK-4136] Fix compilation and tests
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/b640c841
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 c294216cd - ef739d9ea
[SQL] Add toString to DataFrame/Column
Author: Michael Armbrust mich...@databricks.com
Closes #4436 from marmbrus/dfToString and squashes the following commits:
8a3c35f [Michael Armbrust] Merge remote-tracking
Repository: spark
Updated Branches:
refs/heads/master c49a40498 - de80b1ba4
[SQL] Add toString to DataFrame/Column
Author: Michael Armbrust mich...@databricks.com
Closes #4436 from marmbrus/dfToString and squashes the following commits:
8a3c35f [Michael Armbrust] Merge remote-tracking
Repository: spark
Updated Branches:
refs/heads/master de80b1ba4 - f98707c04
[SPARK-5686][SQL] Add show current roles command in HiveQl
show current roles
Author: OopsOutOfMemory victorshen...@126.com
Closes #4471 from OopsOutOfMemory/show_current_role and squashes the following
commits:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 ef739d9ea - 8b7587af8
[SPARK-5686][SQL] Add show current roles command in HiveQl
show current roles
Author: OopsOutOfMemory victorshen...@126.com
Closes #4471 from OopsOutOfMemory/show_current_role and squashes the following
Repository: spark
Updated Branches:
refs/heads/branch-1.3 e53da215c - dbfce30fc
[SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned
table
flowing sql get URISyntaxException:
```
create table sc as select *
from (select '2011-01-11', '2011-01-11+14:18:26' from src
Repository: spark
Updated Branches:
refs/heads/branch-1.3 dbfce30fc - c294216cd
SPARK-5613: Catch the ApplicationNotFoundException exception to avoid thread
from getting killed on yarn restart.
[SPARK-5613] Added a catch block to catch the ApplicationNotFoundException.
Without this catch
Repository: spark
Updated Branches:
refs/heads/branch-1.3 ba3aa8fcb - 2f52489d2
Updating versions for Spark 1.3
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/2f52489d
Tree:
Preparing development version 1.3.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/e57c81b8
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/e57c81b8
Diff:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 6a91d5993 - e57c81b8c
Preparing Spark release v1.3.0-snapshot1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d97bfc6f
Tree:
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [created] d97bfc6f2
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/branch-1.3 0386fc4d6 - 6a91d5993
Revert Preparing development version 1.3.1-SNAPSHOT
This reverts commit ba12b793f1f4f432e71439e2a7ebacce74d9c472.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit:
Revert Preparing Spark release v1.3.0-snapshot1
This reverts commit 53068f56f40bf03b7fc52e5980fb7e205903fc8b.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/6a91d599
Tree:
Repository: spark
Updated Branches:
refs/heads/master 7e2f8821e - c2131c0cd
HOTFIX: Adding Junit to Hive tests for Maven build
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2131c0c
Tree:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 ba12b793f - 0386fc4d6
HOTFIX: Adding Junit to Hive tests for Maven build
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0386fc4d
Tree:
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] 53068f56f
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/master b8f88d327 - f86a89a2e
[SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations
The `initialState` of LDA performs several RDD operations that looks redundant.
This pr tries to simplify these operations.
Author:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 63af90c3c - ba3aa8fcb
[SPARK-5714][Mllib] Refactor initial step of LDA to remove redundant operations
The `initialState` of LDA performs several RDD operations that looks redundant.
This pr tries to simplify these operations.
Author:
Preparing Spark release v1.3.0-snapshot1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/53068f56
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/53068f56
Diff:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 15180bcf8 - ba12b793f
Preparing development version 1.3.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ba12b793
Tree:
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [created] 53068f56f
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [created] c2e400103
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Preparing Spark release v1.3.0-snapshot1
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c2e40010
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c2e40010
Diff:
Repository: spark
Updated Branches:
refs/heads/branch-1.3 2f52489d2 - db80d0fe2
Preparing development version 1.3.1-SNAPSHOT
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/db80d0fe
Tree:
HOTFIX: Java 6 compilation error in Spark SQL
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/15180bcf
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/15180bcf
Diff:
Revert Preparing Spark release v1.3.0-snapshot1
This reverts commit c2e4001030cfb881ff33d448fc0aeaf4f05dad0f.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/536dae90
Tree:
Repository: spark
Updated Tags: refs/tags/v1.3.0-snapshot1 [deleted] c2e400103
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
Repository: spark
Updated Branches:
refs/heads/master f86a89a2e - 7e2f8821e
HOTFIX: Java 6 compilation error in Spark SQL
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/7e2f8821
Tree:
Repository: spark
Updated Branches:
refs/heads/master f98707c04 - fd2c032f9
[SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input
Following discussion in the Jira.
Author: MechCoder manojkumarsivaraj...@gmail.com
Closes #4459 from MechCoder/sparse_gmm and squashes the following
Repository: spark
Updated Branches:
refs/heads/branch-1.3 4e3aa680b - bba095399
[SPARK-5021] [MLlib] Gaussian Mixture now supports Sparse Input
Following discussion in the Jira.
Author: MechCoder manojkumarsivaraj...@gmail.com
Closes #4459 from MechCoder/sparse_gmm and squashes the
Repository: spark
Updated Branches:
refs/heads/branch-1.3 bba095399 - 5be8902f7
[SPARK-5343][GraphX]: ShortestPaths traverses backwards
Corrected the logic with ShortestPaths so that the calculation will run forward
rather than backwards. Output before looked like:
```scala
import
Repository: spark
Updated Branches:
refs/heads/master fd2c032f9 - 582096128
[SPARK-5343][GraphX]: ShortestPaths traverses backwards
Corrected the logic with ShortestPaths so that the calculation will run forward
rather than backwards. Output before looked like:
```scala
import
Repository: spark
Updated Branches:
refs/heads/master 582096128 - 52983d7f4
[SPARK-5644] [Core]Delete tmp dir when sc is stop
When we run driver as a service, and for each time we run job we only call
sc.stop, then will not delete tmp dir create by HttpFileServer and SparkEnv, it
will be
Repository: spark
Updated Branches:
refs/heads/master 52983d7f4 - 91e351254
[SQL][Minor] correct some comments
Author: Sheng, Li oopsoutofmem...@users.noreply.github.com
Author: OopsOutOfMemory victorshen...@126.com
Closes #4508 from OopsOutOfMemory/cmt and squashes the following commits:
Repository: spark
Updated Branches:
refs/heads/master 91e351254 - 2d50a010f
[SPARK-5725] [SQL] Fixes ParquetRelation2.equals
!-- Reviewable:start --
[img src=https://reviewable.io/review_button.png; height=40 alt=Review on
Reviewable/](https://reviewable.io/reviews/apache/spark/4513)
!--
Repository: spark
Updated Branches:
refs/heads/branch-1.3 f43bc3dff - 445dbc721
[SQL] Make Options in the data source API CREATE TABLE statements optional.
Users will not need to put `Options()` in a CREATE TABLE statement when there
is not option provided.
Author: Yin Huai
66 matches
Mail list logo
