svn commit: r1692667 - in /spark: community.md index.md site/community.html site/index.html

Author: matei Date: Sat Jul 25 22:51:21 2015 New Revision: 1692667 URL: http://svn.apache.org/r1692667 Log: Updated with new meetups Modified: spark/community.md spark/index.md spark/site/community.html spark/site/index.html Modified: spark/community.md URL: http

svn commit: r1692668 [1/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

Author: matei Date: Sat Jul 25 23:10:48 2015 New Revision: 1692668 URL: http://svn.apache.org/r1692668 Log: Updates to SQL page Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site/examples.html

svn commit: r1692668 [2/2] - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

Modified: spark/site/releases/spark-release-0-8-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-8-0.html?rev=1692668&r1=1692667&r2=1692668&view=diff == --- spark/site/releases/spark-release-0-8

svn commit: r1692669 - in /spark: index.md site/index.html

Author: matei Date: Sat Jul 25 23:15:18 2015 New Revision: 1692669 URL: http://svn.apache.org/r1692669 Log: Homepage tweak Modified: spark/index.md spark/site/index.html Modified: spark/index.md URL: http://svn.apache.org/viewvc/spark/index.md?rev=1692669&r1=1692668&r2=1692

svn commit: r1692748 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/

Author: matei Date: Sun Jul 26 19:10:57 2015 New Revision: 1692748 URL: http://svn.apache.org/r1692748 Log: Further improvements to site Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

svn commit: r1692749 - in /spark: site/sql/index.html sql/index.md

Author: matei Date: Sun Jul 26 19:11:45 2015 New Revision: 1692749 URL: http://svn.apache.org/r1692749 Log: Fix Python Modified: spark/site/sql/index.html spark/sql/index.md Modified: spark/site/sql/index.html URL: http://svn.apache.org/viewvc/spark/site/sql/index.html?rev=1692749&am

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

cies, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia Closes #8220 from mateiz/shuffle-loc-fix.

spark git commit: [SPARK-10008] Ensure shuffle locality doesn't take precedence over narrow deps

ndencies, it can cause them to place tasks based on the shuffle dependency instead of the narrow one. This case is common in iterative join-based algorithms like PageRank and ALS, where one RDD is hash-partitioned and one isn't. Author: Matei Zaharia Closes #8220 from mateiz/shuffle-loc-

svn commit: r1745631 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/news/spark-summit-2014-videos-posted.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-summit-2014-videos-posted.html?rev=1745631&r1=1745630&r2=1745631&view=diff == --- spark/site/news/spark

svn commit: r1745631 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: matei Date: Thu May 26 18:03:49 2016 New Revision: 1745631 URL: http://svn.apache.org/viewvc?rev=1745631&view=rev Log: 2.0 preview news item Added: spark/news/_posts/2016-05-26-spark-2.0.0-preview.md spark/site/news/spark-2.0.0-preview.html Modified: spark/site/community.

svn commit: r1747763 - in /spark/images: spark-logo-reverse.eps spark-logo-trademark.png spark-logo.eps spark-logo.png spark-runs-everywhere.png

Author: matei Date: Fri Jun 10 18:15:35 2016 New Revision: 1747763 URL: http://svn.apache.org/viewvc?rev=1747763&view=rev Log: Version of logo with Apache Modified: spark/images/spark-logo-reverse.eps spark/images/spark-logo-trademark.png spark/images/spark-logo.eps spark/im

svn commit: r1747764 - in /spark: css/ site/ site/css/ site/images/

Author: matei Date: Fri Jun 10 18:15:52 2016 New Revision: 1747764 URL: http://svn.apache.org/viewvc?rev=1747764&view=rev Log: CSS tweaks Modified: spark/css/custom.css spark/site/css/custom.css spark/site/documentation.html spark/site/images/spark-logo-reverse.eps spark/

svn commit: r1744473 [1/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

Author: matei Date: Thu May 19 00:14:26 2016 New Revision: 1744473 URL: http://svn.apache.org/viewvc?rev=1744473&view=rev Log: Improvements to branding, some general updates, and EPS logos Added: spark/images/spark-logo-reverse.eps (with props) spark/images/spark-logo.eps (with p

svn commit: r1744473 [2/2] - in /spark: ./ _layouts/ graphx/ images/ mllib/ site/ site/graphx/ site/images/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ strea

Modified: spark/site/releases/spark-release-1-0-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-1-0-0.html?rev=1744473&r1=1744472&r2=1744473&view=diff == --- spark/site/releases/spark-release-1-0

svn commit: r1744474 - in /spark/site/images: spark-logo-reverse.eps spark-logo.eps

Author: matei Date: Thu May 19 00:17:34 2016 New Revision: 1744474 URL: http://svn.apache.org/viewvc?rev=1744474&view=rev Log: EPS logos on live site Added: spark/site/images/spark-logo-reverse.eps (with props) spark/site/images/spark-logo.eps (with props) Added: spark/site/im

[2/3] spark-website git commit: Trademarks page and some FAQ cleanup

http://git-wip-us.apache.org/repos/asf/spark-website/blob/9700f2f4/site/news/proposals-open-for-spark-summit-east.html -- diff --git a/site/news/proposals-open-for-spark-summit-east.html b/site/news/proposals-open-for-spark-summit

[1/3] spark-website git commit: Trademarks page and some FAQ cleanup

SparkR + Streaming + Dependency, Packaging, and Operations + Removals, Behavior Changes and Deprecations + Removals + Behavior Changes + Deprecations - Known Issues - Credits + Known Issues + Credits API Stability @@ -394,7 +394,7 @@ - Apache Spark

[3/3] spark-website git commit: Trademarks page and some FAQ cleanup

/asf/spark-website/diff/9700f2f4 Branch: refs/heads/asf-site Commit: 9700f2f4afe566412bdb73b443b3aad99b375af1 Parents: 6123834 Author: Matei Zaharia Authored: Wed Aug 3 19:12:55 2016 -0700 Committer: Matei Zaharia Committed: Wed Aug 3 19:12:55 2016 -0700

spark git commit: [SPARK-7298] Harmonize style of new visualizations

DAG visualization text and colors are more consistent throughout - Fix some JavaScript style issues - Various small fixes throughout (e.g. inconsistent capitalization, some confusing names, HTML escaping, etc) Author: Matei Zaharia Closes #5942 from mateiz/ui and squashes the following comm

spark git commit: [SPARK-7298] Harmonize style of new visualizations

ler - DAG visualization text and colors are more consistent throughout - Fix some JavaScript style issues - Various small fixes throughout (e.g. inconsistent capitalization, some confusing names, HTML escaping, etc) Author: Matei Zaharia Closes #5942 from mateiz/ui and squashes the following comm

svn commit: r1682772 - in /spark: faq.md site/faq.html site/streaming/index.html streaming/index.md

Author: matei Date: Sun May 31 19:04:53 2015 New Revision: 1682772 URL: http://svn.apache.org/r1682772 Log: Some updates to FAQ on streaming Modified: spark/faq.md spark/site/faq.html spark/site/streaming/index.html spark/streaming/index.md Modified: spark/faq.md URL: http

svn commit: r1682773 - in /spark: _layouts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: matei Date: Sun May 31 19:06:00 2015 New Revision: 1682773 URL: http://svn.apache.org/r1682773 Log: Consistent wording of packages link Modified: spark/_layouts/global.html spark/site/community.html spark/site/documentation.html spark/site/downloads.html spark/site

[1/2] [SPARK-1777] Prevent OOMs from single partitions

Repository: spark Updated Branches: refs/heads/master f6ff2a61d -> ecf30ee7e http://git-wip-us.apache.org/repos/asf/spark/blob/ecf30ee7/core/src/test/scala/org/apache/spark/storage/BlockManagerSuite.scala -- diff --git a/core/

git commit: [SPARK-1550] [PySpark] Allow SparkContext creation after failed attempts

700 Committer: Matei Zaharia Committed: Sun Jul 27 22:54:43 2014 -0700 -- python/pyspark/context.py | 18 -- python/pyspark/tests.py | 6 ++ 2 files changed, 18 insertions(+), 6 deleti

git commit: [SPARK-2305] [PySpark] Update Py4J to version 0.8.2.1

mit: 22649b6cde8e18f043f122bce46f446174d00f6c Parents: 86534d0 Author: Josh Rosen Authored: Tue Jul 29 19:02:06 2014 -0700 Committer: Matei Zaharia Committed: Tue Jul 29 19:02:06 2014 -0700 -- LICENSE|

git commit: [SPARK-2762] SparkILoop leaks memory in multi-repl configurations

700 Committer: Matei Zaharia Committed: Thu Jul 31 10:25:40 2014 -0700 -- .../org/apache/spark/repl/SparkILoop.scala | 39 ++-- 1 file changed, 20 insertions(+), 19 deleti

git commit: SPARK-2028: Expose mapPartitionsWithInputSplit in HadoopRDD

org/repos/asf/spark/tree/f1933123 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f1933123 Branch: refs/heads/master Commit: f1933123525e7c806f5fc0b0a46a78a7546f8b61 Parents: 72cfb13 Author: Aaron Davidson Authored: Thu Jul 31 11:35:38 2014 -0700 Committer: Matei Zaharia Committed: Thu

git commit: [SPARK-2670] FetchFailedException should be thrown when local fetch has failed

17f70198ba2d848157f9da4e1e7e18f4fca Parents: cb9e7d5 Author: Kousuke Saruta Authored: Fri Aug 1 00:01:30 2014 -0700 Committer: Matei Zaharia Committed: Fri Aug 1 00:01:30 2014 -0700 -- .../spark/storage/BlockFetc

git commit: SPARK-983. Support external sorting in sortByKey()

Repository: spark Updated Branches: refs/heads/master 8ff4417f7 -> 72e336997 SPARK-983. Support external sorting in sortByKey() This patch simply uses the ExternalSorter class from sort-based shuffle. Closes #931 and Closes #1090 Author: Matei Zaharia Closes #1677 from mateiz/spark-

git commit: SPARK-2134: Report metrics before application finishes

efs/heads/master Commit: f1957e11652a537efd40771f843591a4c9341014 Parents: 72e3369 Author: Rahul Singhal Authored: Fri Aug 1 00:33:15 2014 -0700 Committer: Matei Zaharia Committed: Fri Aug 1 00:33:15 2014 -0700 -- core/src/m

git commit: [SPARK-695] In DAGScheduler's getPreferredLocs, track set of visited partitions.

che.org/repos/asf/spark/tree/eb5bdcaf Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/eb5bdcaf Branch: refs/heads/master Commit: eb5bdcaf6c7834558cb76b7132f68b8d94230356 Parents: c82fe47 Author: Aaron Staple Authored: Fri Aug 1 12:04:04 2014 -0700 Committer: Matei Zaharia Committed: F

git commit: [SPARK-2490] Change recursive visiting on RDD dependencies to iterative approach

Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/baf9ce1a Branch: refs/heads/master Commit: baf9ce1a4ecb7acf5accf7a7029f29604b4360c2 Parents: eb5bdca Author: Liang-Chi Hsieh Authored: Fri Aug 1 12:12:30 2014 -0700 Committer: Matei Zaharia Committed: Fri Aug

git commit: SPARK-1612: Fix potential resource leaks

//git-wip-us.apache.org/repos/asf/spark/tree/f5d9bea2 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f5d9bea2 Branch: refs/heads/master Commit: f5d9bea20e0db22c09c1191ca44a6471de765739 Parents: baf9ce1 Author: zsxwing Authored: Fri Aug 1 13:25:04 2014 -0700 Committer: Matei Zaharia Commit

git commit: SPARK-2791: Fix committing, reverting and state tracking in shuffle file consolidation

tp://git-wip-us.apache.org/repos/asf/spark/tree/78f2af58 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/78f2af58 Branch: refs/heads/master Commit: 78f2af582286b81e6dc9fa9d455ed2b369d933bd Parents: b270309 Author: Aaron Davidson Authored: Fri Aug 1 13:57:19 2014 -0700 Committer: Matei

git commit: [SPARK-2116] Load spark-defaults.conf from SPARK_CONF_DIR if set

wip-us.apache.org/repos/asf/spark/tree/0da07da5 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0da07da5 Branch: refs/heads/master Commit: 0da07da53e5466ec44c8050020cbc4b9957cb949 Parents: 3822f33 Author: Albert Chu Authored: Fri Aug 1 19:00:38 2014 -0700 Committer: Matei Zaharia Committed: Fri

git commit: SPARK-2792. Fix reading too much or too little data from each stream in ExternalMap / Sorter

ading it as part of the next batch. There are also improvements to cleanup to make sure files are closed. In addition to bringing in the changes to ExternalAppendOnlyMap, I also copied them to the corresponding code in ExternalSorter and updated its test suite to test for the same issues. Autho

git commit: SPARK-2792. Fix reading too much or too little data from each stream in ExternalMap / Sorter

Author: Matei Zaharia Closes #1722 from mateiz/spark-2792 and squashes the following commits: 5d4bfb5 [Matei Zaharia] Make objectStreamReset counter count the last object written too 18fe865 [Matei Zaharia] Update docs on objectStreamReset 576ee83 [Matei Zaharia] Allow objectStreamReset to be 0

git commit: SPARK-2685. Update ExternalAppendOnlyMap to avoid buffer.remove()

ved. Author: Matei Zaharia Closes #1773 from mateiz/SPARK-2685 and squashes the following commits: 1ea028a [Matei Zaharia] Update comments in StreamBuffer and EAOM, and reuse ArrayBuffers eb1abfd [Matei Zaharia] Update ExternalAppendOnlyMap to avoid buffer.remove() (cherry picked from com

git commit: SPARK-2685. Update ExternalAppendOnlyMap to avoid buffer.remove()

ved. Author: Matei Zaharia Closes #1773 from mateiz/SPARK-2685 and squashes the following commits: 1ea028a [Matei Zaharia] Update comments in StreamBuffer and EAOM, and reuse ArrayBuffers eb1abfd [Matei Zaharia] Update ExternalAppendOnlyMap to avoid buffer.remove() Project: http://git-wip-us.apache.

git commit: SPARK-2711. Create a ShuffleMemoryManager to track memory for all spilling collections

ere). Author: Matei Zaharia Closes #1707 from mateiz/spark-2711 and squashes the following commits: debf75b [Matei Zaharia] Review comments 24f28f3 [Matei Zaharia] Small rename c8f3a8b [Matei Zaharia] Update ShuffleMemoryManager to be able to partially grant requests 315e3a5 [Matei Zaharia] Some rev

git commit: SPARK-2711. Create a ShuffleMemoryManager to track memory for all spilling collections

hor: Matei Zaharia Closes #1707 from mateiz/spark-2711 and squashes the following commits: debf75b [Matei Zaharia] Review comments 24f28f3 [Matei Zaharia] Small rename c8f3a8b [Matei Zaharia] Update ShuffleMemoryManager to be able to partially grant requests 315e3a5 [Matei Zaharia] Some rev

git commit: SPARK-2294: fix locality inversion bug in TaskManager

14 -0700 Committer: Matei Zaharia Committed: Tue Aug 5 23:02:58 2014 -0700 -- .../apache/spark/scheduler/TaskLocality.scala | 2 +- .../spark/scheduler/TaskSchedulerImpl.scala | 7 +- .../apache/spark/s

git commit: SPARK-2294: fix locality inversion bug in TaskManager

c8c1de4 [CodingCat] simplify the patch be652ed [CodingCat] avoid unnecessary delay when we only have nopref tasks dee9e22 [CodingCat] fix locality inversion bug in TaskManager by moving nopref branch (cherry picked from commit 63bdb1f41b4895e3a9444f7938094438a94d3007) Signed-off-by: Matei Zaharia

git commit: replace println to log4j

Parents: bae35b1 Author: fireflyc Authored: Fri Jul 25 10:47:52 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 13 11:49:12 2014 -0700 -- .../apache/spark/streaming/receiver/ActorReceiver.scala | 12 +++- 1

git commit: [SPARK-2983] [PySpark] improve performance of sortByKey()

434bea1c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/434bea1c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/434bea1c Branch: refs/heads/master Commit: 434bea1c002b597cff9db899da101490e1f1e9ed Parents: c974a71 Author: Davies Liu Authored: Wed Aug 13 14:57:12 2014 -0700 Committer:

git commit: [SPARK-2983] [PySpark] improve performance of sortByKey()

ses #1898 from davies/sort and squashes the following commits: 0a9608b [Davies Liu] Merge branch 'master' into sort 1cf9565 [Davies Liu] improve performance of sortByKey() (cherry picked from commit 434bea1c002b597cff9db899da101490e1f1e9ed) Signed-off-by: Matei Zaharia Project: h

git commit: [SPARK-2736] PySpark converter and example script for reading Avro files

[SPARK-2736] Trying to work with all 3 Avro data models 2271a5b [Kan Zhang] [SPARK-2736] Using the right class loader to find Avro classes 536876b [Kan Zhang] [SPARK-2736] Adding Avro to Java converter (cherry picked from commit 9422a9b084e3fd5b2b9be2752013588adfb430d0) Signed-off-by: Matei Z

git commit: [SPARK-2736] PySpark converter and example script for reading Avro files

1 2014 -0700 Committer: Matei Zaharia Committed: Thu Aug 14 19:03:51 2014 -0700 -- .rat-excludes | 1 + .../spark/api/python/PythonHadoopUtil.scala | 3 +- .../org/apache/spark/api/

svn commit: r1620493 [2/2] - in /spark: screencasts/_posts/ site/ site/news/ site/releases/ site/screencasts/

tor, shuffle write metrics, various fixes and release management - Neal Wiggins – import clean-up, documentation fixes - Andrew Xia – bug fix in UI - Reynold Xin – task killing, support for setting job properties in Spark shell, logging improvements, Kryo improvements, several bug fixes - M

svn commit: r1620493 [1/2] - in /spark: screencasts/_posts/ site/ site/news/ site/releases/ site/screencasts/

Author: matei Date: Tue Aug 26 01:53:10 2014 New Revision: 1620493 URL: http://svn.apache.org/r1620493 Log: Updated screecast links to work over HTTPS too Modified: spark/screencasts/_posts/2013-04-10-1-first-steps-with-spark.md spark/screencasts/_posts/2013-04-11-2-spark-documentation

git commit: [SPARK-2976] Replace tabs with spaces

ored: Mon Aug 25 19:40:08 2014 -0700 Committer: Matei Zaharia Committed: Mon Aug 25 19:40:23 2014 -0700 -- .../org/apache/spark/ui/static/sorttable.js | 275 +-- .../org/apache/spark/examples/JavaPageRa

git commit: [SPARK-3073] [PySpark] use external sort in sortBy() and sortByKey()

e71d4c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f1e71d4c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/f1e71d4c Branch: refs/heads/master Commit: f1e71d4c3ba678fc108effb05cf2d6101dadc0ce Parents: c4787a3 Author: Davies Liu Authored: Tue Aug 26 16:57:40 2014 -0700 Committer: M

git commit: [SPARK-3225]Typo in script

Commit: 2ffd3290fe30c23df8da1efe153b84c23eb2e1cd Parents: f1e71d4 Author: WangTao Authored: Tue Aug 26 17:30:59 2014 -0700 Committer: Matei Zaharia Committed: Tue Aug 26 17:30:59 2014 -0700 -- bin/load-spark-env.sh | 6 +++--- 1 file c

git commit: [SPARK-3240] Adding known issue for MESOS-1688

26 18:30:39 2014 -0700 Committer: Matei Zaharia Committed: Tue Aug 26 18:30:45 2014 -0700 -- docs/running-on-mesos.md | 2 ++ 1 file changed, 2 insertions(+) --

git commit: Manually close some old pull requests

mit/ee91eb8c Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ee91eb8c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ee91eb8c Branch: refs/heads/master Commit: ee91eb8c53da84f8875fb5cec5820a6e189057b9 Parents: d834547 Author: Matei Zaharia Authored: Tue Aug 26 19:29:54 2014 -0700 Commit

git commit: Manually close old pull requests

wip-us.apache.org/repos/asf/spark/tree/e70aff6c Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e70aff6c Branch: refs/heads/master Commit: e70aff6c2d7f216060def0bd02be6a3d9017cd13 Parents: ee91eb8 Author: Matei Zaharia Authored: Tue Aug 26 19:35:19 2014 -0700 Committer: Matei Zaharia Committed:

git commit: [SPARK-3239] [PySpark] randomize the dirs for each process

wip-us.apache.org/repos/asf/spark/diff/092121e4 Branch: refs/heads/branch-1.1 Commit: 092121e477bcd2e474440dbdfdfa69cbd15c4803 Parents: 8f8e2a4 Author: Davies Liu Authored: Wed Aug 27 10:40:35 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 10:40:35 2014 -0

git commit: [SPARK-3256] Added support for :cp that was broken in Scala 2.10.x for REPL

ed: Wed Aug 27 13:01:11 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 13:01:11 2014 -0700 -- .../org/apache/spark/repl/SparkILoop.scala | 19 +++--- .../org/apache/spark/repl/SparkIMain.scala | 65 ++

git commit: [SPARK-3271] delete unused methods in Utils

mit: b86277c13232c3e65ce6c6cf7f6ede6a00546485 Parents: 64d8ecb Author: scwf Authored: Wed Aug 27 19:44:26 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 19:44:30 2014 -0700 -- .../scala/org/apache/spark/util/Utils.sc

git commit: SPARK-3265 Allow using custom ipython executable with pyspark

uthored: Wed Aug 27 19:47:33 2014 -0700 Committer: Matei Zaharia Committed: Wed Aug 27 19:47:33 2014 -0700 -- bin/pyspark | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) --

git commit: [SPARK-2889] Create Hadoop config objects consistently.

master Commit: b6cf1348170951396a6a5d8a65fb670382304f5b Parents: d90434c Author: Marcelo Vanzin Authored: Sat Aug 30 14:48:07 2014 -0700 Committer: Matei Zaharia Committed: Sat Aug 30 14:48:07 2014 -0700 -- .../scala/org/apache/spark/

git commit: SPARK-3318: Documentation update in addFile on how to use SparkFiles.get

83b Branch: refs/heads/master Commit: ba78383bace52b13ee931c6f2df445f721d5080a Parents: b6cf134 Author: Holden Karau Authored: Sat Aug 30 16:58:17 2014 -0700 Committer: Matei Zaharia Committed: Sat Aug 30 16:58:17 2014 -0700 -- c

git commit: [SPARK-3010] fix redundant conditional

ark/commit/725715cb Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/725715cb Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/725715cb Branch: refs/heads/master Commit: 725715cbf3c1834b81aa91ea751fd04d307f504d Parents: c567a68 Author: scwf Authored: Sun Aug 31 14:02:11 2014 -0700 Comm

git commit: [SPARK-3342] Add SSDs to block device mapping

pos/asf/spark/diff/44d3a6a7 Branch: refs/heads/master Commit: 44d3a6a75209370b1648e2dfedaa4c895923dae5 Parents: db16067 Author: Daniel Darabos Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 1 22:16:

git commit: [SPARK-3342] Add SSDs to block device mapping

pos/asf/spark/diff/e1363129 Branch: refs/heads/branch-1.1 Commit: e136312913517f0e2cbce3742076e955fc237c42 Parents: 865e6f6 Author: Daniel Darabos Authored: Mon Sep 1 22:14:28 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 1 22:18:

git commit: SPARK-3052. Misleading and spurious FileSystem closed errors whenever a ...

pos/asf/spark/tree/81b9d5b6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/81b9d5b6 Branch: refs/heads/master Commit: 81b9d5b628229ed69aa9dae45ec4c94068dcd71e Parents: 066f31a Author: Sandy Ryza Authored: Tue Sep 2 11:34:55 2014 -0700 Committer: Matei Zaharia Committed: Tue Sep 2 11:34

git commit: Manually close old PR

ark/tree/0fdf2f5a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0fdf2f5a Branch: refs/heads/master Commit: 0fdf2f5a18d88a600ca1ab7b4bf02fb0537e9411 Parents: dc1ba9e Author: Matei Zaharia Authored: Thu Sep 4 17:47:16 2014 -0700 Committer: Matei Zaharia Committed: Thu Sep 4 17:47:16 2

git commit: Manually close old PR

ark/tree/90b17a70 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/90b17a70 Branch: refs/heads/master Commit: 90b17a70c703c403d397e24cfbc20da22a32102d Parents: 0fdf2f5 Author: Matei Zaharia Authored: Thu Sep 4 17:51:14 2014 -0700 Committer: Matei Zaharia Committed: Thu Sep 4 17:51:14 2014 -0

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

add Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ba5bcadd Branch: refs/heads/master Commit: ba5bcaddecd54811d45c5fc79a013b3857d4c633 Parents: 7ff8c45 Author: Andrew Ash Authored: Fri Sep 5 18:52:05 2014 -0700 Committer: Matei Zaharia Committed: Fri Sep 5 18:52:05 20

git commit: SPARK-3211 .take() is OOM-prone with empty partitions

Spark to be less OOM-prone as well 3a156b8 [Andrew Ash] SPARK-3211 .take() is OOM-prone with empty partitions (cherry picked from commit ba5bcaddecd54811d45c5fc79a013b3857d4c633) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.ap

git commit: [SPARK-3353] parent stage should have lower stage id.

/repos/asf/spark/tree/3fb57a0a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/3fb57a0a Branch: refs/heads/master Commit: 3fb57a0ab3d76fda2301dbe9f2f3fa6743b4ed78 Parents: 110fb8b Author: Reynold Xin Authored: Sat Sep 6 19:06:30 2014 -0700 Committer: Matei Zaharia Committed: Sat Sep 6 19

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

org/repos/asf/spark/tree/6754570d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/6754570d Branch: refs/heads/master Commit: 6754570d83044c4fbaf0d2ac2378a0e081a93629 Parents: 3fb57a0 Author: Eric Liang Authored: Sun Sep 7 17:57:59 2014 -0700 Committer: Matei Zaharia Committed: Sun Sep 7 17

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

ing commits: c87355b [Eric Liang] refactor bfb6140 [Eric Liang] change RDD takeOrdered instead 7a51528 [Eric Liang] fix takeordered when limit = 0 (cherry picked from commit 6754570d83044c4fbaf0d2ac2378a0e081a93629) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/r

git commit: [SPARK-3394] [SQL] Fix crash in TakeOrdered when limit is 0

ing commits: c87355b [Eric Liang] refactor bfb6140 [Eric Liang] change RDD takeOrdered instead 7a51528 [Eric Liang] fix takeordered when limit = 0 (cherry picked from commit 6754570d83044c4fbaf0d2ac2378a0e081a93629) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/r

git commit: SPARK-2978. Transformation with MR shuffle semantics

ents: e16a8e7 Author: Sandy Ryza Authored: Mon Sep 8 11:20:00 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 8 11:20:00 2014 -0700 -- .../org/apache/spark/api/java/JavaPairRDD.scala | 26 + .../apa

git commit: SPARK-2745 [STREAMING] Add Java friendly methods to Duration class

wip-us.apache.org/repos/asf/spark/tree/e73b48ac Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/e73b48ac Branch: refs/heads/master Commit: e73b48ace0a7e0f249221240140235d33eeac36b Parents: 3b8eefa Author: Sean Owen Authored: Tue Sep 23 11:58:05 2014 -0700 Committer: Matei Zaharia Committ

git commit: [SPARK-3389] Add Converter for ease of Parquet reading in PySpark

red: Sat Sep 27 21:48:05 2014 -0700 Committer: Matei Zaharia Committed: Sat Sep 27 21:48:05 2014 -0700 -- examples/src/main/python/parquet_inputformat.py | 59 ++ examples/src/main/resources/full_user.avsc

git commit: [SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

11:25:32 2014 -0700 Committer: Matei Zaharia Committed: Mon Sep 29 11:25:32 2014 -0700 -- .../spark/util/collection/ExternalSorter.scala | 2 +- .../util/collection/ExternalSorterSuite.scala | 55 2 fi

git commit: [SPARK-3032][Shuffle] Fix key comparison integer overflow introduced sorting exception

1e6 [jerryshao] Change the test to show the contract violate exception 83acb38 [jerryshao] Minor changes according to comments fa2a08f [jerryshao] Fix key comparison integer overflow introduced sorting exception (cherry picked from commit dab1b0ae29a6d3017bdca23464f22a51d51eaae1) Signed-off-by: Ma

git commit: [SPARK-3356] [DOCS] Document when RDD elements' ordering within partitions is nondeterministic

0b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ab6dd80b Branch: refs/heads/master Commit: ab6dd80ba0f7e1042ea270d10400109a467fe40e Parents: 157e7d0 Author: Sean Owen Authored: Tue Sep 30 11:15:38 2014 -0700 Committer: Matei Zaharia Committed: Tue Sep 30 11:15:

svn commit: r1660555 - in /spark: community.md site/community.html

Author: matei Date: Wed Feb 18 01:08:19 2015 New Revision: 1660555 URL: http://svn.apache.org/r1660555 Log: Berlin meetup and cleaning up meetup page Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md

spark git commit: [SPARK-732][SPARK-3628][CORE][RESUBMIT] eliminate duplicate update on accmulator

14 -0800 Committer: Matei Zaharia Committed: Wed Nov 26 16:52:04 2014 -0800 -- .../scala/org/apache/spark/Accumulators.scala | 4 +- .../apache/spark/scheduler/DAGScheduler.scala | 53 +++- .../spark/s

spark git commit: [SPARK-732][SPARK-3628][CORE][RESUBMIT] eliminate duplicate update on accmulator

case for resubmitted result stage 5cf586f [CodingCat] de-duplicate on task level 138f9b3 [CodingCat] make MIMA happy 67593d2 [CodingCat] make if allowing duplicate update as an option of accumulator (cherry picked from commit 5af53ada65f62e6b5987eada288fb48e9211ef9d) Signed-off-by: Matei Zaharia

svn commit: r1642003 [1/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: matei Date: Thu Nov 27 02:07:18 2014 New Revision: 1642003 URL: http://svn.apache.org/r1642003 Log: tweak nav bar and add registration for Spark Summit East Added: spark/news/_posts/2014-11-26-registration-open-for-spark-summit-east.md spark/site/news/registration-open-for-spark

svn commit: r1642003 [3/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/releases/spark-release-0-9-0.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-9-0.html?rev=1642003&r1=1642002&r2=1642003&view=diff == --- spark/site/releases/spark-release-0-9

svn commit: r1642003 [2/3] - in /spark: ./ _layouts/ news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/news/spark-1-0-1-released.html URL: http://svn.apache.org/viewvc/spark/site/news/spark-1-0-1-released.html?rev=1642003&r1=1642002&r2=1642003&view=diff == --- spark/site/news/spark-1-0-1-released.html (

svn commit: r1642004 - in /spark: news/_posts/2014-11-26-registration-open-for-spark-summit-east.md site/news/index.html site/news/registration-open-for-spark-summit-east.html

Author: matei Date: Thu Nov 27 02:09:19 2014 New Revision: 1642004 URL: http://svn.apache.org/r1642004 Log: Fixed text Modified: spark/news/_posts/2014-11-26-registration-open-for-spark-summit-east.md spark/site/news/index.html spark/site/news/registration-open-for-spark-summit

spark git commit: [SPARK-4613][Core] Java API for JdbcRDD

ca3a353636d89239 Parents: 84376d3 Author: Cheng Lian Authored: Thu Nov 27 18:01:14 2014 -0800 Committer: Matei Zaharia Committed: Thu Nov 27 18:01:14 2014 -0800 -- .../scala/org/apache/spark/rdd/JdbcRDD.scala| 84 ++

spark git commit: [SPARK-4613][Core] Java API for JdbcRDD

herry picked from commit 120a350240f58196eafcb038ca3a353636d89239) Signed-off-by: Matei Zaharia Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/09280043 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/09280043 Diff: http://git-wip

svn commit: r1642751 - in /spark: community.md site/community.html

Author: matei Date: Mon Dec 1 20:56:05 2014 New Revision: 1642751 URL: http://svn.apache.org/r1642751 Log: tweaks to conferences Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642751&am

svn commit: r1642753 - in /spark: community.md site/community.html

Author: matei Date: Mon Dec 1 21:01:25 2014 New Revision: 1642753 URL: http://svn.apache.org/r1642753 Log: tweaks Modified: spark/community.md spark/site/community.html Modified: spark/community.md URL: http://svn.apache.org/viewvc/spark/community.md?rev=1642753&r1=1642752&r2

spark git commit: [SPARK-3619] Upgrade to Mesos 0.21 to work around MESOS-1688

ri Jan 9 10:47:08 2015 -0800 Committer: Matei Zaharia Committed: Fri Jan 9 10:47:08 2015 -0800 -- pom.xml | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -

svn commit: r1653723 [1/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Author: matei Date: Thu Jan 22 00:27:22 2015 New Revision: 1653723 URL: http://svn.apache.org/r1653723 Log: Add Summit East news item Added: spark/news/_posts/2015-01-21-spark-summit-east-agenda-posted.md spark/site/news/spark-summit-east-agenda-posted.html Modified: spark/site

svn commit: r1653723 [2/2] - in /spark: news/_posts/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/

Modified: spark/site/releases/spark-release-0-5-2.html URL: http://svn.apache.org/viewvc/spark/site/releases/spark-release-0-5-2.html?rev=1653723&r1=1653722&r2=1653723&view=diff == --- spark/site/releases/spark-release-0-5

svn commit: r1657457 - in /spark/site: robots.txt sitemap.xml

Author: matei Date: Thu Feb 5 02:01:47 2015 New Revision: 1657457 URL: http://svn.apache.org/r1657457 Log: Add a sitemap to try to let Google more easily find docs/latest Added: spark/site/robots.txt spark/site/sitemap.xml Added: spark/site/robots.txt URL: http://svn.apache.org/viewvc

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

e's no reason to have "Spark SQL Programming Guide - Spark 1.2.0 documentation", we can just say "Spark SQL - Spark 1.2.0 documentation". Author: Matei Zaharia Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPAR

spark git commit: [SPARK-5608] Improve SEO of Spark documentation pages

x27;s no reason to have "Spark SQL Programming Guide - Spark 1.2.0 documentation", we can just say "Spark SQL - Spark 1.2.0 documentation". Author: Matei Zaharia Closes #4381 from mateiz/docs-seo and squashes the following commits: 4940563 [Matei Zaharia] [SPARK-5608] Improv

svn commit: r1658278 - in /spark: ./ _layouts/ graphx/ mllib/ site/ site/graphx/ site/mllib/ site/news/ site/releases/ site/screencasts/ site/sql/ site/streaming/ sql/ streaming/

Author: matei Date: Sun Feb 8 23:58:24 2015 New Revision: 1658278 URL: http://svn.apache.org/r1658278 Log: Add meta description tags Modified: spark/_layouts/global.html spark/graphx/index.md spark/index.md spark/mllib/index.md spark/site/community.html spark/site

svn commit: r1658279 - in /spark: robots.txt sitemap.xml

Author: matei Date: Sun Feb 8 23:59:49 2015 New Revision: 1658279 URL: http://svn.apache.org/r1658279 Log: Add robots.txt and sitemap.xml to top-level folder too so they get generated Added: spark/robots.txt spark/sitemap.xml Added: spark/robots.txt URL: http://svn.apache.org/viewvc

svn commit: r1725819 - in /spark: ./ site/ site/news/ site/releases/

Author: matei Date: Wed Jan 20 21:40:26 2016 New Revision: 1725819 URL: http://svn.apache.org/viewvc?rev=1725819&view=rev Log: Add TM symbol to download page Modified: spark/downloads.md spark/site/documentation.html spark/site/downloads.html spark/site/news/index.html s

  1   2   3   4   >