spark git commit: [SPARK-11417] [SQL] no @Override in codegen

2015-10-30 Thread davies
Repository: spark Updated Branches: refs/heads/master 56419cf11 -> eb59b94c4 [SPARK-11417] [SQL] no @Override in codegen Older version of Janino (>2.7) does not support Override, we should not use that in codegen. Author: Davies Liu Closes #9372 from

[2/3] spark git commit: [SPARK-10342] [SPARK-10309] [SPARK-10474] [SPARK-10929] [SQL] Cooperative memory management

2015-10-30 Thread davies
http://git-wip-us.apache.org/repos/asf/spark/blob/56419cf1/core/src/main/java/org/apache/spark/util/collection/unsafe/sort/UnsafeExternalSorter.java -- diff --git

spark git commit: [SPARK-11423] remove MapPartitionsWithPreparationRDD

2015-10-30 Thread davies
Repository: spark Updated Branches: refs/heads/master bb5a2af03 -> 45029bfde [SPARK-11423] remove MapPartitionsWithPreparationRDD Since we do not need to preserve a page before calling compute(), MapPartitionsWithPreparationRDD is not needed anymore. This PR basically revert #8543, #8511,

spark git commit: Revert "[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0."

2015-10-30 Thread yhuai
Repository: spark Updated Branches: refs/heads/master 45029bfde -> e8ec2a7b0 Revert "[SPARK-11236][CORE] Update Tachyon dependency from 0.7.1 -> 0.8.0." This reverts commit 4f5e60c647d7d6827438721b7fabbc3a57b81023. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit:

spark git commit: [SPARK-11393] [SQL] CoGroupedIterator should respect the fact that GroupedIterator.hasNext is not idempotent

2015-10-30 Thread marmbrus
Repository: spark Updated Branches: refs/heads/master 59db9e9c3 -> 14d08b990 [SPARK-11393] [SQL] CoGroupedIterator should respect the fact that GroupedIterator.hasNext is not idempotent When we cogroup 2 `GroupedIterator`s in `CoGroupedIterator`, if the right side is smaller, we will

spark git commit: [SPARK-11385] [ML] foreachActive made public in MLLib's vector API

2015-10-30 Thread dbtsai
Repository: spark Updated Branches: refs/heads/master e8ec2a7b0 -> 69b9e4b3c [SPARK-11385] [ML] foreachActive made public in MLLib's vector API Made foreachActive public in MLLib's vector API Author: Nakul Jindal Closes #9362 from

spark git commit: [SPARK-11434][SPARK-11103][SQL] Fix test ": Filter applied on merged Parquet schema with new column fails"

2015-10-30 Thread yhuai
Repository: spark Updated Branches: refs/heads/branch-1.5 6b10ea5d5 -> c9ac0e918 [SPARK-11434][SPARK-11103][SQL] Fix test ": Filter applied on merged Parquet schema with new column fails" https://issues.apache.org/jira/browse/SPARK-11434 Author: Yin Huai Closes #9387

spark git commit: [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio

2015-10-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 729f983e6 -> bb5a2af03 [SPARK-11340][SPARKR] Support setting driver properties when starting Spark from R programmatically or from RStudio Mapping spark.driver.memory from sparkEnvir to spark-submit commandline arguments. shivaram

spark git commit: [SPARK-10986][MESOS] Set the context class loader in the Mesos executor backend.

2015-10-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 14d08b990 -> 0451b0014 [SPARK-10986][MESOS] Set the context class loader in the Mesos executor backend. See [SPARK-10986](https://issues.apache.org/jira/browse/SPARK-10986) for details. This fixes the `ClassNotFoundException` for Spark

spark git commit: [SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru…

2015-10-30 Thread srowen
Repository: spark Updated Branches: refs/heads/master 40c77fb23 -> 729f983e6 [SPARK-11342][TESTS] Allow to set hadoop profile when running dev/ru… …n_tests Author: Jeff Zhang Closes #9295 from zjffdu/SPARK-11342. Project:

spark git commit: [SPARK-11103][SQL] Filter applied on Merged Parquet shema with new column fail

2015-10-30 Thread lian
Repository: spark Updated Branches: refs/heads/master 86d65265f -> 59db9e9c3 [SPARK-11103][SQL] Filter applied on Merged Parquet shema with new column fail When enabling mergedSchema and predicate filter, this fails since Parquet does not accept filters pushed down when the columns of the

spark git commit: [SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.command' in RRDD in the PR for SPARK-10971.

2015-10-30 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 0451b0014 -> fab710a91 [SPARK-11414][SPARKR] Forgot to update usage of 'spark.sparkr.r.command' in RRDD in the PR for SPARK-10971. Author: Sun Rui Closes #9368 from sun-rui/SPARK-11414. Project: