GitHub user gao8658 opened a pull request:
https://github.com/apache/spark/pull/1115
Branch 1.0 Add ZLIBCompressionCodec code
Hi ,ALL,I try to add Spark ZLIBCompressionCodec
the code is here and the jzlib lib is from http://www.jcraft.com/jzlib/
The code can run on Spark source code ,and the test can pass.
code :
@DeveloperApi
class ZLIBCompressionCodec(conf: SparkConf) extends CompressionCodec {
import java.io._
import com.jcraft.jzlib._
@DeveloperApi
class ZLIBCompressionCodec(conf: SparkConf) extends CompressionCodec {
override def compressedOutputStream(s: OutputStream): OutputStream = {
val zOut = new ZOutputStream(s, JZlib.Z_BEST_COMPRESSION)
zOut
}
override def compressedInputStream(s: InputStream): InputStream = new
ZInputStream(s)
}
testsuite :
class CompressionCodecSuite extends FunSuite {
val conf = new SparkConf(false)
def testCodec(codec: CompressionCodec) {
// Write 1000 integers to the output stream, compressed.
val outputStream = new ByteArrayOutputStream()
val out = codec.compressedOutputStream(outputStream)
for (i <- 1 until 1000) {
out.write(i % 256)
}
out.close()
// Read the 1000 integers back.
val inputStream = new ByteArrayInputStream(outputStream.toByteArray)
val in = codec.compressedInputStream(inputStream)
for (i <- 1 until 1000) {
assert(in.read() === i % 256)
}
in.close()
}
test("default compression codec") {
val codec = CompressionCodec.createCodec(conf)
assert(codec.getClass === classOf[LZFCompressionCodec])
testCodec(codec)
}
test("lzf compression codec") {
val codec = CompressionCodec.createCodec(conf,
classOf[LZFCompressionCodec].getName)
assert(codec.getClass === classOf[LZFCompressionCodec])
testCodec(codec)
}
test("snappy compression codec") {
val codec = CompressionCodec.createCodec(conf,
classOf[SnappyCompressionCodec].getName)
assert(codec.getClass === classOf[SnappyCompressionCodec])
testCodec(codec)
}
test("zlib compression codec") {
val codec = CompressionCodec.createCodec(conf,
classOf[ZLIBCompressionCodec].getName)
assert(codec.getClass === classOf[ZLIBCompressionCodec])
testCodec(codec)
}
}
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/spark branch-1.0
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1115.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1115
----
commit 14515b416e9a00cb3a77c2645984265b30b05882
Author: Sean Owen <[email protected]>
Date: 2014-05-12T21:16:19Z
SPARK-1798. Tests should clean up temp files
Three issues related to temp files that tests generate â these should be
touched up for hygiene but are not urgent.
Modules have a log4j.properties which directs the unit-test.log output file
to a directory like `[module]/target/unit-test.log`. But this ends up creating
`[module]/[module]/target/unit-test.log` instead of former.
The `work/` directory is not deleted by "mvn clean", in the parent and in
modules. Neither is the `checkpoint/` directory created under the various
external modules.
Many tests create a temp directory, which is not usually deleted. This can
be largely resolved by calling `deleteOnExit()` at creation and trying to call
`Utils.deleteRecursively` consistently to clean up, sometimes in an `@After`
method.
_If anyone seconds the motion, I can create a more significant change that
introduces a new test trait along the lines of `LocalSparkContext`, which
provides management of temp directories for subclasses to take advantage of._
Author: Sean Owen <[email protected]>
Closes #732 from srowen/SPARK-1798 and squashes the following commits:
5af578e [Sean Owen] Try to consistently delete test temp dirs and files,
and set deleteOnExit() for each
b21b356 [Sean Owen] Remove work/ and checkpoint/ dirs with mvn clean
bdd0f41 [Sean Owen] Remove duplicate module dir in log4j.properties output
path for tests
(cherry picked from commit 7120a2979d0a9f0f54a88b2416be7ca10e74f409)
Signed-off-by: Patrick Wendell <[email protected]>
commit e1852812ff9a8b0b9eb28990db0ad754ab80b08b
Author: Sean Owen <[email protected]>
Date: 2014-05-12T21:17:25Z
SPARK-1802. Audit dependency graph when Spark is built with -Phive
This initial commit resolves the conflicts in the Hive profiles as noted in
https://issues.apache.org/jira/browse/SPARK-1802 .
Most of the fix was to note that Hive drags in Avro, and so if the hive
module depends on Spark's version of the `avro-*` dependencies, it will pull in
our exclusions as needed too. But I found we need to copy some exclusions
between the two Avro dependencies to get this right. And then had to squash
some commons-logging intrusions.
This turned up another annoying find, that `hive-exec` is basically an
"assembly" artifact that _also_ packages all of its transitive dependencies.
This means the final assembly shows lots of collisions between itself and its
dependencies, and even other project dependencies. I have a TODO to examine
whether that is going to be a deal-breaker or not.
In the meantime I'm going to tack on a second commit to this PR that will
also fix some similar, last collisions in the YARN profile.
Author: Sean Owen <[email protected]>
Closes #744 from srowen/SPARK-1802 and squashes the following commits:
a856604 [Sean Owen] Resolve JAR version conflicts specific to Hive profile
(cherry picked from commit 8586bf564fe010dfc19ef26874472a6f85e355fb)
Signed-off-by: Patrick Wendell <[email protected]>
commit 0b07b710ebd91487903e5691a8c4c0e429a5a26b
Author: Patrick Wendell <[email protected]>
Date: 2014-05-12T21:49:42Z
[maven-release-plugin] prepare release v1.0.0-rc4
commit d78e37ab54a92093d25aa2e1d5e6cb20db55ccac
Author: Patrick Wendell <[email protected]>
Date: 2014-05-12T21:49:49Z
[maven-release-plugin] prepare for next development iteration
commit 51142b7732209250dd41e0a4182d02df81d7cc8b
Author: Patrick Wendell <[email protected]>
Date: 2014-05-12T22:23:53Z
Rollback versions for 1.0.0-rc4
commit b66051ebe4708f5d2771691386bbc393d1cf09ad
Author: Patrick Wendell <[email protected]>
Date: 2014-05-12T22:40:48Z
Adding hadoop-2.2 profile to the build
commit e9d602d3b50044f1dfa3fbb4efccfe3c1384711e
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T00:09:13Z
Rename testExecutorEnvs --> executorEnvs.
This was changed, but in fact, it's used for things other than tests.
So I've changed it back.
Author: Patrick Wendell <[email protected]>
Closes #747 from pwendell/executor-env and squashes the following commits:
36a60a5 [Patrick Wendell] Rename testExecutorEnvs --> executorEnvs.
(cherry picked from commit 3ce526b168050c572a1feee8e0121e1426f7d9ee)
Signed-off-by: Patrick Wendell <[email protected]>
commit c294f37f9ac9887266829c68ffb5315e01d4c0f7
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T00:27:28Z
SPARK-1623: Use File objects instead of String's in HTTPBroadcast
This seems strictly better, and I think it's justified only the grounds of
clean-up. It might also fix issues with path conversions, but I haven't
yet isolated any instance of that happening.
/cc @srowen @tdas
Author: Patrick Wendell <[email protected]>
Closes #749 from pwendell/broadcast-cleanup and squashes the following
commits:
d6d54f2 [Patrick Wendell] SPARK-1623: Use File objects instead of string's
in HTTPBroadcast
(cherry picked from commit 925d8b249b84d2706c52f0d1e29fb8dcd6de452e)
Signed-off-by: Patrick Wendell <[email protected]>
commit 02caa7e7eb28fe6ac58ae110bdad3802d66b759d
Author: Sean Owen <[email protected]>
Date: 2014-05-13T00:35:29Z
SPARK-1802. (Addendium) Audit dependency graph when Spark is built with
-Pyarn
Following on a few more items from SPARK-1802 --
The first commit touches up a few similar problems remaining with the YARN
profile. I think this is worth cherry-picking.
The second commit is more of the same for hadoop-client, although the fix
is a little more complex. It may or may not be worth bothering with.
Author: Sean Owen <[email protected]>
Closes #746 from srowen/SPARK-1802.2 and squashes the following commits:
52aeb41 [Sean Owen] Add more commons-logging, servlet excludes to avoid
conflicts in assembly when building for YARN
(cherry picked from commit 4b31f4ec7efab8eabf956284a99bfd96a58b79f7)
Signed-off-by: Patrick Wendell <[email protected]>
commit 59695b367ceb99643eb88bb0b4b0442211697561
Author: Andrew Or <[email protected]>
Date: 2014-05-13T00:39:40Z
[SPARK-1736] Spark submit for Windows
Tested on Windows 7.
Author: Andrew Or <[email protected]>
Closes #745 from andrewor14/windows-submit and squashes the following
commits:
c0b58fb [Andrew Or] Allow spaces in parameters
162e54d [Andrew Or] Merge branch 'master' of github.com:apache/spark into
windows-submit
91597ce [Andrew Or] Make spark-shell.cmd use spark-submit.cmd
af6fd29 [Andrew Or] Add spark submit for Windows
commit 24cc933c893b634a2742e461385fd4ad01bb35e1
Author: Michael Armbrust <[email protected]>
Date: 2014-05-13T01:40:30Z
[SQL] Make Hive Metastore conversion functions publicly visible.
I need this to be public for the implementation of SharkServer2. However,
I think this functionality is generally useful and should be pretty stable.
Author: Michael Armbrust <[email protected]>
Closes #750 from marmbrus/metastoreTypes and squashes the following commits:
f51b62e [Michael Armbrust] Make Hive Metastore conversion functions
publicly visible.
(cherry picked from commit 2f1a3373583f9b34a121236c25f5142ba8729546)
Signed-off-by: Reynold Xin <[email protected]>
commit 1fbebcae0cb90ba26c8292a839116bfb871267ca
Author: Andrew Ash <[email protected]>
Date: 2014-05-13T01:46:28Z
Typo: resond -> respond
Author: Andrew Ash <[email protected]>
Closes #743 from ash211/patch-4 and squashes the following commits:
c959f3b [Andrew Ash] Typo: resond -> respond
(cherry picked from commit a5150d199ca97ab2992bc2bb221a3ebf3d3450ba)
Signed-off-by: Reynold Xin <[email protected]>
commit bad4c9db09f1bcb641155beb50dfdd9df274b921
Author: DB Tsai <[email protected]>
Date: 2014-05-13T02:20:24Z
L-BFGS Documentation
Documentation for L-BFGS, and an example of training binary L2 logistic
regression using L-BFGS.
Author: DB Tsai <[email protected]>
Closes #702 from dbtsai/dbtsai-lbfgs-doc and squashes the following commits:
0712215 [DB Tsai] Update
38fdfa1 [DB Tsai] Removed extra empty line
5745b64 [DB Tsai] Update again
e9e418e [DB Tsai] Update
7381521 [DB Tsai] L-BFGS Documentation
(cherry picked from commit 5c2275d6e4639946fd11ff6403338c8a9ade3d1e)
Signed-off-by: Reynold Xin <[email protected]>
commit 89b56d7b7448f5f1d7ee6ac0ecdbc3a980474f30
Author: Kousuke Saruta <[email protected]>
Date: 2014-05-13T02:21:06Z
Modify a typo in monitoring.md
As I mentioned in SPARK-1765, there is a word 'JXM' in monitoring.md.
I think it's typo for 'JMX'.
Author: Kousuke Saruta <[email protected]>
Closes #698 from sarutak/SPARK-1765 and squashes the following commits:
bae9843 [Kousuke Saruta] modified a typoe in monitoring.md
(cherry picked from commit 9cf9f18973840f7287f7cfa5ce90efed3225bb30)
Signed-off-by: Reynold Xin <[email protected]>
commit b52ac0e0b7f7a5843c0d9caa97a526e6e17b2849
Author: Andrew Ash <[email protected]>
Date: 2014-05-13T02:23:39Z
SPARK-1757 Failing test for saving null primitives with .saveAsParquetFile()
https://issues.apache.org/jira/browse/SPARK-1757
The first test succeeds, but the second test fails with exception:
```
[info] - save and load case class RDD with Nones as parquet *** FAILED ***
(14 milliseconds)
[info] java.lang.RuntimeException: Unsupported datatype StructType(List())
[info] at scala.sys.package$.error(package.scala:27)
[info] at
org.apache.spark.sql.parquet.ParquetTypesConverter$.fromDataType(ParquetRelation.scala:201)
[info] at
org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$1.apply(ParquetRelation.scala:235)
[info] at
org.apache.spark.sql.parquet.ParquetTypesConverter$$anonfun$1.apply(ParquetRelation.scala:235)
[info] at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
[info] at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
[info] at scala.collection.immutable.List.foreach(List.scala:318)
[info] at
scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
[info] at scala.collection.AbstractTraversable.map(Traversable.scala:105)
[info] at
org.apache.spark.sql.parquet.ParquetTypesConverter$.convertFromAttributes(ParquetRelation.scala:234)
[info] at
org.apache.spark.sql.parquet.ParquetTypesConverter$.writeMetaData(ParquetRelation.scala:267)
[info] at
org.apache.spark.sql.parquet.ParquetRelation$.createEmpty(ParquetRelation.scala:143)
[info] at
org.apache.spark.sql.parquet.ParquetRelation$.create(ParquetRelation.scala:122)
[info] at
org.apache.spark.sql.execution.SparkStrategies$ParquetOperations$.apply(SparkStrategies.scala:139)
[info] at
org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:58)
[info] at
org.apache.spark.sql.catalyst.planning.QueryPlanner$$anonfun$1.apply(QueryPlanner.scala:58)
[info] at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:371)
[info] at
org.apache.spark.sql.catalyst.planning.QueryPlanner.apply(QueryPlanner.scala:59)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.sparkPlan$lzycompute(SQLContext.scala:264)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.sparkPlan(SQLContext.scala:264)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.executedPlan$lzycompute(SQLContext.scala:265)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.executedPlan(SQLContext.scala:265)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.toRdd$lzycompute(SQLContext.scala:268)
[info] at
org.apache.spark.sql.SQLContext$QueryExecution.toRdd(SQLContext.scala:268)
[info] at
org.apache.spark.sql.SchemaRDDLike$class.saveAsParquetFile(SchemaRDDLike.scala:66)
[info] at
org.apache.spark.sql.SchemaRDD.saveAsParquetFile(SchemaRDD.scala:98)
```
Author: Andrew Ash <[email protected]>
Author: Michael Armbrust <[email protected]>
Closes #690 from ash211/rdd-parquet-save and squashes the following commits:
747a0b9 [Andrew Ash] Merge pull request #1 from marmbrus/pr/690
54bd00e [Michael Armbrust] Need to put Option first since Option <: Seq.
8f3f281 [Andrew Ash] SPARK-1757 Add failing test for saving SparkSQL
Schemas with Option[?] fields as parquet
(cherry picked from commit 156df87e7ca0e6cda2cc970ecd1466ce06f7576f)
Signed-off-by: Reynold Xin <[email protected]>
commit 5ef24a0c561d9bc58d1a35e471c38892fc6d3dff
Author: Andrew Or <[email protected]>
Date: 2014-05-13T02:42:35Z
[SPARK-1780] Non-existent SPARK_DAEMON_OPTS is lurking around
What they really mean is SPARK_DAEMON_***JAVA***_OPTS
Author: Andrew Or <[email protected]>
Closes #751 from andrewor14/spark-daemon-opts and squashes the following
commits:
70c41f9 [Andrew Or] SPARK_DAEMON_OPTS -> SPARK_DAEMON_JAVA_OPTS
(cherry picked from commit ba96bb3d591130075763706526f86fb2aaffa3ae)
Signed-off-by: Patrick Wendell <[email protected]>
commit b9e41f4b8b52754ea059c3334da10dbfb4f41c17
Author: Andrew Or <[email protected]>
Date: 2014-05-13T02:44:14Z
[SPARK-1753 / 1773 / 1814] Update outdated docs for spark-submit, YARN,
standalone etc.
YARN
- SparkPi was updated to not take in master as an argument; we should
update the docs to reflect that.
- The default YARN build guide should be in maven, not sbt.
- This PR also adds a paragraph on steps to debug a YARN application.
Standalone
- Emphasize spark-submit more. Right now it's one small paragraph preceding
the legacy way of launching through `org.apache.spark.deploy.Client`.
- The way we set configurations / environment variables according to the
old docs is outdated. This needs to reflect changes introduced by the Spark
configuration changes we made.
In general, this PR also adds a little more documentation on the new
spark-shell, spark-submit, spark-defaults.conf etc here and there.
Author: Andrew Or <[email protected]>
Closes #701 from andrewor14/yarn-docs and squashes the following commits:
e2c2312 [Andrew Or] Merge in changes in #752 (SPARK-1814)
25cfe7b [Andrew Or] Merge in the warning from SPARK-1753
a8c39c5 [Andrew Or] Minor changes
336bbd9 [Andrew Or] Tabs -> spaces
4d9d8f7 [Andrew Or] Merge branch 'master' of github.com:apache/spark into
yarn-docs
041017a [Andrew Or] Abstract Spark submit documentation to
cluster-overview.html
3cc0649 [Andrew Or] Detail how to set configurations + remove legacy
instructions
5b7140a [Andrew Or] Merge branch 'master' of github.com:apache/spark into
yarn-docs
85a51fc [Andrew Or] Update run-example, spark-shell, configuration etc.
c10e8c7 [Andrew Or] Merge branch 'master' of github.com:apache/spark into
yarn-docs
381fe32 [Andrew Or] Update docs for standalone mode
757c184 [Andrew Or] Add a note about the requirements for the debugging
trick
f8ca990 [Andrew Or] Merge branch 'master' of github.com:apache/spark into
yarn-docs
924f04c [Andrew Or] Revert addition of --deploy-mode
d5fe17b [Andrew Or] Update the YARN docs
(cherry picked from commit 2ffd1eafd28635dcecc0ac738d4a62c05d740925)
Signed-off-by: Patrick Wendell <[email protected]>
commit 31d54c02021de817f02aa159d9f3cf97f9a73d0b
Author: Sandy Ryza <[email protected]>
Date: 2014-05-13T03:08:30Z
SPARK-1815. SparkContext should not be marked DeveloperApi
Author: Sandy Ryza <[email protected]>
Closes #753 from sryza/sandy-spark-1815 and squashes the following commits:
957a8ac [Sandy Ryza] SPARK-1815. SparkContext should not be marked
DeveloperApi
(cherry picked from commit 2792bd016af2a67848e6f403c4e1e05e9f3e3c2a)
Signed-off-by: Patrick Wendell <[email protected]>
commit fa2d4d8260f44524aaf64a9cb2ce04b1319b1c96
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T03:21:23Z
Adding CHANGES.txt file and removing YARN support for now
commit 3d0a44833ab50360bf9feccc861cb5e8c44a4866
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T03:48:53Z
[maven-release-plugin] prepare release v1.0.0-rc4
commit 9772d85c6f3893d42044f4bab0e16f8b6287613a
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T03:49:00Z
[maven-release-plugin] prepare for next development iteration
commit bcaf01f6d1d5e5bf6dcf171e3d086a8e49f370eb
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T06:24:29Z
Revert "[maven-release-plugin] prepare for next development iteration"
This reverts commit 9772d85c6f3893d42044f4bab0e16f8b6287613a.
commit 9b8b737a43914ba57af35cde4fd3af92d1b36679
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T06:24:37Z
Revert "[maven-release-plugin] prepare release v1.0.0-rc4"
This reverts commit 3d0a44833ab50360bf9feccc861cb5e8c44a4866.
commit 716462c6c265325f2b38ff518ba1610fdc3a139b
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T06:02:54Z
BUILD: Add more content to make-distribution.sh.
commit 18f062303303824139998e8fc8f4158217b0dbc3
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T06:50:43Z
[maven-release-plugin] prepare release v1.0.0-rc5
commit d08e9604fc9958b7c768e91715c8152db2ed6fd0
Author: Patrick Wendell <[email protected]>
Date: 2014-05-13T06:50:51Z
[maven-release-plugin] prepare for next development iteration
commit d6994f4e67c9ab98f7a707fc744939dc0c9107cf
Author: Andrew Tulloch <[email protected]>
Date: 2014-05-14T00:31:27Z
SPARK-1791 - SVM implementation does not use threshold parameter
Summary:
https://issues.apache.org/jira/browse/SPARK-1791
Simple fix, and backward compatible, since
- anyone who set the threshold was getting completely wrong answers.
- anyone who did not set the threshold had the default 0.0 value for the
threshold anyway.
Test Plan:
Unit test added that is verified to fail under the old implementation,
and pass under the new implementation.
Reviewers:
CC:
Author: Andrew Tulloch <[email protected]>
Closes #725 from ajtulloch/SPARK-1791-SVM and squashes the following
commits:
770f55d [Andrew Tulloch] SPARK-1791 - SVM implementation does not use
threshold parameter
(cherry picked from commit d1e487473fd509f28daf28dcda856f3c2f1194ec)
Signed-off-by: Reynold Xin <[email protected]>
commit 3892ec584706a0ee122062ab896a7aca0ff02d93
Author: Andrew Or <[email protected]>
Date: 2014-05-14T01:32:32Z
[SPARK-1816] LiveListenerBus dies if a listener throws an exception
The solution is to wrap a try / catch / log around the posting of each
event to each listener.
Author: Andrew Or <[email protected]>
Closes #759 from andrewor14/listener-die and squashes the following commits:
aee5107 [Andrew Or] Merge branch 'master' of github.com:apache/spark into
listener-die
370939f [Andrew Or] Remove two layers of indirection
422d278 [Andrew Or] Explicitly throw an exception instead of 1 / 0
0df0e2a [Andrew Or] Try/catch and log exceptions when posting events
(cherry picked from commit 5c0dafc2c8734a421206a808b73be67b66264dd7)
Signed-off-by: Patrick Wendell <[email protected]>
commit ef5e9d70fafe9b819a6351fd041d0466e5c1d42d
Author: Ye Xianjin <[email protected]>
Date: 2014-05-14T02:03:51Z
[SPARK-1527] change rootDir*.getName to rootDir*.getAbsolutePath
JIRA issue: [SPARK-1527](https://issues.apache.org/jira/browse/SPARK-1527)
getName() only gets the last component of the file path. When deleting
test-generated directories,
we should pass the generated directory's absolute path to DiskBlockManager.
Author: Ye Xianjin <[email protected]>
This patch had conflicts when merged, resolved by
Committer: Patrick Wendell <[email protected]>
Closes #436 from advancedxy/SPARK-1527 and squashes the following commits:
4678bab [Ye Xianjin] change rootDir*.getname to rootDir*.getAbsolutePath so
the temporary directories are deleted when the test is finished.
(cherry picked from commit 753b04dea4b04ba9d0dd0011f00e9d70367e76fc)
Signed-off-by: Patrick Wendell <[email protected]>
commit 618b3e6e7d0bb826ed333b803fe0a7214e1b14ad
Author: Michael Armbrust <[email protected]>
Date: 2014-05-14T04:23:51Z
[SQL] Make it possible to create Java/Python SQLContexts from an existing
Scala SQLContext.
Author: Michael Armbrust <[email protected]>
Closes #761 from marmbrus/existingContext and squashes the following
commits:
4651051 [Michael Armbrust] Make it possible to create Java/Python
SQLContexts from an existing Scala SQLContext.
(cherry picked from commit 44233865cf8020741d862d33cc660c88e9315dea)
Signed-off-by: Reynold Xin <[email protected]>
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
