GitHub user ilganeli opened a pull request:
https://github.com/apache/spark/pull/5574
[SPARK-5932][CORE][WIP] Use consistent naming for size properties
I've added an interface to JavaUtils to do byte conversion. I will add
hooks within Utils.scala to handle conversion within Spark code (like for time
Strings), matching tests, and then update deprecated configs as per SPARK-5933.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/ilganeli/spark SPARK-5932
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5574.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5574
----
commit d7a06b8b773da4923f5504ee4387906a53249fa3
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-13T23:50:41Z
Updated SparkConf class to add getOrCreate method. Started test suite
implementation
commit a99032f4614589bbc9ad7dd1990b0953254bf649
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T16:26:00Z
Spacing fix
commit e92caf7b4ffb4b5d3ef0e5a90bda0d5dafe96cab
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T16:52:43Z
[SPARK-6703] Added test to ensure that getOrCreate both allows creation,
retrieval, and a second context if desired
commit 8be2f83c16f03b82a00f7e5b4eb21c42db9b77d2
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T16:55:06Z
Replaced match with if
commit 733ec9ff69dbc4dde5b9c6809133308248d16657
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T16:56:22Z
Fixed some bugs in test code
commit dfec4dae763e888a2e8ae267b1a2e21180c9decc
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T17:11:57Z
Changed activeContext to AtomicReference
commit 0e1567cd8dfd7cfc39940cfe8b17fe30f63242e2
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T17:58:50Z
Got rid of unecessary option for AtomicReference
commit 15e8dea2ba4dc8965fe2da8cf88714021e217d19
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T18:01:21Z
Updated comments and added MiMa Exclude
commit 270cfe30da1a216278027276c3366d80271efa0b
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T18:29:18Z
[SPARK-6703] Documentation fixes
commit cb0c6b73e212312ae990fc9c61a4ef5eb8555cd9
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T18:32:23Z
Doc updates and code cleanup
commit 8c884fae2c4f018e76e2b07a94891fca34657cf8
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T18:37:19Z
Made getOrCreate synchronized
commit 1dc044452faf11062aa6f54f01c5d29094ebc113
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-14T18:38:23Z
Added ref equality check
commit db9a9631415d86ee36add876770fbde510530ead
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-17T21:23:22Z
Closing second spark context
commit 5390fd9db9158d21d5ac2309e443739e22ed23db
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-18T15:44:55Z
Merge remote-tracking branch 'upstream/master' into SPARK-5932
commit 09ea450fd5dfa8849c71dbd7420e955d9c22887f
Author: Ilya Ganelin <[email protected]>
Date: 2015-04-18T16:15:36Z
[SPARK-5932] Added byte string conversion to Jav utils
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
