GitHub user srowen opened a pull request:
https://github.com/apache/spark/pull/23065
[SPARK-26090][CORE][SQL][ML] Resolve most miscellaneous deprecation and
build warnings for Spark 3
## What changes were proposed in this pull request?
The build has a lot of deprecation warnings. Some are new in Scala 2.12 and
Java 11. We've fixed some, but I wanted to take a pass at fixing lots of easy
miscellaneous ones here.
They're too numerous and small to list here; see the pull request. Some
highlights:
- `@BeanInfo` is deprecated in 2.12, and BeanInfo classes are pretty
ancient in Java. Instead, case classes can explicitly declare getters
- Lots of work in the Kinesis examples to update and avoid deprecation
- Eta expansion of zero-arg methods; foo() becomes () => foo() in many cases
- Floating-point Range is inexact and deprecated, like 0.0 to 100.0 by 1.0
- finalize() is finally deprecated (just needs to be suppressed)
- StageInfo.attempId was deprecated and easiest to remove here
I'm not now going to touch some chunks of deprecation warnings:
- Parquet deprecations
- Hive deprecations (particularly serde2 classes)
- Deprecations in generated code (mostly Thriftserver CLI)
- ProcessingTime deprecations (we may need to revive this class as internal)
- many MLlib deprecations because they concern methods that may be removed
anyway
- a few Kinesis deprecations I couldn't figure out
- Mesos get/setRole, which I don't know well
- Kafka/ZK deprecations (e.g. poll())
- a few other ones that will probably resolve by deleting a deprecated
method
## How was this patch tested?
Existing tests, including manual testing with the 2.11 build and Java 11.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/srowen/spark SPARK-26090
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/23065.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #23065
----
commit e2e375b592ccbbf2e468736fb2ee00b33787c58e
Author: Sean Owen <sean.owen@...>
Date: 2018-11-17T02:50:57Z
Resolve most miscellaneous deprecations and some build warnings
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
