Sean Owen created SPARK-26090:
---------------------------------
Summary: Resolve most miscellaneous deprecation and build warnings
for Spark 3
Key: SPARK-26090
URL: https://issues.apache.org/jira/browse/SPARK-26090
Project: Spark
Issue Type: Improvement
Components: ML, Spark Core, SQL
Affects Versions: 3.0.0
Reporter: Sean Owen
Assignee: Sean Owen
The build has a lot of deprecation warnings. Some are new in Scala 2.12 and
Java 11. We've fixed some, but I wanted to take a pass at fixing lots of easy
miscellaneous ones here.
They're too numerous and small to list here; see the pull request. Some
highlights:
- @BeanInfo is deprecated in 2.12, and BeanInfo classes are pretty ancient in
Java. Instead, case classes can explicitly declare getters
- Lots of work in the Kinesis examples to update and avoid deprecation
- Eta expansion of zero-arg methods; foo() becomes () => foo() in many cases
- Floating-point Range is inexact and deprecated, like 0.0 to 100.0 by 1.0
- finalize() is finally deprecated (just needs to be suppressed)
- StageInfo.attempId was deprecated and easiest to remove here
I'm not now going to touch some chunks of deprecation warnings:
- Parquet deprecations
- Hive deprecations (particularly serde2 classes)
- Deprecations in generated code (mostly Thriftserver CLI)
- ProcessingTime deprecations (we may need to revive this class as internal)
- many MLlib deprecations because they concern methods that may be removed
anyway
- a few Kinesis deprecations I couldn't figure out
- Mesos get/setRole, which I don't know well
- Kafka/ZK deprecations (e.g. poll())
- a few other ones that will probably resolve by deleting a deprecated method
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
