GitHub user holdenk opened a pull request:
https://github.com/apache/spark/pull/11286
[SPARK-13399][STREAMING] Fix checkpointsuite type erasure warnings
## What changes were proposed in this pull request?
Change the checkpointsuite getting the outputstreams to explicitly be
unchecked on the generic type so as to avoid the warnings. This only impacts
test code.
Alternatively we could encode the type tag in the
TestOutputStreamWithPartitions and filter the type tag as well - but this is
unnecessary since multiple testoutputstreams are not registered and the
previous code was not actually checking this type.
## How was the this patch tested?
unit tests (streaming/testOnly org.apache.spark.streaming.CheckpointSuite)
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/spark
SPARK-13399-checkpointsuite-type-erasure
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11286.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11286
----
commit dd70caddde0100a96a5581725d36c77d31b33c99
Author: Holden Karau <[email protected]>
Date: 2016-02-21T04:46:41Z
Fix the type erasure warning in the checkpoint suite, add the class tag
informtion to the TestOutputStreamWithPartitions and use that in the suite to
verify the correct type
commit 8e18eaf71a4073168c6fb490a879243ff62d3109
Author: Holden Karau <[email protected]>
Date: 2016-02-21T06:35:56Z
Wait we were not actually depending on checking the type of the elements in
the stream before, just mark as unchecked and go for it.
commit 0dd337e5a0e4ade7b09c4cca0cb2a947006fb539
Author: Holden Karau <[email protected]>
Date: 2016-02-21T06:36:21Z
Clarify comment
commit 3f2980a5402277c56835e60c9bb399a35889c1b3
Author: Holden Karau <[email protected]>
Date: 2016-02-21T06:51:50Z
Move to base trait rather than obj
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
