GitHub user holdenk opened a pull request:
https://github.com/apache/spark/pull/11067
[SPARK-13165][STREAMING][WIP] Replace deprecated synchronizedBuffer in
streaming
Building with Scala 2.11 results in the warning trait SynchronizedBuffer in
package mutable is deprecated: Synchronization via traits is deprecated as it
is inherently unreliable. Consider java.util.concurrent.ConcurrentLinkedQueue
as an alternative - we already use ConcurrentLinkedQueue elsewhere so lets
replace it.
Some notes about how behaviour is different for reviewers:
The Seq from a SynchronizedBuffer that was implicitly converted would
continue to receive updates - however when we do the same conversion explicitly
on the ConcurrentLinkedQueue this isn't the case. Hence changing some of the
(internal & test) APIs to pass an Iterable. toSeq is safe to use if there are
no more updates.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/holdenk/spark
SPARK-13165-replace-deprecated-synchronizedBuffer-in-streaming
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/11067.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #11067
----
commit 64f3a2a19e8204cbb387660074c4fe83e809cdda
Author: Holden Karau <[email protected]>
Date: 2016-02-03T21:09:50Z
Start moving ReceiverSupervisorImpl
commit c9b51314ee69b253104ddbbab38025b4bb2bbc7b
Author: Holden Karau <[email protected]>
Date: 2016-02-03T21:12:39Z
fix import
commit 604d39d4b66f4b5686e2576cdb72a55f98469346
Author: Holden Karau <[email protected]>
Date: 2016-02-03T21:14:05Z
First one ported over
commit fba519a47fcd901cd86b68e4e99843dd6dc0d8c3
Author: Holden Karau <[email protected]>
Date: 2016-02-03T21:25:50Z
Update the StreamingJobProgressListener
commit 269f6920d8f45dc736ae65d6e47718dddf135417
Author: Holden Karau <[email protected]>
Date: 2016-02-03T22:26:07Z
Update another batch of tests
commit cefa084165cb308a7e51716901f716eaa3899885
Author: Holden Karau <[email protected]>
Date: 2016-02-03T22:40:36Z
Update block generator and remove import from inputstreamsuite
commit cf7dd4af050dfc207395edaef20664c74b4d6664
Author: Holden Karau <[email protected]>
Date: 2016-02-03T22:55:11Z
change last of the tests
commit a4b96c2b5018e5985fb68d5b537a0c6fee4a517a
Author: Holden Karau <[email protected]>
Date: 2016-02-03T23:03:26Z
fix long line
commit ca953c112dcd1fb674e2864b400560602ea6e7c4
Author: Holden Karau <[email protected]>
Date: 2016-02-03T23:23:16Z
Fix some tests
commit a8ae3097049846296ddc11ebe440a84d9ccc753c
Author: Holden Karau <[email protected]>
Date: 2016-02-03T23:31:15Z
handle empty iterables in test (not that there should be any as currently
written)
commit 9dfb313420086141024b7d8b1562f32e1c2a7720
Author: Holden Karau <[email protected]>
Date: 2016-02-03T23:31:29Z
s/outputBuffer/outputQueue/ for clarity
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
