Github user koeninger commented on the issue:
https://github.com/apache/spark/pull/22703
I guess the only argument to the contrary would be if some of the known
issues end up being better solved with minor API changes, leaving it marked
as experimental would technically be better notice.
I personally think it's clearer to remove the experimental.
On Fri, Oct 12, 2018, 6:18 PM Sean Owen <[email protected]> wrote:
> *@srowen* commented on this pull request.
> ------------------------------
>
> In docs/streaming-kafka-0-10-integration.md
> <https://github.com/apache/spark/pull/22703#discussion_r224936431>:
>
> > @@ -3,7 +3,11 @@ layout: global
> title: Spark Streaming + Kafka Integration Guide (Kafka broker version
0.10.0 or higher)
> ---
>
> -The Spark Streaming integration for Kafka 0.10 is similar in design to
the 0.8 [Direct Stream
approach](streaming-kafka-0-8-integration.html#approach-2-direct-approach-no-receivers).
It provides simple parallelism, 1:1 correspondence between Kafka partitions
and Spark partitions, and access to offsets and metadata. However, because the
newer integration uses the [new Kafka consumer
API](http://kafka.apache.org/documentation.html#newconsumerapi) instead of the
simple API, there are notable differences in usage. This version of the
integration is marked as experimental, so the API is potentially subject to
change.
> +The Spark Streaming integration for Kafka 0.10 provides simple
parallelism, 1:1 correspondence between Kafka
> +partitions and Spark partitions, and access to offsets and metadata.
However, because the newer integration uses
> +the [new Kafka consumer
API](https://kafka.apache.org/documentation.html#newconsumerapi) instead of the
simple API,
> +there are notable differences in usage. This version of the integration
is marked as experimental, so the API is
>
> Yeah, good general point. Is the kafka 0.10 integration at all
> experimental anymore? Is anything that survives from 2.x to 3.x? I'd say
> "no" in almost all cases. What are your personal views on that?
>
> â
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/spark/pull/22703#discussion_r224936431>, or
mute
> the thread
>
<https://github.com/notifications/unsubscribe-auth/AAGAB1mUBOw72gARWj6GcclgXDimi6KIks5ukSNggaJpZM4XYdgE>
> .
>
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
