This is an automated email from the ASF dual-hosted git repository.
mcvsubbu pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
The following commit(s) were added to refs/heads/master by this push:
new 1e65579 Updated hyperlinks and Fully Qualified Class Name for
KafkaConsumerFactory in documentation (#3826)
1e65579 is described below
commit 1e65579ead932e21ed84a8b165a115d14593a37a
Author: Shaun Schembri <[email protected]>
AuthorDate: Wed Feb 13 17:41:51 2019 +0100
Updated hyperlinks and Fully Qualified Class Name for KafkaConsumerFactory
in documentation (#3826)
* Updated hyperlinks and Fully Qualified Class Name for KafkaConsumerFactory
* Updated hyperlink
---
docs/pluggable_streams.rst | 18 +++++++++---------
docs/segment_fetcher.rst | 2 +-
2 files changed, 10 insertions(+), 10 deletions(-)
diff --git a/docs/pluggable_streams.rst b/docs/pluggable_streams.rst
index f11c40c..1c9333a 100644
--- a/docs/pluggable_streams.rst
+++ b/docs/pluggable_streams.rst
@@ -1,11 +1,11 @@
Pluggable Streams
=================
-Prior to commit `ba9f2d
<https://github.com/linkedin/pinot/commit/ba9f2ddfc0faa42fadc2cc48df1d77fec6b174fb>`_,
Pinot was only able to support reading
+Prior to commit `ba9f2d
<https://github.com/apache/incubator-pinot/commit/ba9f2ddfc0faa42fadc2cc48df1d77fec6b174fb>`_,
Pinot was only able to support reading
from `Kafka <https://kafka.apache.org/documentation/>`_ stream.
Pinot now enables its users to write plug-ins to read from pub-sub streams
-other than Kafka. (Please refer to `Issue #2583
<https://github.com/linkedin/pinot/issues/2583>`_)
+other than Kafka. (Please refer to `Issue #2583
<https://github.com/apache/incubator-pinot/issues/2583>`_)
Some of the streams for which plug-ins can be added are:
@@ -63,16 +63,16 @@ Stream plug-in implementation
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
In order to add a new type of stream (say,Foo) implement the following classes:
-#. FooConsumerFactory extends `StreamConsumerFactory
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/StreamConsumerFactory.java>`_
-#. FooPartitionLevelConsumer implements `PartitionLevelConsumer
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/PartitionLevelConsumer.java>`_
-#. FooStreamLevelConsumer implements `StreamLevelConsumer
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/StreamLevelConsumer.java>`_
-#. FooMetadataProvider implements `StreamMetadataProvider
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/StreamMetadataProvider.java>`_
-#. FooMessageDecoder implements `StreamMessageDecoder
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/StreamMessageDecoder.java>`_
+#. FooConsumerFactory extends `StreamConsumerFactory
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConsumerFactory.java>`_
+#. FooPartitionLevelConsumer implements `PartitionLevelConsumer
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PartitionLevelConsumer.java>`_
+#. FooStreamLevelConsumer implements `StreamLevelConsumer
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamLevelConsumer.java>`_
+#. FooMetadataProvider implements `StreamMetadataProvider
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamMetadataProvider.java>`_
+#. FooMessageDecoder implements `StreamMessageDecoder
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamMessageDecoder.java>`_
Depending on stream level or partition level, your implementation needs to
include StreamLevelConsumer or PartitionLevelConsumer.
-The properties for the stream implementation are to be set in the table
configuration, inside `streamConfigs
<https://github.com/linkedin/pinot/blob/master/pinot-core/src/main/java/com/linkedin/pinot/core/realtime/stream/StreamConfig.java>`_
section.
+The properties for the stream implementation are to be set in the table
configuration, inside `streamConfigs
<https://github.com/apache/incubator-pinot/blob/master/pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConfig.java>`_
section.
Use the ``streamType`` property to define the stream type. For example, for
the implementation of stream ``foo``, set the property ``"streamType" : "foo"``.
@@ -122,4 +122,4 @@ The properties for the thresholds are as follows:
"realtime.segment.flush.threshold.time" : "6h"
-An example of this implementation can be found in the `KafkaConsumerFactory
<com.linkedin.pinot.core.realtime.impl.kafka.KafkaConsumerFactory>`_, which is
an implementation for the kafka stream.
+An example of this implementation can be found in the `KafkaConsumerFactory
<org.apache.pinot.core.realtime.impl.kafka.KafkaConsumerFactory>`_, which is an
implementation for the kafka stream.
diff --git a/docs/segment_fetcher.rst b/docs/segment_fetcher.rst
index 97e2339..4ad4d87 100644
--- a/docs/segment_fetcher.rst
+++ b/docs/segment_fetcher.rst
@@ -61,7 +61,7 @@ For example, the following curl requests to Controller will
notify it to downloa
Implement your own segment fetcher for other systems
----------------------------------------------------
-You can also implement your own segment fetchers for other file systems and
load into Pinot system with an external jar. All you need to do is to implement
a class that extends the interface of `SegmentFetcher
<https://github.com/linkedin/pinot/blob/master/pinot-common/src/main/java/com/linkedin/pinot/common/segment/fetcher/SegmentFetcher.java>`_
and provides config to Pinot Controller and Server as follows:
+You can also implement your own segment fetchers for other file systems and
load into Pinot system with an external jar. All you need to do is to implement
a class that extends the interface of `SegmentFetcher
<https://github.com/apache/incubator-pinot/blob/master/pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/SegmentFetcher.java>`_
and provides config to Pinot Controller and Server as follows:
.. code-block:: none
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
