Vicky Kak created GOBBLIN-190:
---------------------------------

             Summary: Kafka Sink replication factor and partition creation.
                 Key: GOBBLIN-190
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-190
             Project: Apache Gobblin
          Issue Type: New Feature
          Components: gobblin-kafka
            Reporter: Vicky Kak
            Assignee: Shirshanka Das
            Priority: Critical


The current implementation of the Kafka Writer does not allow the user to 
configure the replication-factor and partitions for the topic. The producer API 
creates a topic with the default configuration if the topic is not found when 
message is send to the topic. We may have to use the scala API's to configure 
the topics during creation for 0.8.1, for the 0.9.0 kafka there seems to be 
java apis.
The following link could be of help to this issue
[https://stackoverflow.com/questions/16946778/how-can-we-create-a-topic-in-kafka-from-the-ide-using-api]




--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to