vroyer edited a comment on pull request #9956: URL: https://github.com/apache/pulsar/pull/9956#issuecomment-804991628
Why do we need a Schema.OBJECT ? Because Pulsar IO Sink/Source provides a nice way to replicate data to various systems, but like the Kafka-Connect eco-system, pulsar IO sink/source should be schema agnostic at compile time. Sink/Source should be generic and support many kind of message schema using data converters. A data converter is configurable at runtime when deploying a sink/source, and is schema aware to properly convert a message to/from the internal connector representation (depending on the sink/source backend). The Schema.OBJECT does not break existing sink/source implementation, but allow to develop new ones, generic and configurable with data converters, in order to provide the same flexibility as the Kafka connectors. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
