Alex Van Boxel created BEAM-7312:
------------------------------------
Summary: SchemaProvider can't be used with dynamic types
Key: BEAM-7312
URL: https://issues.apache.org/jira/browse/BEAM-7312
Project: Beam
Issue Type: Improvement
Components: sdk-java-core
Reporter: Alex Van Boxel
Assignee: Alex Van Boxel
Looking at the java doc comment of SchemaProvider it hints at getting schema's
from external system. But as the provider only access type this is in general
impossible:
Say you have 2 dynamic types, say Avro, as a java type they have both
GenericRecord. Using the current interface it's impossible to make the
difference between both dynamic types.
As getting information from an external system I propose extending the Provider
interface by adding an extra parameter to the interface. It would be a string
with a URN.
The URN could indicated for example
* Pub/Sub subscription/topic
* Kafka topic
* whatever...
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)