Chitral Verma created GRIFFIN-323:
-------------------------------------
Summary: Refactor configuration for Data Source and Data Source
Connector
Key: GRIFFIN-323
URL: https://issues.apache.org/jira/browse/GRIFFIN-323
Project: Griffin
Issue Type: Improvement
Reporter: Chitral Verma
Current config structure for Data Source is as follows,
{noformat}
"data.sources": [
{
"name": "src",
"connectors": [
{
"type": "AVRO",
"version": "1.7",
"config": {
"file.path": "<path>/<to>",
"file.name": "<source-file>.avro"
}
}
]
},
{
"name": "tgt",
"connectors": [
{
"type": "AVRO",
"version": "1.7",
"config": {
"file.path": "<path>/<to>",
"file.name": "<target-file>.avro"
}
}
]
}
]
{noformat}
This ticket proposes the following changes,
* remove 'version' from 'DataConnectorParam' as it is not being used anywhere
in the codebase.
* change 'connectors' from array type to a single JSON object. Since a data
source named X may only be of one type (hive, file etc), the connector field
should not be an array.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
