CalvinKirs commented on issue #2469: URL: https://github.com/apache/incubator-seatunnel/issues/2469#issuecomment-1220225825
> In my opinion, `format` in file connectors is a little ambiguous. For some text-based connector `format` is a best option. But your question is very right, we should unify a set of standards for all connectors to support user-defined schema. I think we can defined some common parameters to represent the current schema information. > > `fields` represent the fields information of upstream data > > `format` represent the format of upstream data, for example: `json` `csv` `orc` `parquet` etc... > > `delimiter` represent the delimiter of upstream text data to splite fields. > > The function of parsing user-defined schema has implemented in `connector-common`, all that remains is that unified the parameters of connectors > > What do you think about? great, but about `fields` and `schema`, do we still need nesting? For now, it doesn't seem necessary. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
