Taragolis commented on issue #39262: URL: https://github.com/apache/airflow/issues/39262#issuecomment-2077915996
> if it wouldn't be better to extend [this](https://filesystem-spec.readthedocs.io/en/stable/_modules/fsspec/implementations/dbfs.html) and then use it within ObjectStoragePath AIrflow ObjectStorage build in top of the `fsspec` and I guess extend some methods, like [copy](https://github.com/apache/airflow/blob/191b5c30e68566a75f67aefc860f59573b79bed6/airflow/io/path.py#L261) > With respect to the SDK, sounds good to me. However, the whole plugin is done pointing directly to the REST Endpoints Small nit, this one about [Airflow Provider](https://airflow.apache.org/docs/apache-airflow-providers/), not a [Airflow Plugin](https://airflow.apache.org/docs/apache-airflow/stable/authoring-and-scheduling/plugins.html#plugins) that is a bit different things. > I think it may be better in that sense to stick to one strategy (either change everything to point to the SDK or extend it using the REST API) In the long run SDK should replace internal solutions, that is why I propose to use SDK over the direct call to the API -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
