Alex Goodman created CLIMATE-904: ------------------------------------ Summary: New ESGF loader Key: CLIMATE-904 URL: https://issues.apache.org/jira/browse/CLIMATE-904 Project: Apache Open Climate Workbench Issue Type: Improvement Components: regridding/data processing Reporter: Alex Goodman Assignee: Alex Goodman Fix For: 1.3.0
Our current ESGF loader currently has several limitations: - Only one dataset can be downloaded / processed at a time - Datasets must be specified by dataset_id, which requires users to perform manual searches to obtain - Lack of customization options in search Since our original loader was designed, ESGF's REST API (https://www.earthsystemcog.org/projects/cog/esgf_search_restful_api) has come a long way in terms of ease of use and extensibility. It can be used to automatically generate a shell script which can download all of the data. This can be easily done using either our own simple implementation or esgf-pyclient's search API. -- This message was sent by Atlassian JIRA (v6.3.15#6346)