...
For non-Python users, please note that the CDS API is REST-based so it can be wrapped by any programming language. Please see this example with the R package: Download CDS ERA5 data using R.
Users can also set the PROXY within the CDS API script:
Code Block | ||
---|---|---|
| ||
import requests import cdsapi session = requests.Session() session.proxies = { 'http': 'http://10.10.10.10:8000', 'https': 'http://10.10.10.10:8000', } client = cdsapi.Client(session=session) |
...
Table 2 Summary of the number of fields limits, as well as the major features of all ADS datasets (last reviewed on 16 September 202126 April 2023)
Dataset | Number of fields limit | Volume size limit | Adaptor (indicates where the data are stored; see "Efficiency Tips" below) | Notes |
10000 | 175 GB for GRIB files, 30 GB for netCDF files | MARS Internal/external | Those variables listed as fast-access are readily available from ADS disks. Those variables listed as slow-access and data older than 30 days are stored in ECMWF MARS tape archive. | |
100000 | 175 GB for GRIB files, 30 GB for netCDF files | MARS Internal/external | Those variables listed as fast-access are readily available from ADS disks. Those variables listed as slow-access are stored in ECMWF MARS tape archive. | |
100000 | 175 GB for GRIB files, 30 GB for netCDF files | MARS Internal | N/A | |
CAMS global inversion-optimised greenhouse gas fluxes and concentrations | 500 | N/A | adaptor.url | Stored locally on ADS disks |
100000 | 175 GB for GRIB files, 30 GB for netCDF files | MARS external | Data are stored in ECMWF MARS tape archive | |
CAMS global greenhouse gas reanalysis (EGG4) monthly averaged fields | 100000 | 175 GB for GRIB files, 30 GB for netCDF files | MARS external | Data are stored in ECMWF MARS tape archive |
10000 | N/A | adaptor.cams_solar_rad2.retrieve | This data is calculated on demand by a service jointly provided by DLR, Armines, and Transvalor. The ADS forwards requests to this service and returns the data from it. | |
5000 | N/A | adaptor.cams_regional_fc.retrieve | There are three classes of speed at which these requests will be processed:
| |
1000 | N/A | adaptor.url | Check the documentation for data availability | |
1000 | N/A | adaptor.url2.retrieve | N/A | |
1000 | N/A | adaptor.url | ||
1000 | N/A | adaptor.url |
Efficiency tips
- Where the data are actually stored can make a significant difference in the speed at which a request is processed. ADS data hosted in 'MARS internal' is stored on ADS disks, and so is faster to retrieve. The 'MARS external' datasets are stored in the ECMWF MARS (tape) archive, and in this case it is important to request as much data as possible from the same tape file in your ADS request.
- It is better to submit small requests rather than very large requests. This will ensure your requests are not given a lower priority in the ADS request queue.
- When using the CDS API, it is strongly recommended that users take as a starting point the example API request script shown at the bottom of the ADS web 'Download data' page for the dataset of interest, and use this as the basis for your request.
...
Code Block | ||||||||
---|---|---|---|---|---|---|---|---|
| ||||||||
import cdsapi c = cdsapi.Client() c.retrieve( 'cams-global-reanalysis-eac4', { 'variable': 'sulphate_aerosol_optical_depth_550nm', 'date': '2004-01-18/2004-01-18', 'time': '00:00', 'format': 'netcdf', }, 'download.nc') |
Info | ||
---|---|---|
| ||
This document has been produced in the context of theCopernicus Atmosphere Monitoring Service (CAMS). The activities leading to these results have been contracted by the European Centre for Medium-Range Weather Forecasts, operator of CAMS on behalf of the European Union (Delegation Agreement signed on 11/11/2014 and Contribution Agreement signed on 22/07/2021). All information in this document is provided "as is" and no guarantee or warranty is given that the information is fit for any particular purpose. The users thereof use the information at their sole risk and liability. For the avoidance of all doubt , the European Commission and the European Centre for Medium - Range Weather Forecasts have no liability in respect of this document, which is merely representing the author's view. |
Related articles
Content by Label | ||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
...