Configure EODAG#

Configuration in eodag plays an important role:

To provide credentials (e.g. login/password, API key, etc.) required to download (and search sometimes) products with a provider
To specify the search priority of a provider
To indicate where to download products, whether to extract them or not, etc.
To update a provider or add a new one

This page describes how to configure eodag both for interacting with its API or its command line interface.

Automatic pre-configuration#

eodag comes bundled with the pre-configuration of numerous providers. It knows how to search for products in a provider’s catalog, how to download products, etc. However, users are required to complete this configuration with additional settings, such as provider credentials. Users can also override pre-configured settings (e.g. the download folder).

YAML configuration file#

The first time eodag is used after an install a default YAML configuration file is saved in a local directory (~/.config/eodag/eodag.yml on Linux).

This YAML file contains a template that shows how to complete the configuration of one or more providers. It allows to either override an existing setting or add a missing one (e.g. credentials). PEPS’s configuration template is shown below:

peps:
    priority: # Lower value means lower priority (Default: 1)
    search:  # Search parameters configuration
    download:
        extract:  # whether to extract the downloaded products (true or false).
        outputs_prefix: # where to store downloaded products.
        dl_url_params:  # additional parameters to pass over to the download url as an url parameter
        delete_archive: # whether to delete the downloaded archives (true or false, Default: true).
    auth:
        credentials:
            username:
            password:

Click here to display the content of the whole file

peps:
    priority: # Lower value means lower priority (Default: 1)
    search:  # Search parameters configuration
    download:
        extract:  # whether to extract the downloaded products, only applies to archived products (true or false, Default: true).
        outputs_prefix: # where to store downloaded products, as an absolute file path (Default: local temporary directory)
        dl_url_params:  # additional parameters to pass over to the download url as an url parameter
        delete_archive: # whether to delete the downloaded archives (true or false, Default: true).
    auth:
        credentials:
            username:
            password:
theia:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        extract:
        outputs_prefix:
        dl_url_params:
    auth:
        credentials:
            ident:
            pass:
usgs:
    priority: # Lower value means lower priority (Default: 0)
    api:
        extract:
        outputs_prefix:
        dl_url_params:
        product_location_scheme:
        credentials:
            username:
            password:
aws_eos:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            apikey:
            aws_access_key_id:
            aws_secret_access_key:
            aws_profile:
    download:
        outputs_prefix:
creodias:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        extract:
        outputs_prefix:
    auth:
        credentials:
            username:
            password:
mundi:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        extract:
        outputs_prefix:
    auth:
        credentials:
            apikey:
onda:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        extract:
        outputs_prefix:
    auth:
        credentials:
            username:
            password:
astraea_eod:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            aws_access_key_id:
            aws_secret_access_key:
            aws_profile:
    download:
        outputs_prefix:
usgs_satapi_aws:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            aws_access_key_id:
            aws_secret_access_key:
            aws_profile:
    download:
        outputs_prefix:
earth_search:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            aws_access_key_id:
            aws_secret_access_key:
            aws_profile:
    download:
        outputs_prefix:
earth_search_cog:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        outputs_prefix:
earth_search_gcs:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            aws_access_key_id:
            aws_secret_access_key:
    download:
        outputs_prefix:
ecmwf:
    priority: # Lower value means lower priority (Default: 0)
    api:
        outputs_prefix:
        credentials:
            username:
            password:
cop_ads:
    priority: # Lower value means lower priority (Default: 0)
    api:
        outputs_prefix:
        credentials:
            username:
            password:
cop_cds:
    priority: # Lower value means lower priority (Default: 0)
    api:
        outputs_prefix:
        credentials:
            username:
            password:
sara:
    priority: # Lower value means lower priority (Default: 0)
    search:  # Search parameters configuration
    download:
        extract:
        outputs_prefix:
        delete_archive:
    auth:
        credentials:
            username:
            password:
meteoblue:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    auth:
        credentials:
            apikey:
    download:
        outputs_prefix:
cop_dataspace:
    priority: # Lower value means lower priority (Default: 0)
    search:   # Search parameters configuration
    download:
        extract:
        outputs_prefix:
    auth:
        credentials:
            username:
            password:

Users can directly modify the default file, which is then loaded automatically:

API: eodag.EODataAccessGateway()
CLI: eodag search -b 1 43 2 44 -s 2018-01-01 -e 2018-01-31 -p S2_MSI_L1C

They can also choose to create their own configuration file(s) and load them explicitely:

API: eodag.EODataAccessGateway("my_config.yml")
CLI: eodag search -f my_config.yml -b 1 43 2 44 -s 2018-01-01 -e 2018-01-31 -p S2_MSI_L1C

Alternatively, the environment variable EODAG_CFG_FILE can be used to set the path to the configuration file. In that case it is also loaded automatically:

API: eodag.EODataAccessGateway()
CLI: eodag search -b 1 43 2 44 -s 2018-01-01 -e 2018-01-31 -p S2_MSI_L1C

Warning

This file contains login information in clear text. Make sure you correctly configure access rules to it. It should be read/write-able only by the current user of eodag.

Environment variable configuration#

eodag can also be configured with environment variables, which have priority over the YAML file configuration.

The name of the environment variables understood by eodag must follow the pattern EODAG__KEY1__KEY2__[...]__KEYN (note the double underscore between the keys).

See for instance the following configuration extracted from YAML file:

creodias:
    download:
        extract: True
        outputs_prefix: /absolute/path/to/a/folder/
        delete_archive: False

The same configuration could be achieved by setting environment variables:

export EODAG__CREODIAS__DOWNLOAD__EXTRACT=True
export EODAG__CREODIAS__DOWNLOAD__OUTPUTS_PREFIX=/absolute/path/to/a/folder/
export EODAG__CREODIAS__DOWNLOAD__DELETE_ARCHIVE=False

Each configuration parameter can be set with an environment variable.

Note

Setting credentials must be done according to the provider’s plugin (auth | api):

Authentication plugin: EODAG__<PROVIDER>__AUTH__CREDENTIALS__<KEY>
API plugin: EODAG__<PROVIDER>__API__CREDENTIALS__<KEY>

<KEY> should be replaced with the adapted credentials key (USERNAME, PASSWORD, APIKEY, …) according to the provider configuration template in the YAML configuration file.

CLI configuration#

The command options that require a configuration file (e.g. eodag download ) have an argument (usually -f) to provide the path to a YAML configuration file. If not specified, the default configuration filepath is used. Settings defined by environment variables are also taken into account.

API: Dynamic configuration#

eodag ‘s configuration can be altered directly from using Python. See this dedicated page in the Python API user guide.

Priority setting#

Some product types are available from multiple providers, for instance Sentinel 2 Level-1C products. When a search is made for such product types, eodag would use its pre-configured preferred/prioritary provider, which is PEPS currently.

To make a provider the preferred/prioritary one, its priority setting must be set to an integer value that is higher than the priority of all the other providers.

Note

PEPS is currently the default provider used when a search is made. To target another provider its priority must be increased.

Warning

If the priority is set to a provider, and a search is made for a product type available in eodag’s catalog with a provider that doesn’t offer this product type, then the search will still be done. The provider used would be the one with the highest priority among those which offer this product type.

Download settings#

Two useful download parameters can be set by a user:

extract indicates whether the downloaded product archive should be automatically extracted or not. True by default.
outputs_prefix indicates the absolute file path to eodag’s download folder. It is the temporary folder by default (e.g. /tmp on Linux).
delete_archive indicates whether the downloaded product archive should be automatically deleted after extraction or not. True by default.

Credentials settings#

Credentials come into play at different stages for a provider. Most do not require any credentials for a search to be made (a few require an API key). Most, if not all of them, require credentials to be set to download products.

Note

eodag tries to fail as early as possible if some credentials are missing to authenticate to a provider while trying to download a product. If the credentials are set, eodag will keep going. An AuthenticationError is raised if the authentication fails.

Make sure to check that your credentials are correctly set and to keep them up to date.

Example#

Edit your configuration file $HOME/.config/eodag/eodag.yml with the following content:

creodias:
    priority: 2
    download:
        extract: False
        outputs_prefix: /home/user/eodagworkspace/
    auth:
        credentials:
            username: my_creodias_username
            password: my_creodias_password

It updates and completes the settings of the provider creodias by:

Setting its priority to 2, which is higher than the default maximum priority (PEPS at 1). Products will then be searched through creodias’s catalog.
The products downloaded should not be extracted automatically by eodag.
The products should be downloaded to the folder /home/user/eodagworkspace/.
Credentials (username and password) obtained from creodias are saved there, it will be used to authenticate to the provider.

This file can be used to download products with the API:

from eodag import EODataAccessGateway
dag = EODataAccessGateway()
products, total_count = dag.search(
   productType="S2_MSI_L1C",
   start="2018-01-01",
   end="2018-01-31",
   geom=(1, 43, 2, 44)
)
product_paths = dag.download_all(products)

Or with the CLI:

cd /home/user/eodagworkspace/
eodag search -b 1 43 2 44 \
             -s 2018-01-01 \
             -e 2018-01-31 \
             -p S2_MSI_L1C \
             --storage my_search.geojson
eodag download -f my_config.yml --search-results my_search.geojson

Configure EODAG

Contents

Configure EODAG#

Automatic pre-configuration#

YAML configuration file#

Environment variable configuration#

CLI configuration#

API: Dynamic configuration#

Priority setting#

Download settings#

Credentials settings#

Example#