core

Contains core services for the View server - renderer and registrar

Tagging

Before tagging remember to increment the chart version (.charts/<vs-renderer|vs-registrar>/Chart.yaml) manually!

This repository uses bump2version for managing tags. To bump a version use

bump2version --new-version <new_version> # or bump2version <major|minor|patch>
git push && git push --tags

Development

To setup for development run the following commands for your virtual env.

pip install -r requirements.txt
pip install -r requirements-dev.txt
pip install -r requirements-test.txt

Flake8, mypy and black can be ran as commands from terminal:

flake8 # at the root folder
mypy . # at the root folder
black file.py # to autoformat a file. also possible with a path

Or these tools can also be integrated into your IDE/Editor.

• VSCODE

Registrar

Configuration

The registrar module is configured using a YAML based configuration file. It must be declared using the --config-file parameter.

The file contains the following sections:

sources

In this section, the data sources can be declared. These are the references to the storage location where the data to be registered is stored. This includes local (or locally mounted but remote) directories, S3 buckets or OpenStack Swift storages.

Examples:

sources:
  - name: my-local-source
    type: local
    kwargs:
      root_directory: /opt/data
  - name: my-s3-source
    type: s3
    kwargs:
      bucket_name: mybucket
      secret_access_key: mysecret
      access_key_id: myaccess
      endpoint_url: data.storage.com
      strip_bucket: True
      validate_bucket_name: False
      region_name: RegionA
      public: False
  - name: my-swift-source
    type: swift
    kwargs:
      username: myusername
      password: mypassword
      tenant_name: mytenant_name
      tenant_id: mytenant_id
      region_name: myregion_name
      user_domain_id: myuser_domain_id
      user_domain_name: myuser_domain_name
      auth_url: myauth_url
      auth_url_short: myauth_url_short
      auth_version: myauth_version
      container: mycontainer

backends

A backend is where the objects are registered into. This part of the registrar uses a plugin architecture, as in the future, additional backends may need to be added.

There are two distinct types of backends: STAC Item based backends, registering products described by STAC items and path based backends, referencing files or directories to be registered.

Each backend supports both registration and de-registration.

The only built-in backend is the EOxServer.

Example configuration:

backends:
  - path: registrar.backends.eoxserver.EOxServerBackend
    kwargs:
      instance_base_path: /opt/instances
      instance_bane: myproj
      product_types:
        - name: Sentinel-2 Level 1C
          product_type: S2L1C
          filter:
            s2:product_type: S2MSI1C
          coverages:
            # Mapping EOxServer coverage type to assets
            S2L1C_B01:
              assets: [B01]
            # ...
          browses:
            TRUE_COLOR: TCI
          metadata_assets: [metadata]
          collections: [S2L1C, S2]
        - name: Sentinel-2 Level 2A
          product_type: S2L2A
          filter:
            s2:product_type: S2MSI2A
          coverages:
            # Mapping EOxServer coverage type to assets
            S2L1C_B01:
              assets: [B01]
            # ...
          browses:
            TRUE_COLOR: TCI_10m
          metadata_assets: [metadata]
          collections: [S2L2A, S2]
path_backends:
  - path: registrar_pycsw.backends.PycswBackend
    kwargs:
      repository_database_uri: username:pwd@host
      ows_url: https://access.service.org/ows
      public_s3_url: https://storage.service.org

Handlers

These are hooks to handle registration events. There are three distinct kinds of events:

• pre-(de-)registration
• post-(de-)registration
• errors

Each hook can be supplied a list of handlers, which is python path to a callable object.

These handlers exist for both item and path based registrations, resulting in the following list of configurations to be set (with the passed parameters in brackets):

• pre_handlers (config, item)
• post_handlers (config, item)
• error_handlers (config, item, exception)
• path_pre_handlers (config, path)
• path_post_handlers (config, path)
• path_error_handlers (config, path, exception)
• deregister_pre_handlers (config, identifier, item)
• deregister_post_handlers (config, identifier, item)
• deregister_error_handlers (config, identifier, item, exception)
• deregister_path_pre_handlers (config, path)
• deregister_path_post_handlers (config, path)
• deregister_path_error_handlers (config, path, exception)