Software Overview

The Data Hub Software (DHuS) is open source software developed by a Serco/Gael consortium to the purpose of supporting the ESA Copernicus data access.

The DHuS provides a simple web interface to allow interactive data discovery and download, and a powerful Application Programming Interface (API) that allows users to access the data via computer programs/scripts thereby automating/integrating the download within their workflow.

Different instances of the Data Hub are currently operated by ESA allowing for tailored managed levels of service:

Research and General Public (‘Sentinels Scientific Data Hub’)

Copernicus Service (‘Copernicus Service Project Data Hub’)

International Partners (‘Sentinels International Data Hub’)

Collaborative Ground Segment (‘Sentinels Collaborative Data Hub’)

The major functionalities of the Data Hub Software are schematically represented in figure below:

Data Hub Software functions



Product Indexing

The indexing function allows referencing products within the local archive, in other DHuS instances or other data sources (e.g. PDGS’s Long Term Archives). The indexing is based on the creation of configurable metadata (including quick-look, as relevant for EO data).

 


Local Archive

The local archive is the core element of the system; it retains the products managed at a given instance. The local archive is managed as a rolling archive, with configurable eviction strategies and rules.


Centre Management

The centre management service allows the unambiguous identification of each centre. It applies the particular configuration of the local services as well as the configuration of its relationship, if any, with other centres.


 

Product Harvesting

The product harvester is the service responsible for collecting products from (PDGS) data sources (ingestion) or from a DHuS Network (synchronization).


User Interface

This function is in charge of providing the user with an interface for the discovery, and downloading of products and for the visualization of the relevant metadata. It consists of two interfaces: a Graphical User Interface (modern and easy-to-use web application) and an Application Programming Interface (mainly used for batch scripting, machine to machine interactions).


User management

This function is in charge of managing the user accounts for access to the DHuS. It allows the definition of roles and permissions of the users and prevents uncontrolled accesses.


Search and Product Preview

This function is in charge of providing users with the possibility to perform search via standardized API protocols (OData and Opensearch) and via the graphical user interface.


 

Product Navigation

The product navigation function manages the ability to browse the product structure, getting the description or the content of its nodes.


 

Product Dissemination

The dissemination function manages the product dissemination, retrieval and access by the user. It also allows disseminating/retrieving sub-components of products. This is considered of particular relevance for the voluminous data products managed in the Sentinels mission.