D1.4 : Final Architecture, Lessons Learned, Benchmarks and Validation

Abstract

The EXA4MIND project enables Extreme Data analytics at supercomputing facilities with optimum data backends in its “Extreme Data Database” (EDD) – from object stores and flat file structures towards relational and document databases. The EXA4MIND/EDD platform facilitates advanced querying and indexing and leverages state-of-the-art orchestration of processing workflows and pipelines for reproducibility and high performance. It provides connectivity to major European data ecosystems such as EUDAT, EOSC, or European Data Spaces. This deliverable describes the final architecture of the solution, a multitude of lessons learned collected across the work packages throughout the project period, and our successful qualitative and quantitative platform validation efforts, including benchmarks.

Description

Delayed publication

Available after

Subject(s)

data pipelines, data staging, data ingest, caching, HPC, supercomputing, API, extreme data

Citation

Collections