D1.4 : Final Architecture, Lessons Learned, Benchmarks and Validation
Loading...
Downloads
11
Date issued
Journal Title
Journal ISSN
Volume Title
Publisher
Location
Signature
License
Abstract
The EXA4MIND project enables Extreme Data analytics at supercomputing facilities
with optimum data backends in its “Extreme Data Database” (EDD) – from object
stores and flat file structures towards relational and document databases. The
EXA4MIND/EDD platform facilitates advanced querying and indexing and leverages
state-of-the-art orchestration of processing workflows and pipelines for reproducibility and high performance. It provides connectivity to major European data ecosystems such as EUDAT, EOSC, or European Data Spaces. This deliverable describes the final architecture of the solution, a multitude of lessons learned collected across the work packages throughout the project period, and our successful qualitative and quantitative platform validation efforts, including benchmarks.
Description
Delayed publication
Available after
Subject(s)
data pipelines, data staging, data ingest, caching, HPC, supercomputing, API, extreme data