Optimalizace systému pro distribuované přenosy a ukládání rozsáhlých dat

Abstract

Distributed data management between shared repositories across data centers is a growing challenge. This thesis deals with this issue in the context of the LEXIS platform, which simplifies access to HPC resources. The aim of the work is to optimize the Distributed Data Interface (DDI) component, which offers interface for distributed data management and metadata, as well as asynchronous transfers of data collections between locations. This brings the possibility of unified data management regardless of their physical location. The work includes a research of systems for distributed data management. The output of the work is improved source code of the DDI component and load tests with their results.

Description

Subject(s)

LEXIS, iRODS, DDI, Data management, HPC, Dataset

Citation