Development of a fast distributed Key-Value Store

Problem statement

In-memory key-value systems stores such as Memcached and Redis are widely used in industry and are an active area of academic research. To ensure fault-tolerance and availability, replication is essential. Besides, recent key-value stores add security properties using novel technologies such as Intel SGX, or reduce the communication overhead using Remote Direct Memory Access. The goal of this topic is to design a replicated key-value store that uses RDMA to enable a zero-copy replication with no CPU overhead in the target. On the other hand, adding security properties with Intel SGX incurs significant overhead if the dataset is too large. Thus, a solution with sharding over a set of servers can be exploted. The goal is to maintain high availability, but also to consider reducing load imbalance between servers.

Prerequisites

• Basic knowledge of Linux systems as we work with SGX exclusively on Linux
• Good knowledge of C/C++

Links