đī¸ Basic Architecture
This document describes the core components and data flow of Curvine as implemented in the codebase: Master (metadata and Raft), Worker (block storage), and Client (read/write paths).
đī¸ OpenDAL Ecosystem Integration
Overview
đī¸ Fluid Integration
This document describes the current Curvine Fluid integration based on the code under curvine-docker/fluid in the Curvine main branch. It replaces the older thin-runtime-only narrative and reflects the unified curvine-fluid image and entrypoint now used by the main branch.
đī¸ Curvine Metadata Architecture
Metadata is the core component of a distributed file system. It is equivalent to the system's "navigation hub" and is mainly responsible for managing key information such as the namespace of files and directories, storage locations, size and permissions, and modification time. Its read/write speed, storage capacity, and data consistency directly determine the operating performance, stability, and availability of the entire distributed file system. Based on best practices in distributed storage and after comparing and validating multiple solutions, Curvine finally adopts the core combination of the Raft protocol and the RocksDB database to manage metadata. This combination meets low-latency requirements in high-concurrency scenarios, supports massive metadata storage, and ensures multi-node data consistency. The following is a simplified and complete core explanation.
đī¸ SPDK Integration Architecture
Overview