slatedb
A cloud native embedded storage engine built on object storage.
What is slatedb?
A cloud native embedded storage engine built on object storage.
Overview of slatedb
What it is
SlateDB is an embedded storage engine built as a log-structured merge-tree (LSM-tree). Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage services such as S3, GCS, ABS, MinIO, and Tigris. This design provides bottomless storage capacity, high durability, and easy replication. The trade-off is that object storage has higher latency and higher API cost than local disk. To mitigate high write API costs, SlateDB batches writes: MemTables are flushed periodically to object storage as string-sorted tables (SSTs), and the flush interval is configurable. Write operations return a WriteHandle after updating the in-memory WAL and MemTable; callers can wait for durability via handle.await_durable().await or flush all pending writes with db.flush().await. To mitigate read latency and read API costs, SlateDB uses standard LSM-tree caching techniques: in-memory block caches, compression, bloom filters, and local SST disk caches.
Key features
- Basic API: get, put, delete
- SSTs on object storage
- Range queries
- Block cache
- Disk cache
- Compression
- Bloom filters
- Manifest persistence
- Compaction
- Transactions
- Merge operator
- Clones
- Change data capture (CDC)
- Database split/merge (RFC)
Use cases
SlateDB is suitable for applications that need an embedded key-value store with bottomless storage capacity, high durability, and easy replication, and that can tolerate the higher latency and API cost of object storage compared to local disk. It is designed for cloud-native environments where object storage is the primary persistence layer.
Getting started
Add the following to your Cargo.toml:toml[dependencies]slatedb = '*'tokio = '*'Then use SlateDB in Rust code. See the repository README for a complete example.
License and pricing
SlateDB is licensed under the Apache License, Version 2.0. It is open source with no stated pricing.
Based on the project's public README and repository metadata.