slatedb

A cloud native embedded storage engine built on object storage.

What is slatedb?

A cloud native embedded storage engine built on object storage.

Overview of slatedb

What it is

SlateDB is an embedded storage engine built as a log-structured merge-tree (LSM-tree). Unlike traditional LSM-tree storage engines, SlateDB writes data to object storage services such as S3, GCS, ABS, MinIO, and Tigris. This design provides bottomless storage capacity, high durability, and easy replication. The trade-off is that object storage has higher latency and higher API cost than local disk. To mitigate high write API costs, SlateDB batches writes: MemTables are flushed periodically to object storage as string-sorted tables (SSTs), and the flush interval is configurable. Write operations return a WriteHandle after updating the in-memory WAL and MemTable; callers can wait for durability via handle.await_durable().await or flush all pending writes with db.flush().await. To mitigate read latency and read API costs, SlateDB uses standard LSM-tree caching techniques: in-memory block caches, compression, bloom filters, and local SST disk caches.

Key features

  • Basic API: get, put, delete
  • SSTs on object storage
  • Range queries
  • Block cache
  • Disk cache
  • Compression
  • Bloom filters
  • Manifest persistence
  • Compaction
  • Transactions
  • Merge operator
  • Clones
  • Change data capture (CDC)
  • Database split/merge (RFC)

Use cases

SlateDB is suitable for applications that need an embedded key-value store with bottomless storage capacity, high durability, and easy replication, and that can tolerate the higher latency and API cost of object storage compared to local disk. It is designed for cloud-native environments where object storage is the primary persistence layer.

Getting started

Add the following to your Cargo.toml:toml[dependencies]slatedb = '*'tokio = '*'Then use SlateDB in Rust code. See the repository README for a complete example.

License and pricing

SlateDB is licensed under the Apache License, Version 2.0. It is open source with no stated pricing.

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/slatedbslatedb.svg)](https://yunodb.com/tools/slatedbslatedb?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/slatedbslatedb?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/slatedbslatedb.svg" alt="Featured on YunoDB" height="20"></a>