ArcticDB

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.

What is ArcticDB?

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem.

Overview of ArcticDB

What it is

ArcticDB is a high performance, serverless DataFrame database built for the Python Data Science ecosystem. It is the successor to Arctic, launched in March 2023. ArcticDB offers an intuitive Python-centric API enabling you to read and write Pandas DataFrames to S3 or LMDB utilising a fast C++ data-processing and compression engine. It handles data that is big in both row count and column count, so a 20-year history of more than 400,000 unique securities can be stored in a single symbol. Each symbol is maintained as a separate entity with no shared data, allowing ArcticDB to scale horizontally across symbols. The database is designed to be resilient with no single point of failure; persistent data structures ensure that once a version of a symbol has been written, it can never be corrupted by subsequent updates. Pulling compressed data directly from storage to the client means there is no server to overload.

Key features

  • Pandas in, Pandas out: Read and write Pandas DataFrames, NumPy arrays and native types to S3 and LMDB without leaving Python.
  • Built for time-series data: Efficiently index and query time-series data across billions of rows.
  • Time travel: Travel back in time to see previous versions of your data and create customizable snapshots of the database.
  • Schemaless Database: Append, update and modify data without being constrained by the existing schema.
  • Optimised for streaming data: Built in support for efficient sparse data storage.
  • Powerful processing: Filter, aggregate and create new columns on-the-fly with a Pandas-like syntax.
  • C++ efficiency: Accelerate analytics through concurrency in the C++ data-processing engine.

Use cases

ArcticDB is designed for handling large time-series datasets, such as financial market data with long histories and many securities. It is suitable for applications that require efficient storage and retrieval of Pandas DataFrames, especially when data is streamed or updated frequently. The schemaless nature allows for flexible data ingestion without predefined schemas.

Getting started

Install ArcticDB via pip or conda: bash $ pip install arcticdb or bash $ conda install -c conda-forge arcticdb For full quickstart examples, see the repository README.

License and pricing

ArcticDB is released under a Business Source License 1.1 (BSL). The BSL is not certified as an open-source license, but most Open Source Initiative (OSI) criteria are met. Use of ArcticDB in production (including business or commercial environments) or for a Database Service requires a paid license from ArcticDB Limited. Each version converts to Apache 2.0 after a specified date (e.g., version 1.0 converts on Mar 16, 2025; later versions have later conversion dates). For more information, contact [email protected].

Based on the project's public README and repository metadata.

Add this badge to your README

Featured on YunoDB Badge styles & help

Maintain this project? Show that it is featured on YunoDB.

Markdown[![Featured on YunoDB](https://yunodb.com/badge/man-grouparcticdb.svg)](https://yunodb.com/tools/man-grouparcticdb?utm_source=github&utm_medium=badge)
HTML<a href="https://yunodb.com/tools/man-grouparcticdb?utm_source=github&utm_medium=badge"><img src="https://yunodb.com/badge/man-grouparcticdb.svg" alt="Featured on YunoDB" height="20"></a>