Architecture¶

Overview¶

ArcticDB is deployed as a shared library, using PyBind for operability between CPython and the core database engine which is written in C++.

Users interact with the C++ storage engine, and therefore the storage itself, via the Python/C++ bindings. The engine transforms Python objects which are typically DataFrames, Series or numpy arrays to and from its internal columnar structure. The data is then tiled, indexed, compressed, and written to storage. The storage format is tailor-designed for the storage and retrieval of dense and sparse timeseries data.

Please note that there is no required server component.

ArcticDB Architecture

ArcticDB DataFlow¶

The below diagram visualises the flow of data through ArcticDB from source to storage and back again:

ArcticDB Detailed Architecture

For more information on the storage format, please see On-Disk Storage.