Arctic is a high performance datastore for numeric data. It supports Pandas, numpy arrays and pickled objects out-of-the-box, with pluggable support for other data types and optional versioning.
Arctic can query millions of rows per second per client, achieves ~10x compression on network bandwidth, ~10x compression on disk, and scales to hundreds of millions of rows per second per MongoDB instance.
Arctic has been under active development at Man Group since 2012.
ArcticDB, Man Group's high-performance Python-native DataFrame database will soon be available on GitHub. ArcticDB is the next generation of Arctic and is designed to be a drop-in replacement for Arctic, providing a platform that is:
- Fast: Capable of processing billions of rows in seconds
- Flexible: Designed to handle complex real-world datasets
- Familiar: Built for the modern Python Data Science ecosystem - Pandas In/Pandas Out!
This repository does not contain the code for ArcticDB, but instead contains the older (first) version of the Arctic platform. Please note that this repository is now in maintenance mode and all ongoing development efforts will be focused on ArcticDB.
If you would like information on ArcticDB prior to the public release, please get in touch with us at arcticdb@man.com.
Information on how to set up, install and use Arctic has been migrated to README-arctic.md.
Note that as explained in the above message, this repository is in maintenance mode as ongoing development has migrated to ArcticDB, our next-generation high-performance DataFrame database.