Skip to content
Home ยป Database and Storage Stacks

Database and Storage Stacks

This is a manually updating page regarding the database and data storage stacks.

There are many new tech stacks creating everyday, a lot of existing problems in software could be solved in using a different tech stacks, especially in data and data storage area. Based on my experience in software engineering, I found many companies using wrong storage stack,

for example,

  • Using a OLTP db for OLAP purpose, it costs tons of time and money for maintaining the services running.
    • This kind of problems could possibly be solved easily after analysing usage and switching to a data warehouse service like Amazon redshift.
  • Using a single instance DB for different regions customers, with company growing, the main customers/users’ region changed, and company suffer from the bottle neck of DB performance and network latency.
    • This problem could possible be solved by using cloud native db or a proper distribute db.

I know many tech companies suffer from this kind of problems, some are big some are small. This page is (trying) to list all trending/robust/new data related stacks to help engineers and architect to choose next right db stack for their products, to avoid this kind of issues once for all. Hopefully, this could help you a bit.

Relational DB (SQL DB/OLTP)MySQL
PostgreSQLAmazon RDS, Amazon Aurora
absurd-sqlsqlite3 in ur indexeddbWeb, JS, SQLite
PolarDBA cloud-native database service independently developed by Alibaba Cloud, similar to Amazon AuroraCloud Native
YugabyteYugabyteDB is a high-performance transactional distributed SQL database for cloud-native applications, developed by Yugabyte.Cloud Native
Distributed DBBlazing SQLBlazingSQL provides a high-performance distributed SQL engine in Python. Built on the RAPIDS GPU data science ecosystem, ETL massive datasets on GPUs.Python
CockroachDBCloud SQL database โ€” giving all of your apps effortless scale, bulletproof resilience and low latency performance for users anywhere. – How we built a forever-free serverless SQL databasePostgres, Serverless
GunJSCheap distributed edge computing DBEdge, Web
– Document DBMongo DBDocument db
FerretDB (MangoDB)The de-facto open-source substitute to MongoDB, PostgresSQL poweredPostgres, Mongo
DynamoDBAzure Cosmos DB, Oracle NoSQL DB, PartiQL – A SQL Compatible Query language for DynamoDBAWS, Cloud Native
Apache CassandraBig Data
– Graph DBNeo4JCypher language used. – Cypher: How to Rewrite a UNION Query Using a COLLECT ClauseTuning Cypher queries by understanding cardinality
OrientDBopen source, it supports graph, document, key/value and object mode4lsJava
Ontotext GraphDBGraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs.
AgensGrapha transactional graph database based on PostgreSQLPostgres
Hasuragraphql on postgressql How to get instant GraphQL APIs on your existing Django applicationPostgres
EdgeDBas objects with properties connected by links. You can call it a relational database with an object-oriented data model, or a graph database with strictly enforced schema. We call it the first graph-relational database.
terminusdbTerminusDB is a database built for data people. Terminus is a model driven graph database designed specifically for the web-age.
– Key/ValueRedis
KeyDBCompatible with RedisRedis
GhostDBCache key/value db in golangGolang
– Other NO SQLImmuDBimmudb – immutable database based on zero trust, SQL and Key-Value, tamperproof, data change history
NocoDBOpen source Airtable AlternativeNo Codes
AirtableTable as a DB
BaaS/Real Time DBsupabaseCreate a backend in less than 2 minutes. Start your project with a Postgres Database, Authentication, instant APIs, and realtime subscriptions.Postgres
SapphireDbA self-hosted, easy to use realtime database
AppwriteAppwrite is a secure end-to-end backend server for Web, Mobile, and Flutter developers
Firebase/FirestoreGoogle’s Realtime BaaS
RethinkDBRethinkDB pushes JSON to your apps in realtime.Open Source
OLAP/Data WarehousePingCap/TiDBpingcap/tidb open-source NewSQL database that supports Hybrid Transactional and Analytical Processing (HTAP) workloads. It is MySQL compatible and features horizontal scalability ref pingcapHybrid
Amazon RedshiftAmazon data warehouse serviceCloud
metabaseOpen source BI tool
TimeSeries DBQuestDBFast time series data/sensors dataTime Series, IoT
Amazon TimestreamAmazon Timestream is a fast, scalable, and serverless time series database service for IoT and operational applications.Cloud
TDEngineOpen source from a Chinese companyTime Series, IoT
Database and Data Warehouse Stacks

Z3Z3, a tool to backup ZFS snapshot to AWS S3Cloud
MinIOAWS S3 Compatible Object Storage, self host and k8s friendlyCloud, K8s
garagean open source distributed storage service (self host)Self-host
Object/Block Storage Stacks

Feel free to leave comments for discussing ๐Ÿ™‚

BTW, some well known stacks are not listed here, such as Big Table, Oracle DB etc