This is a manually updating page regarding the database and data storage stacks.
There are many new tech stacks creating everyday, a lot of existing problems in software could be solved in using a different tech stacks, especially in data and data storage area. Based on my experience in software engineering, I found many companies using wrong storage stack,
for example,
- Using a OLTP db for OLAP purpose, it costs tons of time and money for maintaining the services running.
- This kind of problems could possibly be solved easily after analysing usage and switching to a data warehouse service like Amazon redshift.
- Using a single instance DB for different regions customers, with company growing, the main customers/users’ region changed, and company suffer from the bottle neck of DB performance and network latency.
- This problem could possible be solved by using cloud native db or a proper distribute db.
I know many tech companies suffer from this kind of problems, some are big some are small. This page is (trying) to list all trending/robust/new data related stacks to help engineers and architect to choose next right db stack for their products, to avoid this kind of issues once for all. Hopefully, this could help you a bit.
| Category | Name | Description | Tag |
|---|---|---|---|
| Relational DB (SQL DB/OLTP) | MySQL | ||
| PostgreSQL | Amazon RDS, Amazon Aurora | ||
| SQLite | |||
| absurd-sql | sqlite3 in ur indexeddb | Web, JS, SQLite | |
| PolarDB | A cloud-native database service independently developed by Alibaba Cloud, similar to Amazon Aurora | Cloud Native | |
| Yugabyte | YugabyteDB is a high-performance transactional distributed SQL database for cloud-native applications, developed by Yugabyte. | Cloud Native | |
| Distributed DB | Blazing SQL | BlazingSQL provides a high-performance distributed SQL engine in Python. Built on the RAPIDS GPU data science ecosystem, ETL massive datasets on GPUs. | Python |
| CockroachDB | Cloud SQL database — giving all of your apps effortless scale, bulletproof resilience and low latency performance for users anywhere. – How we built a forever-free serverless SQL database | Postgres, Serverless | |
| GunJS | Cheap distributed edge computing DB | Edge, Web | |
| No SQL | |||
| – Document DB | Mongo DB | Document db | |
| FerretDB (MangoDB) | The de-facto open-source substitute to MongoDB, PostgresSQL powered | Postgres, Mongo | |
| DynamoDB | Azure Cosmos DB, Oracle NoSQL DB, PartiQL – A SQL Compatible Query language for DynamoDB | AWS, Cloud Native | |
| Apache Cassandra | Big Data | ||
| – Graph DB | Neo4J | Cypher language used. – Cypher: How to Rewrite a UNION Query Using a COLLECT Clause – Tuning Cypher queries by understanding cardinality | |
| OrientDB | open source, it supports graph, document, key/value and object mode4ls | Java | |
| Ontotext GraphDB | GraphDB allows you to link diverse data, index it for semantic search and enrich it via text analysis to build big knowledge graphs. | ||
| AgensGraph | a transactional graph database based on PostgreSQL | Postgres | |
| Hasura | graphql on postgressql How to get instant GraphQL APIs on your existing Django application | Postgres | |
| EdgeDB | as objects with properties connected by links. You can call it a relational database with an object-oriented data model, or a graph database with strictly enforced schema. We call it the first graph-relational database. | ||
| terminusdb | TerminusDB is a database built for data people. Terminus is a model driven graph database designed specifically for the web-age. | ||
| – Key/Value | Redis | ||
| KeyDB | Compatible with Redis | Redis | |
| GhostDB | Cache key/value db in golang | Golang | |
| – Other NO SQL | ImmuDB | immudb – immutable database based on zero trust, SQL and Key-Value, tamperproof, data change history | |
| NocoDB | Open source Airtable Alternative | No Codes | |
| Airtable | Table as a DB | ||
| BaaS/Real Time DB | supabase | Create a backend in less than 2 minutes. Start your project with a Postgres Database, Authentication, instant APIs, and realtime subscriptions. | Postgres |
| SapphireDb | A self-hosted, easy to use realtime database | ||
| Appwrite | Appwrite is a secure end-to-end backend server for Web, Mobile, and Flutter developers | ||
| Firebase/Firestore | Google’s Realtime BaaS | ||
| RethinkDB | RethinkDB pushes JSON to your apps in realtime. | Open Source | |
| OLAP/Data Warehouse | PingCap/TiDB | pingcap/tidb open-source NewSQL database that supports Hybrid Transactional and Analytical Processing (HTAP) workloads. It is MySQL compatible and features horizontal scalability ref pingcap | Hybrid |
| Amazon Redshift | Amazon data warehouse service | Cloud | |
| metabase | Open source BI tool | ||
| TimeSeries DB | QuestDB | Fast time series data/sensors data | Time Series, IoT |
| Amazon Timestream | Amazon Timestream is a fast, scalable, and serverless time series database service for IoT and operational applications. | Cloud | |
| TDEngine | Open source from a Chinese company | Time Series, IoT |
Name | Description | Tag |
|---|---|---|
| Z3 | Z3, a tool to backup ZFS snapshot to AWS S3 | Cloud |
| MinIO | AWS S3 Compatible Object Storage, self host and k8s friendly | Cloud, K8s |
| garage | an open source distributed storage service (self host) | Self-host |
Feel free to leave comments for discussing 🙂
BTW, some well known stacks are not listed here, such as Big Table, Oracle DB etc