Data tooling landscape

Data Plane

Where data is stored and processed. Warehouses, lakehouses, open table formats, engines, storage and streaming.

32 tools · 6 categories

Cloud Data Warehouses (8)

Amazon Redshift

Data Plane · Cloud Data Warehouses

Managed cloud data warehouse on AWS, with provisioned and serverless options.

  • Cloud service

ClickHouse

Data Plane · Cloud Data Warehouses

Open-source columnar database for real-time analytics, also offered as a managed cloud service.

  • Open core

Firebolt

Data Plane · Cloud Data Warehouses

Analytical database for low-latency, high-concurrency workloads, PostgreSQL-compatible and reading Iceberg. The engine is open source in preview; managed and bring-your-own-cloud options are sold.

  • Open core

Google BigQuery

Data Plane · Cloud Data Warehouses

Serverless data warehouse on Google Cloud.

  • Cloud service

Microsoft Fabric Data Warehouse

Data Plane · Cloud Data Warehouses

T-SQL data warehouse in Microsoft Fabric that stores its tables in Delta format in OneLake.

  • Cloud service

MotherDuck

Data Plane · Cloud Data Warehouses

Serverless cloud warehouse built on DuckDB, with dual execution splitting a query between laptop and cloud, and zero-copy sharing between accounts.

  • Cloud service

Snowflake

Data Plane · Cloud Data Warehouses

Fully managed cloud data platform with separate storage and compute, known for SQL warehousing and data sharing.

  • Commercial

Teradata Vantage

Data Plane · Cloud Data Warehouses

Enterprise analytics and data warehouse platform, available on major clouds and on-premises.

  • Commercial

Lakehouse Platforms (5)

Cloudera

Data Plane · Lakehouse Platforms

Hybrid data and AI platform running the same containerised data services on-premises and in cloud, with its own S3-compatible object store built on Apache Ozone.

  • Commercial

Databricks

Data Plane · Lakehouse Platforms

Lakehouse platform built on Apache Spark and open table formats, governed through Unity Catalog.

  • Commercial

Dremio

Data Plane · Lakehouse Platforms

Lakehouse query engine and semantic layer built on Apache Iceberg and Apache Arrow.

  • Open core

Microsoft Fabric

Data Plane · Lakehouse Platforms

SaaS analytics platform that unifies data engineering, warehousing, real-time analytics and Power BI on OneLake.

  • Cloud service

Starburst

Data Plane · Lakehouse Platforms

Commercial data platform based on Trino, for querying data across many sources.

  • Commercial

Open Table Formats (3)

Apache Hudi

Data Plane · Open Table Formats

Open data lakehouse format focused on incremental processing, upserts and deletes.

  • Open source

Apache Iceberg

Data Plane · Open Table Formats

Open table format for large analytic tables, supported by many engines and platforms.

  • Open source

Delta Lake

Data Plane · Open Table Formats

Open table format that adds ACID transactions, time travel and schema enforcement to data lakes.

  • Open source

Query & Processing Engines (5)

Apache Spark

Data Plane · Query & Processing Engines

Distributed engine for large-scale data processing, SQL, streaming and machine learning.

  • Open source

DuckDB

Data Plane · Query & Processing Engines

In-process analytical SQL database, popular for local analytics and embedded workloads.

  • Open source

e6data

Data Plane · Query & Processing Engines

Lakehouse compute engine that allocates compute per query rather than by fixed warehouse size, aimed at high-concurrency SQL and AI workloads with no data movement.

  • Commercial

Polars

Data Plane · Query & Processing Engines

Fast DataFrame library written in Rust, with Python bindings.

  • Open source

Trino

Data Plane · Query & Processing Engines

Distributed SQL query engine for querying data where it lives, across many sources.

  • Open source

Object Storage (4)

Amazon S3

Data Plane · Object Storage

Object storage service from AWS, commonly used as the foundation of data lakes.

  • Cloud service

Azure Data Lake Storage

Data Plane · Object Storage

Data lake storage on Azure Blob Storage, with a hierarchical namespace.

  • Cloud service

Google Cloud Storage

Data Plane · Object Storage

Object storage service on Google Cloud.

  • Cloud service

MinIO

Data Plane · Object Storage

High-performance, S3-compatible object storage for on-premises or any cloud. The AGPL community edition is archived and no longer maintained; the supported product is the commercially licensed AIStor.

  • Commercial

Streaming & Stream Processing (7)

Amazon Kinesis

Data Plane · Streaming & Stream Processing

AWS services for collecting and processing real-time streaming data.

  • Cloud service

Apache Flink

Data Plane · Streaming & Stream Processing

Stateful stream processing framework for real-time computation over unbounded data.

  • Open source

Apache Kafka

Data Plane · Streaming & Stream Processing

Distributed event streaming platform for high-throughput data pipelines and streaming applications.

  • Open source

Azure Event Hubs

Data Plane · Streaming & Stream Processing

Managed event ingestion service on Azure, with a Kafka-compatible endpoint.

  • Cloud service

Conduktor

Data Plane · Streaming & Stream Processing

Kafka operations platform sitting in front of clusters you already run, pairing a console for visibility and self-service with a proxy that enforces encryption, masking and policy on the wire.

  • Commercial

Confluent

Data Plane · Streaming & Stream Processing

Data streaming platform built around Apache Kafka, available as a cloud service or self-managed.

  • Commercial

Redpanda

Data Plane · Streaming & Stream Processing

Kafka API-compatible streaming data platform written in C++.

  • Source available