Apache Spark
Data Plane · Query & Processing Engines
Distributed engine for large-scale data processing, SQL, streaming and machine learning.
- Open source
Data Plane · Query & Processing Engines
Lakehouse compute engine that allocates compute per query rather than by fixed warehouse size, aimed at high-concurrency SQL and AI workloads with no data movement.
e6data's argument is about allocation, not speed alone. A conventional warehouse reserves compute by warehouse size, so every query gets whatever the warehouse was sized for whether it needs it or not. e6data allocates compute per query instead, and its own illustration puts conventional utilisation around 35 per cent against roughly 95 per cent for adaptive allocation.
Whether those figures hold for a given workload is exactly the thing to test rather than accept, and the same applies to the headline claims of ten times faster and sixty per cent cheaper. They are vendor benchmarks. The underlying mechanism, though, is a real architectural difference rather than a tuning claim, and it is most likely to matter where query sizes vary widely and concurrency is high — the pattern that wastes the most reserved capacity.
It runs as a compute engine over an existing lakehouse with no data movement, so it is a layer added to storage you already have rather than a warehouse to migrate into. That makes it comparable to the other query engines in this category rather than to Snowflake or BigQuery.
Stated workloads are high-concurrency, complex SQL analytics and AI workloads, with data analysts, scientists and engineers as the named audience.
One caveat on the documentation: its landing page carried a last-updated stamp of nine months before this was read, and the docs direct detailed questions to an account manager. Public technical depth is therefore thinner than for the open-source engines in this category, and more of the evaluation has to happen through the vendor.
The same headings are used for every query & processing engines entry, so two tools can be read side by side.
Price on request
Not published. The cost argument is made comparatively — sixty per cent cheaper through better compute utilisation — rather than through rates or tiers, so any saving has to be verified against your own workload and your current bill rather than read off a price list.
e6data builds a lakehouse compute engine for SQL analytics and AI workloads, sold commercially. Its public materials lead with comparative performance and cost claims — ten times faster, sixty per cent cheaper, zero data movement — illustrated by a compute-utilisation comparison against fixed warehouse sizing. Documentation is public but shallower than the category norm, with a landing page last updated nine months before this reading and detailed enquiries routed to an account manager. No pricing is published.
Data Plane · Query & Processing Engines
Distributed engine for large-scale data processing, SQL, streaming and machine learning.
Data Plane · Query & Processing Engines
In-process analytical SQL database, popular for local analytics and embedded workloads.

Data Plane · Query & Processing Engines
Fast DataFrame library written in Rust, with Python bindings.
Data Plane · Query & Processing Engines
Distributed SQL query engine for querying data where it lives, across many sources.
Drafted with AI assistance and checked against the vendor’s own documentation.