Skip to main content

Roadmap 2023

tip

This is Databend Roadmap in 2023 🚀, sync from the #9448

After a full year of research and development in 2022, the functionality and stability of Databend were significantly enhanced, and several users began using it in production. Databend has helped them greatly reduce costs and operational complexity issues.

This is Databend Roadmap in 2023 (discussion).

See also:

Main tasks

Features

TaskStatusComments
UpdateIN PROGRESS
MergePLAN
Alter tableIN PROGRESS
Window functionPLAN
Lambda function and high-order functionsPLAN
TimestampTz data typePLAN
Decimal data typePLAN
Materialized viewPLAN
Support SET_VAR hints#8833PLAN
Parquet readerPLAN
Distributed COPYPLAN
JSON indexingPLAN
DataFramePLAN
Data Sharing(community version)IN PROGRESS
Concurrent query enhancePLAN

Improvements

TaskStatusComments
New expression#9411IN PROGRESS
Error messagePLAN

Planner

TaskStatusComments
Scalar expression normalizationPLAN
Column constraint frameworkPLAN
Functional dependency framework#7438PLAN
Join reorderIN PROGRESS
CBO for distributed planPLAN
Support TPC-DSPLAN
Support optimization tracingPLANEasy to debug/study.

Cache

TaskStatusComments
Unified cache layerIN PROGRESS
Meta data cacheIN PROGRESS
Index data cacheIN PROGRESS
Block data cachePLAN

Data Storage

TaskStatusComments
Fuse engine re-clusteringPLAN
Fuse engine orphan data cleanupPLAN
Fuse engine segment treePLANSupport large dataset(PB) in one table

LakeHouse

TaskStatusComments
Apache HiveIN PROGRESS
Apache IcebergIN PROGRESS
Querying external storage(Parquet)IN PROGRESS

Distributed Query Execution

TaskStatusComments
Visualized profilingIN PROGRESS
Aggregation spillingIN PROGRESS

Resource Quota

TaskStatusComments
Session-level quota control (CPU/Memory)IN PROGRESS
User-level quota control (CPU/Memory)PLAN

Integrations

TaskStatusComments
Dbt integrationIN PROGRESS
Airbyte integrationIN PROGRESS
Datadog Vector integrate with Rust-driverIN PROGRESS
Datax integrate with Java-driverIN PROGRESS
CDC with FlinkPLAN
CDC with KafkaPLAN

Meta

TaskStatusComments
Jepsen testIN PROGRESS

Testing

TaskStatusComments
SQLlogic TestIN PROGRESSSupports more test cases
SQLancer TestIN PROGRESSSupports more type and more cases
Fuzzer TestPLAN

Releases