Databend Open Source Weekly Issue 132

[Live broadcast preview] Will large models replace programmers? "

Databend is a modern cloud data warehouse. Designed for flexibility and efficiency to support your large-scale analysis needs. Free and open source. Experience the cloud service now: https://app.databend.cn .

What's On In Databend

Explore Databend's new developments this week and encounter Databend that is closer to your heart.

Provides `CREATE [ OR REPLACE ]`full support for

Databend now provides CREATE [ OR REPLACE ]full support for syntactic sugar to cover potential DROP IF EXISTS ...+ CREATE ...use cases.

Objects currently supporting this syntax sugar include: DATABASE, TABLE, VIEW, AGGREGATING INDEX, STREAM, CONNECTION, FUNCTION, FILE FORMAT, MASKING POLICYetc.

If you'd like to learn more, feel free to contact the Databend team or check out the resources listed below.

Issue #14299 | tracking: CREATE OR REPLACE

Code Corner

Let’s explore code snippets or projects in Databend and the surrounding ecosystem.

Using Databend Cloud for query analysis

Databend Cloud provides visual analytics tools to simplify the dissection and understanding of complex queries.

The profiling tool can track the performance of each step, from TableScan duration to HashJoin details, and monitor data spills. Helps you easily analyze query cost and time and perform targeted optimization.

The Databend team also makes good use of the tool to assess the impact of code changes on query execution. For example PR #14561 | feat: use materialized cte for standard stream .

Highlights

Here are some noteworthy events, maybe you can find something of interest.

JSON operators are supported #-.
Use materialized common table expressions (Materialized CTE) in standard streams to avoid repeated scanning.
Read Docs | Data Management to learn how to use Databend to manage, recover and protect your data.

What's Up Next

We are always open to cutting-edge technologies and innovative ideas, and welcome you to join the community and inject vitality into Databend.

Support multi-table insertion

Databend plans support multi-table inserts to allow conditional or unconditional inserts into multiple tables using a single statement.

Multi-table insert statements can reduce the table scans and SQL required to perform multiple conditional inserts. Mainly suitable for ETL processes in data warehouses, supporting parallelization and/or converting non-relational data into relational formats.

-- Unconditional multi-table insert
INSERT [ OVERWRITE ] ALL
  intoClause [ ... ]
<subquery>

-- Conditional multi-table insert
INSERT [ OVERWRITE ] { FIRST | ALL }
  { WHEN <condition> THEN intoClause [ ... ] }
  [ ... ]
  [ ELSE intoClause ]
<subquery>

Issue #14565 | Feature: Multi-table Inserts support

If you are interested in this topic, you can try to solve some of the problems or participate in discussions and PR reviews. Alternatively, you can click on https://link.databend.rs/im-feeling-lucky to pick a random question, good luck!

Changelog

Check out the changelog for Databend's daily builds to stay up to date on the latest developments.

Address: https://github.com/datafuselabs/databend/releases

Contributors

A big thank you to the contributors for their great work this week.

Connect With Us

Databend is an open source, flexible, low-cost, new data warehouse based on object storage that can also perform real-time analysis. We look forward to your attention and exploring cloud native data warehouse solutions together to create a new generation of open source Data Cloud.