As we walk through 2023 together｜Apache Doris annual moments inventory

The first month of 2024 has completely passed, and the review and summary of 2023 is long overdue.

For most of the past year, we have been busy, with intensive code development, high-speed version iterations, and tight schedules across the country, as witnessed by many community users and developers.

The busier we are, the more valuable this review at the end of the year is. At the beginning of 2024, we have selected some meaningful moments and look forward to sharing with every community user and developer what they have experienced together in the past year. It is precisely because each of you is a witness and participant that the title of this review is "When We Walk Through 2023 Together".

"A landmark leap"

In August 2023, we ushered in the landmark release of version 2.0, and Apache Doris has officially entered the 2.0 era.

Apache Doris version 2.0.0 is officially released: blind test performance is improved 10 times, providing a more unified and diverse high-speed analysis experience

If we use one keyword to describe the various gains made by Apache Doris in the past 2022, we believe it is "comprehensive evolution after thick accumulation and thin development", and the release of version 2.0 in 2023 marks our achievement of a "milestone" "Leap-over":

Introducing an adaptive parallel execution model and a new query optimizer, blind test performance is improved by 10 times, multi-table association is improved by 13 times, single table scenarios are improved by 10 times, and high concurrency point queries are improved by 20 times;
Expand from typical OLAP scenarios such as reports and Ad-hoc to lake-warehouse integration, high-concurrency data services, and log retrieval and analysis to support more unified and diverse analysis scenarios;
Supports high-throughput writing of real-time data, second-level latency, complete support for all types of data updates, and builds a more efficient, easy-to-use and stable real-time data processing and analysis link;

From the data of contributors and Commits, we can see that version 2.0.0 has incorporated more than 4,100 PRs, an increase of 70% compared to version 1.2, and an increase of nearly 10 times compared to version 1.1 released in the same period last year. Participate in the development of this version The number of contributors has reached 275. I would like to express my heartfelt thanks again to all contributors who participated in requirement feedback, code development, functional testing and version verification.

"10000 Star New Achievement Achieved"

In November 2023, we exceeded 10,000 stars for the first time on GitHub, an increase of more than 70% compared to the same period last year.

Over the past year or so, Apache Doris has maintained extremely stable and rapid GitHub Star growth, topped the GitHub Trending list many times, and received the attention of developers around the world.

“600”、“4000”

In December 2023, the number of Apache Doris kernel contributors reached 600 . Compared with 2021, the number of kernel contributors has increased by more than 100% for two consecutive years, and many new faces begin to participate in community contributions almost every week.

Many of them have also become new PMCs and Committers because of their outstanding contributions to the community.

Judging from community developer activity indicators:

In the past ten months, the average number of monthly active contributors in the Apache Doris community has stabilized at around 120, which has significantly exceeded the world's leading open source big data projects, including Spark, Elasticsearch, Trino, Druid, etc.;
These contributors contribute more than 160 PRs to Apache Doris every week. At the same time, the community has also established a more mature and stable CR pipeline. Each incorporated code will go through 3000+ test cases, which also allows the community to develop at an extremely fast speed. While iterating, stability is also ensured;

This series of numbers all shows that Apache Doris has now become one of the most active open source big data projects in the world .

While technology is accelerating iteration, we have also seen that more and more users are beginning to choose to trust Apache Doris. By the end of 2023, the community exchange group has gathered more than 36,000 engineers in database and big data related fields.

In the past, many community users had the impression that Apache Doris was mostly used by Internet companies, such as Baidu, Meituan, Xiaomi, JD.com, Tencent and other first-line Internet companies. Nowadays, the industries covered have become more and more extensive. Whether it is finance, government and enterprises, telecommunications, manufacturing, transportation, logistics, fast moving consumer goods industries, etc., many companies are applying Apache Doris in their core analysis business. Therefore, at this year’s Summit, we officially announced the scale of Apache Doris users worldwide. **More than 4,000 companies have used Apache Doris in production environments to enjoy the ultimate analysis experience brought by Apache Doris, and this number is still Growing rapidly! **The vast majority of these more than 4,000 enterprise users have direct contact with us, whether they are feedback requirements, participating in testing, submitting code or sharing practical experience, they are all giving back and contributing to the community in their own way.

So we have reason to believe that with such a huge user scale, Apache Doris has become the first choice for users from all walks of life to use real-time data warehouses, and has become the de facto standard in the field of open source real-time data warehouses!

We also sincerely invite more friends to leave their mark on the official website of Apache Doris and share their stories of meeting Apache Doris.

"Walking with Innovators"

In October 2023, Apache Doris's first offline technology summit concluded in Beijing.

Around the beginning of August, there were still more than ten weeks before the opening of the summit. At that time, the preparations for the summit had been fully launched, but there was always a question in front of us, which was what theme we should choose for the summit.

This question may be said to be simple or difficult. The simplest thing is the accumulation of vague words. After all, after a period of time, apart from the event of hosting the summit, the memories that can be left behind are limited. The difficulty is that we really want to present the progress and gains, concepts and visions of the past period in a few simple words - the more highly condensed the expression, the harder it is to extract it.

So after reviewing the complete history of Apache Doris from its birth to the present, we thought, isn't this a story about technological innovation? ——So the theme "Walking with Innovators" came into being.

Here’s a little behind-the-scenes story.

During a break in the speeches at the main forum of the summit, Ming Yu, who is also the host of the summit, sat on the rostrum in the first row and posted a message on Moments. The first photo is the first Meetup held when Doris was open source but had not yet entered the Apache Foundation. At that time, Doris had not yet changed its name and had no reputation. The audience was very few, even less than the staff. The second photo is a photo of a packed house at Summit. There were nearly a thousand people in attendance, and even the aisle in the last row was full of spectators.

Therefore, we need to pay tribute to all the guests who participated in the summit sharing, and more importantly, we need to pay tribute to every community user, developer and open source enthusiast. It is these innovators who are chasing the wind and the moon that allow us to forge ahead together, and we look forward to working with more innovators in the future to explore more possibilities in the data world.

"Large-scale netizen meeting"

In April 2023, we launched a nationwide city tour, and the total number of User Groups in each city exceeded 1,000 people.

In this year, Apache Doris has traveled to nearly ten cities including Beijing, Shanghai, Xi'an, Hangzhou, Shenzhen, Chengdu, Wuhan, and Guangzhou, communicating face-to-face with thousands of open source users, listening to the most authentic voices from users, and letting people More people feel the free and pure technical atmosphere of the Apache Doris community.

Jigsaw puzzle 8.jpeg

In 2024, stay focused and move towards new extraordinary things

Staying focused is difficult, and the more uncertain you are in an external environment, the harder it is to stay focused.

I am very fortunate that the Apache Doris community has been focusing on how to be a good open source community, how to serve users well, thinking and iterating on needs, and future evolution trends and visions in the past few years.

As for the future, we will also maintain our original intention of open source and move forward more firmly on the road of open source. We believe that we will eventually move towards new excellence.

New Year activities

The 2024 Apache Doris Community RoadMap has been released on GitHub, and all community partners are welcome to participate in the discussion. We will select 5 friends who participated in the discussion to send out blind boxes around the New Year community. We look forward to hearing your voice.

[https://github.com/apache/doris/issues/30669](