Get tickets for a limited time｜Enter the 2023 Yunqi Conference and watch big names talk about open source

From data to large model application, on November 25th, Hangzhou Yuanchuang Conference was held to share development tips.

The 2023 Yunqi Conference is here. Big data and data analysis, open source technology and many other themed activities are gathered with you. Tickets are available for free, the quantity is limited, first come first served!

Time: November 1st
Address: D4-1, Yunqi Town, Hangzhou

Click to collect tickets

Introduction to guests and topics

Topic 1｜Alibaba Cloud Open Source Big Data Platform 3.0 Technical Interpretation

Speaker: Wang Feng

Alibaba Cloud researcher, head of open source big data platform

■ Topic introduction

Since 2009, it has experienced the 1.0 era of big data on the cloud, and the 2.0 era represented by data lakes and real-time. Alibaba Cloud's open source big data platform has moved into the 3.0 era, innovatively launching a new generation of streaming services partnered by Flink and Paimon. It is a fully serverless warehouse, fully releasing the dividends of open source technology to users, and integrating with AI to evolve more intelligently.

Topic 2｜Alibaba Cloud’s annual release of open source big data products

Speaker: Chen Shouyuan

Alibaba Cloud Open Source Big Data Product Director

■ Topic introduction

Alibaba Cloud's open source big data products are fully serverless: EMR Spark Serverless, EMR StarRocks storage and calculation separation, ES Serverless release; and major upgrades for data lake warehouse and AI scenarios, including Flink streaming lake warehouse release, EMR data lake management upgrade, ES Integrate LLM and upgrade to AI search, etc.

Topic 3｜Alibaba Cloud EMR fully opens the serverless era

Speaker: Li Yu

Alibaba Cloud senior technical expert, head of EMR

■ Topic introduction

Two new engines, StarRocks and Spark, are launched, providing fully managed and operation-free product and service forms, which greatly reduces the complexity of operation, maintenance and use. At the same time, the enhanced engine core greatly improves computing efficiency. Provides a billing model based on actual usage, without the need to reserve resources, which greatly reduces resource costs. Enterprise-level management capabilities such as permission management, diagnostic analysis, and integrated data development experience.

The cloud-native data lake analysis solution has been significantly upgraded, with fully managed and lake-storage OSS-HDFS: fully compatible with HDFS/POSIX protocols and seamlessly connected to the integrated ecology of big data and AI;

One-stop lake management DLF: Provides comprehensive database storage management capabilities; Multi-modal lake computing: Based on one lake and multiple architectures, it implements integrated cloud-native data lake solutions such as offline lakes, real-time lakes, and lake warehouse analysis.

Topic 4｜Building a new streaming lake warehouse solution based on Flink SQL and Paimon

Speaker: Li Jinsong

Senior technical expert at Alibaba Cloud, Apache Flink PMC, Paimon PPMC Member

■ Topic introduction

Based on Flink, Paimon and diversified open source engines, a new streaming lake warehouse solution is created to provide users with one-stop data entry into the lake, real-time processing and exploration and analysis capabilities, expanding Flink’s real-time computing capabilities in data lake scenarios, and at the same time on the cloud Batch is moving towards production availability, supporting batch data processing and job scheduling on the lake.

Topic 5｜Building an enterprise-level real-time data integration solution based on Flink CDC

Speaker: Xu Bangjiang

Senior technical expert at Alibaba Cloud, Apache Flink PMC Member

■ Topic introduction

As a new generation of real-time data integration framework, Flink CDC has technical advantages such as full incremental integration, lock-free reading, parallel reading, automatic synchronization of table structure changes, and distributed architecture. This topic provides an in-depth explanation of the enterprise-level real-time data integration solution based on Alibaba Cloud's real-time computing Flink CDC.

Topic 6｜Elasticsearch Serverless version product release

Speaker: Zhao Hongyang

Alibaba Cloud Senior Product Expert

■ Topic introduction

Alibaba Cloud Elasticsearch launches a serverless product that is compatible with open source and can be used on demand. Based on the combination of Indexing Service index construction service and intelligent hybrid storage engine, it can achieve a 150% increase in write performance and a 70% reduction in unit data storage costs, providing a solution for small and medium-sized enterprises and enterprises. Developers provide inclusive search capabilities on the cloud.

Click to collect tickets