From August 28th to September 1st, 2023, VLDB 2023 will be held in Vancouver, Canada.
The research results of Bytedance Infrastructure-Real-time Engine and Streaming Computing Team were accepted by VLDB 2023 and invited to give on-site reports.
The full name of the VLDB
conference
is International Conference on Very Large Data Bases. It is one of
the three top conferences
(
SIGMOD, VLDB,
ICDE
)
with a long history in the database field. Established in 1975, VLDB attracts contributions from the world's top research institutions every year, and has extremely high requirements for system innovation, integrity, and experimental design.
Krypton
: Real-time Serving and Analytical
SQL
Engine at ByteDance
Krypton is a new generation of real-time service analysis HSAP (Hybrid Serving & Analytical Processing) system for complex business scenarios jointly developed by ByteDance infrastructure-real-time engine, innovative application center, storage-HDFS & NoSQL team. Based on the unified data storage, it can not only meet the online Serving requirements of users with high concurrency (eg million QPS) and low latency (eg ~10ms), but also meet users' real-time complex analysis requirements for massive data. It supports real-time writing, real-time updating and real-time analysis of massive data, supports standard SQL (compatible with MySQL syntax), cloud-native architecture (separation of storage and computing), low user threshold, and works out of the box.
StreamOps: Cloud-Native Runtime Management for StreamingServices in ByteDance
StreamOps is a lightweight streaming task runtime management solution extracted by the Bytedance Infrastructure-Streaming Computing Team and the SANE research group at Department of Computer Science, National University of Singapore (SANE research group at Department of Computer Science, National University of Singapore) based on Byte's internal 10,000+ Flink streaming task management practice. It supports AutoScaling of streaming tasks, automatic processing of slow nodes, and delay/fault diagnosis, which can effectively reduce the maintenance cost of user streaming tasks.
The above papers and on-site reports will be officially presented at VLDB 2023 at the end of August. At that time, the ByteDance infrastructure team will also publish corresponding interpretations of related papers, so stay tuned.
{{o.name}}
{{m.name}}