In Taobao, how does the marketing technology team support Double 11?




Every year, Double 11 attracts hundreds of millions of consumers and millions of merchants to participate, with a dazzling array of venues, red envelopes, coupons, and various ways to play. As the main battleground for major promotions, Taotian marketing technology has accumulated rich business capabilities after years of experience in major promotions, supporting various marketing business scenarios such as major promotions and marketing channels. This article will introduce you to the marketing technology system.


Marketing and Marketing Technology


Before introducing the technology, we need to briefly understand the business background. We must first understand marketing. The definition of marketing given by Philip Kotler, the "father of modern marketing": "An activity in which enterprises identify existing market needs to determine target consumer groups to provide services for them." Marketing itself is a relatively broad concept, and we The marketing businesses supported mainly include marketing activities (integrated marketing), effect marketing (marketing products), brand marketing, merchant self-marketing, etc. The Double 11 promotion mentioned above is a marketing activity, such as "New Year's Day", "Spring Festival No Closing", and "618 Promotion". These are all marketing activities. They meet the needs of most consumers under the corresponding marketing theme. , a marketing method that uses systematic and integrated marketing of marketing methods to form the breaking point of marketing climax. The marketing channel is generally a normalized marketing business, which operates for a long time and has a fixed traffic entrance, mentality and positioning. Such as Juhuasuan, tens of billions of subsidies, Taobao good prices, daily specials, etc.



The business scenario is composed of a series of products, including venues, channels, interactive gameplay, and live broadcast marketing components.



The marketing business process can be simply divided into two parts, organization and supply on the ToB side, and expression and transformation on the ToC side.


Organization and supply on the ToB side. Marketing is a platform-based business, and the platform is the starting point for business. The operation team formulates the investment strategy of the platform through the investment promotion system, including merchants, goods, rules, gameplay, etc. For example, they determine the theme and duration of the event, as well as the main benefits and gameplay, etc. Merchants can complete the product reporting and information supplement according to the requirements and their own business needs. The submitted products and gameplay are then selected by the product selection system to accurately match the supply side and the consumer side. Here is the area for investment promotion and product selection.


Expression and transformation of the ToC side. After the supply is ready, the next step is how to reach and present it to consumers.
There are many forms of undertaking, among which the more common ones are various venues, channel pages, live broadcasts, etc. We abstract them into marketing venues. For these marketing sites, the platform will design a series of content organization methods and traffic mechanisms. On the one hand, it will show consumers the best quality products and the best ways to play. On the other hand, it will help merchants exert their independent operation capabilities and improve services while obtaining Better traffic. Ultimately, the delivery system communicates the presentation of products and gameplay to consumers based on operational strategies and algorithms. This constitutes the area of ​​construction and delivery.


The last step is the most critical conversion stage, the core of which is to let consumers clearly know the offer. In basic links such as product details, shopping carts, and ordering, on the one hand, consumers have a strong sense of experience through the rights issuance process; on the other hand, marketing benefit information is revealed through shopping guides and transaction links, allowing consumers to clearly perceive The composition of rights and interests creates a preferential experience and promotes the completion of the transaction.



What problems and challenges will we encounter?

Through a simple business introduction, we can have a basic understanding of the marketing business. Next, we will use some examples to experience the technical challenges we need to deal with.
  1. Every year, nearly a million merchants participate in the Double 11 promotion, involving tens of millions of product registrations. This will involve information submission, rule verification, and activity rules. From the writing of operating rules, the display of merchant announcements to the final system execution, how to maintain the unity of text expression and execution logic? Each activity has many rules and requirements, involving many downstream and data indicators. Can the accuracy of data and the speed of system verification be improved?
  2. For every major promotion, merchants must provide a large amount of materials as the core elements for expressing information on the massive promotion products, gameplay, and rights in the consumer shopping guide link. Material production is very energy-consuming. Large businesses will have their own professional designer teams, while many small businesses rely on their own PS. How to reduce the cost of merchant material production and maintenance through technical means?
  3. The big promotion period contains a lot of business data and business status, including materials, discounts, gameplay, freight insurance, free shipping, etc. As a distribution center for data distribution on marketing links, marketing products are the source of supply for each marketing execution link and the key to collaboration and unification. How to ensure data consistency for tens of millions of products in numerous upstream and downstream systems during a major promotion cycle?
  4. When a user gets a consumer coupon or a large discount, how can we help the user quickly find the product, complete the order, and enjoy the best discount?
  5. Changes in product inventory, adjustments to merchant discounts, product purchase restrictions and other factors will all affect the price of the final consumer discount. The most important thing here is to ensure that "what you see is what you get" in price. This is not only the price expressed by the system text seen on the homepage, search, details, shopping cart, order, etc., but also the price expressed by the merchant's main image. How to ensure consistency in price expression?
  6. Before and after major promotions, due to various commercial reasons, product prices may fluctuate. The platform and merchants provide users with price guarantee services. Faced with a large number of orders, how to accurately and quickly calculate price fluctuations and return the price difference to consumers in a timely manner.
  7. During the Spring Festival Gala of a certain year, the host broadcast a lottery on Taobao. Faced with a user scale of 100 million, more than one million users participated in the lottery at the same time every second. How to ensure the stability of user draws under high concurrency? This extremely hot spot with high concurrent writing is not a simple single technical problem. The entire architecture will be challenged. Even the current limiting system used to provide system protection has been greatly challenged.
  8. The venue serves as an exclusive venue for big sales, showing users what to buy and play during the big sales. The venue is a collection of shopping pages, a group of pages organized together in the form of a page shopping guide. In recent years, the content displayed at major promotion venues has become increasingly rich, including not only product pictures and prices, but also short videos, live broadcasts, interactive gameplay, etc. However, not all users use high-end equipment, and they will encounter great challenges when rendering responsible pages like the venue. How to improve the speed of page opening and improve the smoothness of page traffic for users with mid- to low-end devices is also a proposition we need to solve.
  9. The interactive scenes of 3D&XR bring users an immersive experience that is interesting and vivid. However, 3D&XR production generally requires a relatively long cycle and cost, and the window period for hot spot marketing and event marketing is very valuable. We hope to precipitate the one-time production gameplay through productization. But the most difficult thing here is to understand 2D/3D/XR technology and find a suitable solution based on the current and future demands of marketing interactive scenarios.

The above are common business demands and problems. They are not a single technical scenario (such as high concurrency, distributed transactions, etc.). In many cases, it is necessary to find the optimal solution under limited business conditions. Combined with the characteristics of marketing business, try to summarize the technical challenges and requirements.

The first is marketing business understanding and abstraction. The marketing business models are rich and timely. From a scenario perspective, whether online or offline, marketing activities can be carried out in various scenarios, such as e-commerce platforms, offline shopping malls, social media, etc. From a rhythm perspective, whether it is a traditional festival or a current hot topic, it is a point of opportunity, and business strategies may be adjusted flexibly in a timely manner. One of the core requirements of this feature for technology is delivery efficiency. When the business has an idea, whether it can be implemented quickly and win the precious time window. Therefore, product and technical architecture must be built on a stable and powerful basic platform and have rapid scalability. There are very high requirements for business understanding, domain abstraction and architecture design.

Second, is high availability. The marketing business itself is organized for a specific marketing scenario or theme, so it is naturally explosive and may even far exceed the peak order placement. For example, the Spring Festival Gala lottery method mentioned earlier has more than one million users participating every second. In addition, the marketing activity itself also has a high degree of attention. Once something goes wrong, it will have a huge negative impact. Therefore, high availability is a very important technical challenge.

In addition, intelligence is also a key point. The marketing business process is complex, involving the participation of multiple roles, and there are many interactions between systems. In order to reduce labor investment costs and improve business efficiency and effectiveness, products, technologies and algorithms need to be effectively combined.

最后,前沿技术的探索是不可或缺的。在数字化时代,营销创意的落地非常依赖技术的可行性。比如,AR、VR和智能设备等新兴技术正在改变营销方式和消费者体验。可以利用这些技术来打造更具创意和互动性的营销活动。


我们是如何去解问题的

  业务高效支撑


针对业务复杂性和迭代效率的要求,平台化的架构起了关键的作用。整个营销支撑体系进行了合理的领域划分,上面提到的几个业务域,都形成了各自的平台体系,例如招商平台、投放平台、权益平台、搭建平台等。从大的建设思路去看,平台系统核心通过领域模型标准化和业务流程的抽象,实现80%~90%的系统功能的复用,同时架构上实现单一能力点的扩展以提高迭代效率。

所以平台上面新增的每个功能大部分都能沉淀下来,类似场景的需求就像遵循“摩尔定律”一样,支持得越来越快。




当然平台化架构只是基础,再此之上技术上还在做进一步演进和探索。


我们发现虽然实现单一能力点的扩展,但是部署、发布过程还是要跟着这个系统一起进行,功能变多了以后,系统也变得臃肿起来。为此,我们参考了docker容器的方案,实现了一套JVM级别轻量级容器解决方案,在代码层面把平台基础功能和业务定制扩展功能分开,扩展功能可以以插件形式实现热部署。这个方案可以帮助迭代和维护效率进一步提高,让调试/部署的耗时减少10倍以上。




另外,在某些特定领域,我们还在进一步探索低代码的方案。例如大促会场模块的实现,前端工程师以往大部分的时间都是做设计稿的还原,我们实现了一套设计稿智能生成前端代码的平台(imgcook[01],19年双11的会场模块 79.43%的线上代码由imgcook一键智能生成。




去年在“低代码生产”进一步向“无代码生产”做进一步探索,通过可视化配置的方式实现会场模块编排和生产,22年双11已经有30%的新会场模块需求通过无代码生成方式实现。

  高可用


高可用针对单一场景都是有成熟解法的,但是结合业务场景可能就会有不同的方案。


在营销中高并发读的场景,主要是会场、频道等页面导购场景。这种场景面向都是用户端的流量,很多时候流量都是尖刺型的,在峰值瞬间比次峰值甚至会高几倍。所以这里设计上主要是避免预期外洪峰流量的影响,这里业务容灾兜底方案就比较重要了。目前投放系统有是多级限流做到自我保护,基于多级兜底机制保障保底业务表现。最悲观的情况,整个系统都挂了还是能保证最兜底的业务表现。在21年春晚的时候,脉冲流量远超预期,超过40%的请求都被限流了,但是用户端页面透出依然是正常的,也不影响用户进一步抽奖的动作。




说到抽奖,是一个典型的高并发写场景。这个场景类似于秒杀,在某个时刻会有百万到千万级的的用户同一时间涌入系统争抢。而权益本身是有限的,就要求需要在极短的时间内对红包的数量做正确的扣减,比如每秒扣减100w次,这个对现在任何系统、机器都是要突破物理瓶颈的。


如何既能保证用户顺利抽奖又不超发就成为一项非常困难的事情。


针对这种场景,业界里面比较成熟的方案是分布式库存扣减,即将库存提前分配到多个分桶中,不同用户路由到不同分桶进行扣减。但是在营销的场景中,常规的分桶方案会引入其他问题,包括分桶数的确定,分桶碎片问题,分桶库存回收问题等等。例如业务预算剩余3块钱分了10个桶,每个桶3毛钱,这时业务要发1元是无法发放出去的,这对调用方会带来非常大的业务问题(有预算却永远发不出去)。


因此在权益系统里面,针对业界常规的分桶方案进行了一个升级,实现了一套渐进式分桶的方案。库存架构上有一个主桶和多个分桶,根据业务状态渐进式从主桶中把库存分配到分桶中,而非一次性全部分配出去。这样既能解决高并发写带来的热点问题,又能规避方案引入带来的业务和运维问题。


上面是两个比较典型场景的高可用设计,很多时候都需要基于业务背景的考量去寻求最佳的解决方案。


▐  数据化&智能化


数据化&智能化的概念在13年业界就已经提出了,我们在13年已经开始做摸索,主要是优化业务流程,降低人工投入成本,提高业务效率和效能。目前有两种形式。

一种是数据辅助运营。算法根据业务经验,基于一定的业务目标构建出一系列的算法模型。产品技术侧将这些算法模型应用到业务流程里面,辅助运营进行业务决策。例如活动审批、商品圈品、权益投放等等。在过程中,结合运营行为和业务结果形成正负反馈,不断迭代优化模型结果。通过这样的单个业务节点的数据算法赋能,运营的个人经验能够形成了算法、产品维度的系统沉淀,不断提升业务效率和结果。

一种是自动化运营。在上一种方式的基础上进一步探索,将数据和算法的能力扩展到全流程,由算法和产品规则驱动整个流程自动化运转。
以下是以营销频道招商为例简单介绍下数据化运营是如何实现的。
首先运营定义出营销频道的业务目标,数据算法基于消费者需求和行业洞察,根据业务服务的人群和业务目标,智能构建业务的品类规划。
运营确认和修正后,发布招商活动入口。
商家报名时提交营销方案(包括商品、权益、素材、意向时间等)。
报名的商品经过人工和算法审核进入入围池,智能排期系统以品规为依据,通过数据模型进行择优,再根据业务目标、商家意愿度因素,通过排期算法模型自动产出排期结果。
最后经商家确认后,完成排期确认最终到用户端生效。最后,在营销产品正式售卖结束后,整体运营效果,反馈到算法品规、算法审核、算法排期等环节形成反馈链路。
相比传统链路,数据化的链路释放了60%以上的运营精力,另外在供给上也更加稳定,提升了业务效果。



  前沿技术探索


关于前沿技术探索,我们更多的是关注与业务的结合点。


品牌营销、事件营销中有很多互动玩法的场景,用3D场景去承接能获得更好的效果。面对3D场景研发成本和周期长的问题,我们把互动玩法抽象成几种类似场景,例如品牌虚拟空间,虚拟形象养成。针对特定的场景,进一步细粒度的抽象出空间、组件和素材。再结合3D底层渲染引擎的规范,实现3D场景的构建。这跟上面提到的平台化抽象的思路类似,但是不同的是需要对3D建模和3D引擎有比较深入的理解,才能实现业务侧的编排。



而本轮AI技术爆发,我们看到了新技术在营销场景大量应用的潜力,也开始做一些尝试。


在商家素材提交场景中,为了适配因多个导购场景需要产生的多种图片尺寸规范。针对这种场景,我们在素材中心引入了AIGC的技术,实现了图片的智能剪裁。商家只需要提供一个图片素材,系统会自动帮助他们生产多种图片尺寸,目前仍在灰度和调优中。



另外在今年造物节,我们基于AIGC技术为用户带来更有新鲜感、创造性的营销互动玩法。



下一步做什么?


最后提到AI技术应用,上面提到的只是一些探索,只是敲门砖,营销场景中有大量应用机会。
  1. 从商家角度 ,仍然有很多环节靠“人”驱动的,上面提到素材制作也仅仅是解决了多尺寸素材的问题,像多场景图生产、店铺封面等制作仍然需要去突破。
  2. 从用户角度 ,原来用户需求的表达,都是基于货相关的。而大模型突破了这层的限制,可以承接用户自然语言表达的需求,从现在的个性化到定制化。我们有可能突破现有的场的交互形式的产品,实现真正面向每个人的营销场,带来转化和复购大幅提高。
  3. 从运营角度,更精准的用户意图理解、更宽泛的货和内容理解,意味着可以更高效地进行供需匹配。原有的数据辅助运营体系有可能进一步突破。

同时,用户体验依然是关键。

结合商业策略升级现有的产品链路,让业务可以提供更多的好货好价;通过技术架构层面的升级,让用户更清晰有效地感受到价格优惠。例如通过导购、交易等全链路价格表达架构升级,进一步提升价格一致性、确定性和表达方式。

最后,我们还会持续关注业务效率的提升,实现成本的降低和效率的提高。例如,我们上文提到的会场模块的“无代码生产”、大促自动化和3D互动玩法搭建等方面会进一步升级和完善,覆盖更多的业务场景。

欢迎加入

以上就是营销技术的简单介绍,由于篇幅有限,很多细节没法详细说明。如果你对上面业务场景和技术问题感兴趣,希望在评论区和我们做进一步交流,也更希望邀请感兴趣的技术同学们加入我们,一起参与建设和创造新商业的前沿阵地。


感兴趣的同学们可以直接投简历到这个邮箱:[email protected]


¤  拓展阅读  ¤

3DXR技术 |  终端技术 |  音视频技术
服务端技术  |  技术质量 |  数据算法


本文分享自微信公众号 - 大淘宝技术(AlibabaMTT)。
如有侵权,请联系 [email protected] 删除。
本文参与“OSC源创计划”,欢迎正在阅读的你也加入,一起分享。

博通宣布终止现有 VMware 合作伙伴计划 deepin-IDE 版本更新,旧貌换新颜 周鸿祎:鸿蒙原生必将成功 WAVE SUMMIT 迎来第十届,文心一言将有最新披露! 养乐多公司确认 95 G 数据被泄露 2023 年各编程语言中最流行的许可证 《2023 中国开源开发者报告》正式发布 Julia 1.10 正式发布 Fedora 40 计划统一 /usr/bin 和 /usr/sbin Rust 1.75.0 发布
{{o.name}}
{{m.name}}

Guess you like

Origin my.oschina.net/u/4662964/blog/10149406