Doubling the performance of road practice Hadoop MapReduce tasks

Author: Lee Wan snow, eBay software development engineer, graduated from Shanghai Jiaotong University in 2017. The current implementation is responsible for log analysis and opentracing on a large platform on ebay log data platform.

Original link: https://mp.weixin.qq.com/s?__biz=MzA3MDMyNDUzOQ==&mid=2650505625&idx=1&sn=374ae0fdf7b02cf3dfdd9180580204cb&chksm


Summary

eBay's CAL (Central Application Logging) eBay system is responsible for collecting log data for various applications, and job log report generated by Hadoop MapReduce, application developers and maintenance personnel can be obtained through the following report:

  • Percentile API call response time
  • Service call relationship
  • Database operations

eBay generates log CAL PB order of day,







Guess you like

Origin yq.aliyun.com/articles/740716