高版本springcloud sleuth+zipkin+rabbitmq+ES 微服务链路追踪,还是有几个坑哎

一、用来干嘛的

微服务运用较多,相互调用可能错综复杂,springcloud sleuth+zipkin+rabbitmq+ES可以帮助定位问题,分析各个服务性能瓶颈,快速了解整个服务调用过程

二、了解原理,虚线外部分一般springcloud sleuth实现,zipkin将链路数据通过http或mq发送到ES或MySQL

一个链路一个traceId多个跨度spanId(第一个spanId=traceId),可以自定义跨度,前一个spanId是后一个的parent,维系调用顺序。如图上一行的server received(SR)事件对应下一行的则是server sent (SS)事件(或相反),client sent (CS)对应client recieved(CR)事件(或相反),且上下行spanId对应,整个过程traveId不变。spanId=A的server receive时间与spanId=A的server sent时间差为调用耗时。springcloud-sleuth大致原理是这样的:也是扫描spring.factories里一些配置类实例化一些特殊bean实现链路追踪,有十余个配置类,这里简单看几个

TraceAutoConfiguration->主要配置了一个Tracing对象到spring
TraceWebServletAutoConfiguration->设置自定义请求头traceID,spanID,这是为什么traceID,spanID能跨服务器传递的原因,而同一进程内能够自由获取到traceID,spanID就是threadlocal的作用了
TraceSchedulingAutoConfiguration ->通过aop切入@Scheduled注解的方法来记录spanid等,
TraceFeignClientAutoConfiguration同上
TraceZuulAutoConfiguration以拦截器方式获取请求中获取请求头中的span等

 

三、集成步骤

先整合log4j2,@link https://mp.csdn.net/postedit/88916349log4j2    异步日志总结

,关键是日志pattern配置pattern="%d{yyyy-MM-dd HH:mm:ss.SSS} [%t] %-5level [%logger{50}:%L] [%X{X-B3-TraceId},%X{X-B3-SpanId}] - %msg%n" ,然后每个服务添加依赖,重启即可看到traceID与spanID.,需要配置类zipkin URL等相关配置

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>
每个服务的主配置都要配置,通过http上传链路数据
spring.zipkin.base-url=http://localhost:9411
spring.zipkin.enabled=true
spring.sleuth.sampler.probability=1

四、zipkin-server

网上找了一些资料想直接搭一个zipkin-server,网上找了一些资料都是整合的低版本springboot。这里有最新版本=>最新zipkin-server,需要其它版本可修改URL中的版本参数。直接启动jar包,默认端口9411。浏览器访问:http://localhost:9411/zipkin/

五、使用rabbitmq/kafak收集数据,ES储存数据

1、自己搭建zipkin-server,实现从rabbitMQ收集数据,ES储存数据

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/>
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>zipkin-server</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>zipkin-server</name>
    <description>zipkin-server</description>

    <properties>
        <project-name>zipkin-server-stream</project-name>
        <spring-cloud.version>Finchley.SR2</spring-cloud.version>
        <zipkin.version>2.11.9</zipkin.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-server</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 使用消息的方式收集数据(使用rabbitmq) -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-collector-rabbitmq</artifactId>
            <version>${zipkin.version}</version>
        </dependency>

        <!-- 支持Elasticsearch 2.x - 6.x -->
        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-storage-elasticsearch-http</artifactId>
            <version>2.8.4</version>
        </dependency>

        <dependency>
            <groupId>io.zipkin.java</groupId>
            <artifactId>zipkin-autoconfigure-ui</artifactId>
            <version>2.11.12</version>
        </dependency>
        
    </dependencies>
    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>
    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

</project>

2.配置文件,入口类开启@EnableZipkinServer

server.port=9411
spring.application.name=zipkin
management.metrics.web.server.auto-time-requests=false
#rabbitmq采集数据
zipkin.collector.rabbitmq.addresses=127.0.0.1:5672
zipkin.collector.rabbitmq.password=guest
zipkin.collector.rabbitmq.username=guest
zipkin.collector.rabbitmq.queue=zipkin  #不可自定义

#ES存储数据
zipkin.storage.type=elasticsearch
zipkin.storage.elasticsearch.cluster=elasticsearch
zipkin.storage.elasticsearch.hosts=192.168.199.128:9200
zipkin.storage.elasticsearch.index=zipkin #可自定义
zipkin.storage.elasticsearch.index-shards=3
zipkin.storage.elasticsearch.index-replicas=0

3.各个被监控微服务client端基本依赖

<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
         xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
    <modelVersion>4.0.0</modelVersion>
    <parent>
        <groupId>org.springframework.boot</groupId>
        <artifactId>spring-boot-starter-parent</artifactId>
        <version>2.1.1.RELEASE</version>
        <relativePath/> <!-- lookup parent from repository -->
    </parent>
    <groupId>com.jwolf</groupId>
    <artifactId>jwolf-ordercenter</artifactId>
    <version>0.0.1-SNAPSHOT</version>
    <name>jwolf-ordercenter</name>
    <description>order center</description>

    <properties>
        <java.version>1.8</java.version>
        <spring-cloud.version>Greenwich.RC2</spring-cloud.version>
    </properties>

    <dependencies>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-web</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-eureka-client</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-ribbon</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-openfeign</artifactId>
        </dependency>

        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-actuator</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-netflix-hystrix-dashboard</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-test</artifactId>
            <scope>test</scope>
        </dependency>
        <dependency>
            <groupId>com.jwolf</groupId>
            <artifactId>jwolf-usercenter</artifactId>
            <version>0.0.1-SNAPSHOT</version>
        </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-starter-sleuth</artifactId>
        </dependency>
        <dependency>
             <groupId>org.springframework.cloud</groupId>
             <artifactId>spring-cloud-starter-zipkin</artifactId>
         </dependency>
        <dependency>
            <groupId>org.springframework.cloud</groupId>
            <artifactId>spring-cloud-stream-binder-rabbit</artifactId>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <!-- 排除自带的logback依赖 -->
                <exclusion>
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>

        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter</artifactId>
            <exclusions>
                <exclusion>   <!-- 排除自带的logback依赖 -->
                    <groupId>org.springframework.boot</groupId>
                    <artifactId>spring-boot-starter-logging</artifactId>
                </exclusion>
            </exclusions>
        </dependency>
        <dependency>
            <groupId>org.springframework.boot</groupId>
            <artifactId>spring-boot-starter-log4j2</artifactId>
        </dependency>
        <dependency><!--log4j2异步支持-->
            <groupId>com.lmax</groupId>
            <artifactId>disruptor</artifactId>
            <version>3.3.6</version>
        </dependency>
        
    </dependencies>

    <dependencyManagement>
        <dependencies>
            <dependency>
                <groupId>org.springframework.cloud</groupId>
                <artifactId>spring-cloud-dependencies</artifactId>
                <version>${spring-cloud.version}</version>
                <type>pom</type>
                <scope>import</scope>
            </dependency>
        </dependencies>
    </dependencyManagement>

    <build>
        <plugins>
            <plugin>
                <groupId>org.springframework.boot</groupId>
                <artifactId>spring-boot-maven-plugin</artifactId>
            </plugin>
        </plugins>
    </build>

    <repositories>
        <repository>
            <id>spring-milestones</id>
            <name>Spring Milestones</name>
            <url>https://repo.spring.io/milestone</url>
        </repository>
    </repositories>

</project>

4.client端配置

spring.sleuth.sampler.probability=1
spring.sleuth.web.client.enabled=true
spring.zipkin.enabled=true
#spring.zipkin.base-url=http://localhost:9411   默认web http方式上传,改用mq异步方式
spring.zipkin.sender.type=rabbit
spring.rabbitmq.addresses=localhost:5672
spring.rabbitmq.password=guest
spring.rabbitmq.username=guest
spring.rabbitmq.port=5672
spring.zipkin.service.name=${spring.application.name}

5.ES效果预览,睡觉!

五、点到即止:也可以不自己单独搭一个rabbitmq上报链路信息,es存储信息的zipkin-server.

可以直接log4j2直接上报到logstash或日志落地后上传到logstash,或rabbitmq到logstash或filebeat读取日志文件到es(或logstash)

猜你喜欢

转载自blog.csdn.net/qq_39506978/article/details/88912365
今日推荐