Docker+Jmeter+InfluxDB+Grafana to build a performance monitoring platform

With the rapid development of the Internet today, the performance monitoring of applications is becoming more and more important. Docker+Jmeter+InfluxDB+Grafana is a common performance monitoring platform that can help developers quickly build a reliable monitoring system. In this article, we will introduce how to use these tools to build a performance monitoring platform so that developers can quickly find and solve application performance problems.

01 Docker installation and configuration

First, we need to install Docker. Docker is an open source containerization platform that packages applications together with all the components they depend on. This ensures that the application can run in any environment, and there will be no problems due to differences in the environment.

The process of installing Docker is very simple, just execute the following command:

sudo apt-get update

sudo apt-get install docker.io

After the installation is complete, we can verify that the installation was successful with the following command:

docker --version

If the Docker version information is output, the Docker installation is successful.

02 Jmeter performance testing tool installation and configuration

Next, we need to install Jmeter.

 Jmeter is an open source Java application for performance testing of web applications.

The process of installing Jmeter is also very simple, just execute the following command:

sudo apt-get update

sudo apt-get install jmeter

After the installation is complete, we can verify that the installation was successful with the following command:

jmeter --version

If the Jmeter version information is output, it means that Jmeter is installed successfully.

03 InfluxDB database installation and configuration

InfluxDB is an open source time series database for storing and querying time series data.

It is a very popular performance monitoring platform because it can easily handle large amounts of time series data.

The process of installing InfluxDB is also very simple, just execute the following command:

sudo apt-get update

sudo apt-get install influxdb

Once installed, we can start the InfluxDB service with the following command:

sudo service influxdb start

We can then verify that the startup was successful with the following command:

sudo service influxdb status

If the output is active (running), it means that InfluxDB started successfully.

04 Grafana visualization tool installation and configuration

Finally, we need to install Grafana. Grafana is an open source visualization tool for presenting time series data.

The process of installing Grafana is also very simple, just execute the following command:

sudo apt-get update

sudo apt-get install grafana

Once installed, we can start the Grafana service with the following command:

sudo service grafana-server status

If the output is active (running), it means that Grafana started successfully.

05 Build a performance monitoring platform

Now that we have installed all the required tools, we can start building the performance monitoring platform.

• Create an InfluxDB database

First, we need to create an InfluxDB database to store the performance data generated by Jmeter. Log into InfluxDB with the following command:

influx

We can then create a database called jmeterdb with the following command:

CREATEDATABASE jmeterdb

• Configure Jmeter

Next, we need to configure Jmeter to write performance data to the InfluxDB database.

First, we need to install the Jmeter Plugin Manager. Plugin Manager is a Jmeter plugin that makes it easy to install other plugins. Download the plugin manager with the following command:

wget https://jmeter-plugins.org/get/ -O /tmp/plugins-manager.jar

We can then start the plugin manager with the following command:

jmeter -g /tmp/plugins-manager.jar

Next, we need to install the InfluxDB plugin. Use the plugin manager to search for the InfluxDB plugin, then install it. After the installation is complete, we need to configure the InfluxDB plugin. In Jmeter select Options > InfluxDB Graphite Backend Listener and enter the following information:

• InfluxDB host：localhost

• InfluxDB port：8086

• InfluxDB database：jmeterdb

• InfluxDB user: (leave blank)

• InfluxDB password: (leave blank)

• Create a Grafana data source

Next, we need to create a Grafana data source to read performance data from InfluxDB.

Open Grafana in a browser (the default port is 3000), and log in with the default username and password (admin/admin). Choose Configuration > Data Sources, then choose Add data source.

Select InfluxDB in Type, and enter the following information:

• Name: any name

• URL：http://localhost:8086

• Database：jmeterdb

Choose Save & Test, and wait for the test to complete. If the test is successful, the Grafana data source configuration is complete.

• Create a Grafana panel

Finally, we need to create a Grafana dashboard in order to present performance data.

Choose Create > Dashboard, then choose Add panel.

Select Graph in Visualization, then select Panel Title and enter any name. Select Metrics, then select Data source and choose the data source we created earlier. Enter the following query in Query:

SELECT mean("aggregate_report_median") FROM "jmeter" WHERE $timeFilter GROUP BYtime($__interval) fill(null)

Then choose Apply, then choose Save Dashboard and enter any name.

Now we have successfully built a performance monitoring platform. Run performance tests in Jmeter and view performance data in Grafana.

06 Optimization and expansion of performance monitoring platform

We have successfully built a performance monitoring platform, but it can still be optimized and extended.

• Optimize InfluxDB configuration

The InfluxDB default configuration may not be suitable for high load situations. You can edit the /etc/influxdb/influxdb.conf file to optimize the configuration.

For example, you can increase max-connections and max-concurrent-queries to improve InfluxDB throughput and response time.

• Optimizing the Grafana configuration

Grafana's default configuration may not be suitable for high load situations. You can edit the /etc/grafana/grafana.ini file to optimize the configuration.

For example, you can increase max-concurrent-datasource-requests to improve Grafana's throughput and response time.

• Add more data sources

You can add more data sources to get performance data from different systems.

For example, you can add a data source that extracts response times from Apache logs to compare Jmeter and actual response times.

• add more panels

You can add more panels to monitor performance more comprehensively. For example, you can add a panel that shows the distribution of response times for different requests.

• Deploy to the cloud

You can deploy the performance monitoring platform to the cloud to monitor performance anytime and anywhere. You can use cloud computing services like Amazon EC2, Microsoft Azure, or Google Cloud Platform.

07 Summary

Through this article, we learned how to use Docker, Jmeter, InfluxDB and Grafana to build a performance monitoring platform. The platform helps us monitor application performance in real time, optimize and scale. By optimizing the configuration of InfluxDB and Grafana, adding more data sources and panels, and deploying the platform to the cloud, we can monitor performance more comprehensively and find and solve problems in a timely manner.

Finally: The following complete software testing video learning tutorial has been sorted out and uploaded. Friends can get it for free if they need it [Guaranteed 100% free]

Software Testing Interview Documentation

We must study to find a high-paying job. The following interview questions are the latest interview materials from first-tier Internet companies such as Ali, Tencent, and Byte, and some Byte bosses have given authoritative answers. Finish this set The interview materials believe that everyone can find a satisfactory job.