I have been working on a framework project for more than a year. As a Scala framework, the framework has excellent performance. Therefore, we hope to introduce continuous performance testing, so that we can know every day whether the framework built by the latest code still maintains the original performance level.
As a continuous performance test, the automatic comparison of performance is a difficult point, and it is difficult to use a simple method to judge, otherwise false positive alarm or false negative alarm will easily appear. After performing data analysis on the data, I decided to use the method of mathematical analysis for automatic comparison.
For specific solutions, see http://blog.csdn.net/ebay/article/details/48805767