Optimizing the generation of Java JMH Benchmarks

Abstract

The evolution of the software system during its development is a complex process, which is both very important and difficult to track. One of the methods that offers such functionality is microbenchmarking, which is a type of regression testing. Although its efficient at software project performance measurement and tracking, its also rather difficult to conduct and therefore rarely used in industry. In this study, several potential optimization approaches are applied to the benchmarking process in open-source projects in order to make it less complex and applicable to real-world scenarios, improving its accessibility for software engineering researchers and practitioners.