Open benchmarking in quantum computing

As quantum hardware continues to improve in terms of scale, quality, and speed, it is imperative that this progress be tracked via rigorous and transparent benchmarking. As quantum computations are inherently hybrid, this performance analysis necessarily needs to include the classical software used to implement algorithms that map, optimize, execute, and post-process quantum circuits. Although the focus of quantum benchmarks has been on hardware quality, software plays an equally important role, and the difference in implementations becomes readily apparent as qubit counts get higher, and techniques such as error mitigation become more commonly used. In this talk we will discuss efforts to create open-source frameworks for reproducible benchmarking of quantum software, focusing comparative analysis of quantum software development kits and abstract functions for algorithmic discovery.