Eclipse OpenJ9 is an open source, industrial-scale JVM built on top of the Eclipse OMR language runtime framework. Benchmarks are core part of monitoring code contributions to the project to avoid performance regressions and to ensure that expect performance gains are realized. In this talk I will discuss the different aspects of performance that the project monitors on a regular basis, how we select benchmarks for monitoring, properties of some of the key benchmarks we use to measure performance, and how we are trying to make performance measurement a first-class citizen in our open code review process. I will also touch on some of the techniques we use when trying to produce minimized micro-benchmarks to recreate performance problems for easier investigation.