A perennial favourite - lots of SDET’s will be familiar with middle/senior managers dropping in to ask for cold hard metrics on coverage, time saved, failure rates, bugs found etc… These are all valid questions but what I find hard to impress on managers who are less technical is just how hard it is to assess some of these metrics.
There seem to be a bewildering array of tools out there that support discovery of such metrics (TestRail, Katalon, Lambdatest, Browserstack…) but I’m looking for ideas around what approaches people have taken in this area and what tooling they have found to be really powerful. Managers always want snappy one-liners and infographics - I’m investigating tooling that can give us the ‘big data’ over time that will be really powerful.