Hi, Ministry of Testing community! Itβs Oleksandr
I am researching software quality metrics right now and how they affect project delivery.
As a part of my research study, I want to know which software quality metrics you are using. So, I am kindly asking you to fill out this anonymous survey.
The survey is not only for testers. Do not hesitate to fill out if you are a lead, manager, or developer. All responses are much appreciated!
I strongly advocate against the use of metrics in software testing because none of them are statistically valid, primarily because of non-fungibility, i.e. one bug is not the same as another in any respect, one test case is not the same as another in any respect, etcβ¦
Most metrics such as defect density are idiotic. I would discipline anyone I caught using these metrics and I would fire anyone caught using second-order metrics like defect escape ratio, which is one meaningless number divided by another meaningless number. I recommend you do two things:
Read everything that James Bach and Michael Bolton have written about metrics, and follow their advice.
Read Capers Jonesβ books on metrics. I had best not publicly repeat my private comments other than to say I have literally burst out laughing at some of his work, which I doubt was his intention.