There is no single answer for this. So I asked my team this very question to see what quality is for them in the context of check automation, and this is what I gathered (in no particular order):
- Zero false positives (always re-run and verify failures before flagging them to maintain trust in the suite)
- Result consistency (check should yield the same results unless the app behavior changes)
- Fast feedback (reduces context switching and speeds up response time)
- Coverage Depth (prioritizing high-value business cases over broad, shallow checks.)
- Checks Logging and Readability (clear intent and useful logs to make debugging easier and faster)