Hi Ali,
This is a good question when doing automation testing.
Below are some criterials to measure automation success based on my experience:
- The framework is clear/logic/easy to use and enough power to catch log/result/reports, can integrate to other CI tools, ex: jenkins…
- The stable of written scripts
- The scope of automation testing? ( how many percents TCs automated? how scale the automation TCs covered?)
- Performance of automation test suite? (how long does it takes to run?, how much time we need to have the final result after a run?
- Can release the code with high quality at the submitted time.