Hi all,
I’m a Test Lead and the only QA in my team, so I’m looking for something that one person can set up and keep going.
I’m trialling Datadog Synthetics (including Bits AI) for UI test automation. I’m running it alongside Playwright on the same web sign-up journey, so I can compare the two. It works, but I’m not convinced yet that it’s the right long-term choice.
I’d love to hear from anyone who has used it beyond a trial:
- How does it hold up as the number of tests grows - maintenance, flaky tests, test data?
- How do you handle logins with OTP or MFA?
- Have you got it running in your CI/CD pipeline?
- Has anyone used it for mobile app testing?
- Do you keep your tests in code (version control, reviews), or only in the Datadog UI?
- How useful has the AI side been in practice?
- If you moved away from it, what made you switch?
Good and bad experiences are both welcome. Thanks!