Hi community, first time posting so please be kind.
Just a bit of background, I came from traditional orgs with waterfall methodologies following agile principles. Now I have moved into a scale up / start up with DevOps / Lean methodologies with 2-week sprint releases.
To speed up our automation, we have re-factored our automation tests from Selenium to Cypress and oh boy, it was significantly faster and quicker to create / troubleshoot test scripts.
Now comes the test case management tool, which at this stage, is more of a nice-to-have since our test cases are basically our Cypress spec files and our test result reporting is TeamCity, which is our CI/CD tool. We map our test scenarios via JIRA stories as acceptance criteria.
Our management has given us a go-ahead to PoC some tools, with obvious justifications before we procure the decided tool. I have used Zephyr (and ZAPI) to automate our Selenium test scripts and results generated in JIRA in my previous stint (It even creates a unique JIRA Bug when a run fails). I’ve heard good reviews on XRAY as well. We basically shortlisted between these two tools (We decided to make it a JIRA plug-in for easier automation and more centralised).
Can people share experience on both these JIRA plug-ins and what makes the other different?
Also, the reason looking for a test case mgmt tool at this stage is because of the following:
- No need to collaborate as we only have 2 QA’s against 8 devs so we can just chat / discuss what the test scenarios are or who is working on which test script to automate.
- Only two test environments
- Reporting or failed scripts are already recorded in TeamCity builds.
However, we want to be prepared as there is a high chance of the team growing and usually, when the team scales, it gets a bit too late and these things get buried in the tech debts.