I appreciate the insight here. It definitely makes sense that the simpler the job, the less complex of a toolset one would want.
Permutations is another interesting idea thoughā¦. It seems like a visual modeler that generates and tracks permutations could be useful. (Something like a mind map but with a little more logic behind it?)
Itās largely the templating and quick note taking using markdown. I started using it for personal projects, the get away from wiki style knowledge management, and it just sort of filtered into my professional day to day.
Next week, October 12th, Iāll be delivering a workshop for MoT open to the community around this theme and this tool, if you want feel free to participate!.
You donāt need Jira nor Xray (a test management tool for Jira) to use it.
Dennis from Testmo here. I just wanted to mention that some test management tools also already include built-in support for exploratory test sessions. If exploratory testing is an important part of your testing efforts (like for most teams nowadays), you might benefit from using a tool that supports test sessions natively, so you donāt need to import/convert things to test cases or similar.
E.g. in Testmo we include full exploratory test session support (with note-taking) besides manual cases & automation. We also show this in our video here. There are also other test management tools that have some support for test sessions as well. I would just make sure to choose a tool that supports this natively and doesnāt require any browser add-ons or downloads. You might also find our recently published list of additional exploratory testing tools interesting (it also lists Notion among other note-taking apps).
My only issue here is that I want the option to upload things to wherever I like natively without having to hack automation around a tool. (With the inevitable brittleness that brings.)
Likewise, some of the folks on this thread have given really good ideas about features that I donāt see in your app, so Iām keen to explore those.
I may attend your session though - Iām always keen to learn more about whatās out there!
My main issue here is that it isnāt a free tool and it locks me into a specific platform.
Generally, there seems to be an unfortunate amount of that in the test management space.
Iām likewise a huge fan of data portability and owning oneās data but when I look at the Testmo API, I donāt see the option to access any of the data programmatically. (Itās all POST and no GET!) Maybe there are better options for that in the UI?
Itās very cool that vendors are starting to get on board with exploratory testing though!
The reason professional test management tools cost money is that they are very time and resource intensive to develop & build (many many years), and vendors also need to invest to run & maintain them. But you can also find other note-taking apps in the above link and tools like Notion can be a good starting point (although Notion also costs money if you need non-basic features; itās just expensive to build software).
100% agreed, and this is an important aspect when I choose products as well. You can always export your full data to open JSON files, no API needed for this. Plus also CSV files for Excel etc. and more. Feel free to email or DM if you have any other questions.
Iām building an exploratory testing tool called Replayable that records your screen in the background. When you catch a bug or finish a test, you can upload the video and embed it wherever you want.
Would love to hear what you think and open to feedback! Email me at ian@replayable.io
Itās indeed a pleasure to see Exploratory Testing and its related tools being discussed.
The tools, as you rightly pointed out, could become a mishmash, or a jungle, if you will. I would always go with the definition of Exploratory Testing to start with, as it was coined back in 2008:
I would reckon that the tools that you build or use be better aligned with the definition and helps you explore in the context in which you are working with. As some wrote here, short notes or tools that help make short notes could be useful. The objective is to have something that would keep your mind engaged and attentive during the process, so that you can make progress with your learning, test design, test execution and test results interpretation in parallel, and of value.
Hope that helps, and all the best. Please do feel free to let me know of your opinions, feedback, and comments. Thanks & Regards.
I like the idea of using āExplorationā as a guide when thinking about potential features and UX. The core question for any decision should always be āDoes this help users explore better?ā
Not sure if you managed to attend the session but it was really interesting. Iām probably going to can my tool as the xray app looks really useful and pretty sure it can do everything i need but better. Possibly requiring a few extra clicks here and there but its really pretty powerful!
I didnāt get to catch it. (Family duties took precedence in that time slot!) Do you know if there is a recording?
But I did get a chance to look at the tool. I really like the directionā¦ (Their timeline idea and capture methods were spot on for what I was already working on.)
But it seems like itās been out for a while without a lot of material changes to it. Likewise, Iām not always working in the JIRA ecosystem. Meanwhile, Iāve got a ton of ideas (many thanks to everyone on this thread for some great ones!) and I am aiming to make it very open to the community to drive the direction that makes it most useful.
On my end, Iām probably a week or two out from releasing my tool (YATTIE) which covers a lot of the same ground.
Iāll let you know when I have something - Iād love your feedback!
Iād really appreciate that @simon_tomes! Iāll DM you and see if we can find a time.
This last week got busy and Iām traveling next week, but all the while Iām finding time to squash my last few bugs before YATTIE is ready to share.
Iām quite excited to get some community feedback!
@dacoaster I was able to build it and give it a try. Thereās a lot of work there I have to say. However, unfortunately, with the exception of mindmap feature, I found it to be a clone of Xray Exploratory App, having the same kind of UI, timeline concept, comments, actions. I was expecting something different.
Iāve had a chance to play with all three tools now and one thing that I think all three could benefit from is the ability to add a summary / tldr that goes to the top of the report when testing is completed.
I was using XRA over the past couple of days for testing a larger project and then provided links to the PDF reports to the team afterwards. My manager asked if it was possibly to have a summary and it was a fair point. From a quick look you canāt tell if thereās anything that needs attention. Obviously I could/should have said āNo defects foundā along with each of the links but it would have been handy to have an overall summary displayed at the top (perhaps immediately after the charter?).
When we developed TestBuddy we offered a summary feature.
User marks their session as complete
The UI automatically creates a section called Summary. It included an auto-count of all notes labelled with a PQIP (Problems/Question/Idea/Praise). Plus a space to add a manual text narrative.
When someone exported the session as a PDF it added the summary counts and summary description to the top of the report
Our customers liked it!
The tool actively encouraged a written summary. Folks could leave it blank if they wished though, and the PQIP counts would appear automatically.