I’m a graduate student completing my thesis on test automation, and I need help from experienced testers to evaluate a research prototype.
What I’m researching: A tool that generates test cases from natural language descriptions. I need feedback from people who actually write tests to evaluate whether the output is useful, complete, and catches real issues.
What you’d do:
Install a Chrome extension
Use natural language prompts to generate tests for a sample application
Provide feedback on test quality, coverage, and whether you’d actually use something like this
Time: ~25 minutes, completely remote, on your own schedule
Why participate:
Contribute to academic research on test tooling
Shape how these tools are evaluated and developed
What I need from you:
Experience writing tests (manual or automated)
Ability to evaluate whether generated tests are actually good
Access to Chrome on desktop
If you’re interested the website in questions is testhelix.com and the end if you could please fill out this google form, Participant Consent & Acceptance, that would be greatly appreciated.
Are you also communicating with all the commercial organizations doing the exact same research? I only ask as I would be reluctant to do unpaid dev work, personally
For a half hour task, it’s not really “homework”, might log in tonight in a trash-eable browser since I’m at work right now. Worth it as a thought experiment instead of playing counterstrike all evening, probably much more enlightening. Who am I fooling, let’s hope I remember.
That’s a fair question and no I am not. This is just part of a university Master’s thesis where I am the sole researcher, not a commercial project or a data collection effort for a company. Nobody’s work is being used to build or train anything, and nothing people enter is used beyond the anonymous research results.
I’m posting it in a few developer communities because I need a mix of real world perspectives, not just people from one company or one tool. The goal is simply to see whether a prompt driven approach is faster compared to traditional methods.
Hi @wake049! Welcome to MoT Club! This sounds really cool. I can’t promise anything but my curiosity is piqued. I will evaluate my schedule and see what I can offer you. I’m curious to hear what you find, though! Would love an update on your project!
Yeah, unfortunately there is still a lot of bugs but the main functionality of gathering elements and creating test should still work and thats all I am really asking anyone to focus on. Thanks for reporting it though!
I’m can try from another PC, if that helps, quite keen to always give early feedback on apps. I review computer games on my weekends (or at least try to) and I mostly get into pre-release copies because that can help shape early bug-fixes. So yeah I like to jump on things. My home computer is behind a NAT firewall, so I thought that might be a problem, it generally is not, so wanted to check.
The thing the chrome extension did that was most confusing is that it does not maintain state if you click to a different browser tab, or if you click onto a notepad so you can note takes, the extension closes and you have to start all over again. Will do the survey anyway, since that will give you a data point.