With the latest openAI trendy about “ChatGPT”, I’m curious to know your opinions about it, do you think it could improve your testing tasks?
In my opinions, it could be effective in testdata generation, in devops pipeline technical tasks, maybe giving new testing ideas that could be added to exploratory testing…
I also have more questions for you,
- How can we become more productive using its hacks and (sometime smart) replays ?
- What are the new tasks that could be easily automated with chatGPT ?
- What new challenges we could encounter in the future as testers ?
- Shall we also include them into our testing strategy?
I’ve used it to read the long article for me and provide me a short summary, it’s fairly accurate but a little too literal sometimes, but still it seems useful. Maybe the next thing to try is to have it generate some test data!
It can struggle with test data. Also math. And it does it with authoritative confidence as well. Check out some of these sweet birthdates.
that’s shocking ! 45 day or month of birth
Looks like the sort of progression I was using to create test datasets 25 years ago when I was working in utilities regulation - though those were for numbers like “Length of water mains refurbished” and “Number of properties connected to mains”, and the progression was over time. And I knew what the likely upper and lower limits of each data point were.
This got interesting where one client started falsifying their data returns and were providing numbers with similar progressions to my test dataset as their live data. As real-world pricing decisions were based on this data return, there were consequences (a £35 million fine and an investigation by the Serious Fraud Office).
Which suggests a use for an AI system, albeit more in validation than in testing: using ChatGPT output as a benchmark against which future data submissions might be compared. If the progression patterns within the submitted data was too close a match to a ChatGPT “benchmark” dataset, the system would raise a flag. Especially useful if the dataset has something like 40,000 data points, like the one I was working on.
To be fair, it’s not October 2025 yet. We could get a 55th of the month by then. I’m not willing to say it’s impossible.
I did not use it for that. I will give it a try.
that’s a good point ! talking about blogs I’m also thinking to make a serious interview with chatGPT and then comment about the result in a funny way
BTW, chatGPT has funny jokes to tell
a bonus for @mirza
I love those explanations!
OMG, what a great idea! I’m going to steal it
I used it to help me get started with the code for API tests, it worked pretty well actually. Not sure how it would work for complex scenarios, though.