Iām exploring the huge quantity of automation tools based on record&playback/ codeless automation tools.
They are very interesting they are supposed to give the opportunity to build an automation framework in very few hours.
I have tried many tools and almost all of them can record correctly basic tests. However, when you try to record more complex web pages actions they donāt record very well.
Iām not a big fan of such tools myself, but I do admit that they can have their usefulness, if your SUT is not very large or too complex. When I was just learning Selenium I used the Selenium IDE browser plugin to record tests, then Iād export the test and check the code, after that I was trying to improve the test code by seeing how I can refactor it.
No they are all awful. They always have been and always will be. Donāt get sucked in by the marketing hype. I looked at the market again myself recently and the AI and self healing is still just hype.
For web stick with selenium, cypress or pupetter family of tools and hire good engineers, if you donāt have the skills in house.
The commercial tools are targeting enterprise companies which big wallets and low skills. You donāt want to be one of those guys. There is no independent reports of those approaches leading to any kind of successful outcomes. All the evidence is in favour Devs we writing automated tests possibly optionally with support from sdet.
I am encouraged, by folk like @enrico_gua signing up and asking such brilliant questions. Iām also keen to try make only one single point in every conversation, this post is my opinion, my experience, not fact. The world is full of āsolutionsā, and really not āsolutionā is 100% correct. My good experiences have been short, very helpful, but just short.
āNo codeā testing tools have their place, but depending on them in a mission critical product is not one of those places. Saying they are bad is probably a strong statement which would undermine a lot of the conversation around testing being about exploration and discovering actual true unbiased facts.
Some codeless tools recording workings can often teach you more about your app that you did not know.
They are a brilliant stepping stone. But ātrying to use one as as bridgeā, is sometimes like delivering chickens in the back of a Ferrari instead of in a truck.
Thank you for your post that allowed me to discover your interesting blog.
Well, about Microsoft Power Automate it will depend on the software that Iām supposed to test/automate, maybe it could be enough. And as you said, āas the solution grows proper coding features are indeed neededā
Anyway, thank you, I had never heard before.
I think itās true for most of the codeless tools, but maybe some of them could be enough for many companies where the productās UI is very simple and QA teams have low coding skills.
I have done many POCs with codeless tools and many were awful : sometimes you need to do loops and you canāt, some tools has this loop feature but itās even harder than doing directly in Java, things are not recorded properlyā¦ my conclusion was that the idea of creating automated tests quickly and be able to scale is great, but if the tool is not extremely good you should give up asap. Unfortunately, very few of them are good enough.
Iāve been using a codeless tool for about 3 years now, Iāve got pretty used to using it over that time. I donāt generally use the record and playback functions of it, however, I had a go on the site you linked to. I had two issues:
I didnāt notice that I could type my score on number 3, so the slider didnāt work, there is an option to drag the mouse, but typing is easier.
The combobox is weird and non-standard, I have to open it and pick the item from the list. This is instead of using the inbuilt control.
We use our tool to automate regression on large corporate systems such as Oracle Fusion and Banner - a student records system - I had something run earlier in the year to support a new curriculum build, it ran for over a hundred hours. With these systems if your strategy to define the elements and tags is sound you can create very reliable automation thatās never needed self healing and AI.
Iām building one of these no-code testing tools and have experimented with a ārecorderā and itās extremely nuanced and difficult to record actions accurately and successful implementation really depends on your app having well structured markup with unique elements and well labelled attributes for targeting.
Many people uses themes and kits which donāt have this, so itās hit or miss whether the recorder will work.
Because of this, Iāve settled on a UI builder instead and will probably eventually have a hybird model where you can use the recorder to get the initial steps down and then fine tune them later, but Iām finding users prefer to just build the tests manually using a flow-chart style UI.
I think this is true, in my instance I donāt trust what the recorder captures, so I always check and change it. The other thing about the recorder is itās just duplicating elements. An input field is an input field, thereās something unique about it and something thatās least likely to change , so you need to parameterise that uniqueness and use the ID or class or name or type.
TEST GEAR is best automation tools based on record and playback/codeless. I also using this tool for about 6 months and its working is very useful and time saving. I have used it to automate regression . Through TEST GEAR, you can easily automate the application in a very short period of time.