I have used newrelic for this. We had a couple of things running regularly, but that one that stands out was a UI test (using playwright) we used for testing the log in and log out functionality. Proved a useful early indicator of issues more than once.
Where I am currently we have a combination of a postman collection run on a schedule and some in datadog. These all monitor apis.