Auto Analysis in Report Portal...any feedback?

Discussions
,
1

I am trying to understand the scope of the auto analysis provided by Report Portal and was looking for feedback from other people’s experience.

As I understand it, the data source is the log for each test execution. However, this could be quite limited, especially as it will be from the view of the test rather than the AUT.

In a UI test, i could imagine a scenario which could be the manifestation of many issues.

e.g.

Symptom: Test fails due to being unable to find control in UI

Potential causes ; slow response from server, incorrect data returned from server, screen slow to render etc…

Assuming that the test log is consistent for all these causes, how would AI help me in this case?

If I were to attach more rich data as attachments such as HAR, HTML at failure, websocket traffic, etc, would RP also analyse these too?

I would love it to be able to correlate say a HTTP error in the HAR file to a missing control in the UI.

Is this too advance for RP?

2 Likes
2

It seems it’s a quite basic automatic analysis of log errors types’ (each log should be with level Error and higher (log level >= 40 000))’
So maybe you could control in advance the error type, level of error, and exception message for all failures you might expect, to obtain what you want in the analysis.

1 Like
3

Thanks for that link,

Yes it seems very basic and I wasn’t aware it was only looking at error logs and no other heuristics around it. The info logs that lead up to the error logs could be just as useful as the error log itself.