What tools do you use to aggregate test results?

1 pointsickyforce5y ago3 comments

I'm looking for a tool which would present results of automated system tests that talk to a real environment via API. Think E2E but without UI. Ideally I'd like to use a standard framework for such tests (like junit, jest, rspec) and upload the results somewhere. Devs would be able to browse them, filter by environment, version and other tags, view logs or attached comments, see execution history for a single test and maybe some basic reports.

I've found https://reportportal.io/ which seems like an ideal fit but will be complex to manage (microservices + postgres + rabbit + elasticsearch). TestRail might be good, will need to evaluate it, although it's more expensive than I would expect. I think that TeamCity has a decent view of test results but it's a full-blown CI system, more than I need.

Is there some other tool that you'd suggest? Preferably a managed offering.

3 comments

3 comments · 2 top-level

forgotmypw175y ago· 1 in thread

what about, now wait, hear me out:

   test_results/timestamp/framework/enviro/version/log.txt

example:

    test_results/1610687003/junit/prod1/1234abcd/log.txt

You can browse, filter, view logs and comments, see history for a single tests.

If you want to build reporting on top of text files, pick one of out of a million tools which accept them as input.

No management, no microservices, no database, and easy to archive and compress, de-archive.

ickyforceOP5y ago

> If you want to build reporting on top of text files

The thing is - I don't want to build it (in this case a bunch of scripts that would parse and manage these logs). I want to use something that exists.

jordhy5y ago

SauceLabs, TestNG, etc

j / k navigate · click thread line to collapse