Commit Graph

3 Commits

Author SHA1 Message Date
Miro Hrončok
6ac9ed170a acceptable_failure_rate.patch: Don't use pytest private API
The private API used here was removed in pytest 5.
There is a public API now, pytest.ExitCode.TESTS_FAILED,
however that is not yet available in pytest 4.

We hardcode the value 1 instead, it is unlikely to be changed.
Once pytest 4 is gone, we can switch to the new API.

See https://github.com/pytest-dev/pytest/issues/5125
2020-01-02 16:22:28 +01:00
Charalampos Stratakis
98a80e211d Update to 1.2.0 2019-02-07 00:43:31 +01:00
Miro Hrončok
2b99813d54 Don't ignore the tests results but rather have a tolerance rate
Historically, we ignored the test results as we don't have the
manpower to investigate the failures on various architectures.

Since most of the test pass, I've added a 1% failure tolerance
on everything except x86_64, so we do no longer need to ignore the
results. This makes it easier to spat that it's no longer a couple
test that fails on some random architecture but rather a more
severe problem.

In the process I had to disable test_decomp on ppc64le, because it
segfaults.
2018-06-23 23:00:13 +02:00