tests: Properly label and detect unexpected successes

Unexpected successes were being labeled as failures, which might be
related to [1]. This behaviour is indeed welcome - we want to detect if
tests are unexpectedly succeeding via test pipeline failures, however,
the current implementation of the simpletap did not properly implement
this.

[1] https://bugs.python.org/issue20165
This commit is contained in:
Tomas Babej
2020-12-05 19:28:33 -05:00
parent aa97cc7108
commit 095d51e479
2 changed files with 5 additions and 1 deletions

View File

@@ -56,7 +56,7 @@ if __name__ == "__main__":
timestamp = re.compile("^# (\d+(?:\.\d+)?) ==>.*$")
expected_fail = re.compile(r"^not ok.*?#\s*TODO", re.I)
unexpected_pass = re.compile(r"^ok .*?#\s*TODO", re.I)
unexpected_pass = re.compile(r"^not ok .*?#\s*FIXED", re.I)
skip = re.compile(r"^ok .*?#\s*skip", re.I)
ok = re.compile(r"^ok ", re.I)
not_ok = re.compile(r"^not ok", re.I)