contest: collector: don't discard results with crashes due to instability

Some tests always fail but they may start to trigger crashes.
In that case we want to make sure the crashes / warnings are
noticed. Never filter out results with crashes based on stability.

Signed-off-by: Jakub Kicinski <[email protected]>

Author: kuba-moo

contest/results-collector.py

@@ -300,12 +300,18 @@ def filter_l1(test):
         # Defer filtering to L2
         if test.get("results"):
             return True
+        # Crashes must always be reported
+        if test.get("crashes"):
+            return True
         return (test['group'], test['test'], None) not in unstable[u_key]
 
     def trim_l2(test):
         # Skip over pure L1s
         if "results" not in test:
             return test
+        # Crashes must always be reported
+        if test.get("crashes"):
+            return test
 
         def filter_l1_l2(case):
             return (test['group'], test['test'], case['test']) not in unstable[u_key]