Martin Robinson 5e30ce8532 Filter unknown flaky tests when filtering known intermittents ... There are two kinds of flaky/intermittent tests in Servo. The traditional kind is the test that fails on the CI, but has an associated bug indicating that the test is an intermittent failure. Many of these tests have completely unstable results, for instance those where an unpredictable set of subtests fail. It's impossible to generate stable results for these, so we have traditionally simply discard these unexpected results. Another kind of intermittent test is one that will produce an expected result when rerun (ie will flake). Some of these are also labeled with bugs, while some are not. In some cases, there is flakiness in some core Servo functionality that can lead to *any* test flaking, such as a race condition that can lead to an early screenshot for reftests. When these kinds of tests do not have associated bugs, they cause the CI to fail. In this case, it is impossible to label these tests as intermittent because it can literally be any test. This change, reruns failed tests in order to detect unlabeled tests in the second category. Instead of blocking the CI when the second run leads to expected results, the CI will now pass, but the flake will be reported to the new flakiness dashboard. This prevents unrelated flakes from slowing down the merge queue.		2023-02-21 12:10:02 +01:00
..
ci	Filter unknown flaky tests when filtering known intermittents	2023-02-21 12:10:02 +01:00
doc.servo.org	Update MPL license to https (part 1)	2018-11-19 14:46:43 +01:00
layout_viewer	[Layout 2020] Adapt layout viewer to new box and fragment tree structs	2020-05-19 09:31:24 +02:00
taskcluster	Fix typos in markdown files	2022-01-14 16:46:10 -07:00
cert_generator.js	Update cert-generator and certs	2017-03-14 08:01:54 -07:00
cert_generator.sh	Apply format change to cert_generator.sh	2019-05-08 19:24:32 +02:00
crates-graph.py	Add a minimal alternative to cargo graph	2020-04-21 10:54:21 +02:00
jsdefine	Use #!/usr/bin/env bash in shell scripts for NixOS compatibility	2021-06-14 22:06:09 +09:00
memory_chart.html	Add tool to chart memory usage from reports.	2018-03-08 22:46:42 -05:00
memory_reports_over_time.py	Port some code to Python3	2021-02-18 09:35:46 -05:00
patch-trace-template.py	profile: Integrate the time profiler with the macOS signpost	2016-10-01 00:12:49 -07:00
profilicate.py	Add a sampling profiler and a script to generate profiles for use with Gecko tooling.	2019-03-26 16:35:08 -04:00
run_in_headless_android_emulator.py	com.mozilla to org.mozilla	2018-10-02 08:09:35 +02:00
rustdoc-style.html
rustdoc-with-private	Use #!/usr/bin/env bash in shell scripts for NixOS compatibility	2021-06-14 22:06:09 +09:00
servo.sb
servo_automation_screenshot.py	Fix remaining flake8 warnings	2020-06-21 03:34:32 +02:00
servo_gdb.py	Fix remaining flake8 warnings	2020-06-21 03:34:32 +02:00
shell.nix	chore(nix): replace pkgconfig with pkg-config	2022-10-07 01:40:54 +09:00
start_servo.py	Update getopts	2018-08-24 17:49:58 +02:00
unused_wpt_results.py	Add script to find unused WPT results.	2019-09-25 12:38:00 -04:00
valgrind-memcheck.supp
wpt-summarize.py	Fix remaining flake8 warnings	2020-06-21 03:34:32 +02:00
wpt-timing.py	Fix remaining flake8 warnings	2020-06-21 03:34:32 +02:00
wpt_result_analyzer.py	Add explanatory comment for wpt_result_analyzer.py.	2019-11-22 13:23:43 -05:00