Auto merge of #29746 - servo:always-run-layout-2020-in-main-workflow, r=atbrakhi

Run the Layout 2020 tests in main workflow

Also fix report_aggregated_expected_results.py which was reporting an error when there were no failing tests. This is more commonly an issue with Layout 2020 because if runs fewer tests and was causing builds to show up as failing even when they were not.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `___` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes do not require tests because they change the build infrastructure.

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->
This commit is contained in:
bors-servo 2023-05-17 14:45:28 +02:00 committed by GitHub
commit e09f85e17b
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 6 additions and 2 deletions

View file

@ -59,6 +59,7 @@ jobs:
uses: ./.github/workflows/linux.yml
with:
layout: '2020'
wpt: 'test'
build_result:
name: homu build finished

View file

@ -105,8 +105,11 @@ class Item:
def get_results(filenames: list[str], tag: str = "") -> Optional[Item]:
unexpected = []
for filename in filenames:
with open(filename, encoding="utf-8") as file:
unexpected += json.load(file)
try:
with open(filename, encoding="utf-8") as file:
unexpected += json.load(file)
except FileNotFoundError as exception:
print(exception)
unexpected.sort(key=lambda result: result["path"])
def is_flaky(result):