Commit graph

566 commits

Author SHA1 Message Date
Josh Matthews
1a8507cada
Clean up after some disk-space intensive builds. 2018-02-27 12:10:24 -05:00
bors-servo
8329a45163
Auto merge of #20112 - servo:jdm-patch-11, r=asajeffrey
Include non-upstream metadata changes in WPT sync.

The original sync work excluded changes to metadata files under tests/wpt/mozilla under the assumption that any change in test results indicated an existing intermittent issue. This is incorrect, because these tests rely on shared infrastructure with upstream, so the results can be influenced by syncing.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20112)
<!-- Reviewable:end -->
2018-02-23 13:55:06 -05:00
Josh Matthews
86e4fa50d3
Refine the set of directories that are checked during WPT syncing. 2018-02-23 12:58:56 -05:00
Josh Matthews
5b050d093e
Include non-upstream metadata changes in WPT sync. 2018-02-23 10:21:52 -05:00
bors-servo
f74451f039
Auto merge of #20107 - servo:jdm-patch-10, r=emilio
Clean more build artificats

This is the latest attempt in the war against disk space usage on the build machines.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20107)
<!-- Reviewable:end -->
2018-02-23 10:09:49 -05:00
Josh Matthews
878bf4ee6f Use CI script instead of ./mach clean
The script is more thorough that the mach command, which only wraps `cargo clean`.
2018-02-23 10:08:35 -05:00
Josh Matthews
0896fca5f0 Create script to easily remove existing CI build artifacts. 2018-02-23 10:08:35 -05:00
bors-servo
16bd067c6c
Auto merge of #20086 - servo:jdm-patch-6, r=aneeshusa
Add debug output to doc build.

This should narrow down the cause of https://github.com/servo/servo/issues/17243.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20086)
<!-- Reviewable:end -->
2018-02-22 14:36:17 -05:00
Josh Matthews
0fc667fcee
Use more periods. 2018-02-22 10:58:07 -05:00
Josh Matthews
47e0dab42a
Set CARGO_HOME for Windows builders.
This sets it to a directory that all relevant users can manipulate without any issues.
2018-02-20 22:02:01 -05:00
Josh Matthews
e3ab8b6d90
Add debug output to doc build.
This should narrow down the cause of https://github.com/servo/servo/issues/17243.
2018-02-20 12:05:33 -05:00
Josh Matthews
710baa4f6f
Clean target directories of linux builders.
This should avoid our frequent problems with running out of disk space on the smallest linux build machines.
2018-02-20 10:21:27 -05:00
Josh Matthews
c51505718b
Avoid duplicate error codes when opening WPT PR. 2018-02-11 22:09:48 -05:00
Josh Matthews
97b218d098
Propagate error code from fetching WPT changes. 2018-02-11 22:09:20 -05:00
Josh Matthews
298f70711c
Try to reduce instances of intermittent failures in nightly sync. 2018-02-09 10:26:35 -05:00
Josh Matthews
ee2ef627c8
Fix syntax error in WPT syncing script. 2018-02-01 23:10:45 -05:00
bors-servo
b5e5a99cb7
Auto merge of #19920 - servo:jdm-patch-10, r=aneeshusa
Supress output from git push in WPT sync.

Pushing to the remote exposes sensitive data in the logs of the job. The old token has been revoked as a consequence.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19920)
<!-- Reviewable:end -->
2018-02-01 18:09:55 -05:00
Josh Matthews
b003f5ad06 Supress output from git push in WPT sync. 2018-02-01 18:08:57 -05:00
Josh Matthews
910e9db277
Make the syncing PR a bit harder to mess up. 2018-02-01 09:53:56 -05:00
bors-servo
3e3e05c99d Auto merge of #19900 - paulrouget:dropcef, r=jdm
Drop CEF support

<!-- Reviewable:start -->
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19900)
<!-- Reviewable:end -->
2018-01-31 08:53:16 -06:00
Paul Rouget
2282292fa4 Drop CEF support 2018-01-31 06:36:21 +01:00
Josh Matthews
7dc38db13b
Double the sccache timeout.
Fixes #19907.
2018-01-30 11:58:03 -05:00
Josh Matthews
3e323345a3 Address WPT sync problems from nightly run.
* The commit author is inferred from the hostname
* There's no debug build present, so the update-manifest command exits immediately
* The test run opens too many files and is killed
2018-01-29 13:02:57 -05:00
bors-servo
1cb824d48e Auto merge of #19882 - aneeshusa:move-global-env-vars-to-servo, r=jdm
Move global CI environment variables to servo

Migrate RUST_BACKTRACE out of saltfs.
SCCACHE_IDLE_TIMEOUT has already been migrated.

<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes help with servo/saltfs#770 (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because they change the CI configuration

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19882)
<!-- Reviewable:end -->
2018-01-28 11:01:23 -06:00
bors-servo
78ffce1cbe Auto merge of #19883 - aneeshusa:reenable-sccache-partially, r=jdm
Re-enable sccache for Linux builds

As far as I know, sccache is working properly
on the non-cross-compiling Linux builders.
For safety, only enable it for the builders that run on PRs,
to avoid breaking our nightly generation and scheduled test runs.

This will also allow testing new versions of sccache more easily.
This implements my suggestion from https://github.com/servo/servo/pull/19858#issuecomment-360514782, and should also let us
handle testing a new sccache: https://github.com/rust-lang/rust/issues/42867#issuecomment-358692077 (our current version of sccache [seems to be 2018-01-09](f50214b8fa/servo-build-dependencies/ci-map.jinja (L5))).

<!-- Please describe your changes on the following line: -->

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because they change the CI configuration

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19883)
<!-- Reviewable:end -->
2018-01-28 10:17:02 -06:00
Aneesh Agrawal
a280188fdc Fix mutation test in CI by passing env vars correctly
Originally, buildbot would try to directly execute `RUSTFLAGS=` as a binary
since it was the first token in the command string, which won't work.

Fix this by using the `env` command to set the environment variables,
as there is currently no support for setting per-step environment variables
in the `buildbot_steps.yml` file.
2018-01-27 15:55:22 -08:00
Aneesh Agrawal
9f59050677 Re-enable sccache for Linux builds
As far as I know, sccache is working properly
on the non-cross-compiling Linux builders.
For safety, only enable it for the builders that run on PRs,
to avoid breaking our nightly generation and scheduled test runs.

This will also allow testing new versions of sccache more easily.
2018-01-27 15:26:41 -08:00
Aneesh Agrawal
fde0b79028 Move global CI environment variables to servo
Migrate RUST_BACKTRACE out of saltfs.
SCCACHE_IDLE_TIMEOUT has already been migrated.
2018-01-27 14:41:35 -08:00
bors-servo
ce17959f7c Auto merge of #18726 - jdm:automate-wpt-sync, r=asajeffrey
Add script to automate pulling changes from upstream WPT.

I want to make automated WPT syncing happen this quarter. This script should allow us to run a nightly job on the builder that grabs the latest changes from upstream runs our testsuite, updates the expected test results, then open a PR with the changes. It still requires saltfs changes to allow it to actually run, but I don't see any harm in getting it reviewed and merged before everything is ready.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/18726)
<!-- Reviewable:end -->
2018-01-26 12:58:50 -06:00
Josh Matthews
0c95c69030 Add script to automate pulling changes from upstream WPT. 2018-01-26 13:58:13 -05:00
Alan Jeffrey
234c72b15a Use https github URL to clone servo-warc-tests repo 2018-01-26 09:44:07 -06:00
bors-servo
8c1af9cce7 Auto merge of #19855 - asajeffrey:test-perf-git-progress, r=jdm
Added --progress flag to test-perf git commands

<!-- Please describe your changes on the following line: -->

Adding a `--progress` flag to git commands in test-perf to try to avoid the timeouts we're seeing at http://build.servo.org/builders/linux-nightly/builds/581/steps/test/logs/stdio
---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19855)
<!-- Reviewable:end -->
2018-01-25 15:30:22 -06:00
Josh Matthews
9e6f3f003e
Disable sccache. 2018-01-24 23:06:44 -05:00
Josh Matthews
a589f7e107
Fix yaml. 2018-01-24 11:14:51 -05:00
Josh Matthews
643e5c268b
Use default sccache timeout. 2018-01-24 11:10:58 -05:00
Alan Jeffrey
7a8890df50 Added --progress flag to test-perf git commands 2018-01-24 09:54:52 -06:00
bors-servo
2024ef56b0 Auto merge of #19820 - asajeffrey:test-perf-run-warc-tests, r=jdm
Run servo-warc-tests as part of test-perf

<!-- Please describe your changes on the following line: -->

Run the servo-warc-tests as part of performance testing.

Depends on https://github.com/servo/servo-warc-tests/pull/1

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is adding more test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19820)
<!-- Reviewable:end -->
2018-01-23 17:48:07 -06:00
Aneesh Agrawal
89dac98f16 Enable sccache for all builds 2018-01-22 11:10:54 -05:00
Alan Jeffrey
c3e2ce0624 Run servo-warc-tests as part of test-perf 2018-01-19 11:59:49 -06:00
Fernando Jiménez Moreno
f46fbe4599 Remove gecko-media dependency 2018-01-19 15:06:52 +01:00
tigercosmos
ebf8348aa2 auto clean cache 2018-01-18 16:47:23 +08:00
bors-servo
2b9dbc3415 Auto merge of #19740 - servo:jdm-patch-2, r=aneeshusa
Allow warnings during mutation tests.

Sometimes mutations include removing the only use of a variable. When we deny warnings globally, we inhibit these mutations that trigger new warnings.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19740)
<!-- Reviewable:end -->
2018-01-11 10:30:19 -06:00
Simon Sapin
cee2aadd82 Disable incremental compilation on CI
We don’t keep the `target` directory between builds,
and incremental cache takes a lot of space.
2018-01-10 20:54:35 +01:00
Simon Sapin
6dff251e35 Revert "Use rustdoc --document-private-item instead of deprecated flags"
This reverts commit d96f0ff6a7.
2018-01-10 18:05:28 +01:00
Josh Matthews
12ad5b6a3d
Allow warnings during mutation tests. 2018-01-10 12:04:45 -05:00
Aneesh Agrawal
e9eaadc913 Deny warnings in rust code globally in CI
Use the new environment variable support for `buildbot_steps.yml`
to do this globally instead of having to patch every call,
which is error prone.

Set this variable globally in .travis.yml and appveyor.yml as well.
2018-01-09 17:13:48 +01:00
Alan Jeffrey
fcc64cfd29 Filter out failed test-perf runs. 2018-01-05 07:43:05 -06:00
tigercosmos
6d6491e814 deny warnings 2017-12-22 03:34:11 +08:00
bors-servo
89f9af88a3 Auto merge of #19528 - asajeffrey:test-perf-measure-loadEventEnd, r=avadacatavra
Capture loadEventEnd in test-perf

<!-- Please describe your changes on the following line: -->

Capture perf-test data after the load event has finished firing.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19528)
<!-- Reviewable:end -->
2017-12-18 16:54:07 -06:00
bors-servo
57277acd27 Auto merge of #19574 - asajeffrey:rustdown-2017-11-14, r=glennw
Downgrade to rustc nightly-2017-11-14

<!-- Please describe your changes on the following line: -->

This is causing nightly servo to crash with hardware acceleration.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes work around #19519
- [X] These changes do not require tests because testing requires AWS instances with GPUs.

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19574)
<!-- Reviewable:end -->
2017-12-18 13:59:23 -06:00