Commit graph

332 commits

Author SHA1 Message Date
Aneesh Agrawal
6861f9bdcf Make it easier to debug Taskcluster runs
Print out each command before it is run,
to help debug future Taskcluster issues.
2018-05-20 18:41:11 -07:00
bors-servo
b0cb92176a
Auto merge of #20819 - servo:fourchette, r=jdm
Remove unused build targets

<!-- Reviewable:start -->
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20819)
<!-- Reviewable:end -->
2018-05-19 06:22:21 -04:00
Emilio Cobos Álvarez
a440a0bdaf Remove geckolib-related build commands. 2018-05-17 11:24:59 -05:00
Simon Sapin
f69cbbb647 Install rustup in TaskCluster builds 2018-05-15 16:58:07 -05:00
Simon Sapin
00de912ad5 Set environment variables for taskcluster builds 2018-05-15 15:54:39 -05:00
Emilio Cobos Álvarez
8146850215
Remove Geckolib CI. 2018-04-28 10:26:48 +02:00
asoni3
437276d3dc Automation Script to take screenshot for servo 2018-04-27 14:05:32 -04:00
bors-servo
eb09d8c6e2
Auto merge of #20259 - vugarmammadli:master, r=jdm
Support memory report logs with interleaved non-report output

<!-- Please describe your changes on the following line: -->
`line 30-31` in `servo/etc/memory_reports_over_time.py`  should just ignore any line that doesn't begin with `|`.

The new if statement added such as `if line.startswith('|'):` then continue to append. So, only lines begin with `|` will be appended.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [ ] These changes fix #20257(github issue number if applicable).

<!-- Either: -->
- [X] There are tests for these changes OR
- [ ] These changes do not require tests because of __

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20259)
<!-- Reviewable:end -->
2018-03-19 10:21:21 -04:00
Vugar Mammadli
e6c85b97f9 Support memory report logs with interleaved non-report output, added automated tests 2018-03-19 09:49:09 -04:00
Josh Matthews
f1e9e6d111
Remove update-manifest argument that is no longer valid. 2018-03-16 21:49:24 -04:00
Josh Matthews
8b378120a4 Avoid using WPT test runner to update the test manifest. 2018-03-16 02:17:49 -04:00
bors-servo
1c7424d920
Auto merge of #20260 - servo:jdm-patch-11, r=asajeffrey
Run automated test for memory report charter.

No point in having tests if they don't get run.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20260)
<!-- Reviewable:end -->
2018-03-15 11:07:40 -04:00
Josh Matthews
34d14a092c
Unbreak the docs build. 2018-03-11 13:45:44 -04:00
Josh Matthews
ec5daacaa9
Run memory charting test on CI. 2018-03-09 14:47:06 -05:00
Josh Matthews
dd1b43b890 Add tool to chart memory usage from reports. 2018-03-08 22:46:42 -05:00
Josh Matthews
ed05c51f22
Improve disk usage of doc builds. 2018-03-02 08:09:44 -05:00
Josh Matthews
1a8507cada
Clean up after some disk-space intensive builds. 2018-02-27 12:10:24 -05:00
bors-servo
8329a45163
Auto merge of #20112 - servo:jdm-patch-11, r=asajeffrey
Include non-upstream metadata changes in WPT sync.

The original sync work excluded changes to metadata files under tests/wpt/mozilla under the assumption that any change in test results indicated an existing intermittent issue. This is incorrect, because these tests rely on shared infrastructure with upstream, so the results can be influenced by syncing.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20112)
<!-- Reviewable:end -->
2018-02-23 13:55:06 -05:00
Josh Matthews
86e4fa50d3
Refine the set of directories that are checked during WPT syncing. 2018-02-23 12:58:56 -05:00
Josh Matthews
5b050d093e
Include non-upstream metadata changes in WPT sync. 2018-02-23 10:21:52 -05:00
bors-servo
f74451f039
Auto merge of #20107 - servo:jdm-patch-10, r=emilio
Clean more build artificats

This is the latest attempt in the war against disk space usage on the build machines.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20107)
<!-- Reviewable:end -->
2018-02-23 10:09:49 -05:00
Josh Matthews
878bf4ee6f Use CI script instead of ./mach clean
The script is more thorough that the mach command, which only wraps `cargo clean`.
2018-02-23 10:08:35 -05:00
Josh Matthews
0896fca5f0 Create script to easily remove existing CI build artifacts. 2018-02-23 10:08:35 -05:00
bors-servo
16bd067c6c
Auto merge of #20086 - servo:jdm-patch-6, r=aneeshusa
Add debug output to doc build.

This should narrow down the cause of https://github.com/servo/servo/issues/17243.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/20086)
<!-- Reviewable:end -->
2018-02-22 14:36:17 -05:00
Josh Matthews
0fc667fcee
Use more periods. 2018-02-22 10:58:07 -05:00
Josh Matthews
47e0dab42a
Set CARGO_HOME for Windows builders.
This sets it to a directory that all relevant users can manipulate without any issues.
2018-02-20 22:02:01 -05:00
Josh Matthews
e3ab8b6d90
Add debug output to doc build.
This should narrow down the cause of https://github.com/servo/servo/issues/17243.
2018-02-20 12:05:33 -05:00
Josh Matthews
710baa4f6f
Clean target directories of linux builders.
This should avoid our frequent problems with running out of disk space on the smallest linux build machines.
2018-02-20 10:21:27 -05:00
Josh Matthews
c51505718b
Avoid duplicate error codes when opening WPT PR. 2018-02-11 22:09:48 -05:00
Josh Matthews
97b218d098
Propagate error code from fetching WPT changes. 2018-02-11 22:09:20 -05:00
Josh Matthews
298f70711c
Try to reduce instances of intermittent failures in nightly sync. 2018-02-09 10:26:35 -05:00
Josh Matthews
ee2ef627c8
Fix syntax error in WPT syncing script. 2018-02-01 23:10:45 -05:00
bors-servo
b5e5a99cb7
Auto merge of #19920 - servo:jdm-patch-10, r=aneeshusa
Supress output from git push in WPT sync.

Pushing to the remote exposes sensitive data in the logs of the job. The old token has been revoked as a consequence.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19920)
<!-- Reviewable:end -->
2018-02-01 18:09:55 -05:00
Josh Matthews
b003f5ad06 Supress output from git push in WPT sync. 2018-02-01 18:08:57 -05:00
Josh Matthews
910e9db277
Make the syncing PR a bit harder to mess up. 2018-02-01 09:53:56 -05:00
bors-servo
3e3e05c99d Auto merge of #19900 - paulrouget:dropcef, r=jdm
Drop CEF support

<!-- Reviewable:start -->
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19900)
<!-- Reviewable:end -->
2018-01-31 08:53:16 -06:00
Paul Rouget
2282292fa4 Drop CEF support 2018-01-31 06:36:21 +01:00
Josh Matthews
7dc38db13b
Double the sccache timeout.
Fixes #19907.
2018-01-30 11:58:03 -05:00
Josh Matthews
3e323345a3 Address WPT sync problems from nightly run.
* The commit author is inferred from the hostname
* There's no debug build present, so the update-manifest command exits immediately
* The test run opens too many files and is killed
2018-01-29 13:02:57 -05:00
bors-servo
1cb824d48e Auto merge of #19882 - aneeshusa:move-global-env-vars-to-servo, r=jdm
Move global CI environment variables to servo

Migrate RUST_BACKTRACE out of saltfs.
SCCACHE_IDLE_TIMEOUT has already been migrated.

<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes help with servo/saltfs#770 (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because they change the CI configuration

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19882)
<!-- Reviewable:end -->
2018-01-28 11:01:23 -06:00
bors-servo
78ffce1cbe Auto merge of #19883 - aneeshusa:reenable-sccache-partially, r=jdm
Re-enable sccache for Linux builds

As far as I know, sccache is working properly
on the non-cross-compiling Linux builders.
For safety, only enable it for the builders that run on PRs,
to avoid breaking our nightly generation and scheduled test runs.

This will also allow testing new versions of sccache more easily.
This implements my suggestion from https://github.com/servo/servo/pull/19858#issuecomment-360514782, and should also let us
handle testing a new sccache: https://github.com/rust-lang/rust/issues/42867#issuecomment-358692077 (our current version of sccache [seems to be 2018-01-09](f50214b8fa/servo-build-dependencies/ci-map.jinja (L5))).

<!-- Please describe your changes on the following line: -->

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because they change the CI configuration

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19883)
<!-- Reviewable:end -->
2018-01-28 10:17:02 -06:00
Aneesh Agrawal
a280188fdc Fix mutation test in CI by passing env vars correctly
Originally, buildbot would try to directly execute `RUSTFLAGS=` as a binary
since it was the first token in the command string, which won't work.

Fix this by using the `env` command to set the environment variables,
as there is currently no support for setting per-step environment variables
in the `buildbot_steps.yml` file.
2018-01-27 15:55:22 -08:00
Aneesh Agrawal
9f59050677 Re-enable sccache for Linux builds
As far as I know, sccache is working properly
on the non-cross-compiling Linux builders.
For safety, only enable it for the builders that run on PRs,
to avoid breaking our nightly generation and scheduled test runs.

This will also allow testing new versions of sccache more easily.
2018-01-27 15:26:41 -08:00
Aneesh Agrawal
fde0b79028 Move global CI environment variables to servo
Migrate RUST_BACKTRACE out of saltfs.
SCCACHE_IDLE_TIMEOUT has already been migrated.
2018-01-27 14:41:35 -08:00
bors-servo
ce17959f7c Auto merge of #18726 - jdm:automate-wpt-sync, r=asajeffrey
Add script to automate pulling changes from upstream WPT.

I want to make automated WPT syncing happen this quarter. This script should allow us to run a nightly job on the builder that grabs the latest changes from upstream runs our testsuite, updates the expected test results, then open a PR with the changes. It still requires saltfs changes to allow it to actually run, but I don't see any harm in getting it reviewed and merged before everything is ready.

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/18726)
<!-- Reviewable:end -->
2018-01-26 12:58:50 -06:00
Josh Matthews
0c95c69030 Add script to automate pulling changes from upstream WPT. 2018-01-26 13:58:13 -05:00
Alan Jeffrey
234c72b15a Use https github URL to clone servo-warc-tests repo 2018-01-26 09:44:07 -06:00
bors-servo
8c1af9cce7 Auto merge of #19855 - asajeffrey:test-perf-git-progress, r=jdm
Added --progress flag to test-perf git commands

<!-- Please describe your changes on the following line: -->

Adding a `--progress` flag to git commands in test-perf to try to avoid the timeouts we're seeing at http://build.servo.org/builders/linux-nightly/builds/581/steps/test/logs/stdio
---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [X] `./mach build -d` does not report any errors
- [X] `./mach test-tidy` does not report any errors
- [X] These changes do not require tests because this is test infrastructure

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/19855)
<!-- Reviewable:end -->
2018-01-25 15:30:22 -06:00
Josh Matthews
9e6f3f003e
Disable sccache. 2018-01-24 23:06:44 -05:00
Josh Matthews
a589f7e107
Fix yaml. 2018-01-24 11:14:51 -05:00