Commit graph

250 commits

Author SHA1 Message Date
Aneesh Agrawal
45c499d011 Fix ./mach upload-nightly macbrew 2017-05-30 14:27:27 -04:00
Aneesh Agrawal
16ed388a8a Remove redundant ANDROID_SDK variables
The r25.2.3 Android SDK has been made the current version in saltfs,
so we no longer need to override it via environment variable.
2017-05-29 15:36:48 -04:00
bors-servo
166abb82bc Auto merge of #16940 - ccarruitero:fix16887, r=emilio
upload geckolib docs to doc.servo.org

<!-- Please describe your changes on the following line: -->
add `geckolib` docs into upload docs script

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [ ] `./mach test-tidy` does not report any errors
- [X] These changes fix #16887

<!-- Either: -->
- [ ] There are tests for these changes OR
- [X] These changes do not require tests because are in ci script

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16940)
<!-- Reviewable:end -->
2017-05-29 09:04:55 -05:00
Lars Bergstrom
bf5728c750 Split out some mac builds 2017-05-26 18:50:24 -05:00
bors-servo
9468fae0d4 Auto merge of #16565 - aneeshusa:move-upload-nightly-script-to-python, r=metajack
Convert nightly upload script to Python

Now that MinGW and MSYS have been removed from the Windows builders,
bash is not available to run the previous upload_nightlies.sh script.
Convert the script to Python 2 for cross-platform support.
Additionally, switch to the `boto3` library for easy uploading
without needing to install `s3cmd`,
and move the code into mach for easy `boto3` installation
as the new `./mach upload-nightly` command.

Also, hard-code the paths to the packages instead of using
globs to look for them, as the paths are static.
(The paths used to contain timestamps,
but we now insert timestamps when uploading to S3
to improve reproducibility.)

<!-- Please describe your changes on the following line: -->

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes fix #16560 (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because Buildbot will test them.

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16565)
<!-- Reviewable:end -->
2017-05-22 18:11:19 -05:00
Aneesh Agrawal
043f78db53 Move nightly upload script into Mach
Now that MinGW and MSYS have been removed from the Windows builders,
bash is not available to run the previous upload_nightlies.sh script.
Convert the script to Python 2 for cross-platform support.
Additionally, switch to the `boto3` library for easy uploading
without needing to install `s3cmd`,
and move the code into mach for easy `boto3` installation
as the new `./mach upload-nightly` command.

Also, hard-code the paths to the packages instead of using
globs to look for them, as the paths are static.
(The paths used to contain timestamps,
but we now insert timestamps when uploading to S3
to improve reproducibility.)
2017-05-20 14:50:04 -04:00
Cesar Carruitero
ee908d2440 upload geckolib docs to doc.servo.org 2017-05-18 15:02:13 -05:00
Imanol Fernandez
a4a4d96e9c Update blurdroid and set ANDROID_SDK in build_steps.yml 2017-05-11 14:43:51 +02:00
Nathan Froyd
f51ea4ac3d halve the process count for mac wpt
...on the theory that reducing the process count will reduce timeout
problems.
2017-05-05 10:37:48 -04:00
Imanol Fernandez
7a2a90959e Android life cycle improvements and Gradle integration 2017-04-21 18:24:10 +02:00
bors-servo
a754c10e79 Auto merge of #16487 - aneeshusa:automatically-clean-old-nightlies, r=larsbergstrom
Automatically clean old nightlies

<!-- Please describe your changes on the following line: -->

Automatically clean old rustc and cargo nightlies on our builders up to preserve disk space.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #12103 and help with servo/saltfs#321 (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because tested manually

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16487)
<!-- Reviewable:end -->
2017-04-18 11:00:27 -05:00
bors-servo
2b353e04f0 Auto merge of #16464 - UK992:upload-nightly, r=larsbergstrom
Upload zipfile of Windows nightly build

- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes fix #16437

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16464)
<!-- Reviewable:end -->
2017-04-18 09:50:23 -05:00
Aneesh Agrawal
060a813b45 Automatically clean old nightlies
Add a new `-keep` flag to `./mach clean-nightlies` to control how many
nightlies to keep, which keeps the n most recent nightlies found in git.

Use this to clean old nightlies at the start of each build,
currently keeping 3 nightlies at a time.
2017-04-18 09:30:45 -04:00
Aneesh Agrawal
c23b753a74 Test packaging during normal builds 2017-04-17 20:44:21 -04:00
Aneesh Agrawal
0df627e9e8 Remove windows-gnu build code
These builds have been deprecated,
so we don't need to keep this code around anymore.
2017-04-14 20:45:07 -04:00
UK992
8740abce37 Upload zipfile of Windows nightly build 2017-04-14 19:59:48 +02:00
Josh Matthews
65f076b3b0 Double number of WPT processes for Linux builders. 2017-04-10 14:31:10 +10:00
bors-servo
aa6cf08e4b Auto merge of #15106 - Manishearth:certs, r=avadacatavra
Update cert-generator and certs

r? @avadacatavra

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/15106)
<!-- Reviewable:end -->
2017-04-03 12:50:21 -05:00
Josh Matthews
9867605779 Revert changes to mac builder processes. 2017-03-29 10:30:23 -04:00
Josh Matthews
c563f1620f Halve number of processes for test runs. 2017-03-28 18:24:31 -04:00
Volodymyr M. Lisivka
da6aab60d2 Layout viewer now uses local copy of jquery. 2017-03-16 18:38:33 +02:00
Manish Goregaokar
40742902c2 Update cert-generator and certs 2017-03-14 08:01:54 -07:00
Shing Lyu
aaa0d46135 Remove link to servo from treeherder job detail to reduce noise 2017-03-07 10:20:47 +08:00
Simon Sapin
7b9ddab663 Buildbot steps: move geckolib from mac-rel-css to mac-rel-wpt2.
mac-rel-css is currently the job that takes the longest,
and its geckolib step is independent from other jobs.
Hopefully, this should reduce the overall CI cycle time.
2017-02-17 21:27:07 +01:00
Simon Sapin
8bc9f0ed85 Also keep LLVM assertions enabled for ARM Linux and Android CI. 2017-02-17 11:02:12 +01:00
Simon Sapin
bd8ec03740 Disable LLVM assertions by default, on supported platforms.
But keep them on linux-dev CI.
2017-02-16 08:38:14 +01:00
bors-servo
e9933f36b7 Auto merge of #15067 - shinglyu:stylo-perf-async, r=Manishearth
Added async performance test

<!-- Please describe your changes on the following line: -->
Add a new way to test arbitrary timing from JavaScript (only for Gecko). This is for Stylo testing.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [x] There are tests for these changes OR
- [ ] These changes do not require tests because _____

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/15067)
<!-- Reviewable:end -->
2017-02-07 18:59:03 -08:00
Shing Lyu
7aa3350d45 Added async performance test 2017-02-08 10:46:00 +08:00
Aneesh Agrawal
6ecd0456e2 Remove unused builders
These have been superseded by the windows-gnu and windows-msvc versions.
Removing them allows freeing up disk space on the Windows builders.
2017-01-28 15:28:41 -05:00
UK992
46bba56a9c Upload MSVC nightlies via MSYS environment 2017-01-26 19:12:27 +01:00
Aneesh Agrawal
73485b8a32 Check all constellation files for panics
Teaches the `etc/ci/check_no_panic.sh` script to handle directories,
so it can check all constellation files for panics.
2017-01-20 14:24:21 -05:00
Aneesh Agrawal
78a2e6a930 Avoid using variables in printf format string 2017-01-13 01:20:53 -05:00
Aneesh Agrawal
90735661fe Set git user info for Homebrew committing
The `git commit` command wants to set both an author and a committer.
The `--author` flag only sets the author,
leaving git without a value for the committer,
causing git to attempt to autodiscover that value.

To work around it, use the `-c` git flag to temporarily set the relevant
config variables for the scope of the command.
2017-01-13 01:18:54 -05:00
bors-servo
da25e88145 Auto merge of #14937 - shinglyu:stylo-perf, r=Manishearth
Read firefox path from environment variable for performance test

<!-- Please describe your changes on the following line: -->
This is for Stylo performance testing (at least before we got Talos running)

r?@Manishearth

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because independent from servo itself

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/14937)
<!-- Reviewable:end -->
2017-01-11 23:14:48 -08:00
Shing Lyu
d8501badc0 Read firefox path from environment variable for performance test 2017-01-12 11:39:24 +08:00
Paul Rouget
feffd41c4d Add git author 2017-01-10 05:18:03 +01:00
Paul Rouget
e1654d9b01 Fix brew formula update 2017-01-05 09:29:17 +01:00
bors-servo
58fec2f05a Auto merge of #14124 - shinglyu:flexbox-trace, r=glennw
Flexbox trace

<!-- Please describe your changes on the following line: -->
This is a follow up for #13740, so r? @jdm

The first patch enables JSON serialization for flexbox flows, the second one fixed format incompatibilities for the layout viewer.

The 3rd and 4th patches are just layout viewer UI enhancements, we could split that to a spearate PR if you prefer.

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes fix #13846  (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [x] These changes do not require tests because it's a trivial debug tool

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->

---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/14124)
<!-- Reviewable:end -->
2016-12-28 00:33:31 -08:00
Shing Lyu
344ad61f2c Added a toolbar for going to previous and next node 2016-12-28 15:31:48 +08:00
Shing Lyu
fe82d277cd Added toolbar for toggling unchanged code display 2016-12-28 15:31:47 +08:00
Shing Lyu
22ffdf8018 Fix flexbox trace loading problem in layout_viewer 2016-12-28 15:31:46 +08:00
Aneesh Agrawal
c865515757 Rename Windows nightly builders for consistency 2016-12-22 13:00:36 -05:00
Lars Bergstrom
8fcf88f2aa Create windows-gnu and windows-msvc builds 2016-12-22 10:46:46 -06:00
Lars Bergstrom
9ac11177d2 Exempt __cxa_type_match as an allowed dynamic symbol 2016-12-14 10:02:34 -06:00
bors-servo
4cb3404c09 Auto merge of #13845 - birryree:package-under-target-profile-dirs, r=aneeshusa
Part of #13551 - Create packages under release/debug directories as appropriate

r? @aneeshusa

This change implements fixes for #13551 for Linux and MacOS targets.

`/python/servo/package_commands.py` was modified so that:
- On MacOS, it creates all intermediate packaging directories like `dmg`, `brew`, and `brew-tmp` under `target/(release|debug)`, rather than in `target` directly.
- On MacOS, all packaging artifacts (`.dmg`, brew `.tar.gz`) are packaged under `target/(release|debug)`, rather than in `target` directly.
- On Linux, the resulting `tar.gz` Servo package is placed under `target/(release|debug)`, rather than in `target`.
- Also did some extra cleanup around path parsing in the MacOS packaging code, to use `os.path` methods rather than straight `'/'` parsing with `split` and `join` where it was applicable.

`/etc/ci/upload_nightly.sh` was modified to:
- Look for artifacts in `target/release` for `mac`, `macbrew`, and `linux` platforms, rather than just `target/`.

---

<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes fix #13551
- [x] These changes do not require tests because it is based on CI and packaging tools. They were manually tested for correctness.

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

…lease/debug as specified or detected. Modify macos packaging to create all packages under release/debug directory. Updated etc/ci/upload_nightly.sh to support uploading from either release/debug directory, depending on what was built

<!-- Reviewable:start -->

---

This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/13845)

<!-- Reviewable:end -->
2016-12-09 14:46:14 -08:00
William Lee
6a7fb6cd2b Package macos/Linux builds under release/debug dirs
This commit updates the 'mach package' command to generate output
under the target/release and target/debug directories when run on
macOS and Linux.

etc/ci/upload_nightly.sh has also been updated to upload packages from
the release/debug directories.
2016-12-09 15:28:39 -05:00
Corey Farwell
968346d907 Update lockfile_changed script to search for all lockfiles. 2016-12-08 09:58:00 -10:00
Shing Lyu
ddd03229e0 Add an option to submit test-perf result to perfherder 2016-12-01 10:23:27 +08:00
bors-servo
69f914b8b5 Auto merge of #14194 - shinglyu:gecko-webdriver, r=larsbergstrom,aneeshusa,jgraham
Use Selenium for Gecko performance test

<!-- Please describe your changes on the following line: -->
We run the `etc/ci/performance` test on Gecko for comparison, but the old add-on approach doesn't work anymore. I'm using selenium to drive Gecko instead. Also did some refactoring and fixed some nits I saw along the way.

r? @aneeshusa

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [x] These changes fix #14148  (github issue number if applicable).

<!-- Either: -->
- [x] There are tests for these changes OR
- [ ] These changes do not require tests because _____

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/14194)
<!-- Reviewable:end -->
2016-11-28 20:22:05 -08:00
Manish Goregaokar
c23ea67af7 Add a log of only intermittents 2016-11-28 16:46:33 -08:00