Commit graph

69 commits

Author SHA1 Message Date
Simon Sapin
6b523302e1 Fetch "alt" rust std build when we do so for rustc 2017-06-30 15:44:03 +02:00
UK992
0e072df8c3 Improve clean-cargo-cache 2017-05-25 20:44:16 +02:00
Simon Sapin
6a3864de5f Fix UnicodeDecodeError in mach clean-nightlies 2017-05-13 17:49:37 +02:00
bors-servo
f6bd158fd4 Auto merge of #16593 - UK992:clean-cargo-cache, r=wafflespeanut
Mach: Add `mach clean-cargo-cache` command

<!-- Please describe your changes on the following line: -->

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [x] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [ ] These changes do not require tests because _____

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16593)
<!-- Reviewable:end -->
2017-05-08 04:37:21 -05:00
UK992
66ea4b21d0 Add mach clean-cargo-cache command 2017-05-08 11:25:21 +02:00
Aneesh Agrawal
cc86993857 Keep stable rustc versions in clean-nightlies
Check the `rust-stable-version` file to keep the last n
versions of both the nightly and the stable compiler.
2017-05-02 02:41:55 -04:00
bors-servo
5c321737c6 Auto merge of #16639 - aneeshusa:skip-nonexisting-dirs-when-cleaning-nightlies, r=jdm
Avoid searching for old nightlies in missing dirs

These directories may be missing (e.g. a first time build or due to Buildbot cleaning),
so don't try to look inside them for old nightlies if so.

I noticed this in http://build.servo.org/builders/arm32/builds/6815/steps/shell__1/logs/stdio.

<!-- Please describe your changes on the following line: -->

---
<!-- Thank you for contributing to Servo! Please replace each `[ ]` by `[X]` when the step is complete, and replace `__` with appropriate data: -->
- [ ] `./mach build -d` does not report any errors
- [x] `./mach test-tidy` does not report any errors
- [ ] These changes fix #__ (github issue number if applicable).

<!-- Either: -->
- [ ] There are tests for these changes OR
- [ ] These changes do not require tests because _____

<!-- Also, please make sure that "Allow edits from maintainers" checkbox is checked, so that we can help you if you get stuck somewhere along the way.-->

<!-- Pull requests that do not address these steps are welcome, but they will require additional verification as part of the review process. -->

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="34" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/16639)
<!-- Reviewable:end -->
2017-04-27 17:18:55 -05:00
Aneesh Agrawal
ba874d67bb Avoid searching for old nightlies in missing dirs
These directories may be missing (e.g. a first time build),
so don't try to look inside them for old nightlies if so.
2017-04-27 17:30:56 -04:00
UK992
c5f13063a5 Optimize clean-nightlies 2017-04-23 01:09:46 +02:00
Aneesh Agrawal
060a813b45 Automatically clean old nightlies
Add a new `-keep` flag to `./mach clean-nightlies` to control how many
nightlies to keep, which keeps the n most recent nightlies found in git.

Use this to clean old nightlies at the start of each build,
currently keeping 3 nightlies at a time.
2017-04-18 09:30:45 -04:00
Matt Brubeck
79275ab68c Fix bug bootstrapping stable rust 2017-03-08 09:19:37 -08:00
Anthony Ramine
57fd45a5c2 Allow disabling LLVM assertions in rustc (fixes #15548) 2017-02-15 14:55:02 +01:00
Anthony Ramine
336e6c8f28 Switch to commit-specific nightlies 2017-02-15 14:55:02 +01:00
Aneesh Agrawal
60a1503b29 Clean up and simplify existing mach bootstrap
- Default to interactive mode and remove the `--interactive` flag
- Use `--force` to skip interactivity
- Change MSVC dependency storage organization on disk: put each version
  into its own folder and directly refer to the versioned folders,
  providing immutability and making the installation list redundant
- Reuse `host_triple()` function to fix broken bootstrapper dispatching
- Simplify code:
  - Remove or inline many unused and redudant functions and variables
  - Prefer plain functions to classes
  - Consolidate into fewer files, remove unnecessary bootstrapper/ dir
- Improve Python style
- Sort dependency list
2017-01-15 15:41:37 -05:00
Aneesh Agrawal
02b054ec9e Create a util.py Python module for common functions
Extracting these functions helps avoid circular dependencies,
and make them easier to find/reuse.
2017-01-15 15:21:35 -05:00
Aneesh Agrawal
5b8d783f4c Remove unusable --android flag for mach bootstrap
`mach` can't do any bootstrapping for Android, so the flag is useless.
2017-01-14 00:10:50 -05:00
Simon Sapin
f5af40d694 Upgrade to cargo 0.16.0-nightly (built 2016-12-06)
Instead of once per day (or night) with a date in the URL,
Cargo binaries are now built and published for every merge to master
(with the merge commit hash in the URL).
2016-12-06 12:40:40 -10:00
UK992
b0fabec6c7 Fix msvc packages download dir for custom .servo location 2016-09-28 22:58:38 +02:00
UK992
fc3555556c Create mach bootstrap based on Mozilla's mozboot bootstrapper 2016-09-07 22:45:05 +02:00
S
f5c5fdebe1 Add error message for connectivity issues during bootstrap 2016-08-17 01:13:18 +00:00
S
8e12e3ce68 Fix overriding url with Request obj. when resuming download 2016-08-16 04:09:10 +00:00
S
c3d118a45e Fix error-prone message while bootstrapping 2016-08-15 04:36:41 +00:00
Simon Sapin
e2262882ad Use static-rust-lang-org.s3.amazonaws.com everywhere. 2016-07-08 22:28:54 +02:00
Simon Sapin
6ae5598a5c Fix "looking for rustc at …" message for stable when already bootstrapped
Also always download from static-rust-lang-org.s3.amazonaws.com instead
of static.rust-lang.org. They host the same content, but the latter goes
through a CDN and has a TLS certificate that failed to verify and some
Python versions:

https://github.com/servo/servo/issues/3582
https://github.com/servo/servo/pull/3971
2016-07-08 22:27:20 +02:00
Matt Brubeck
a824177bf1 Fix error in cross-compiling bootstrap 2016-07-05 11:17:46 -07:00
Gabriel Poesia
a1a1dec4d5 Add mach build-stable to build with stable rustc
Github issue: #11806
Building with current stable rust (1.9.0) still fails because of
feature pragmas in some dependencies (e.g. serde_item).
2016-06-30 00:15:50 -03:00
Florian Duraffourg
dbef65129f Add mach command to update public domain list and use a HashSet instead of a Vec to lookup public domains 2016-06-09 09:14:01 +02:00
Per Lundberg
70b64d654b Provide a better error message when downloading rustc fails
I was running into the error below locally. The previous version of the code hid away important details that helps when debugging; hence, this suggested change.

> Error downloading Rust compiler: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590). URL: https://static-rust-lang-org.s3.amazonaws.com/dist/2016-05-17/rustc-nightly-x86_64-pc-windows-gnu.tar.gz
2016-05-31 21:04:04 +03:00
bors-servo
491b5ff47e Auto merge of #10923 - askeing:fix_10922, r=jdm
Remove dir by shutil.rmtree, remove file by os.remove

fix #10922

<!-- Reviewable:start -->
---
This change is [<img src="https://reviewable.io/review_button.svg" height="35" align="absmiddle" alt="Reviewable"/>](https://reviewable.io/reviews/servo/servo/10923)
<!-- Reviewable:end -->
2016-04-30 03:42:18 -07:00
askeing
3103cd4b34 Handle HTTP specific errors then other errors when downloading rustc 2016-04-30 12:45:32 +09:00
askeing
c4b0e20bc5 Remove dir by shutil.rmtree, remove file by os.remove 2016-04-29 23:18:28 +09:00
rwa
79a1dfe226 Handle URLError in download() #10679
Print a human-friendly message if there is no internet connection.
2016-04-18 20:34:35 +02:00
Adrian Utrilla
78b2c5d323 Added caching support to mach bootstrap 2016-04-07 08:10:42 +00:00
malayaleecoder
4ee331059d Remove submodule update from mach bootstrap. Fixes #10010 2016-03-16 00:02:15 +05:30
Daniel Robertson
0df4118db9 Download extra std lib when cross-compiling #9557
Split ensure_bootstrap into two phases including a phase checking the
compiler, and a phase checking for target libraries.
2016-02-12 14:58:08 -05:00
Jason Williams
13d98f153a adding check for windows then using Scripts instead of bin 2016-01-22 19:27:29 -06:00
Vladimir Vukicevic
ee863fde59 win32: mach and build command fixes
- Add SERVO_USE_NIGHTLY_RUST env var to use the latest rust/cargo nightly snapshot
- Fix up looking for cargo binary (in cargo/bin/cargo, not bin/cargo)
- Fix up win32 executable checking (use .exe suffix)
- fix up win32 PATH handling (subprocess must use shell=True for PATH change to be honored)
2016-01-20 08:38:24 -06:00
Simon Sapin
b2af8567fa Rename rust-snapshot-hash to rust-nightly-date
… and remove mentions of "snapshots".

We now use rust-lang.org nightly builds rather than our own snapshots.
2015-12-30 13:36:47 +00:00
Simon Sapin
856eea3a0e Remove "Servo does not bootstrap 32bit snapshots of Rust" message
We now use rust-lang.org nightly builds rather than our own snapshots.
2015-12-30 12:06:54 +00:00
Sam Gibson
732ae5714f Fix the parsing of the chromium HSTS preload list
Urg! The Chromium HSTS preload JSON file contains single line comments. Previously these were filtered out with a very simple regex that just looked for '//' and removed the line. Now the file has added a couple fields that have URLs in them that were erroneously removed and caused the JSON parsing to fail. This commit slightly complicates the regex to fix this specific problem.

If this happens again, it's likely worth it to figure out how to use a real parser to remove the comments.

servo/servo#8760
2015-12-02 15:36:38 +11:00
Ms2ger
21f532758b Ensure the bootstrap-rust-docs and doc mach commands agree on the location of the Rust documentation. 2015-11-27 09:47:38 +01:00
Manish Goregaokar
dc0e467945 Upgrade to rustc 1.6.0-nightly (d5fde83ae 2015-11-12)
… and libc 0.2 and many other dependencies
2015-11-27 00:15:29 -05:00
Corey Farwell
d1acefa452 Prevent warning about redefining Python variable
'e' is also used later on in a list comprehension, and flake8 warns when
variables get redefined within a function
2015-07-26 22:07:23 +07:00
Sam Gibson
29a34dbdb5 Resolves code review comments
* Lots of rust-isms
* Mutable iterator for modifying entries (much better)
2015-07-22 11:49:06 +12:00
Sam Gibson
8086034e0b Commit HSTS preload list to source control
* No longer download the HSTS list as a bootstrap step
* Check the current revision of the HSTS list into source
2015-07-22 11:49:06 +12:00
Sam Gibson
865fb2eacb Resolve tidy issues 2015-07-22 11:49:05 +12:00
Sam Gibson
aa19a9a741 Preload an HSTS domain list from chromium
This resolves the first part of servo/servo#6105. The remaining part is
to update the list based on the STS headers from the server.
2015-07-22 11:48:03 +12:00
Corey Farwell
848c57653c Add flake8 to the tidy process for Python files
Fixes #6236

Also included in this commit are the changes need to make flake8 pass
for the existing python file
2015-06-04 11:17:34 -04:00
Corey Farwell
e3b71c65bf Fix tidy issues with Python files in python/ 2015-06-02 19:51:41 -04:00
ringmaster101
c4b73e703a Ensure installed git version is above 1.8.1 [Bug #5637]
Versions of git before 1.8.1 do not support git submodule --recursive sync
This commit makes update_submodules() exit with an error message if the version is <1.8.1

https://github.com/servo/servo/issues/5637
2015-06-01 18:37:37 -04:00