Sebastian C 27c8a899ea Replace hsts preload list hashmap with an FST (#37015) ... This reduces the memory used by the preload list to just 1.9MB. The total memory savings in HSTS from pre-103cbed928 is now 62MB, or 96%. And in terms of total resident memory is a 7.5% reduction. The DAFSA/DAWG used by Firefox is 1.1MB so there could be additional gains available but this seems like the best option based on maintained libraries available (I could not find a good maintained library for DAFSAs in Rust). The main trick is this: the FST map API is currently designed to map byte sequences to u64 values. Because we only need to determine if a preloaded domain has the `includeSubdomains` flag set, we encode that into the lowest bit of the ids in the map. This way finding an entry in the map directly provides us with the `includeSubdomains` flag and we don't need to keep another mapping in memory or on disk. Updated the `./mach update-hsts-preload` command to generate the new FST map file. (Not sure if I need to update any dev-dependencies anywhere for this change) This change also replaces the use of "mozilla.org" with "example.com" in the HSTS unit tests to make sure that entries in the preload list do not influence the tests (since example.com should not ever end up on the preload list) Testing: Updated unit tests Fixes: #25929 --------- Signed-off-by: Sebastian C <sebsebmc@gmail.com>		2025-05-20 04:26:55 +00:00
..
devtools_tests/sources	Devtools: add automated test for Debugger > Sources (#36401)	2025-05-07 10:43:18 +00:00
mutation	Remove __future__ imports that are no longer necessary (#30661)	2023-11-02 12:01:10 +00:00
platform	Check for existence of 'sudo' on Linux in ./mach bootstrap (#35739)	2025-03-28 14:58:25 +00:00
__init__.py	Fix tidy issues with Python files in python/	2015-06-02 19:51:41 -04:00
bootstrap_commands.py	Replace hsts preload list hashmap with an FST (#37015)	2025-05-20 04:26:55 +00:00
build_commands.py	Extend --with-asan to support C/C++ code (#36873)	2025-05-11 07:27:40 +00:00
command_base.py	mach: Fix cross-compiling from windows to non windows (#36070)	2025-04-04 08:07:32 +00:00
devenv_commands.py	Rename 'cargo-clippy' mach command to just 'clippy' (#34481)	2024-12-05 03:19:15 +00:00
devtools_tests.py	Devtools: add more test cases (#36910)	2025-05-09 08:10:00 +00:00
gstreamer.py	clippy: Fix a variety of clippy warnings in fonts, layout_2020 and the DOM code (#33894)	2024-10-18 13:57:13 +00:00
package_commands.py	Remove resources/prefs.json (#34999)	2025-01-16 07:38:58 +00:00
post_build_commands.py	mach: adopt uv and avoid system python (#34632)	2024-12-16 09:20:37 +00:00
testing_commands.py	Devtools: add automated test for Debugger > Sources (#36401)	2025-05-07 10:43:18 +00:00
try_parser.py	CI: add build-args (#36947)	2025-05-12 07:41:12 +00:00
util.py	mach: remove python2 compatibility code (#33410)	2024-09-11 18:25:25 +00:00
visual_studio.py	Fix visual_studio.py to call vswhere with -utf8 (#32949)	2024-08-06 09:35:05 +00:00