gitlab-build-images/scripts
Stan Hu 519554013c
Add custom www-gitlab-com image with patched gsutil rsync command
Currently the `gsutil rsync` command does not support the `-z` or `-Z`
options available in `gsutil cp` to compress files locally via gzip
before uploading
(https://github.com/GoogleCloudPlatform/gsutil/issues/579). As
https://cloud.google.com/storage/docs/gsutil/commands/cp states:

When you specify the -z option, the data from your files is
compressed before it is uploaded, but your actual files are left
uncompressed on the local disk. The uploaded objects retain the
Content-Type and name of the original files, but have their
Content-Encoding metadata set to gzip to indicate that the object data
stored are compressed on the Cloud Storage servers and have their
Cache-Control metadata set to no-transform.

about.gitlab.com is currently serving uncompressed HTML files because
`Cache-Control: max-age=0` is set (see
https://gitlab.com/gitlab-com/www-gitlab-com/-/merge_requests/87045),
and Fastly has a custom rule to skip HTML files and therefore won't
cache them.

This patches the `rsync.py` using
https://github.com/GoogleCloudPlatform/gsutil/pull/1430 to support these
command-line options so local gzip compression can be performed.

Relates to
https://gitlab.com/gitlab-com/gl-infra/infrastructure/-/issues/14852
2022-01-05 08:37:26 -08:00
..
lib Welcome to the matrix 2021-12-07 12:10:42 +01:00
cache-google-chrome Only do a HEAD request for the image to avoid downloading it 2018-02-28 13:42:44 -08:00
custom-docker-build Upgrade to Go v1.16.12 and v1.17.5 2021-12-09 10:40:39 -08:00
custom-docker-push Welcome to the matrix 2021-12-07 12:10:42 +01:00
install-bazelisk Add Bazelisk support to Dockerfile.custom 2021-06-29 13:25:07 +00:00
install-chrome Remove sources from Google to reduce dependency 2019-05-30 13:40:56 +00:00
install-docker Tighten Docker package regexp 2020-06-05 11:58:25 -07:00
install-essentials Use C.UTF-8 2021-12-13 10:31:08 +00:00
install-git Install pcre2 2019-05-07 12:32:22 -07:00
install-golang Fix for bug that forces all Go binaries to be based on Go 1.8 (the default) 2017-12-21 11:55:07 +00:00
install-graphicsmagick Compile graphicsmagick with jpeg/tiff 2019-02-18 14:25:42 +00:00
install-lfs Add Git LFS 2019-12-04 14:46:07 +00:00
install-node Use npm repo instead of apt on Yarn install 2021-04-27 14:19:31 +00:00
install-noto-emoji Add workaround for installing Noto Emoji for gitlab-puppeteer 2018-11-08 21:54:07 +00:00
install-pcre2 Use sourceforge mirror for PCRE2 as FTP one has been removed 2021-11-10 11:21:04 +05:30
install-pgbouncer scripts: Fix pgbouncer install script not reporting errors 2021-03-16 10:41:30 +01:00
install-postgresql Make PostgreSQL v12 the default 2021-11-11 07:50:17 -08:00
install-ruby Set frame pointer in cflags instead of optargs 2021-04-28 15:45:03 -07:00
install-www-gitlab-com Add custom www-gitlab-com image with patched gsutil rsync command 2022-01-05 08:37:26 -08:00