| Commit message (Collapse) | Author | Age | Files | Lines |
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
| |
TODO: rcpt_to likely needs some canonicalization (lists.g.o vs g.o, some
other stuff.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
| |
Terraform wants to recreate the network to wipe the description and we
do not want that.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
| |
Tag our rsync nodes and add a firewall rule to allow tcp/873.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
| |
The container spec is still causing some trouble.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
| |
I pulled the REST and merged it.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
|
| |
Use :prod container.
Mark privileged.
Rename to rsync-4
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
| |
Main and Rysnc template.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
| |
The previous instance would mount the tmpfs over our two created tmpdirs
causing our tmpdirs to be unavailable and causing a failure.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
|
|
|
|
| |
Currently the "logger -t" lines in wrap_rsync.sh do get caught by the
logs collector, but the rsync logs do not because /var/log/rsync.log
is not configured to be collected by default.
Configure rsync to log to /var/log/syslog, which is automatically parsed
and streamed to stackdriver.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
rsync basically takes like no resources to run; we hope. Most of our
real servers are doing this with like 1-2 CPUs and 2GB of memory. So
align that with our vm sizing.
The g1-small is a 1.7GB memory container with 1 shared vcpu.
Allocate 1.3GB of memory to the tmpfs. This should house 2 rsync trees
(clocking in at 590MB a piece).
Further work with hardlinks can likely reduce the size even more.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| |
WAIT_TIME=30m to test in production.
Move content to /srv/gentoo. On GCP we need to explicitly declare a
tmpfs (we are advised not to re-use /dev/shm).
In the Dockerfile, explicitly make /srv/gentoo and try to make a tmpfs
there.
Sync directly from Turnstone, because its fast at syncing and more
reliable than rsync.us.gentoo.org.
Remove --checksum from args as it causes some mirrors to fail.
Log with logger -t so logs get sent to stackdriver on gcp.
Disable chroot; it doesn't seem to work with Containers on GCE.
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
|
|
|
|
| |
This supports denying syncing when busy / out of date
and an rsync friendly deny message; similar to http 429 (TOO_BUSY)
or 503 (SERVICE_UNAVAILABLE.)
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
|
|
|
| |
Signed-off-by: Alec Warner <antarus@gentoo.org>
|
| |
|
|
|
|
| |
Some members are inactive (retired) developers.
|
| |
|
| |
|
| |
|
|
|