Incident: Partial disruption 2023-09-11 00:10 - 07:20 due to DDoS attack

Type	Maintenance
Summary	Update of multiple server / infrastructure components
Impact	Multiple downtimes of impacted services
Duration	2023-08-12 19:00 - 2023-08-13 01:00 (CEST)
Status	Success
Reporter(s)	@b2c@wien.rocks
Responder(s)	@fossie@wien.rocks, @b2c@wien.rocks
Internal reference	n/a

Introduction

Maintenance has to be conducted on multiple core infrastructure servers and components to apply necessary software, server, distribution, security and firmware updates. This will ensure continued stable and secure operation of the fediverse.foundation environment.

Service interruptions are to be expected due to multiple reboots of the impacted components.

We apologize for any inconvenience!

Maintenance tasks

• Router firmware upgrade

• Configuration changes
  • Configure NICs on various virtual machines for IPv6 multicast
  • Misc. VM configuration changes (CPU/Memory allocation etc.)

• Distribution upgrade on all Debian-based servers
  
  • Upgrade all physical servers to Debian 12 'Bookworm'
  • Upgrade all virtual machines to Debian 12 'Bookworm'

• Update Openshift/OKD to 4.13

• Introduction of the Mastodon "Translate" feature (based on libretranslate)

• Update to Mastodon 4.2-beta1 on instance fedi.at