Jump to content

TimeLine2008: Difference between revisions

m
Added rooting
(Added epic tale of 19th of April)
m (Added rooting)
Line 86: Line 86:


*19th - Admins take down Murphy for a while to rearrange disk partitions, because /var/tmp really doesn't need 105GB. This part goes suspiciously smoothly, with nothing breaking. Admins then begin to move vhosts to murphy (unrelated, but we had planned it today anyway). This part takes 6 hours, and involves pain and cursing at computer screens, and werdz committing his second ever [[Inevitable Admin Fuckups|IAF]] when he accidentally deletes the apache configuration, and realises we had no backups of it. Luckily, the important parts were modularised (thank you, Debian), so restoring the default configuration and rewriting our bits only took about half an hour. The Redbrick main site is then moved to murphy's local disks, and everything is faster afterwards.
*19th - Admins take down Murphy for a while to rearrange disk partitions, because /var/tmp really doesn't need 105GB. This part goes suspiciously smoothly, with nothing breaking. Admins then begin to move vhosts to murphy (unrelated, but we had planned it today anyway). This part takes 6 hours, and involves pain and cursing at computer screens, and werdz committing his second ever [[Inevitable Admin Fuckups|IAF]] when he accidentally deletes the apache configuration, and realises we had no backups of it. Luckily, the important parts were modularised (thank you, Debian), so restoring the default configuration and rewriting our bits only took about half an hour. The Redbrick main site is then moved to murphy's local disks, and everything is faster afterwards.
*25th - Redbrick gets rooted. Elected root holders (three out of four of them on INTRA) cry.
** Decision taken to take redbrick offline at about 10am. Network is disconnected by taking down the interface connecting us to CSD on enzyme.
** Root holders in DCU spend the day running between fourth year projects and looking through logs looking for evidence of the intrusion.
** Reinstall begins later on, with the help of atlas. Minerva is reinstalled first, as it's needed for us to receive mail. First packages are installed again there by 9.50pm that night. The internet connection is switched back on and deathray is configured to receive and store mail by about 1am. Everything else remains unavailable, and the network is left in a rediculously complicated segregated state to stop anyone accessing anything.