Tag Archives: talesfromtheserverroom

Beware the Ides of March

So on March 15th (well, March 16th UTC and EDT) - the public facing website that I share in the responsibility for suffered an outage.
It’s a classic example of a cascaded failure - particularly a failure of human judgement (mine). I spend a lot of my time in my job [...]

Note to Self

Keeping around a half-million spam emails in a single folder? Terrible idea.

System, Deconstructed

So I had this long, ginormous post series planned about a service transition last week - where I had to move the mail server from one room to another to preempt a 57 hour outage. It was going to full of all kinds of fun tidbits about sheer panic with Apple’s OpenDirectory - and [...]