Mea culpa, outage at around 13:45

Hello — I’m really sorry, that was entirely my fault.

We were just down for between 30 and 40 minutes, there.

I was working on background improvements to the image service and accidentally, and *really* stupidly, deleted one of our main load balancers: the one that routes requests to item pages, amongst other key areas. I rebuilt it as quickly as I could and we’re back online now, of course.

I’m so sorry to everyone who was inconvenienced by that.

I am now looking at ways that I can make operating in the depths of our infrastructure safer in the future. I think I’ve come up with a way to ring-fence the areas I want to look at, first, so that nothing I do can have repercussions for other areas of the overall site.

Once again, you have my sincere apologies and my assurance that I’m looking very hard into making sure something like this doesn’t happen again,

Doug.

%d bloggers like this: