Hi — we’re having a few image service backend issues, which I’m just looking into fixing at the moment.
Sorry for any inconvenience, we hope to have this fixed within 5-10 minutes.
Thanks,
Doug.
Advertisements
Hi — we’re having a few image service backend issues, which I’m just looking into fixing at the moment.
Sorry for any inconvenience, we hope to have this fixed within 5-10 minutes.
Thanks,
Doug.
Hi — there is a major outage at the moment of rubygems, the package manager we use to provision instances of our image service servers.
We’re trying to mitigate it, but at the moment it looks like we’re going to have to ride the issue out and hope that the people at rubygems can fix things quickly.
In the meantime, the vast majority of regularly-accessed images are in the cache and are still serving.
But people won’t be able to upload new images, and some images won’t be displaying if they weren’t already in the cache as of 2 hours or so ago.
We’re really sorry for the inconvenience, and are monitoring the situation with rubygems to fix things as soon as they have a handle on the problem they’re having.
Thanks,
Doug.
Hi — we need to restart the image service this morning. Hopefully, there will be no-to-minimal disruption as a result of this, but we thought we’d best let you know it was happening, in case any bad images were encountered.
We’ll keep you posted as to progress, here.
Cheers,
Doug.
Hi — we’re just about to boost the size of the image cache, which means that it will start rebuilding in the next 15 minutes or so.
This means that images may become unresponsive for a short while, but should be fine in very short order.
Thanks for bearing with us whilst we perform this work,
Doug.
Hi — it looks like the new image service cache went over, which means that the cache is rebuilding, now. We’ve boosted the number of backend image servers to help it do this, and hopefully images should be responding within the next 5-10 minutes.
Sorry about this, obviously we need to increase the size of the image cache server to even bigger than we did recently. That’s something I’ll get on to doing tomorrow, after the current cache server has rebuilt and handled the rest of tonight’s traffic.
I’m just getting notifications from our alert services that images are back online, so that means they should be starting to work again for everybody.
Again, sorry about that wobble — I hope nobody was too seriously inconvenienced by it.
Thanks,
Doug.
Hi — we’re about to upgrade the image service cache, which means that images may not load for a couple of minutes whilst the heaviest caching takes place.
This should only affect things for that couple of minutes, though.
Once this work is done, we should hopefully have fixed any issues around the image service for the time being.
Thanks,
Doug.
Hi — the issue with uploading avatars and banners should now be fixed.
Once again, thankyou everyone for your patience whilst we’ve been working on these issues, and our apologies for the inconvenience caused.
Thanks,
Doug.
Hi — we’ve managed to push out the fix for the bug with images over 1 megabyte, so people should be able to list normally again.
We’re now looking into the issues with uploading shop banners and avatars, and will keep you posted here as to progress. Hopefully, this shouldn’t take nearly as long as the image size bug.
Thanks again for your patience, it really is appreciated.
Doug.
Hi — people have been having issues uploading images from the listing page.
We’ve been investigating the issue, and it appears to be caused by uploading images of over 1 megabyte.
We’ve developed a fix for this, and are currently awaiting some support input from our hosts to help implement it across our servers. We are assured that it should be within an hour or two.
Apologies to everyone who has been inconvenienced by this bug.
I’ll post here once the fix is out, and in the meantime, thanks for bearing with us,
Doug.
