We’ve seen a few reports of people experiencing errors whilst trying to list tonight (although sales appear unaffected). We’re currently running some background jobs to prune old data and improve site performance. We didn’t anticipate that these would affect users, but it appears that in some cases (such as listing) it has and some users may need to try submitting the problem page again if they receive an error page initially. These jobs will be finished before tomorrow morning, so any problems will be gone by then. Apologies to any sellers who have been affected by this.
Latest Updates RSS
-
robl
-
robl
We just experienced a problem with one of the servers in the Folksy Cluster. This may have resulted in some customers experiencing error messages whilst attempting to access the site. The problem persisted for approximately 10 minutes whilst the problem was diagnosed. We’ve removed the server from the cluster whilst we investigate further. The service is now running normally.
-
robl
We’ll be performing some scheduled maintenance on the site on 2010/01/08 at 8:00am. We anticipate the site being unavailable for approximately 45 minutes.
-
robl
After the rollout of some new features and bugfixes earlier in the day, we experienced some problems with purchased items still being available for sale. We fixed this issue and associated affected orders/items at around 21:00.
-
robl
We’ll be performing scheduled maintenance on the site at 08:00 on 04/12/09. The site will be unavailable for approximately 30 minutes.
-
robl
We just experienced a 10 minute outage due to the search and indexing service failing and not restarting. The site should be running as normal again now. We’ll investigate why the service failed to restart.
-
robl
We’ve experienced some slow response times and an outage earlier today due to the Folksy database servers being overloaded. We’ll be migrating onto a new database cluster in a scheduled maintenance period which should alleviate these problems as part of our ongoing upgrades to the service. The mainteance will begin at midnight tonight (00:00 3rd Nov 09) and last for approximately an hour.
-
robl
We just had a problem with the Folksy database server experiencing high load which led to long response times for page loads and occasional errors. The server load was reduced and normal service was resumed. The problem persisted for approximately half an hour.
-
robl
We’ll be doing some work on one of the servers in the Folksy cluster in the morning so the service will be unavailable from about 8.00am for about an hour. This is to improve resiliency in the light of the recent downtime.
-
robl
Tomorrow morning we’ll be migrating the service back to the main Folksy server cluster which should eliminate any problems people have experienced with the forums this evening. The switchover should cause approx 10 minutes of outage to the service whilst the servers switchover. We’ll post here with more details when we have them.
Apologies to all our customers who have experienced problems today, moving forwards we’ll be putting some new plans in place that should reduce the impact to the service if this type of failure occurs again.
Update 12:50 : This is now underway and should be completed shortly
Update 1:06pm : One machine is taking longer than expected to switchover, awaiting filesystem checks to finish
Update 2:25pm : There was a problem restoring one machine, however this has now been resolved
