2020-11-04/05 Server Issues [Resolved]

Status
Not open for further replies.
Switches things on and off again
Joined 2000
Paid Member
Issue: Pages have been timing out

Analysis: Services and the server itself have not been restarted for a long time.

Action Taken: Services restarted. Full server reboot performed.

Outlook: Still looking choppy. Situation being monitored.
 
Last edited:
Switches things on and off again
Joined 2000
Paid Member
Issue: Pages have been timing out

Analysis: The majority of web traffic is coming from bots aggressively spidering the site.

Action Taken: Blocks have been put in place to block bots hogging server resources.

Outlook: Page timeouts still evident. Situation being monitored.
 
Last edited:
Switches things on and off again
Joined 2000
Paid Member
Issue: Site down (database unavailable)

Analysis: Database crashed

Action Taken: Database repaired, dumped, reimported, and rechecked. This caused 1 hour of downtime.

Outlook: Page timeouts still evident. Situation being monitored.
 
Last edited:
Switches things on and off again
Joined 2000
Paid Member
Issue: Pages still timing out

Analysis: Tracing of database queries showed that searches were creating traffic jams for the database

Action Taken: Search has been disabled for the next 24 hours while we monitor the situation.

In the meantime please use Google for your searches using the search format:

site:diyaudio.com beer

Outlook: At the time of writing this post, server behaviour is back to normal, with average response time matching historical averages of 85-120ms.

We will wait 24 hours and monitor the situation before making a decision on how to restore search without it impacting the regular use of the site.
 
Last edited:
Status
Not open for further replies.