Updated

Following our troubleshooting with the vendor, this issue has now been identified as being caused by a product hotfix.

The vendors development team are working on a fix as their highest priority. We'll implement the fix as soon as it's available - an exact ETA is not yet available.

Further updates to follow as soon as we have them.

Thank you, Wessex IT

Avatar for
Updated

We have allocated additional resources to the email firewall this morning and it is helping with queues, but we're still seeing delays currently up to around 8 minutes.

The original problem is still being investigated and updates will be provided as soon as we have them.

Thank you, Wessex IT

Avatar for
Updated

Mail queues are currently back to normal.

We're planning to make a change to FW1 tomorrow morning which may help with processing mail faster, but it's possible we'll see queues rise again.

Next update will be provided tomorrow morning.

Thank you, Wessex IT

Avatar for
Updated

A further configuration change was made shortly after 12pm, which has helped the queues partially.

Since 2pm they have been rising again and we're seeing delays of up to 10 minutes.

Further updates to follow.

Thank you, Wessex IT

Avatar for
Updated

We're continuing to see messages delayed by up to 50 minutes.

We're monitoring the situation closely and continue to work with our vendor to work towards a solution.

Further updates to follow later this afternoon.

Thank you, Wessex IT

Avatar for
Updated

Some messages are currently delayed by up to 30 minutes.

We're still working with our vendor to identify the cause, and will update here once we have more information.

Thank you, Wessex IT

Avatar for
Updated

We're monitoring the queues closely this morning. Only one node has a noticeable delay with the oldest mail waiting to be processed being 6 minutes old.

We continue to work with our vendor to confirm if there are ongoing issues. Further updates to follow later this morning.

Thank you, Wessex IT

Avatar for
Recovering

Troubleshooting has been ongoing with our vendor throughout the day. Two issues believed to be contributing to slow mail processing have been identified & resolved. It's not yet possible to confirm they were the original cause of the mail delays because the server was back to normal load when they were resolved.

The highest load on the server is generally on a morning, so we will continue to monitor tomorrow morning and work with our vendor if the problem continues. Further updates to follow tomorrow.

Thank you, Wessex IT

Avatar for
Updated

The problem has been determined to be unrelated to the Link Lock feature, and so it has now been re-enabled.

We continue to work with our vendors to identify the cause of the mail delays.

Avatar for
Updated

The Link Lock feature of the email firewall has been temporarily disabled whilst we investigate.

Avatar for
Investigating

We are currently experiencing high mail queues on our email firewall, causing significant delays to email.

We are working with our vendors to resolve the problem and will provide updates on the issue here as we progress.

Thank you, Wessex IT

Avatar for
Began at:

Affected components
  • Cloud Services
    • Email Firewall