Velocity Mail - Increased SMTP Connection Latency – Incident details

Increased SMTP Connection Latency

ResolvedDegraded performance11 hours 25 minutes

Affected

Email

Degraded performance from 3:22 PM to 2:47 AM

  • PostmortemUTC

    Some SMTP connections experienced slower-than-normal banner responses. The issue was caused by elevated latency from our hosting provider’s recursive DNS service, which affected DNS lookups used by our mail servers.

    We mitigated the issue by moving the servers to independent DNS resolvers. SMTP response times returned to normal afterward. We found no evidence of message loss. We have also updated our monitoring and resolver configuration to reduce the chance and impact of a recurrence.

  • ResolvedUTC

    SMTP banner response times have returned to normal. This incident has been resolved.

  • MonitoringUTC

    We have implemented a fix and are monitoring the result.

  • InvestigatingUTC

    We are investigating increased SMTP connection latency caused by an upstream DNS resolver incident at our hosting provider. Some SMTP clients may experience a short delay when establishing a connection. Message delivery is not affected.