On Friday, June 9, Central 1’s Data Center provider was completing a power maintenance on one of the power sources. This resulted in a newly installed piece of Interac’s equipment to power down impacting OAS service and unattended e-Transfers like auto-deposit.

Central 1 worked with Interac and our Data Center Technicians to restore Interac’s service in our data center resolving the incident.

All e-Transfer auto deposits were queued during the outage were processed and completed after power was restored including OAS access. During the outage, sending and receiving of regular e-Transfers was not impacted.

Outage was from 10:03 to 11:49 p.m. PT (1:03 to 2:49 a.m. ET).

Point of failure: Interac has two firewalls in our racks, and both were plugged into the same circuit.  Interac completed an audit of for their other devices power connections in the follow week.

Actions:

RITM339054 – Documented SOP for dual power distribution audits

Assigned to: C1 Network team

Target date: End of July 2023

Create and document SOP to ensure we have dual power distribution for any new equipment being installed or relocated.  This will include a verification step and applies to vendor managed equipment.

RITMXXXXX – Complete audit for dual power distribution in both data centers

Review any new equipment installed or moved after the most recent validation exercise to ensure that we have dual power distribution across all datacenters.

Assigned to: C1 Network team

Target date: End of Q3