AI Matrx Logo

Incident Postmortems

Brightlane Pay · Reliability · Denver, CO

Sigrid Halvorsen heads reliability at a payments company and uses this to run postmortems the same way every time and chase their action items.

Any businessComplianceBoards3 tables · 9 views · 1 form · 1 agent
Use this template

By status

Action items
Open3
Test replica promotion every week in stagingPreventKeiko Tanaka-Ruiz
Alert fourteen days before any certificate expiresDetectAmara Nwachukwu
Automate certificate renewal with a staging dry runPreventAmara Nwachukwu
In progress4
Run a monthly region-loss drillPreventSigrid Halvorsen
Retry queue alert when depth passes 1000DetectPatrick Osei
Move email sending to its own worker poolPreventBruno Castellanos
Write the manual promotion steps into a runbookMitigateKeiko Tanaka-Ruiz
Done4
Add a regional health check to the payment routerDetectBruno Castellanos
Fail over card traffic automatically when errors pass 5%MitigateAmara Nwachukwu
Add an index to the transactions tablePreventKeiko Tanaka-Ruiz
Alert when dashboard p95 passes 3 secondsDetectAmara Nwachukwu

Tables

Action items

11 sample rows · 5 columns

The follow-up work each incident produced, by type, owner and due day.

ActionTypeOwnerDueStatus
Add a regional health check to the payment routerDetectBruno CastellanosSep 2, 2026Done
Add an index to the transactions tablePreventKeiko Tanaka-RuizSep 12, 2026Done
Fail over card traffic automatically when errors pass 5%MitigateAmara NwachukwuSep 17, 2026Done
Alert when dashboard p95 passes 3 secondsDetectAmara NwachukwuSep 19, 2026Done
Retry queue alert when depth passes 1000DetectPatrick OseiOct 3, 2026In progress
Run a monthly region-loss drillPreventSigrid HalvorsenOct 12, 2026In progress
Write the manual promotion steps into a runbookMitigateKeiko Tanaka-RuizOct 20, 2026In progress
Alert fourteen days before any certificate expiresDetectAmara NwachukwuOct 21, 2026Open
Test replica promotion every week in stagingPreventKeiko Tanaka-RuizOct 23, 2026Open
Move email sending to its own worker poolPreventBruno CastellanosOct 29, 2026In progress
Automate certificate renewal with a staging dry runPreventAmara NwachukwuNov 6, 2026Open

Incidents

5 sample rows · 13 columns

Every incident: how severe, how long, who led it and what came out of it.

IncidentSeverityStatusStartedResolvedCommanderServices
Login errors after a certificate renewalSEV2MitigatedOct 16, 1:15 PM—Sigrid HalvorsenAuthAPI
Database failover did not promote a replicaSEV2ResolvedOct 9, 4:10 AMOct 9, 5:50 AMKeiko Tanaka-RuizDatabasePayments
Payout emails delayed by six hoursSEV3Postmortem doneSep 20, 12:30 PMSep 20, 7:00 PMAmara NwachukwuNotifications
Dashboard slow for all customersSEV2Postmortem doneSep 6, 3:40 PMSep 6, 5:15 PMAmara NwachukwuDashboardDatabase
Card payments failing for one regionSEV1Postmortem doneAug 16, 8:05 PMAug 16, 10:20 PMSigrid HalvorsenPaymentsAPI

Related templates