This talk is based on a true horror story.
Imagine your work week ends after releasing a set of features to production. Your team is happy and you feel good about yourself. A call about a problem with payments wakes you up the next morning. You find out your most valuable users were charged hundreds of times, consuming their credit card limits, leaving others in overdraft. They're angry because they can't even buy milk at the store.
In this talk you'll learn how a "perfect bug storm" caused the problem, how our processes failed to catch it and how hard it was to gain our users and teammates trust back.