To be fair, there’s a story on here every week about how cloud provider alarms are happy to ping you 24h after the spend.

According to reports, their monthly AWS spend (prior to today, obviously) was ~300k (or 3.6M/year).

7.7k is not really a noticeable increase, and any alarms that did trigger would likely have been attributed to increased user growth and platform load.

That is if someone was even seeing a billing alarm alerting with every other issue that was going on.

I've seen more than one company that had a cloud spend policy that boiled down to: "if you spend a lot, the finance guy is gonna send you a snarky email a week later"

Totally not surprised they didn't catch a 7.7k spike in real time

Of course, being unaware of how much you’re being charged is par for the course with AWS!

Best they can do is eventual consistency for billing, apparently.

This so much. Are they not using dashboards? This amount of traffic should have triggered multiple alarms. Makes me think their devs just stopped caring.

maybe the devs are doing free speech activites and not watching the dashboard. I know I am being distracted from work by the activity here

At a certain scale it can be difficult to distinguish between data exfiltration and normal spikes in legitimate traffic.