The Node.js bug that's invisible to your monitoring

Your health check is a single line. res.send('ok'). It used to take a millisecond. Then traffic ramped up one afternoon and p99 went to 400ms, and you spent the next three hours staring at dashboards that all said the same thing, which was nothing. CPU is moderate, event loop lag is flat, memory loo